-- Logs begin at Wed 2022-08-24 11:40:42 UTC, end at Wed 2022-08-24 13:35:11 UTC. -- Aug 24 12:21:23.876907 dv-cinder-848899-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 12:21:23.884293 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 12:21:23.886269 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 12:21:23 2022] *** Aug 24 12:21:23.886269 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 12:21:23.886269 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 12:21:23.886269 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: nodename: dv-cinder-848899-3-iscsi Aug 24 12:21:23.886269 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: machine: x86_64 Aug 24 12:21:23.886269 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: clock source: unix Aug 24 12:21:23.886269 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: pcre jit disabled Aug 24 12:21:23.886269 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: detected number of CPU cores: 4 Aug 24 12:21:23.886886 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: current working directory: / Aug 24 12:21:23.886886 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: detected binary path: /usr/bin/uwsgi-core Aug 24 12:21:23.886886 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: your processes number limit is 47680 Aug 24 12:21:23.886886 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: your memory page size is 4096 bytes Aug 24 12:21:23.886886 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: detected max file descriptor number: 2048 Aug 24 12:21:23.886886 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: lock engine: pthread robust mutexes Aug 24 12:21:23.886886 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: thunder lock: enabled Aug 24 12:21:23.886886 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 12:21:23.887511 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 12:21:23.926584 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: Python main interpreter initialized at 0x55eaaf43a9c0 Aug 24 12:21:23.926584 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: python threads support enabled Aug 24 12:21:23.926584 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: your server socket listen backlog is limited to 100 connections Aug 24 12:21:23.926584 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: your mercy for graceful operations on workers is 90 seconds Aug 24 12:21:23.926966 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 12:21:23.927069 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: *** Operational MODE: preforking *** Aug 24 12:21:23.927338 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: *** uWSGI is running in multiple interpreter mode *** Aug 24 12:21:23.927338 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: spawned uWSGI master process (pid: 105915) Aug 24 12:21:23.927535 dv-cinder-848899-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 12:21:23.928235 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: spawned uWSGI worker 1 (pid: 105916, cores: 1) Aug 24 12:21:23.928723 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: spawned uWSGI worker 2 (pid: 105917, cores: 1) Aug 24 12:21:23.928723 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 12:21:24.583729 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 12:21:24.584318 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 12:21:25.672530 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:21:25.672530 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: from cryptography.utils import int_from_bytes Aug 24 12:21:25.673123 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:21:25.673123 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: from cryptography.utils import int_from_bytes Aug 24 12:21:25.765877 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:21:25.765877 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: from cryptography.utils import int_from_bytes Aug 24 12:21:25.766457 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:21:25.766457 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: from cryptography.utils import int_from_bytes Aug 24 12:21:28.159495 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 12:21:28.160075 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 12:21:28.160254 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 12:21:28.160610 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 12:21:28.160867 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 12:21:28.161015 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 12:21:28.161368 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.161463 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 12:21:28.161550 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.161786 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 12:21:28.161886 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.162144 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 12:21:28.162232 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.162399 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 12:21:28.162493 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.162803 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.162893 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.163124 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.163209 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.163438 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.163539 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.163754 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.163849 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.164010 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.164094 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.164327 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.164433 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.164648 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848899-3-iscsi {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.164747 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.164965 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.165051 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.165269 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.165369 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.165537 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.165630 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.165852 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.165945 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.166195 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.166289 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848899-3-iscsi {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.166513 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.166607 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.166838 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.166926 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.167145 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.167334 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.167444 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.168477 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.168622 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.168622 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.168822 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.168904 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.168993 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.169072 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.169217 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.169324 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.169453 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.169542 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.169669 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.169751 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.169876 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.169968 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.170055 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.170134 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.170346 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.170433 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.170669 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.170854 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848899-3-iscsi {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.171007 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.171164 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.171375 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.171462 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.171595 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.171770 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.171904 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.172176 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.172296 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848899-3-iscsi {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.172483 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.172615 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.172790 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.172892 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.173108 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.173197 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.173437 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.173598 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.173742 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.173909 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.174065 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.174219 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.174381 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.174537 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.174720 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.174894 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.175039 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.175203 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.175344 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.175528 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.175648 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.175846 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.175954 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.176162 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.176264 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.176480 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.176567 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.176779 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.176873 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.177077 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.177175 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.177380 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.177509 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.177695 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.177782 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.177996 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.178100 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.178297 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.178385 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.178546 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.178633 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.178815 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.178904 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.179129 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.179216 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.179446 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.179544 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.179749 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.179837 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.180027 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.180121 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.180276 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.180377 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.180592 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.180687 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.180911 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.180998 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.181213 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.181303 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.181515 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.181602 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.182347 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.182436 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.182676 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.182768 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.182999 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.183094 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.183318 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.183406 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.183622 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.183712 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.183938 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.184026 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.184252 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.184337 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.184564 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.184651 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.184869 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.184956 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.185172 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.185257 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.185491 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.185587 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.185800 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.185887 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.186115 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.186211 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.186417 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.186503 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.186758 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.186858 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.187063 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.187158 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.187365 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.187453 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.187679 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.187784 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.187995 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.188090 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.188291 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.188377 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.188539 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.188633 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.188836 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.188931 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.189135 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.189221 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.189448 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.189548 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.189749 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.189874 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.190011 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.190105 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.190309 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.190402 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.190610 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.190738 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.190935 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.191027 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.191236 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.191323 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.191538 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.191625 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.191839 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.191934 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.192136 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.192221 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.192431 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.192523 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.192731 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.192816 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.193029 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.193121 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.193328 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.193428 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.193628 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.193712 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.193927 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.194023 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.194230 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.194316 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.194529 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.194613 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.194852 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.194951 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.195153 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.195241 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.195465 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.195552 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.195766 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.195865 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.196066 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.196194 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.196366 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.196528 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.196666 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.196767 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.196965 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.197052 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.197294 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.197907 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.198132 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.198235 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.198436 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.198525 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.198787 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.198878 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.199086 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.199186 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.199389 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.199476 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.199702 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.199796 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.200005 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.200101 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.200304 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.200398 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.200601 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.200696 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.200898 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.200999 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.201194 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.201327 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.201494 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.201628 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.201791 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.201885 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.202088 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.202182 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.202384 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.202470 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.202701 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.202804 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.203006 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.203092 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.203306 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.203392 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.203605 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.203701 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.203903 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.203988 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.204216 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.204308 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.204535 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.204622 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.204840 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.204934 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.205145 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.205240 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.205446 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.205532 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.205760 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:21:28.205846 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.206095 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.206190 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.206428 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.206530 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.206765 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.206856 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.207077 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.207218 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.207401 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.207488 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.207708 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.207795 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.208019 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.208150 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.208326 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.208412 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.208637 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.208723 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.208951 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.209038 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.209260 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.209345 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.209570 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.209657 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.209880 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.209976 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.210194 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.210283 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.210500 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.210594 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.210839 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.210943 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.211159 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.211246 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.211473 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.211561 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.211782 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.211870 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.212095 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.212189 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.212411 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.212499 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.212738 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.212828 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.213083 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.213170 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.213395 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.213492 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.213700 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.213786 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.214007 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.214094 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.214315 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.214410 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.214634 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.214734 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.214982 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.215079 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.215291 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.215400 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.215602 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.215690 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.215912 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.215999 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.216219 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.216315 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.216528 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.216618 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.216836 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.216923 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.217146 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.217285 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.217475 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.217607 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.217767 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.217863 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.218077 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.218167 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.218383 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.218471 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.218712 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.218804 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.219025 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.219121 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.219336 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.219423 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.219645 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.219733 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.219948 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.220036 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.220248 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.220336 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.220549 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.220643 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.220853 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.220941 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.221154 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.221242 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.221458 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.221554 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.221765 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.221852 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.222067 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.222153 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.222373 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.222507 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.222695 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.222789 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.223004 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.223090 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.223310 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.223416 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.223615 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.223702 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.223915 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.224002 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.224221 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.224317 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.224527 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.224615 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.224827 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.224924 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.225134 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.225229 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.225438 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.225524 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.225745 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.225831 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.226052 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.226147 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.226354 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.226440 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.226695 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.226794 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.226988 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.227078 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.227291 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.227386 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.227597 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.227693 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.227905 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.227994 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.228209 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.228335 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.228541 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.228637 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.228854 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.228948 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.229161 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.229259 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.229470 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.229593 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.229783 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.229880 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.230093 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.230186 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.230405 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.230509 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.230741 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.230836 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.231055 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.231143 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.231359 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.231455 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.231667 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.231754 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.231970 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.232057 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.232272 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.232366 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.232572 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.232660 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.232879 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.232966 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.233179 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.233267 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.233481 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.233573 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.233783 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.233877 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.234083 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.234170 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.234385 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.234470 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.234728 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.234836 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.235018 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.235114 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.235320 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.235413 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.235619 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.235714 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.235922 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.236008 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.236245 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.236344 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.236553 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.236649 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.236856 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.236943 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.237160 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.237247 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.237461 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.237561 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.237801 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.237888 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.238105 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.238193 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.238686 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.238791 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.238999 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.239086 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.239311 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.239399 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.239622 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.239710 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.239931 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.240026 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.240248 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.240335 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.240556 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.240651 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.240869 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.240963 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.241174 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.241261 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.241485 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.241573 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.241790 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.241875 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.242108 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.242195 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.242410 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.242499 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.242742 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.242830 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.243071 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.243161 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.243383 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.243472 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.243705 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.243793 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.244010 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.244106 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.244840 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.244928 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.245157 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.245253 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.245467 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.245564 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.245780 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.245868 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.246091 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.246178 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.246404 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.246499 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.246743 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.246833 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.247054 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.247141 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.247367 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.247464 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.247675 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.247763 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.247984 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.248071 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.248292 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.248381 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.248599 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.248727 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.248899 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.248986 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.249209 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.249296 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.249530 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.249625 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.249841 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.249928 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.250151 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.250238 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.250451 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.250583 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.250789 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.250879 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.251097 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.251185 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.251405 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.251492 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.251713 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.251814 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.252016 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.252105 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.252320 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.252408 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.252626 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.252721 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.252932 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.253019 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.253236 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.253321 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.253535 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.253629 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.253834 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.253921 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.254138 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.254223 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.254439 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.254533 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.254766 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.254858 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.255067 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.255193 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.255368 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.255455 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.255678 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.255772 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.255984 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.256070 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.256286 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.256382 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.256592 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.256686 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.256898 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.256993 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.257198 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.257287 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.257512 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.257611 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.257813 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.257899 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.258115 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.258204 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.258418 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.258505 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.258791 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.258892 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.259075 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.259170 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.259379 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.259466 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.259680 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.259776 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.260537 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.260677 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.260844 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.260932 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.261150 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.261246 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.261461 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.261553 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.261767 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.261855 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.262072 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.262168 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.262391 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.262487 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.262720 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.262812 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.263026 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.263125 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.263332 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.263426 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.263639 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.263724 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.263946 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.264034 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.264253 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.264340 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.264556 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.264642 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.264864 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.264951 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.265172 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.265269 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.265478 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.265564 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.265777 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.265871 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.266083 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.266170 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.266387 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.266483 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.266717 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.266994 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.267082 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.267323 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.267420 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.267635 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.267723 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.267950 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.268037 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.268269 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.268509 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.268605 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.268911 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.269013 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.269156 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.269244 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.269474 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.269571 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.269792 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.269889 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.270109 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.270197 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.270421 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.270507 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.270748 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.270856 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.271059 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.271146 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.271364 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.271461 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.271668 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.271769 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.271971 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.272065 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.272273 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.272359 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.272572 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.272732 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.272873 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.272962 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.273174 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.273269 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.273472 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.273568 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.273778 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.273873 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.274076 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.274162 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.274376 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.274463 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.274696 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.274797 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.275004 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.275092 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.275317 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.275440 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.275643 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.275729 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.275948 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.276035 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.276249 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.276337 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.276569 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.276656 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.276875 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.276964 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.277178 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.277279 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.277480 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.277568 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.277780 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.277877 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.278122 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.278217 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.278428 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.278513 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.278778 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.278892 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.279086 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.279187 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.279387 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.279484 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.279691 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.279788 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.280000 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.280088 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.280307 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.280394 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.280610 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.280698 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.280914 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.281010 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.281219 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.281307 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.281528 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.281616 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.281831 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.281917 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.282131 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.282218 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.282440 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.282529 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.282772 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.282880 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.283079 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.283166 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.283383 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.283471 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.283684 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.283772 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.283984 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.284080 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.284294 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.284383 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.284601 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.284696 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.284903 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.285004 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.285209 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.285297 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.285510 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.285604 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.285816 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.285911 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.286115 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.286208 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.286414 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.286509 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.286740 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.286849 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.287044 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.287181 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.287348 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.287448 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.287649 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.287738 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.287968 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.288056 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.288277 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.288372 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.288583 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.288672 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.288884 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.288972 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.289186 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.289286 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.289482 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.289571 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.289782 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.289869 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.290088 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.290174 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.290387 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.290475 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.290733 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.290823 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.291064 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.291166 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.291370 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.291467 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.291674 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.291781 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.291977 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.292074 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.292278 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.292366 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.292582 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.292680 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.292880 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.292977 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.293180 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.293276 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.293480 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.293567 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.293780 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.293876 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.294084 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.294170 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.294385 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.294472 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.294707 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.294801 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.295010 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.295098 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.295311 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.295439 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.295611 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.295706 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.295930 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.296028 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.296235 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.296324 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.296539 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.296627 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.296841 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.296929 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.297140 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.297275 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.297480 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.297569 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.297785 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.297872 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.298090 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.298185 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.298403 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.298492 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.298726 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.298828 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.299041 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.299139 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.299353 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.299453 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.299658 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.299744 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.299958 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.300056 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.300258 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.300354 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.300570 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.300656 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.300878 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.301040 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.301187 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.301275 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.301486 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.301572 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.301788 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.301892 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.302109 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.302197 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.302407 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.302493 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.302739 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.302833 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.303050 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.303138 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.303356 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.303443 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.303663 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.303752 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.303965 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.304051 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.304273 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.304359 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.304580 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.304667 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.304887 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.304973 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.305195 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.305288 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.305499 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.305592 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.305802 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.305897 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.306109 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.306205 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.306418 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.306512 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.307249 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.307413 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.307560 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.307658 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.307867 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.307963 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.308166 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.308252 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.308472 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.308575 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.308770 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.308866 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.309078 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.309166 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.309386 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.309534 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.309686 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.309788 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.309990 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.310100 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.310292 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.310410 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.310602 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.310744 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.310935 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.311031 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.311327 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.311418 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.311642 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.311737 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.311951 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.312037 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.312251 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.312338 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.312557 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.312667 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.312871 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.312981 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.313185 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.313280 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.313497 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.313593 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.313801 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.313898 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.314166 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.314252 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.314473 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.314560 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.314821 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.314931 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.315128 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.315223 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.315430 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.315560 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.315729 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.315828 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.316035 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.316122 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.316339 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.316424 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.316647 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.316742 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.316949 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.317067 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.317252 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.317376 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.317577 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.317688 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.317881 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.318075 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.318229 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.318378 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.318620 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.318787 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.318953 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.319087 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.319258 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.319403 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.319621 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.319720 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.319922 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.320018 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.320233 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.320380 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.320526 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.320662 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.320846 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.320994 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.321171 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.321315 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.321475 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.321562 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.321786 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.321875 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.322089 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.322177 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.322968 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.323085 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.323295 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.323391 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.323610 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.323698 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.323934 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.324035 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.324241 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.324329 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.324568 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.324656 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.324890 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.324992 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.325206 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.325304 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.325527 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.325682 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.325857 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.325955 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.326161 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.326257 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.326469 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.326565 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.326797 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.326887 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.327104 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.327192 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.327424 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.327513 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.327726 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.327819 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.328035 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.328132 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.328343 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.328440 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.328649 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.328738 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.328950 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.329037 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.329251 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.329338 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.329559 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.329670 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.329862 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.329969 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.330163 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.330259 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.330467 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.330564 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.330795 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.330898 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.331114 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.331211 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.331415 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.331511 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.331731 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.331817 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.332038 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.332135 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.332341 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.332437 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.332642 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.332731 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.332943 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.333040 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.333271 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.333359 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.333573 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.333659 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.333874 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.333962 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.334178 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.334266 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.334481 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.334576 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.334836 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.334937 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.335144 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.335239 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.335461 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.335550 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.335786 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.335886 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.336103 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.336199 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.336407 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.336500 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.336720 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.336808 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.337023 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.337119 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.337331 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.337428 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.337636 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.337770 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.337965 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.338056 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.338268 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.338367 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.338569 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.338676 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.338895 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.338983 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.339197 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.339297 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.339498 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.339586 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.339798 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.339899 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.340106 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.340217 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.340406 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.340506 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.340707 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.340796 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.341009 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.341107 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.341314 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.341403 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.341613 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.341716 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.341931 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.342021 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.342238 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.342326 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.342539 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.342627 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.342871 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.342972 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.343173 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.343269 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.343506 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.343593 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.343809 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.343904 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.344124 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.344212 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.344431 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.344526 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.344741 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.344828 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.345053 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.345141 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.345365 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.345460 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.345669 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.345756 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.345982 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.346069 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.346293 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.346393 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.346606 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.346765 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.346945 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.347143 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.347238 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.347472 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.347561 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.347783 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.347871 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.348094 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.348256 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.348404 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.348646 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.348735 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.348974 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.349062 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.349288 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.349377 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.349598 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.349695 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.349905 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.349992 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.350211 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.350302 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.350523 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.350619 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.350865 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.350967 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.351174 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.351264 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.351486 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.351636 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.351792 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.351896 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.352108 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.352201 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.352423 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.352512 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.352736 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.352833 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.353069 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.353157 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.353387 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.353475 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.354204 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.354294 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.354518 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.354605 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.354854 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.354956 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.355170 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.355325 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.355483 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.355573 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.355793 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.355958 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.356103 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.356199 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.356412 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.356499 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.356722 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.356820 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.357029 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.357123 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.357338 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.357438 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.357648 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.357744 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.357956 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.358044 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.358263 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.358360 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.358570 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.358685 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.358909 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.359007 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.359219 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.359306 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.359536 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.359625 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.359868 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.360053 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.360189 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.360366 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.360502 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.360697 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.360801 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.361022 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.361110 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.361346 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.361618 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.361707 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.361933 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.362029 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.362264 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.362362 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.362565 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.362677 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.362894 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.362983 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.363203 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.363553 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.363765 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.363853 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.364069 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.364157 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.364388 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.364485 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.364689 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.364775 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.364989 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.365082 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.365293 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.365381 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.365597 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.365685 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.365918 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.366126 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.366229 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.366471 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.366559 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.366815 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.366907 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.367142 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.367242 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.367471 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.367675 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.367788 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.368023 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.368111 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.368341 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.368431 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.368671 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.368760 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.368989 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.369084 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.369840 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.369946 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.370154 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.370243 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.370461 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.370575 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.370791 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.370883 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.371104 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.371207 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.371415 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.371514 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.371721 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.371809 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.372023 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.372110 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.372325 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.372420 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.372635 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.372729 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.372945 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.373038 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.373247 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.373342 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.373548 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.373636 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.373854 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.373941 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.374155 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.374252 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.374458 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.374598 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.374785 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.374874 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.375089 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.375177 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.375394 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.375481 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.375697 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.375791 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.375999 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.376087 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.376300 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.376386 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.376604 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.376700 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.376904 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.376990 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.377204 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.377290 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.377505 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.377600 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.377807 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.377893 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.378113 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.378200 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.378413 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.378509 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.378744 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.378849 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.379053 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.379142 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.379375 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.379472 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.379680 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.379768 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.379992 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.380080 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.380331 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.380426 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.380640 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.380728 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.380963 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.381169 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.381274 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.381503 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.381591 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.381822 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.381910 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.382155 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.382252 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.382486 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.382748 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.382841 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.383087 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.383176 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.383407 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.383502 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.383728 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.383824 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.384038 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.384137 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.384346 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.384434 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.384654 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.384742 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.384987 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.385085 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.385294 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.385390 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.385601 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.385689 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.385911 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.386073 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.386217 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.386306 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.386522 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.386611 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.386852 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.386942 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.387159 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.387251 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.387469 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.387557 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.387775 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.387873 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.388079 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.388168 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.388390 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.388494 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.388726 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.388823 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.389032 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.389120 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.389342 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.389439 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.389651 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.389739 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.389962 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.390048 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.390272 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.390374 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.390580 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.390711 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.390911 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.391012 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.391218 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.391319 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.391534 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.391632 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.391844 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.391972 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.392157 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.392247 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.392458 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.392544 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.392765 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.392872 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.393082 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.393170 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.393412 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.393501 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.393733 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.393820 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.394040 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.394130 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.394395 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.394482 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.394736 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.394843 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.395048 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.395137 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.395367 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.395455 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.395675 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.395772 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.396002 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.396090 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.396324 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.396413 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.396640 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.396738 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.396958 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.397046 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.397266 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.397360 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.397568 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.397670 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.397869 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.397958 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.398173 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.398262 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.398488 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.398597 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.398816 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.398907 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.399119 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.399207 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.399420 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.399510 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.399726 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.399815 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.400027 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.400123 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.400328 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.400436 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.400653 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.400743 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.400953 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.401055 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.401258 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.401346 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.401559 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.401645 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.401855 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.401955 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.402157 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.402248 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.402456 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.402544 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.402780 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.402895 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.403082 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.403171 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.403382 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.403469 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.403680 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.403776 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.403979 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.404067 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.404274 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.404360 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.404574 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.404670 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.404871 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.404960 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.405171 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.405259 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.405476 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.405565 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.405776 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.405864 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.406081 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.406169 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.406383 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.406475 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.406732 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.406824 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.407040 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.407128 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.407365 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.407492 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.407684 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.407776 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.407991 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.408092 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.408293 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.408380 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.408606 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.408701 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.408915 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.409011 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.409227 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.409323 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.409583 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.409678 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.409843 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.409940 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.410148 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.410236 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.410455 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.410543 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.410790 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.410894 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.411105 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.411194 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.411415 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.411512 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.411735 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.411863 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.412049 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.412164 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.412367 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.412483 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.412681 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.412798 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.412986 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.413101 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.413312 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.413429 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.413619 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.413735 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.413931 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.414048 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.414239 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.414436 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.414556 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.414708 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.414872 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.415000 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.415186 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.415313 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.415496 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.415612 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.415804 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.415918 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.416632 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.416759 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.416945 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.417059 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.417261 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.417383 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.417572 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.417665 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.417883 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.417971 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.418204 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.418297 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.418528 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.418618 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.418895 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.418985 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.419208 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.419305 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.419526 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.419622 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.419850 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.419938 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.420163 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.420264 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.420474 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.420563 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.420777 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.420873 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.421019 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 12:21:28.421123 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.421452 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.421795 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.422114 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.422423 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:21:28.422689 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 12:21:28.574087 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO dbcounter [None req-8c5a374b-0ccd-4013-97e9-b7d4b1b047ab None None] Registered counter for database nova_api Aug 24 12:21:28.575548 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO dbcounter [None req-4cd64e13-ea51-4b81-a782-5440edfc8f7b None None] Registered counter for database nova_api Aug 24 12:21:28.595581 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_db.sqlalchemy.engines [None req-8c5a374b-0ccd-4013-97e9-b7d4b1b047ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105917) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:21:28.598320 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG oslo_db.sqlalchemy.engines [None req-4cd64e13-ea51-4b81-a782-5440edfc8f7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105916) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:21:28.602253 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG dbcounter [-] [105917] Writer thread running {{(pid=105917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:21:28.605289 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG dbcounter [-] [105916] Writer thread running {{(pid=105916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:21:28.657928 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.context [None req-8c5a374b-0ccd-4013-97e9-b7d4b1b047ab None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),acc877c2-bd26-41e8-94b1-fba881fedcaf(cell1) {{(pid=105917) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 12:21:28.659765 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.context [None req-4cd64e13-ea51-4b81-a782-5440edfc8f7b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),acc877c2-bd26-41e8-94b1-fba881fedcaf(cell1) {{(pid=105916) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 12:21:28.661783 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-8c5a374b-0ccd-4013-97e9-b7d4b1b047ab None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:21:28.662252 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-8c5a374b-0ccd-4013-97e9-b7d4b1b047ab None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:21:28.663557 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG oslo_concurrency.lockutils [None req-4cd64e13-ea51-4b81-a782-5440edfc8f7b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:21:28.663891 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-8c5a374b-0ccd-4013-97e9-b7d4b1b047ab None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:21:28.664038 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG oslo_concurrency.lockutils [None req-4cd64e13-ea51-4b81-a782-5440edfc8f7b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:21:28.664624 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-8c5a374b-0ccd-4013-97e9-b7d4b1b047ab None None] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:21:28.665067 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-8c5a374b-0ccd-4013-97e9-b7d4b1b047ab None None] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:21:28.665628 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG oslo_concurrency.lockutils [None req-4cd64e13-ea51-4b81-a782-5440edfc8f7b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:21:28.666911 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG oslo_concurrency.lockutils [None req-4cd64e13-ea51-4b81-a782-5440edfc8f7b None None] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:21:28.667357 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG oslo_concurrency.lockutils [None req-4cd64e13-ea51-4b81-a782-5440edfc8f7b None None] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:21:28.667614 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-8c5a374b-0ccd-4013-97e9-b7d4b1b047ab None None] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:21:28.669348 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG oslo_concurrency.lockutils [None req-4cd64e13-ea51-4b81-a782-5440edfc8f7b None None] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:21:28.669546 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO dbcounter [None req-8c5a374b-0ccd-4013-97e9-b7d4b1b047ab None None] Registered counter for database nova_cell0 Aug 24 12:21:28.671313 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO dbcounter [None req-4cd64e13-ea51-4b81-a782-5440edfc8f7b None None] Registered counter for database nova_cell0 Aug 24 12:21:28.675076 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO dbcounter [None req-8c5a374b-0ccd-4013-97e9-b7d4b1b047ab None None] Registered counter for database nova_cell1 Aug 24 12:21:28.676610 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO dbcounter [None req-4cd64e13-ea51-4b81-a782-5440edfc8f7b None None] Registered counter for database nova_cell1 Aug 24 12:21:28.682589 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_db.sqlalchemy.engines [None req-8c5a374b-0ccd-4013-97e9-b7d4b1b047ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105917) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:21:28.684776 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_db.sqlalchemy.engines [None req-8c5a374b-0ccd-4013-97e9-b7d4b1b047ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105917) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:21:28.686011 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG oslo_db.sqlalchemy.engines [None req-4cd64e13-ea51-4b81-a782-5440edfc8f7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105916) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:21:28.688286 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG oslo_db.sqlalchemy.engines [None req-4cd64e13-ea51-4b81-a782-5440edfc8f7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105916) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:21:28.688405 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG dbcounter [-] [105917] Writer thread running {{(pid=105917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:21:28.693244 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG dbcounter [-] [105916] Writer thread running {{(pid=105916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:21:28.828946 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG dbcounter [-] [105917] Writer thread running {{(pid=105917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:21:28.830530 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG dbcounter [-] [105916] Writer thread running {{(pid=105916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:21:28.837638 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO dbcounter [None req-8c5a374b-0ccd-4013-97e9-b7d4b1b047ab None None] Registered counter for database nova_cell0 Aug 24 12:21:28.840843 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO dbcounter [None req-4cd64e13-ea51-4b81-a782-5440edfc8f7b None None] Registered counter for database nova_cell0 Aug 24 12:21:28.845490 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_db.sqlalchemy.engines [None req-8c5a374b-0ccd-4013-97e9-b7d4b1b047ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105917) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:21:28.849599 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG oslo_db.sqlalchemy.engines [None req-4cd64e13-ea51-4b81-a782-5440edfc8f7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105916) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:21:28.849844 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG dbcounter [-] [105917] Writer thread running {{(pid=105917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:21:28.854469 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG dbcounter [-] [105916] Writer thread running {{(pid=105916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:21:29.283724 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: WARNING keystonemiddleware.auth_token [None req-8c5a374b-0ccd-4013-97e9-b7d4b1b047ab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 12:21:29.290967 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: WARNING keystonemiddleware.auth_token [None req-8c5a374b-0ccd-4013-97e9-b7d4b1b047ab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 12:21:29.307986 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: WARNING keystonemiddleware.auth_token [None req-4cd64e13-ea51-4b81-a782-5440edfc8f7b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 12:21:29.315282 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: WARNING keystonemiddleware.auth_token [None req-4cd64e13-ea51-4b81-a782-5440edfc8f7b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 12:21:29.632140 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: WARNING keystonemiddleware.auth_token [None req-8c5a374b-0ccd-4013-97e9-b7d4b1b047ab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 12:21:29.638723 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: WARNING keystonemiddleware.auth_token [None req-8c5a374b-0ccd-4013-97e9-b7d4b1b047ab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 12:21:29.644235 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55eaaf43a9c0 pid: 105917 (default app) Aug 24 12:21:29.646305 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-8c5a374b-0ccd-4013-97e9-b7d4b1b047ab None None] Calling method '>' {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:21:29.647500 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-8c5a374b-0ccd-4013-97e9-b7d4b1b047ab None None] 10.222.0.45 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001766 Aug 24 12:21:29.647898 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 788 bytes} [Wed Aug 24 12:21:29 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:21:29.657829 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: WARNING keystonemiddleware.auth_token [None req-4cd64e13-ea51-4b81-a782-5440edfc8f7b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 12:21:29.663818 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: WARNING keystonemiddleware.auth_token [None req-4cd64e13-ea51-4b81-a782-5440edfc8f7b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 12:21:29.669090 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55eaaf43a9c0 pid: 105916 (default app) Aug 24 12:22:49.856803 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-8c5a374b-0ccd-4013-97e9-b7d4b1b047ab None None] Calling method '>' {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:22:49.857713 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-8c5a374b-0ccd-4013-97e9-b7d4b1b047ab None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 24 12:22:49.858118 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 2/2] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 12:22:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:22:49.870850 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG dbcounter [-] [105916] Writing DB stats nova_api:SELECT=3 {{(pid=105916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:22:49.871796 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG dbcounter [-] [105916] Writing DB stats nova_cell1:SELECT=3 {{(pid=105916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:22:49.872636 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG dbcounter [-] [105916] Writing DB stats nova_cell0:SELECT=3 {{(pid=105916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:22:49.873745 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG dbcounter [-] [105916] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:22:50.727790 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-9ea493a8-b65c-42ff-9fb7-a2e111e9e126 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:22:50.760346 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-9ea493a8-b65c-42ff-9fb7-a2e111e9e126 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.895172 Aug 24 12:22:50.761089 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 1/3] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Aug 24 12:22:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:22:53.112467 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-8c5a374b-0ccd-4013-97e9-b7d4b1b047ab None None] Calling method '>' {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:22:53.113734 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-8c5a374b-0ccd-4013-97e9-b7d4b1b047ab None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 24 12:22:53.114918 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 3/4] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 12:22:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:22:53.537465 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-080f3d1a-c775-46c4-bb23-4a6f57fc4610 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "cirros256", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1"}} {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:22:53.563719 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 12:22:53.563719 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: warnings.warn(msg) Aug 24 12:22:53.649424 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-080f3d1a-c775-46c4-bb23-4a6f57fc4610 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.528440 Aug 24 12:22:53.650238 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 2/5] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 24 12:22:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:22:53.665004 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG dbcounter [-] [105917] Writing DB stats nova_api:SELECT=3 {{(pid=105917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:22:53.666458 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG dbcounter [-] [105917] Writing DB stats nova_cell1:SELECT=3 {{(pid=105917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:22:53.667426 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG dbcounter [-] [105917] Writing DB stats nova_cell0:SELECT=3 {{(pid=105917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:22:53.673006 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG dbcounter [-] [105917] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:22:53.880039 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-23ea2c39-90f7-4583-9dc3-86470640e7f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:22:53.884316 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 12:22:53.884316 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: warnings.warn(msg) Aug 24 12:22:54.011136 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-23ea2c39-90f7-4583-9dc3-86470640e7f2 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.352051 Aug 24 12:22:54.011907 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 4/6] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Aug 24 12:22:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:22:56.399094 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-080f3d1a-c775-46c4-bb23-4a6f57fc4610 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:22:56.400954 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-080f3d1a-c775-46c4-bb23-4a6f57fc4610 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002093 Aug 24 12:22:56.401571 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 3/7] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 12:22:56 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:22:57.078490 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-8091d7f2-377d-43aa-8bd1-5504060f7f47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "d1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "name": "ds512M", "disk": 5}} {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:22:57.097142 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 12:22:57.097142 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: warnings.warn(msg) Aug 24 12:22:57.215864 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-8091d7f2-377d-43aa-8bd1-5504060f7f47 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.807863 Aug 24 12:22:57.216807 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 5/8] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 24 12:22:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:22:57.230249 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-88469f6a-085c-4c95-9415-576259b73101 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:22:57.233712 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 12:22:57.233712 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: warnings.warn(msg) Aug 24 12:22:57.367785 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-88469f6a-085c-4c95-9415-576259b73101 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.142777 Aug 24 12:22:57.368810 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 4/9] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Aug 24 12:22:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:22:59.690018 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-8091d7f2-377d-43aa-8bd1-5504060f7f47 admin admin] Calling method '>' {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:22:59.691057 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-8091d7f2-377d-43aa-8bd1-5504060f7f47 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 24 12:22:59.691457 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 6/10] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 12:22:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:23:00.077732 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-49d7b80c-c4cd-467c-85b9-8d0cddff5020 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "ram": 1024, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "name": "ds1G", "os-flavor-access:is_public": true}} {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:23:00.179770 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-49d7b80c-c4cd-467c-85b9-8d0cddff5020 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.481364 Aug 24 12:23:00.180244 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 5/11] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 24 12:22:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:23:00.193270 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-64d5d66b-b77f-4cc1-913b-9a2311ceeb3b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:23:00.310133 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-64d5d66b-b77f-4cc1-913b-9a2311ceeb3b admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120641 Aug 24 12:23:00.310744 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 7/12] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Aug 24 12:23:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:23:02.666534 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-49d7b80c-c4cd-467c-85b9-8d0cddff5020 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:02.667727 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-49d7b80c-c4cd-467c-85b9-8d0cddff5020 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001615 Aug 24 12:23:02.668390 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 6/13] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 12:23:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:23:03.081409 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-692b082d-8b3c-4d40-b5f8-82f15f7cc05f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "ram": 2048, "name": "ds2G", "id": "d3", "swap": 0, "disk": 10}} {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:23:03.157895 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-692b082d-8b3c-4d40-b5f8-82f15f7cc05f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.483231 Aug 24 12:23:03.158425 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 8/14] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 24 12:23:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:23:03.170858 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-5ba9c497-c528-4cc3-abd9-6c24a01fe85b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:23:03.247829 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-5ba9c497-c528-4cc3-abd9-6c24a01fe85b admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080928 Aug 24 12:23:03.248459 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 7/15] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Aug 24 12:23:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:23:05.593533 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-692b082d-8b3c-4d40-b5f8-82f15f7cc05f admin admin] Calling method '>' {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:05.594538 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-692b082d-8b3c-4d40-b5f8-82f15f7cc05f admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 24 12:23:05.594972 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 9/16] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 12:23:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:23:06.039496 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-5ea6ebff-08b3-45ab-87e5-07d743ba5397 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds4G", "rxtx_factor": 1.0, "vcpus": 4, "disk": 20}} {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:23:06.142640 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-5ea6ebff-08b3-45ab-87e5-07d743ba5397 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.541341 Aug 24 12:23:06.143258 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 8/17] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 24 12:23:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:23:06.156460 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-e70f7f94-15d9-4b85-9a95-5af3751256ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:23:06.274882 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-e70f7f94-15d9-4b85-9a95-5af3751256ce admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.122176 Aug 24 12:23:06.275397 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 10/18] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Aug 24 12:23:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:23:08.614605 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-5ea6ebff-08b3-45ab-87e5-07d743ba5397 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:08.615656 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-5ea6ebff-08b3-45ab-87e5-07d743ba5397 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001825 Aug 24 12:23:08.616069 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 9/19] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 12:23:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:23:09.030011 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-63877998-f148-489c-b6ae-de0293f9d17f admin admin] Calling method '>' {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:09.061713 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-63877998-f148-489c-b6ae-de0293f9d17f admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.438688 Aug 24 12:23:09.062369 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 11/20] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Aug 24 12:23:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:23:11.698485 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-5ea6ebff-08b3-45ab-87e5-07d743ba5397 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:11.699576 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-5ea6ebff-08b3-45ab-87e5-07d743ba5397 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 24 12:23:11.699913 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 10/21] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 12:23:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:23:12.113794 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-bd62b866-e56b-4616-810e-362e34645fa6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "ram": 512, "name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:23:12.226246 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-bd62b866-e56b-4616-810e-362e34645fa6 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.519988 Aug 24 12:23:12.227711 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 12/22] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 24 12:23:11 2022] POST /compute/v2.1/flavors => generated 402 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:23:12.240287 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-5a6d3161-950c-4c7f-896f-cebae58cb920 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:23:12.326742 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-5a6d3161-950c-4c7f-896f-cebae58cb920 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090191 Aug 24 12:23:12.327288 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 11/23] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Aug 24 12:23:12 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:23:14.646532 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-bd62b866-e56b-4616-810e-362e34645fa6 admin admin] Calling method '>' {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:14.647572 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-bd62b866-e56b-4616-810e-362e34645fa6 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 24 12:23:14.647976 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 13/24] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 12:23:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:23:15.046744 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-ab7d3113-eb0e-44ad-ac2f-9db215bc848d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small", "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:23:15.117472 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-ab7d3113-eb0e-44ad-ac2f-9db215bc848d admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.462729 Aug 24 12:23:15.118097 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 12/25] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 24 12:23:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:23:15.130461 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-21cc202a-560a-44f7-b55b-566ec9ea9335 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:23:15.361294 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-21cc202a-560a-44f7-b55b-566ec9ea9335 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.234311 Aug 24 12:23:15.362683 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 14/26] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Aug 24 12:23:15 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:23:17.709789 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-ab7d3113-eb0e-44ad-ac2f-9db215bc848d admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:17.711046 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-ab7d3113-eb0e-44ad-ac2f-9db215bc848d admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 24 12:23:17.712015 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 13/27] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 12:23:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:23:18.196907 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-f17f6f3d-0df2-406b-99c3-b4457ef12215 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "name": "m1.medium", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3"}} {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:23:18.288691 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-f17f6f3d-0df2-406b-99c3-b4457ef12215 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.570349 Aug 24 12:23:18.289246 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 15/28] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 24 12:23:17 2022] POST /compute/v2.1/flavors => generated 406 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:23:18.301586 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-5a475d94-b778-403a-97ff-1be3ae8d9853 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:23:18.384879 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-5a475d94-b778-403a-97ff-1be3ae8d9853 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087008 Aug 24 12:23:18.385455 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 14/29] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Aug 24 12:23:18 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:23:20.835947 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-f17f6f3d-0df2-406b-99c3-b4457ef12215 admin admin] Calling method '>' {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:20.836993 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-f17f6f3d-0df2-406b-99c3-b4457ef12215 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 24 12:23:20.837395 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 16/30] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 12:23:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:23:21.297389 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-f427c75e-8d14-4c7d-8bc0-7e20695e95de admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "rxtx_factor": 1.0, "swap": 0, "name": "m1.large", "vcpus": 4, "disk": 80, "id": "4"}} {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:23:21.303005 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG dbcounter [-] [105916] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:23:21.357433 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-f427c75e-8d14-4c7d-8bc0-7e20695e95de admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.513666 Aug 24 12:23:21.358413 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 15/31] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 24 12:23:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:23:21.371012 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-345da04f-c34d-4382-8856-89c2ab855fc3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:23:21.464169 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-345da04f-c34d-4382-8856-89c2ab855fc3 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097309 Aug 24 12:23:21.465075 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 17/32] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Aug 24 12:23:21 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:23:23.818301 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-f427c75e-8d14-4c7d-8bc0-7e20695e95de admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:23.819924 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-f427c75e-8d14-4c7d-8bc0-7e20695e95de admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002058 Aug 24 12:23:23.820332 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 16/33] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 12:23:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:23:24.279970 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-05105458-c774-4e06-8942-e74ae97cf4ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 160, "vcpus": 8, "swap": 0, "rxtx_factor": 1.0, "id": "5", "ram": 16384}} {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:23:24.288742 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG dbcounter [-] [105917] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:23:24.375143 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-05105458-c774-4e06-8942-e74ae97cf4ec admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.548165 Aug 24 12:23:24.375866 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 18/34] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 24 12:23:23 2022] POST /compute/v2.1/flavors => generated 408 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:23:24.387655 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-aaa92ab6-90d9-4879-870a-9df7e56a927e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:23:24.487317 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-aaa92ab6-90d9-4879-870a-9df7e56a927e admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103376 Aug 24 12:23:24.488337 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 17/35] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Aug 24 12:23:24 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:23:43.444273 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-05105458-c774-4e06-8942-e74ae97cf4ec admin admin] Calling method '>' {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:43.445967 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-05105458-c774-4e06-8942-e74ae97cf4ec admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002110 Aug 24 12:23:43.446367 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 19/36] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 12:23:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:23:43.826906 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-f66d38a9-bb12-4f04-94e9-03bd04c00d30 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:43.844956 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-f66d38a9-bb12-4f04-94e9-03bd04c00d30 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.392480 Aug 24 12:23:43.845482 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 18/37] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Aug 24 12:23:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:23:44.893245 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-05105458-c774-4e06-8942-e74ae97cf4ec admin admin] Calling method '>' {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:44.894251 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-05105458-c774-4e06-8942-e74ae97cf4ec admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 24 12:23:44.894661 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 20/38] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 24 12:23:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:23:45.407304 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-bf856c30-1803-4b43-ad67-1b0641f969e3 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:45.412783 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.wsgi [None req-bf856c30-1803-4b43-ad67-1b0641f969e3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 12:23:45.416533 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-bf856c30-1803-4b43-ad67-1b0641f969e3 admin admin] Request method failure captured: Aug 24 12:23:45.416533 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 12:23:45.416533 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: Accept: application/json Aug 24 12:23:45.416533 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: Accept-Encoding: gzip, deflate Aug 24 12:23:45.416533 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: Connection: keep-alive Aug 24 12:23:45.416533 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: Content-Length: 0 Aug 24 12:23:45.416533 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: Host: 10.222.0.45 Aug 24 12:23:45.416533 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: Openstack-Api-Version: compute 2.90 Aug 24 12:23:45.416533 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: Openstack-System-Scope: None Aug 24 12:23:45.416533 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: User-Agent: python-novaclient Aug 24 12:23:45.416533 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Auth-Token: gAAAAABjBhhQO8ojoSA1K1_O-8GKX3W7Di8pxMxW6f_mhWjKmnzRljaOUBKVp_biLFzJRBiMcptQu_K-t0aGmLUzXZov5tHaONCySeNMa_fzTnsdHHodUOjSaiio9YAzpWRiRqs8AuCwtBtMx-DP0q6rzk-wOsVVj0fEzfkHSq0m14WR7z9tNPg Aug 24 12:23:45.416533 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Domain-Id: None Aug 24 12:23:45.416533 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Domain-Name: None Aug 24 12:23:45.416533 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Identity-Status: Confirmed Aug 24 12:23:45.416533 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Is-Admin-Project: True Aug 24 12:23:45.416533 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 12:23:45.416533 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Project-Domain-Id: default Aug 24 12:23:45.416533 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Project-Domain-Name: Default Aug 24 12:23:45.416533 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Project-Id: 4cfd603abe4c44b2a5789dbc4d8a6f2b Aug 24 12:23:45.416533 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Project-Name: admin Aug 24 12:23:45.416533 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Role: admin,member,reader Aug 24 12:23:45.416533 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Roles: admin,member,reader Aug 24 12:23:45.418232 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4cfd603abe4c44b2a5789dbc4d8a6f2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4cfd603abe4c44b2a5789dbc4d8a6f2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4cfd603abe4c44b2a5789dbc4d8a6f2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4cfd603abe4c44b2a5789dbc4d8a6f2b"}]}] Aug 24 12:23:45.418232 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Tenant: admin Aug 24 12:23:45.418232 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Tenant-Id: 4cfd603abe4c44b2a5789dbc4d8a6f2b Aug 24 12:23:45.418232 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Tenant-Name: admin Aug 24 12:23:45.418232 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-User: admin Aug 24 12:23:45.418232 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-User-Domain-Id: default Aug 24 12:23:45.418232 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-User-Domain-Name: Default Aug 24 12:23:45.418232 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-User-Id: ad9be8700f45469d8fb5f44fbb2eeb2c Aug 24 12:23:45.418232 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-User-Name: admin Aug 24 12:23:45.418232 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: method: > Aug 24 12:23:45.418232 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: exception: Flavor 42 could not be found. Aug 24 12:23:45.418232 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: action_args: {'id': '42'} Aug 24 12:23:45.418232 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:23:45.418232 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:23:45.419278 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 12:23:45.419278 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 12:23:45.419278 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 12:23:45.419278 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 12:23:45.419278 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 12:23:45.419278 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 12:23:45.419278 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 12:23:45.419278 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 12:23:45.419278 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 12:23:45.419278 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:23:45.419278 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 12:23:45.419278 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 12:23:45.419278 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 12:23:45.419278 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 24 12:23:45.419278 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:23:45.419278 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 24 12:23:45.419278 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:23:45.419278 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:23:45.419278 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:23:45.420748 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:23:45.420748 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:23:45.420748 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:23:45.420748 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:23:45.420748 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 12:23:45.420748 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:23:45.420748 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 12:23:45.420748 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 24 12:23:45.420748 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:23:45.420748 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 24 12:23:45.420748 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:23:45.420748 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:23:45.420748 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:23:45.420748 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:23:45.420748 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:23:45.420748 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 12:23:45.420748 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 24 12:23:45.420748 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-bf856c30-1803-4b43-ad67-1b0641f969e3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:23:45.422053 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-bf856c30-1803-4b43-ad67-1b0641f969e3 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.387601 Aug 24 12:23:45.422053 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 19/39] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Aug 24 12:23:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 12:23:45.427640 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-4a255e1f-1f3a-4a1e-b410-3204c9ed99d8 admin admin] Calling method '>' {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:45.450785 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-4a255e1f-1f3a-4a1e-b410-3204c9ed99d8 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026706 Aug 24 12:23:45.451350 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 21/40] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 24 12:23:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:23:45.461385 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-fa165d23-e096-41e9-bcc8-6c7b1c6018f7 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:45.485216 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-fa165d23-e096-41e9-bcc8-6c7b1c6018f7 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027668 Aug 24 12:23:45.485733 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 20/41] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 24 12:23:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:23:45.496069 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-c19ed39e-a3b9-41a1-b0b6-d4bbe7718325 admin admin] Calling method '>' {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:45.501716 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.wsgi [None req-c19ed39e-a3b9-41a1-b0b6-d4bbe7718325 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 12:23:45.504948 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-c19ed39e-a3b9-41a1-b0b6-d4bbe7718325 admin admin] Request method failure captured: Aug 24 12:23:45.504948 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 12:23:45.504948 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: Accept: application/json Aug 24 12:23:45.504948 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: Accept-Encoding: gzip, deflate Aug 24 12:23:45.504948 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: Connection: keep-alive Aug 24 12:23:45.504948 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: Content-Length: 0 Aug 24 12:23:45.504948 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: Host: 10.222.0.45 Aug 24 12:23:45.504948 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: Openstack-Api-Version: compute 2.90 Aug 24 12:23:45.504948 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: Openstack-System-Scope: None Aug 24 12:23:45.504948 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: User-Agent: python-novaclient Aug 24 12:23:45.504948 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Auth-Token: gAAAAABjBhhQO8ojoSA1K1_O-8GKX3W7Di8pxMxW6f_mhWjKmnzRljaOUBKVp_biLFzJRBiMcptQu_K-t0aGmLUzXZov5tHaONCySeNMa_fzTnsdHHodUOjSaiio9YAzpWRiRqs8AuCwtBtMx-DP0q6rzk-wOsVVj0fEzfkHSq0m14WR7z9tNPg Aug 24 12:23:45.504948 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Domain-Id: None Aug 24 12:23:45.504948 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Domain-Name: None Aug 24 12:23:45.504948 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Identity-Status: Confirmed Aug 24 12:23:45.504948 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Is-Admin-Project: True Aug 24 12:23:45.504948 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 12:23:45.504948 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Project-Domain-Id: default Aug 24 12:23:45.504948 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Project-Domain-Name: Default Aug 24 12:23:45.504948 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Project-Id: 4cfd603abe4c44b2a5789dbc4d8a6f2b Aug 24 12:23:45.504948 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Project-Name: admin Aug 24 12:23:45.504948 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Role: admin,member,reader Aug 24 12:23:45.504948 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Roles: admin,member,reader Aug 24 12:23:45.510584 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4cfd603abe4c44b2a5789dbc4d8a6f2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4cfd603abe4c44b2a5789dbc4d8a6f2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4cfd603abe4c44b2a5789dbc4d8a6f2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4cfd603abe4c44b2a5789dbc4d8a6f2b"}]}] Aug 24 12:23:45.510584 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Tenant: admin Aug 24 12:23:45.510584 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Tenant-Id: 4cfd603abe4c44b2a5789dbc4d8a6f2b Aug 24 12:23:45.510584 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Tenant-Name: admin Aug 24 12:23:45.510584 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-User: admin Aug 24 12:23:45.510584 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-User-Domain-Id: default Aug 24 12:23:45.510584 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-User-Domain-Name: Default Aug 24 12:23:45.510584 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-User-Id: ad9be8700f45469d8fb5f44fbb2eeb2c Aug 24 12:23:45.510584 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-User-Name: admin Aug 24 12:23:45.510584 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: method: > Aug 24 12:23:45.510584 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: exception: Flavor 42 could not be found. Aug 24 12:23:45.510584 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: action_args: {'id': '42'} Aug 24 12:23:45.510584 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:23:45.510584 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:23:45.511624 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 12:23:45.511624 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 12:23:45.511624 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 12:23:45.511624 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 12:23:45.511624 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 12:23:45.511624 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 12:23:45.511624 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 12:23:45.511624 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 12:23:45.511624 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 12:23:45.511624 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:23:45.511624 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 12:23:45.511624 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 12:23:45.511624 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 12:23:45.511624 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi Aug 24 12:23:45.511624 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:23:45.511624 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi Aug 24 12:23:45.511624 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:23:45.511624 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:23:45.511624 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:23:45.512909 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:23:45.512909 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:23:45.512909 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:23:45.512909 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:23:45.512909 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 12:23:45.512909 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:23:45.512909 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 12:23:45.512909 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi Aug 24 12:23:45.512909 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:23:45.512909 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi Aug 24 12:23:45.512909 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:23:45.512909 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:23:45.512909 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:23:45.512909 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:23:45.512909 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:23:45.512909 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 12:23:45.512909 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi Aug 24 12:23:45.512909 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-c19ed39e-a3b9-41a1-b0b6-d4bbe7718325 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:23:45.514145 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-c19ed39e-a3b9-41a1-b0b6-d4bbe7718325 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014761 Aug 24 12:23:45.514145 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 22/42] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Aug 24 12:23:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 12:23:46.469199 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-fa165d23-e096-41e9-bcc8-6c7b1c6018f7 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:46.470257 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-fa165d23-e096-41e9-bcc8-6c7b1c6018f7 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 24 12:23:46.470658 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 21/43] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 24 12:23:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:23:46.986245 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-0f9034e8-928c-4d29-adf9-8b081855241d admin admin] Calling method '>' {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:46.992396 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.wsgi [None req-0f9034e8-928c-4d29-adf9-8b081855241d admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 12:23:46.993890 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-0f9034e8-928c-4d29-adf9-8b081855241d admin admin] Request method failure captured: Aug 24 12:23:46.993890 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 12:23:46.993890 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: Accept: application/json Aug 24 12:23:46.993890 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: Accept-Encoding: gzip, deflate Aug 24 12:23:46.993890 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: Connection: keep-alive Aug 24 12:23:46.993890 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: Content-Length: 0 Aug 24 12:23:46.993890 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: Host: 10.222.0.45 Aug 24 12:23:46.993890 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: Openstack-Api-Version: compute 2.90 Aug 24 12:23:46.993890 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: Openstack-System-Scope: None Aug 24 12:23:46.993890 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: User-Agent: python-novaclient Aug 24 12:23:46.993890 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Auth-Token: gAAAAABjBhhSBvgRms9ubRGUANfsKf-a5BmsMAkOJ2m5Xy-QO_WkIMZDs_Whesu4XXs76913fUVpK5eGKxyZcm9Stg_HNbeowF4kmRCHQaNquk_FMhvLbCfkNBfx9f6R_PYEzQcE1fCJTpHFIP4VmlqMRZytlPWjl0OOH__Klj3uv7QKGqLz4vE Aug 24 12:23:46.993890 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Domain-Id: None Aug 24 12:23:46.993890 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Domain-Name: None Aug 24 12:23:46.993890 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Identity-Status: Confirmed Aug 24 12:23:46.993890 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Is-Admin-Project: True Aug 24 12:23:46.993890 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 12:23:46.993890 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Project-Domain-Id: default Aug 24 12:23:46.993890 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Project-Domain-Name: Default Aug 24 12:23:46.993890 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Project-Id: 4cfd603abe4c44b2a5789dbc4d8a6f2b Aug 24 12:23:46.993890 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Project-Name: admin Aug 24 12:23:46.993890 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Role: admin,member,reader Aug 24 12:23:46.993890 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Roles: admin,member,reader Aug 24 12:23:46.995418 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4cfd603abe4c44b2a5789dbc4d8a6f2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4cfd603abe4c44b2a5789dbc4d8a6f2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4cfd603abe4c44b2a5789dbc4d8a6f2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4cfd603abe4c44b2a5789dbc4d8a6f2b"}]}] Aug 24 12:23:46.995418 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Tenant: admin Aug 24 12:23:46.995418 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Tenant-Id: 4cfd603abe4c44b2a5789dbc4d8a6f2b Aug 24 12:23:46.995418 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Tenant-Name: admin Aug 24 12:23:46.995418 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-User: admin Aug 24 12:23:46.995418 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-User-Domain-Id: default Aug 24 12:23:46.995418 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-User-Domain-Name: Default Aug 24 12:23:46.995418 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-User-Id: ad9be8700f45469d8fb5f44fbb2eeb2c Aug 24 12:23:46.995418 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-User-Name: admin Aug 24 12:23:46.995418 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: method: > Aug 24 12:23:46.995418 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: exception: Flavor 84 could not be found. Aug 24 12:23:46.995418 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: action_args: {'id': '84'} Aug 24 12:23:46.995418 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:23:46.995418 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:23:46.996358 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 12:23:46.996358 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 12:23:46.996358 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 12:23:46.996358 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 12:23:46.996358 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 12:23:46.996358 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 12:23:46.996358 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 12:23:46.996358 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 12:23:46.996358 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 12:23:46.996358 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:23:46.996358 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 12:23:46.996358 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 12:23:46.996358 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 12:23:46.996358 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi Aug 24 12:23:46.996358 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:23:46.996358 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi Aug 24 12:23:46.996358 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:23:46.996358 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:23:46.996358 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:23:46.997494 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:23:46.997494 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:23:46.997494 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:23:46.997494 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:23:46.997494 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 12:23:46.997494 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:23:46.997494 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 12:23:46.997494 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi Aug 24 12:23:46.997494 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:23:46.997494 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi Aug 24 12:23:46.997494 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:23:46.997494 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:23:46.997494 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:23:46.997494 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:23:46.997494 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:23:46.997494 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 12:23:46.997494 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi Aug 24 12:23:46.997494 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-0f9034e8-928c-4d29-adf9-8b081855241d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:23:46.998507 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-0f9034e8-928c-4d29-adf9-8b081855241d admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.386386 Aug 24 12:23:46.998507 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 23/44] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Aug 24 12:23:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 12:23:47.004898 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-705b290b-9d32-41ea-96c4-8a5a001ade5a admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:47.020154 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-705b290b-9d32-41ea-96c4-8a5a001ade5a admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018765 Aug 24 12:23:47.020664 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 22/45] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 24 12:23:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:23:47.030436 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-ebb0bab7-f334-473c-bbaf-3e5df2c34d0b admin admin] Calling method '>' {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:47.045124 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-ebb0bab7-f334-473c-bbaf-3e5df2c34d0b admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018161 Aug 24 12:23:47.045638 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 24/46] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 24 12:23:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:23:47.055091 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-2555a4ea-9f30-448e-a814-a0923fd2ead2 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:47.060232 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.wsgi [None req-2555a4ea-9f30-448e-a814-a0923fd2ead2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 12:23:47.061706 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-2555a4ea-9f30-448e-a814-a0923fd2ead2 admin admin] Request method failure captured: Aug 24 12:23:47.061706 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 12:23:47.061706 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: Accept: application/json Aug 24 12:23:47.061706 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: Accept-Encoding: gzip, deflate Aug 24 12:23:47.061706 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: Connection: keep-alive Aug 24 12:23:47.061706 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: Content-Length: 0 Aug 24 12:23:47.061706 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: Host: 10.222.0.45 Aug 24 12:23:47.061706 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: Openstack-Api-Version: compute 2.90 Aug 24 12:23:47.061706 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: Openstack-System-Scope: None Aug 24 12:23:47.061706 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: User-Agent: python-novaclient Aug 24 12:23:47.061706 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Auth-Token: gAAAAABjBhhSBvgRms9ubRGUANfsKf-a5BmsMAkOJ2m5Xy-QO_WkIMZDs_Whesu4XXs76913fUVpK5eGKxyZcm9Stg_HNbeowF4kmRCHQaNquk_FMhvLbCfkNBfx9f6R_PYEzQcE1fCJTpHFIP4VmlqMRZytlPWjl0OOH__Klj3uv7QKGqLz4vE Aug 24 12:23:47.061706 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Domain-Id: None Aug 24 12:23:47.061706 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Domain-Name: None Aug 24 12:23:47.061706 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Identity-Status: Confirmed Aug 24 12:23:47.061706 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Is-Admin-Project: True Aug 24 12:23:47.061706 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 12:23:47.061706 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Project-Domain-Id: default Aug 24 12:23:47.061706 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Project-Domain-Name: Default Aug 24 12:23:47.061706 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Project-Id: 4cfd603abe4c44b2a5789dbc4d8a6f2b Aug 24 12:23:47.061706 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Project-Name: admin Aug 24 12:23:47.061706 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Role: admin,member,reader Aug 24 12:23:47.061706 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Roles: admin,member,reader Aug 24 12:23:47.063254 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4cfd603abe4c44b2a5789dbc4d8a6f2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4cfd603abe4c44b2a5789dbc4d8a6f2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4cfd603abe4c44b2a5789dbc4d8a6f2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4cfd603abe4c44b2a5789dbc4d8a6f2b"}]}] Aug 24 12:23:47.063254 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Tenant: admin Aug 24 12:23:47.063254 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Tenant-Id: 4cfd603abe4c44b2a5789dbc4d8a6f2b Aug 24 12:23:47.063254 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Tenant-Name: admin Aug 24 12:23:47.063254 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-User: admin Aug 24 12:23:47.063254 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-User-Domain-Id: default Aug 24 12:23:47.063254 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-User-Domain-Name: Default Aug 24 12:23:47.063254 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-User-Id: ad9be8700f45469d8fb5f44fbb2eeb2c Aug 24 12:23:47.063254 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-User-Name: admin Aug 24 12:23:47.063254 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: method: > Aug 24 12:23:47.063254 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: exception: Flavor 84 could not be found. Aug 24 12:23:47.063254 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: action_args: {'id': '84'} Aug 24 12:23:47.063254 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:23:47.063254 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:23:47.064277 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 12:23:47.064277 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 12:23:47.064277 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 12:23:47.064277 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 12:23:47.064277 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 12:23:47.064277 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 12:23:47.064277 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 12:23:47.064277 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 12:23:47.064277 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 12:23:47.064277 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:23:47.064277 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 12:23:47.064277 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 12:23:47.064277 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 12:23:47.064277 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 24 12:23:47.064277 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:23:47.064277 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 24 12:23:47.064277 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:23:47.064277 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:23:47.064277 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:23:47.065566 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:23:47.065566 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:23:47.065566 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:23:47.065566 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:23:47.065566 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 12:23:47.065566 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:23:47.065566 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 12:23:47.065566 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 24 12:23:47.065566 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:23:47.065566 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 24 12:23:47.065566 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:23:47.065566 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:23:47.065566 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:23:47.065566 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:23:47.065566 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:23:47.065566 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 12:23:47.065566 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 24 12:23:47.065566 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-2555a4ea-9f30-448e-a814-a0923fd2ead2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:23:47.066813 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-2555a4ea-9f30-448e-a814-a0923fd2ead2 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011898 Aug 24 12:23:47.066813 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 23/47] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Aug 24 12:23:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 12:23:48.019858 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-ebb0bab7-f334-473c-bbaf-3e5df2c34d0b admin admin] Calling method '>' {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:48.020856 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-ebb0bab7-f334-473c-bbaf-3e5df2c34d0b admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 24 12:23:48.021251 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 25/48] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 24 12:23:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:23:48.533023 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-ec0be21b-71b3-4f62-9620-db7641de8f0d admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:48.538628 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.wsgi [None req-ec0be21b-71b3-4f62-9620-db7641de8f0d admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 12:23:48.540119 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-ec0be21b-71b3-4f62-9620-db7641de8f0d admin admin] Request method failure captured: Aug 24 12:23:48.540119 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 12:23:48.540119 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: Accept: application/json Aug 24 12:23:48.540119 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: Accept-Encoding: gzip, deflate Aug 24 12:23:48.540119 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: Connection: keep-alive Aug 24 12:23:48.540119 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: Content-Length: 0 Aug 24 12:23:48.540119 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: Host: 10.222.0.45 Aug 24 12:23:48.540119 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: Openstack-Api-Version: compute 2.90 Aug 24 12:23:48.540119 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: Openstack-System-Scope: None Aug 24 12:23:48.540119 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: User-Agent: python-novaclient Aug 24 12:23:48.540119 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Auth-Token: gAAAAABjBhhTi1y3EmCgFM1_SBXNv10N9Edie9zKQ-LDSEz8ce2Ww09QpfzKHTjQOFPEesqnO6WanQoqjWtvBmwxLlrDOAo3MWmHoZlp8XWgqLydQhmTq4vBPS_hr6KPz4a89vtNBDESdD2cE7NZH5oS5cI8NIWT7DQ15JB_G51XuBSV7HHkgno Aug 24 12:23:48.540119 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Domain-Id: None Aug 24 12:23:48.540119 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Domain-Name: None Aug 24 12:23:48.540119 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Identity-Status: Confirmed Aug 24 12:23:48.540119 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Is-Admin-Project: True Aug 24 12:23:48.540119 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 12:23:48.540119 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Project-Domain-Id: default Aug 24 12:23:48.540119 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Project-Domain-Name: Default Aug 24 12:23:48.540119 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Project-Id: 4cfd603abe4c44b2a5789dbc4d8a6f2b Aug 24 12:23:48.540119 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Project-Name: admin Aug 24 12:23:48.540119 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Role: admin,member,reader Aug 24 12:23:48.540119 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Roles: admin,member,reader Aug 24 12:23:48.541653 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4cfd603abe4c44b2a5789dbc4d8a6f2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4cfd603abe4c44b2a5789dbc4d8a6f2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4cfd603abe4c44b2a5789dbc4d8a6f2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4cfd603abe4c44b2a5789dbc4d8a6f2b"}]}] Aug 24 12:23:48.541653 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Tenant: admin Aug 24 12:23:48.541653 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Tenant-Id: 4cfd603abe4c44b2a5789dbc4d8a6f2b Aug 24 12:23:48.541653 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-Tenant-Name: admin Aug 24 12:23:48.541653 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-User: admin Aug 24 12:23:48.541653 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-User-Domain-Id: default Aug 24 12:23:48.541653 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-User-Domain-Name: Default Aug 24 12:23:48.541653 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-User-Id: ad9be8700f45469d8fb5f44fbb2eeb2c Aug 24 12:23:48.541653 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: X-User-Name: admin Aug 24 12:23:48.541653 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: method: > Aug 24 12:23:48.541653 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: exception: Flavor 451 could not be found. Aug 24 12:23:48.541653 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: action_args: {'id': '451'} Aug 24 12:23:48.541653 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:23:48.541653 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:23:48.542726 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 12:23:48.542726 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 12:23:48.542726 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 12:23:48.542726 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 12:23:48.542726 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 12:23:48.542726 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 12:23:48.542726 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 12:23:48.542726 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 12:23:48.542726 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 12:23:48.542726 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:23:48.542726 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 12:23:48.542726 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 12:23:48.542726 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 12:23:48.542726 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 24 12:23:48.542726 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:23:48.542726 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 24 12:23:48.542726 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:23:48.542726 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:23:48.542726 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:23:48.544061 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:23:48.544061 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:23:48.544061 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:23:48.544061 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:23:48.544061 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 12:23:48.544061 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:23:48.544061 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 12:23:48.544061 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 24 12:23:48.544061 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:23:48.544061 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 24 12:23:48.544061 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:23:48.544061 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:23:48.544061 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:23:48.544061 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:23:48.544061 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:23:48.544061 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 12:23:48.544061 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: ERROR nova.api.openstack.wsgi Aug 24 12:23:48.544061 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-ec0be21b-71b3-4f62-9620-db7641de8f0d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:23:48.545295 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-ec0be21b-71b3-4f62-9620-db7641de8f0d admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.382986 Aug 24 12:23:48.545295 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 24/49] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 24 12:23:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 384 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 12:23:48.551122 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-bad65726-f382-413e-857b-e52ff79835d9 admin admin] Calling method '>' {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:48.566338 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-bad65726-f382-413e-857b-e52ff79835d9 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018765 Aug 24 12:23:48.566929 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 26/50] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 24 12:23:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:23:48.576390 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-64af6ef9-04f0-42d1-9487-6061551cd1c2 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:48.590912 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-64af6ef9-04f0-42d1-9487-6061551cd1c2 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017852 Aug 24 12:23:48.591419 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 25/51] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 24 12:23:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:23:48.600330 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-7608e054-da29-4fa0-8d2c-0146d1b6a835 admin admin] Calling method '>' {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:48.605495 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.wsgi [None req-7608e054-da29-4fa0-8d2c-0146d1b6a835 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 12:23:48.606999 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-7608e054-da29-4fa0-8d2c-0146d1b6a835 admin admin] Request method failure captured: Aug 24 12:23:48.606999 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 12:23:48.606999 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: Accept: application/json Aug 24 12:23:48.606999 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: Accept-Encoding: gzip, deflate Aug 24 12:23:48.606999 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: Connection: keep-alive Aug 24 12:23:48.606999 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: Content-Length: 0 Aug 24 12:23:48.606999 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: Host: 10.222.0.45 Aug 24 12:23:48.606999 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: Openstack-Api-Version: compute 2.90 Aug 24 12:23:48.606999 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: Openstack-System-Scope: None Aug 24 12:23:48.606999 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: User-Agent: python-novaclient Aug 24 12:23:48.606999 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Auth-Token: gAAAAABjBhhTi1y3EmCgFM1_SBXNv10N9Edie9zKQ-LDSEz8ce2Ww09QpfzKHTjQOFPEesqnO6WanQoqjWtvBmwxLlrDOAo3MWmHoZlp8XWgqLydQhmTq4vBPS_hr6KPz4a89vtNBDESdD2cE7NZH5oS5cI8NIWT7DQ15JB_G51XuBSV7HHkgno Aug 24 12:23:48.606999 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Domain-Id: None Aug 24 12:23:48.606999 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Domain-Name: None Aug 24 12:23:48.606999 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Identity-Status: Confirmed Aug 24 12:23:48.606999 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Is-Admin-Project: True Aug 24 12:23:48.606999 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 12:23:48.606999 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Project-Domain-Id: default Aug 24 12:23:48.606999 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Project-Domain-Name: Default Aug 24 12:23:48.606999 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Project-Id: 4cfd603abe4c44b2a5789dbc4d8a6f2b Aug 24 12:23:48.606999 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Project-Name: admin Aug 24 12:23:48.606999 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Role: admin,member,reader Aug 24 12:23:48.606999 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Roles: admin,member,reader Aug 24 12:23:48.608498 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4cfd603abe4c44b2a5789dbc4d8a6f2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4cfd603abe4c44b2a5789dbc4d8a6f2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4cfd603abe4c44b2a5789dbc4d8a6f2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4cfd603abe4c44b2a5789dbc4d8a6f2b"}]}] Aug 24 12:23:48.608498 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Tenant: admin Aug 24 12:23:48.608498 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Tenant-Id: 4cfd603abe4c44b2a5789dbc4d8a6f2b Aug 24 12:23:48.608498 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-Tenant-Name: admin Aug 24 12:23:48.608498 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-User: admin Aug 24 12:23:48.608498 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-User-Domain-Id: default Aug 24 12:23:48.608498 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-User-Domain-Name: Default Aug 24 12:23:48.608498 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-User-Id: ad9be8700f45469d8fb5f44fbb2eeb2c Aug 24 12:23:48.608498 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: X-User-Name: admin Aug 24 12:23:48.608498 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: method: > Aug 24 12:23:48.608498 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: exception: Flavor 451 could not be found. Aug 24 12:23:48.608498 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: action_args: {'id': '451'} Aug 24 12:23:48.608498 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:23:48.608498 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:23:48.609565 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 12:23:48.609565 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 12:23:48.609565 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 12:23:48.609565 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 12:23:48.609565 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 12:23:48.609565 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 12:23:48.609565 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 12:23:48.609565 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 12:23:48.609565 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 12:23:48.609565 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:23:48.609565 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 12:23:48.609565 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 12:23:48.609565 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 12:23:48.609565 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi Aug 24 12:23:48.609565 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:23:48.609565 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi Aug 24 12:23:48.609565 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:23:48.609565 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:23:48.609565 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:23:48.610998 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:23:48.610998 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:23:48.610998 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:23:48.610998 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:23:48.610998 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 12:23:48.610998 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:23:48.610998 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 12:23:48.610998 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi Aug 24 12:23:48.610998 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:23:48.610998 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi Aug 24 12:23:48.610998 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:23:48.610998 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:23:48.610998 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:23:48.610998 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:23:48.610998 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:23:48.610998 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 12:23:48.610998 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: ERROR nova.api.openstack.wsgi Aug 24 12:23:48.610998 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-7608e054-da29-4fa0-8d2c-0146d1b6a835 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:23:48.612243 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-7608e054-da29-4fa0-8d2c-0146d1b6a835 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011414 Aug 24 12:23:48.612243 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 27/52] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 24 12:23:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 12:23:49.566923 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-64af6ef9-04f0-42d1-9487-6061551cd1c2 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:49.567947 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-64af6ef9-04f0-42d1-9487-6061551cd1c2 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 24 12:23:49.568334 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 26/53] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 24 12:23:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:23:50.086691 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-1197cc49-0a2d-42b2-adc6-67e946d707af admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:23:50.167175 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-1197cc49-0a2d-42b2-adc6-67e946d707af admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.460214 Aug 24 12:23:50.167727 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 28/54] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Aug 24 12:23:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:23:51.138057 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-64af6ef9-04f0-42d1-9487-6061551cd1c2 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:51.139180 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-64af6ef9-04f0-42d1-9487-6061551cd1c2 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 24 12:23:51.139573 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 27/55] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 24 12:23:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:23:51.661049 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-c3532529-f159-4a23-94a3-20ca5a7f5f87 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:23:51.721736 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-c3532529-f159-4a23-94a3-20ca5a7f5f87 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.440603 Aug 24 12:23:51.722216 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 29/56] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Aug 24 12:23:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:23:52.756825 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-64af6ef9-04f0-42d1-9487-6061551cd1c2 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:52.761873 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-64af6ef9-04f0-42d1-9487-6061551cd1c2 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005452 Aug 24 12:23:52.762262 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 28/57] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 24 12:23:52 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:23:53.276727 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-da2a5c53-26b3-4005-8442-d21629693ea2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:23:53.350204 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-da2a5c53-26b3-4005-8442-d21629693ea2 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.449878 Aug 24 12:23:53.350790 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 30/58] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Aug 24 12:23:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:23:54.434940 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-64af6ef9-04f0-42d1-9487-6061551cd1c2 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:54.435941 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-64af6ef9-04f0-42d1-9487-6061551cd1c2 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 24 12:23:54.436325 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 29/59] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 24 12:23:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:23:54.946751 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-cf1ce5cb-120c-469f-8a0e-70a313687fb7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:23:55.030301 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-cf1ce5cb-120c-469f-8a0e-70a313687fb7 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.455788 Aug 24 12:23:55.030882 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 31/60] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Aug 24 12:23:54 2022] POST /compute/v2.1/flavors => generated 409 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:23:55.988422 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-64af6ef9-04f0-42d1-9487-6061551cd1c2 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:55.989451 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-64af6ef9-04f0-42d1-9487-6061551cd1c2 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Aug 24 12:23:55.990107 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 30/61] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 24 12:23:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:23:56.509317 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-80740d9f-eca2-4c83-89d3-16db9e6893e7 admin admin] Calling method '>' {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:23:56.529791 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-80740d9f-eca2-4c83-89d3-16db9e6893e7 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.401560 Aug 24 12:23:56.530326 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 32/62] 10.222.0.45 () {60 vars in 1202 bytes} [Wed Aug 24 12:23:56 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:24:49.459269 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-64af6ef9-04f0-42d1-9487-6061551cd1c2 admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:24:49.460326 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-64af6ef9-04f0-42d1-9487-6061551cd1c2 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Aug 24 12:24:49.460765 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 31/63] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 24 12:24:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:24:49.471524 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG dbcounter [-] [105917] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:24:49.845115 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-3674bfa0-200c-4a68-9c42-01811d3650aa admin admin] Calling method '>' {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:24:49.865760 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-3674bfa0-200c-4a68-9c42-01811d3650aa admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.398988 Aug 24 12:24:49.866286 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 33/64] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Aug 24 12:24:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:24:49.887749 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG dbcounter [-] [105916] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105916) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:24:49.892008 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-6503c27b-8e46-48af-94ae-531a8e2b4f1f admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:24:49.899951 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-6503c27b-8e46-48af-94ae-531a8e2b4f1f admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013359 Aug 24 12:24:49.903703 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 32/65] 10.222.0.45 () {60 vars in 1283 bytes} [Wed Aug 24 12:24:49 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:24:49.911684 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-dd718a54-6f43-421c-bf89-1af38a012f33 admin admin] Calling method '>' {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:24:49.919125 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-dd718a54-6f43-421c-bf89-1af38a012f33 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010991 Aug 24 12:24:49.919629 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 34/66] 10.222.0.45 () {60 vars in 1286 bytes} [Wed Aug 24 12:24:49 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:24:49.930610 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-a4451531-aa7b-45b2-88ec-0122e0890fdd admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:24:49.938292 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-a4451531-aa7b-45b2-88ec-0122e0890fdd admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011030 Aug 24 12:24:49.938820 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 33/67] 10.222.0.45 () {60 vars in 1286 bytes} [Wed Aug 24 12:24:49 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:24:49.950381 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-7182a530-3abe-47e1-8fe0-a529d294a959 admin admin] Calling method '>' {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:24:49.957809 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-7182a530-3abe-47e1-8fe0-a529d294a959 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010871 Aug 24 12:24:49.958950 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 35/68] 10.222.0.45 () {60 vars in 1283 bytes} [Wed Aug 24 12:24:49 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:27:55.084799 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-a4451531-aa7b-45b2-88ec-0122e0890fdd admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:27:55.085834 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-a4451531-aa7b-45b2-88ec-0122e0890fdd admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001984 Aug 24 12:27:55.086256 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 34/69] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 24 12:27:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:27:55.227399 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG dbcounter [-] [105917] Writing DB stats nova_api:SELECT=6 {{(pid=105917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:27:55.382305 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-053f5fb7-64ad-4825-999b-3ae66c0ccdd7 admin admin] Calling method '>' {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:27:55.384654 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 12:27:55.384654 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: warnings.warn(msg) Aug 24 12:27:55.385787 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-053f5fb7-64ad-4825-999b-3ae66c0ccdd7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:27:55.386251 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-053f5fb7-64ad-4825-999b-3ae66c0ccdd7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:27:55.386684 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-053f5fb7-64ad-4825-999b-3ae66c0ccdd7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:27:55.387389 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-053f5fb7-64ad-4825-999b-3ae66c0ccdd7 admin admin] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:27:55.387825 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-053f5fb7-64ad-4825-999b-3ae66c0ccdd7 admin admin] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:27:55.388241 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-053f5fb7-64ad-4825-999b-3ae66c0ccdd7 admin admin] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:27:55.421885 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-053f5fb7-64ad-4825-999b-3ae66c0ccdd7 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.196566 Aug 24 12:27:55.422452 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 36/70] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 24 12:27:55 2022] GET /compute/v2.1/os-services => generated 791 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:27:56.244770 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-a4451531-aa7b-45b2-88ec-0122e0890fdd admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:27:56.245761 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-a4451531-aa7b-45b2-88ec-0122e0890fdd admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Aug 24 12:27:56.246153 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 35/71] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 24 12:27:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:27:56.435833 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-75b3051e-52a6-4a0b-8092-3df137006238 admin admin] Calling method '>' {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:27:56.438167 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 12:27:56.438167 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: warnings.warn(msg) Aug 24 12:27:56.439288 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-75b3051e-52a6-4a0b-8092-3df137006238 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:27:56.439763 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-75b3051e-52a6-4a0b-8092-3df137006238 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:27:56.440215 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-75b3051e-52a6-4a0b-8092-3df137006238 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:27:56.440950 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-75b3051e-52a6-4a0b-8092-3df137006238 admin admin] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:27:56.441386 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-75b3051e-52a6-4a0b-8092-3df137006238 admin admin] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:27:56.441797 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-75b3051e-52a6-4a0b-8092-3df137006238 admin admin] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:27:56.461292 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-75b3051e-52a6-4a0b-8092-3df137006238 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076613 Aug 24 12:27:56.461825 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 37/72] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 24 12:27:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:28:07.697400 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-a4451531-aa7b-45b2-88ec-0122e0890fdd admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:28:07.698429 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-a4451531-aa7b-45b2-88ec-0122e0890fdd admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 24 12:28:07.698859 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 36/73] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 24 12:28:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:28:07.843425 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG dbcounter [-] [105917] Writing DB stats nova_cell0:SELECT=4 {{(pid=105917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:28:07.844149 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG dbcounter [-] [105917] Writing DB stats nova_cell1:SELECT=4 {{(pid=105917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:28:07.844761 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG dbcounter [-] [105917] Writing DB stats nova_api:SELECT=8 {{(pid=105917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:28:07.894325 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-b825b343-b8ac-4766-9760-04d814c52044 admin admin] Calling method '>' {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:28:07.894325 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 12:28:07.894325 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: warnings.warn(msg) Aug 24 12:28:07.895556 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-b825b343-b8ac-4766-9760-04d814c52044 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:28:07.896021 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-b825b343-b8ac-4766-9760-04d814c52044 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:28:07.896443 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-b825b343-b8ac-4766-9760-04d814c52044 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:28:07.897141 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-b825b343-b8ac-4766-9760-04d814c52044 admin admin] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:28:07.897577 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-b825b343-b8ac-4766-9760-04d814c52044 admin admin] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:28:07.897982 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-b825b343-b8ac-4766-9760-04d814c52044 admin admin] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:28:07.923746 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-b825b343-b8ac-4766-9760-04d814c52044 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084719 Aug 24 12:28:07.924226 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 38/74] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 24 12:28:07 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:28:08.747680 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: DEBUG nova.api.openstack.wsgi [None req-a4451531-aa7b-45b2-88ec-0122e0890fdd admin admin] Calling method '>' {{(pid=105916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:28:08.748673 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: INFO nova.api.openstack.requestlog [None req-a4451531-aa7b-45b2-88ec-0122e0890fdd admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 Aug 24 12:28:08.749063 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: [pid: 105916|app: 0|req: 37/75] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 24 12:28:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:28:08.940270 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG nova.api.openstack.wsgi [None req-9f082563-1c1e-4b71-b15b-bd5f2342cf41 admin admin] Calling method '>' {{(pid=105917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:28:08.942643 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 12:28:08.942643 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: warnings.warn(msg) Aug 24 12:28:08.943775 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-9f082563-1c1e-4b71-b15b-bd5f2342cf41 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:28:08.944233 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-9f082563-1c1e-4b71-b15b-bd5f2342cf41 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:28:08.944686 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-9f082563-1c1e-4b71-b15b-bd5f2342cf41 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:28:08.945396 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-9f082563-1c1e-4b71-b15b-bd5f2342cf41 admin admin] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:28:08.945841 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-9f082563-1c1e-4b71-b15b-bd5f2342cf41 admin admin] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:28:08.946258 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: DEBUG oslo_concurrency.lockutils [None req-9f082563-1c1e-4b71-b15b-bd5f2342cf41 admin admin] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:28:08.967621 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: INFO nova.api.openstack.requestlog [None req-9f082563-1c1e-4b71-b15b-bd5f2342cf41 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078957 Aug 24 12:28:08.968107 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: [pid: 105917|app: 0|req: 39/76] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 24 12:28:08 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:29:06.365121 dv-cinder-848899-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 12:29:06.366050 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: Wed Aug 24 12:29:06 2022 - graceful shutdown triggered... Aug 24 12:29:06.366563 dv-cinder-848899-3-iscsi devstack@n-api.service[105916]: Gracefully killing worker 1 (pid: 105916)... Aug 24 12:29:06.366958 dv-cinder-848899-3-iscsi devstack@n-api.service[105917]: Gracefully killing worker 2 (pid: 105917)... Aug 24 12:29:07.366915 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: worker 1 buried after 1 seconds Aug 24 12:29:07.366915 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: worker 2 buried after 1 seconds Aug 24 12:29:07.367586 dv-cinder-848899-3-iscsi devstack@n-api.service[105915]: goodbye to uWSGI. Aug 24 12:29:07.368467 dv-cinder-848899-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 12:29:07.369013 dv-cinder-848899-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 12:29:07.371884 dv-cinder-848899-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 12:29:07.381204 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 12:29:07.383247 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 12:29:07 2022] *** Aug 24 12:29:07.383247 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 12:29:07.383247 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 12:29:07.383247 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: nodename: dv-cinder-848899-3-iscsi Aug 24 12:29:07.383247 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: machine: x86_64 Aug 24 12:29:07.383247 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: clock source: unix Aug 24 12:29:07.383247 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: pcre jit disabled Aug 24 12:29:07.383247 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: detected number of CPU cores: 4 Aug 24 12:29:07.383247 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: current working directory: / Aug 24 12:29:07.383247 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: detected binary path: /usr/bin/uwsgi-core Aug 24 12:29:07.383247 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: your processes number limit is 47680 Aug 24 12:29:07.384096 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: your memory page size is 4096 bytes Aug 24 12:29:07.384096 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: detected max file descriptor number: 2048 Aug 24 12:29:07.384096 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: lock engine: pthread robust mutexes Aug 24 12:29:07.384096 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: thunder lock: enabled Aug 24 12:29:07.384096 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 12:29:07.384096 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 12:29:07.423125 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: Python main interpreter initialized at 0x5629c693b9c0 Aug 24 12:29:07.423125 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: python threads support enabled Aug 24 12:29:07.423125 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: your server socket listen backlog is limited to 100 connections Aug 24 12:29:07.423125 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: your mercy for graceful operations on workers is 90 seconds Aug 24 12:29:07.423566 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 12:29:07.423566 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: *** Operational MODE: preforking *** Aug 24 12:29:07.423843 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: *** uWSGI is running in multiple interpreter mode *** Aug 24 12:29:07.423843 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: spawned uWSGI master process (pid: 121156) Aug 24 12:29:07.426815 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: spawned uWSGI worker 1 (pid: 121170, cores: 1) Aug 24 12:29:07.426815 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: spawned uWSGI worker 2 (pid: 121171, cores: 1) Aug 24 12:29:07.426815 dv-cinder-848899-3-iscsi devstack@n-api.service[121156]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 12:29:07.424065 dv-cinder-848899-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 12:29:08.081773 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 12:29:08.087261 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 12:29:09.234829 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:29:09.234829 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: from cryptography.utils import int_from_bytes Aug 24 12:29:09.235494 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:29:09.235494 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: from cryptography.utils import int_from_bytes Aug 24 12:29:09.235923 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:29:09.235923 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: from cryptography.utils import int_from_bytes Aug 24 12:29:09.236078 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:29:09.236078 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: from cryptography.utils import int_from_bytes Aug 24 12:29:11.669927 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 12:29:11.670499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 12:29:11.670956 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 12:29:11.671082 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 12:29:11.671262 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 12:29:11.671699 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.671994 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.672320 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.672811 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.673301 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.673618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.673944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.674218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 12:29:11.674601 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.674717 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 12:29:11.674793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.674870 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.675184 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 12:29:11.675301 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.675447 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 12:29:11.675550 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848899-3-iscsi {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.675713 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 12:29:11.675812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.676047 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.676180 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.676378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.676485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.676710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.676817 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.677011 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.677124 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.677867 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.677999 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.678090 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.678171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.678171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.680471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.680573 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.680654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.680733 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.680811 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.680898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.680972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.681345 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.681613 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.681837 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848899-3-iscsi {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.682064 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.682296 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.682555 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.682807 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.683013 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.683261 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.683624 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.683870 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.684131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.684344 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.684568 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.687421 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.687714 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848899-3-iscsi {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.687977 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.688188 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.688406 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.688618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.688806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.689024 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.689184 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.689184 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.689559 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.689559 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.689860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.690004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.690175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.690320 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.690469 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.690469 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.690796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.690796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.691173 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.691328 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.691909 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.692076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.692192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.692309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.692430 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848899-3-iscsi {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.692547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.692668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.692779 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.693208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.693337 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.693459 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.698424 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.698589 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.698811 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.698961 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.699110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.699266 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.699432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.699432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.699730 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.699882 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.700024 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.700166 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.700324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.700478 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.700630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.700630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.700918 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.700918 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.701292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.701448 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.701594 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.701746 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.701889 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.702039 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.702191 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.702351 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.702504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.702674 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.702836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.703031 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.703179 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.703337 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.703487 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.703637 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.704124 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.704308 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.704453 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.704602 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.704932 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.705154 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.705322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.705703 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.705866 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.706022 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.706199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.706199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.706491 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.706643 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.706810 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.706963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.707118 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.707274 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.707416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.707566 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.707764 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.707919 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.708647 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.708771 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.708861 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.708936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.709017 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.709095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.709176 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.709260 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.709338 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.709410 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.709479 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.709558 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.709638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.709717 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.709855 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.709949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.709949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.710091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.710177 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.710254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.710254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.710403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.710403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.710544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.710544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.710725 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.710801 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.710877 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.710955 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.711025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.711103 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.711174 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.711250 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.711335 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.711411 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.711490 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.711567 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.711643 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.711720 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.711797 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.711873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.711957 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.712027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.712106 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.712183 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.712253 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.712328 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.712409 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.712479 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.712547 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.712614 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.712682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.712757 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.712843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.712914 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.712982 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.713050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.713117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.713191 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.713274 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.713351 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.713430 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.713500 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.713568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.713649 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.713745 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.713824 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.713901 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.713984 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.714054 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.714054 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.714191 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.714270 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.714347 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.714417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.714485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.714552 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.714552 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.715658 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.715891 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.716047 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.716193 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.716346 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.716495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.716648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.716804 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.716954 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.717107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.717250 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.717398 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.717549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.717726 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.717878 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.717878 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.718170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.718170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.718458 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.718615 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.718797 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.718797 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.719097 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.719238 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.719380 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.719520 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.719669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.719853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.719999 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.720140 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.720296 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.720543 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.720711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.720867 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.721017 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.721157 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.721304 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.721454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.721596 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.721749 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.721898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.721898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.722181 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.722323 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.722487 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.722630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.722805 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.722956 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.723105 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.723261 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.723413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.723572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.723729 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.723905 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.724059 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.724217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.724371 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.724538 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.724697 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.724851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.725000 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.725150 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.725304 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.725979 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.726131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.726273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.726273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.726547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.726721 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:29:11.726869 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.727027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.727168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.727168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.727444 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.727592 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.727742 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.727890 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.728080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.728221 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.728374 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.728519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.728673 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.728837 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.729010 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.729169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.729318 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.729610 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.729785 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.729943 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.730166 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.730334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.730486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.730908 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.731075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.731303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.731469 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.731621 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.731772 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.731923 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.732084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.732232 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.732382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.732527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.732649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.732760 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.732870 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.732988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.733098 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.733208 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.733365 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.733482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.733593 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.733711 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.733822 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.733932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.734052 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.734163 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.738507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.738731 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.739456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.739700 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.740196 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.740365 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.740513 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.740656 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.740808 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.740967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.741660 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.742477 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.742641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.742816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.742961 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.743122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.743290 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.743434 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.743610 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.743756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.743897 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.744053 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.744195 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.744335 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.744485 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.744626 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.744776 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.744931 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.745080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.745239 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.745381 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.745530 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.745681 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.745822 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.746005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.746158 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.746352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.746517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.747002 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.747161 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.747312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.747471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.747614 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.747797 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.747954 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.748103 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.748245 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.748393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.748535 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.748754 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.748904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.749053 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.749194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.749345 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.749505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.749661 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.749805 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.749946 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.750129 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.750274 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.750424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.750580 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.750759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.750903 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.751055 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.751207 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.751349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.751513 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.751662 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.751856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.752012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.752154 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.752315 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.752457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.752457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.752724 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.752864 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.753005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.753156 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.753297 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.753297 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.753584 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.753725 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.753876 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.754028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.754201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.754354 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.754504 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.754698 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.754847 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.755006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.755148 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.755303 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.755444 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.756056 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.756223 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.756412 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.756557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.756736 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.757179 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.757331 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.757488 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.757631 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.757788 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.757930 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.758089 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.758233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.758384 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.758534 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.758695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.758842 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.758984 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.759125 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.759284 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.759433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.759574 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.759723 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.759872 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.760033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.760182 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.760333 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.760482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.760623 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.760764 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.760915 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.761067 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.761209 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.761351 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.761492 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.761640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.761800 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.761953 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.762102 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.762284 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.762431 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.762587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.762801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.762944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.763085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.763225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.763364 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.763487 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.763599 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.763708 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.763843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.763989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.764105 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.764231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.764352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.764464 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.764574 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.764692 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.765368 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.765502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.765615 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.765735 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.765846 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.765966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.766077 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.766194 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.766304 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.766473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.766598 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.766730 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.766845 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.770622 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.770813 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.770995 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.771170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.771324 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.771480 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.771636 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.771793 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.771957 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.772155 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.772420 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.772589 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.772827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.772984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.773188 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.773362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.773519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.773677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.773835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.773992 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.774168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.774326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.774475 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.774630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.774816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.774976 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.775126 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.775281 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.775440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.775588 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.775743 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.775905 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.776055 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.776203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.776349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.776549 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.776711 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.776908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.777070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.777481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.777640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.777800 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.777994 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.778171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.778411 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.778594 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.778794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.778945 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.779144 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.779302 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.779457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.779612 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.779778 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.779934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.780141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.780405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.780678 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.780833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.780989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.781137 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.781296 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.781444 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.781599 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.781763 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.781919 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.782067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.782342 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.782504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.782744 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.782909 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.783074 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.783245 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.783395 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.783550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.783697 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.783844 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.783999 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.784167 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.784373 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.784537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.784685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.784780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.784908 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.785069 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.785233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.785390 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.785538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.785693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.785841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.786003 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.786105 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.786245 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.786386 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.786630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.786869 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.787010 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.787107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.787198 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.787463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.787598 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.787741 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.787830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.788489 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.788577 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.788668 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.788751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.788844 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.788936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.789027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.789119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.789203 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.789292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.789391 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.789482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.789581 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.789667 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.789756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.789854 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.789946 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.790030 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.790113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.790206 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.790290 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.790501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.790596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.790714 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.790809 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.790894 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.790976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.791068 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.791160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.791251 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.791344 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.791436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.791529 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.791623 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.791708 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.791791 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.791881 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.791965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.792056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.792147 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.792230 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.792313 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.792395 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.792609 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.792713 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.792857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.792945 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.793036 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.793131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.793213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.793297 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.793376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.793447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.793516 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.793617 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.793711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.793805 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.793890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.793890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.794040 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.794124 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.794351 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.794533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.794631 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.794782 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.794887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.794973 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.795071 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.795156 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.795245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.795335 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.795425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.795515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.795612 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.795696 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.795785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.795877 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.795969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.796060 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.796143 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.796233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.796316 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.796416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.796500 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.796624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.796785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.796785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.797004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.797105 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.797190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.797271 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.797360 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.797574 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.797710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.797837 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.797938 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.798031 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.798129 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.798213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.798296 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.798296 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.798453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.798543 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.798730 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.798819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.798902 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.805061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.805253 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.805253 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.805253 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.805512 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.805662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.805758 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.805843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.805935 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.806034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.806118 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.806118 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.806312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.806403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.806497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.806582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.806695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.806828 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.806913 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.807053 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.807155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.807248 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.807332 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.807414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.807503 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.807718 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.807841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.807941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.808026 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.808109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.808191 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.808283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.808410 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.808504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.808587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.808670 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.808751 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.808843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.808936 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.809020 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.809110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.809193 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.809290 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.809449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.809536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.809618 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.809701 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.809786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.809908 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.810057 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.810184 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.810274 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.810366 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.810557 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.810698 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.810790 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.810862 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.810930 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.811168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.811328 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.811494 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.811647 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.811824 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.811982 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.812138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.812295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.812461 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.812655 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.812935 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.813091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.813255 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.813419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.813570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.813720 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.813867 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.814036 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.814211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.814395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.814554 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.814713 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.814814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.814899 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.814981 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.815079 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.815170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.815253 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.815336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.815419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.815509 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.815674 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.815759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.815831 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.815900 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.815900 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.816038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.816110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.816190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.816272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.816361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.816468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.816561 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.816633 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.816711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.816802 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.816938 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.817011 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.817090 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.817168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.817307 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.817401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.817499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.817499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.817856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.817978 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.818079 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.818166 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.818256 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.818354 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.818447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.818531 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.818613 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.818775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.818864 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.818958 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.819048 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.819153 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.819247 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.819340 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.819425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.819518 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.819609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.819700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.819788 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.819871 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.819991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.820100 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.820192 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.820276 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.820366 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.820451 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.820543 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.820630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.820702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.820771 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.820888 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.820966 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.821100 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.821209 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.821294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.821377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.821377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.821527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.821620 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.821620 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.821620 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.821826 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.821905 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.821982 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.822062 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.822134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.822203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.822271 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.822347 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.822424 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.822503 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.822580 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.822801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.822892 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.828153 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.828303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.828400 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.828493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.828578 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.828661 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.828754 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.828848 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.828848 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.828848 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.828848 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.828848 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.829246 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.829340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.829340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.829340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.829623 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.829721 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.829806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.829897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.829982 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.830073 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.830158 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.830240 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.830324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.830407 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.830488 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.830569 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.830681 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.830782 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.830869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.830953 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.831035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.831124 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.831197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.831273 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.831353 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.831436 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.831520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.831611 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.831705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.831789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.831881 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.831971 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.832062 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.832145 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.832228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.832323 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.832413 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.832496 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.832585 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.832668 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.832759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.833546 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.833648 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.833743 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.833838 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.833930 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.834021 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.834118 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.834211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.834303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.834395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.834485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.834626 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.834816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.834909 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.834993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.835076 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.835166 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.835265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.835384 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.835472 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.835563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.835648 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.835737 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.835840 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.835925 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.836009 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.836098 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.836182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.836273 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.836370 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.836462 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.836547 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.836637 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.836721 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.836810 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.836907 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.837047 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.837141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.837223 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.837306 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.837398 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.837490 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.837581 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.837665 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.837744 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.837822 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.838005 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.838228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.838362 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.838451 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.838542 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.838626 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.838846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.838935 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.839017 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.839100 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.839190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.839280 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.839373 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.839457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.839457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.839603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.839692 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.839788 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.839872 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.839962 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.840051 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.840160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.840289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.840390 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.840523 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.840619 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.840704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.840795 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.840795 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.840977 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.841103 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.841215 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.841295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.841374 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.841458 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.841554 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.841639 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.841722 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.841803 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.841899 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.842049 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.842160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.842251 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.842343 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.842426 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.842523 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.842607 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.842704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.842800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.842885 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.842990 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.843084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.843167 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.843250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.843327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.843397 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.843475 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.843566 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.843649 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.843731 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.843819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.843910 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.844005 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.844097 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.844181 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.844263 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.844335 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.844405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.844484 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.844559 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.844638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.844708 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.844778 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.844778 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.844923 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.845001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.845071 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.845139 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.845206 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.845283 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.845360 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.845430 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.845507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.845592 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.845664 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.845758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.845831 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.845912 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.846002 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.846002 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.846159 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.846251 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.846342 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.846432 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.846515 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.846603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.846822 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.846925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.847017 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.847156 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.847248 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.847332 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.847428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.847519 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.847609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.847694 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.847776 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.847859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.847950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.848050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.848135 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.848356 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.848458 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.848550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.848643 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.848724 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.848814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.848905 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.848988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.849192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.849294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.849508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.849637 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.849820 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.849962 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.850130 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.850272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.851022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.851174 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.851388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.851538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.851703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.851854 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.852033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.852173 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.852368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.852511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.852675 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.852816 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.852979 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.853150 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.853290 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.853498 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.853629 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.853759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.853886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.854014 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.854192 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.854335 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.854504 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.854639 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.854836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.854969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.855144 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.855291 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.855450 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.855594 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.855811 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.855953 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.856126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.856268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.856437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.856577 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.856750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.856894 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.857058 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.857236 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.857374 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.857503 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.857660 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.857794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.857989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.858129 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.858429 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.858570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.858718 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.858879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.859046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.859178 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.859306 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.859441 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.859560 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.859687 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.859872 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.860006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.860187 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.860318 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.860509 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.860655 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.860845 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.861068 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.861201 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.861404 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.861616 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.861763 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.861903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.862033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.862169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.862305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.862435 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.862627 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.862796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.862967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.863101 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.863280 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.863414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.863592 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.863719 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.863904 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.864046 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.864215 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.864358 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.864544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.864677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.865123 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.865255 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.865447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.865683 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.865809 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.866065 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.866734 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.866913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.867055 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.867285 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.867426 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.867565 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.867695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.867854 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.867996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.868176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.868310 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.868581 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.868728 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.868860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.869003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.869142 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.869273 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.869409 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.869539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.869729 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.869870 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.870048 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.870187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.870362 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.870496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.870706 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.870844 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.871006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.871139 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.871322 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.871446 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.871641 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.871763 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.871940 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.872061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.872264 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.872382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.872598 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.872700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.872911 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.873011 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.873221 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.873334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.873532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.873659 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.873851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.873944 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.874165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.874363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.874480 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.874696 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.874901 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.875036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.875219 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.875354 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.875536 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.875680 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.875853 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.876025 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.876166 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.876296 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.876462 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.876598 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.876794 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.876927 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.877132 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.877266 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.877453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.877584 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.877744 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.877892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.878048 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.878181 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.878369 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.878502 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.878837 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.878983 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.879114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.879243 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.879378 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.879541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.879678 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.879872 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.880193 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.880328 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.880511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.880650 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.880839 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.881001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.881162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.881292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.881471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.881627 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.881845 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.881979 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.882117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.882261 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.882412 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.882545 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.882745 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.882889 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.883052 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.883183 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.883371 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.883506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.883713 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.883852 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.884004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.884133 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.884269 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.884407 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.884570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.884878 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.885019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.885183 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.885309 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.885491 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.885624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.885796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.885928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.886124 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.886255 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.886430 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.886563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.886774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.886916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.887081 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.887208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.887397 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.887518 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.887701 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.887814 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.888008 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.888121 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.888312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.888421 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.888617 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.888783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.888985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.889133 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.889272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.889409 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.889539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.889668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.889796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.889934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.890104 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.890238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.890411 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.890552 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.890745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.890890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.891053 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.891187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.891376 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.891508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.891679 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.891836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.892032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.892171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.892309 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.892440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.892583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.892714 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.892876 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.893009 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.893184 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.893318 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.893502 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.893642 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.893812 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.893952 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.894127 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.894259 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.894437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.894715 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.894852 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.895059 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.895193 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.895377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.895518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.895689 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.895821 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.896017 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.896149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.896325 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.896459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.896640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.896810 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.896958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.897163 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.897330 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.897566 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.897752 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.897894 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.898031 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.898169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.898311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.898450 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.898588 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.898749 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.898877 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.899019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.899225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.899423 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.899557 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.899736 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.899869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.900050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.900192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.900361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.900494 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.900675 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.900809 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.900986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.901120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.901298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.901431 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.901608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.901740 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.901923 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.902070 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.902273 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.902421 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.902573 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.902753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.902918 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.903051 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.903237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.903376 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.903550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.903692 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.903859 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.904007 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.904170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.904309 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.904471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.904616 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.904776 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.904910 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.905088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.905219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.905404 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.905530 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.905717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.905858 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.906022 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.906163 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.906333 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.906472 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.906671 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.906890 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.907026 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.907211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.907359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.907533 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.907705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.907834 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.907971 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.908152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.908292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.908475 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.908617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.908788 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.908928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.909109 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.909262 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.909465 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.909599 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.909728 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.909857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.910060 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.910196 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.910377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.910516 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.910704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.910856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.911027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.911158 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.911333 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.911473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.911637 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.911783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.911947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.912079 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.912272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.912404 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.912585 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.912772 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.913445 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.913599 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.913841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.913980 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.914168 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.914311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.914485 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.914626 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.914813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.914954 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.915122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.915255 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.915427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.915560 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.915738 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.915878 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.916045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.916177 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.916354 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.916480 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.916658 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.916790 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.916961 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.917093 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.917265 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.917404 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.917568 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.917746 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.917888 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.918026 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.918156 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.918285 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.918458 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.918607 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.918783 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.918916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.919087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.919232 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.919392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.919608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.919744 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.919881 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.920062 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.920200 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.920331 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.920469 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.920607 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.920745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.920885 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.921021 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.921177 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.921315 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.921453 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.921589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.921752 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.921892 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.922062 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.922196 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.922369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.922504 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.922694 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.922830 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.922989 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.923167 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.923309 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.923480 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.923612 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.923795 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.923944 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.924107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.924240 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.924419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.924545 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.924730 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.924872 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.925041 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.925182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.925366 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.925506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.925692 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.925825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.925998 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.926132 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.926327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.926461 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.926685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.926833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.926986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.927119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.927303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.927436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.927666 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.927847 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.927980 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.928110 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.928238 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.928376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.928560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.929192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.930025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.930185 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.930327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.930467 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.930467 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.930735 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.930866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.930995 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.931141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.931283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.931421 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.931551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.931679 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.931808 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.931947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.932077 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.932217 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.932347 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.932475 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.932613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.932752 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.932882 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.933019 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.933149 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.933279 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.933409 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.933551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.933690 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.933819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.933961 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.934091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.934236 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.934368 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.934498 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.934706 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.934839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.934981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.935121 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.935280 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.935436 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.935570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 12:29:11.935698 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.935873 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.936202 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.936516 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.936845 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.937173 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.937540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.937843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.938180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.938512 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.938855 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.939174 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.939485 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:29:11.939730 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 12:29:11.997710 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO dbcounter [None req-76c5b5aa-c1d3-430b-afbc-24d2e2f6433d None None] Registered counter for database nova_api Aug 24 12:29:12.002244 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO dbcounter [None req-f9ba93f6-6de9-4430-9bda-fe29ae0e0a37 None None] Registered counter for database nova_api Aug 24 12:29:12.017876 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_db.sqlalchemy.engines [None req-76c5b5aa-c1d3-430b-afbc-24d2e2f6433d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:29:12.022142 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_db.sqlalchemy.engines [None req-f9ba93f6-6de9-4430-9bda-fe29ae0e0a37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:29:12.024661 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writer thread running {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:29:12.028924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writer thread running {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:29:12.080946 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.context [None req-76c5b5aa-c1d3-430b-afbc-24d2e2f6433d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),acc877c2-bd26-41e8-94b1-fba881fedcaf(cell1) {{(pid=121171) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 12:29:12.085519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76c5b5aa-c1d3-430b-afbc-24d2e2f6433d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:29:12.085992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76c5b5aa-c1d3-430b-afbc-24d2e2f6433d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:29:12.086330 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.context [None req-f9ba93f6-6de9-4430-9bda-fe29ae0e0a37 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),acc877c2-bd26-41e8-94b1-fba881fedcaf(cell1) {{(pid=121170) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 12:29:12.087581 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76c5b5aa-c1d3-430b-afbc-24d2e2f6433d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:29:12.088335 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76c5b5aa-c1d3-430b-afbc-24d2e2f6433d None None] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:29:12.088783 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76c5b5aa-c1d3-430b-afbc-24d2e2f6433d None None] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:29:12.090366 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9ba93f6-6de9-4430-9bda-fe29ae0e0a37 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:29:12.090783 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76c5b5aa-c1d3-430b-afbc-24d2e2f6433d None None] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:29:12.090887 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9ba93f6-6de9-4430-9bda-fe29ae0e0a37 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:29:12.092405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9ba93f6-6de9-4430-9bda-fe29ae0e0a37 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:29:12.092758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO dbcounter [None req-76c5b5aa-c1d3-430b-afbc-24d2e2f6433d None None] Registered counter for database nova_cell0 Aug 24 12:29:12.093146 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9ba93f6-6de9-4430-9bda-fe29ae0e0a37 None None] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:29:12.093592 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9ba93f6-6de9-4430-9bda-fe29ae0e0a37 None None] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:29:12.095644 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9ba93f6-6de9-4430-9bda-fe29ae0e0a37 None None] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:29:12.096791 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO dbcounter [None req-76c5b5aa-c1d3-430b-afbc-24d2e2f6433d None None] Registered counter for database nova_cell1 Aug 24 12:29:12.097619 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO dbcounter [None req-f9ba93f6-6de9-4430-9bda-fe29ae0e0a37 None None] Registered counter for database nova_cell0 Aug 24 12:29:12.102340 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO dbcounter [None req-f9ba93f6-6de9-4430-9bda-fe29ae0e0a37 None None] Registered counter for database nova_cell1 Aug 24 12:29:12.105857 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_db.sqlalchemy.engines [None req-76c5b5aa-c1d3-430b-afbc-24d2e2f6433d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:29:12.106992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_db.sqlalchemy.engines [None req-76c5b5aa-c1d3-430b-afbc-24d2e2f6433d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:29:12.110223 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_db.sqlalchemy.engines [None req-f9ba93f6-6de9-4430-9bda-fe29ae0e0a37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:29:12.112537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_db.sqlalchemy.engines [None req-f9ba93f6-6de9-4430-9bda-fe29ae0e0a37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:29:12.112660 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writer thread running {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:29:12.115521 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writer thread running {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:29:12.120597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writer thread running {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:29:12.121904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writer thread running {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:29:12.261305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO dbcounter [None req-76c5b5aa-c1d3-430b-afbc-24d2e2f6433d None None] Registered counter for database nova_cell0 Aug 24 12:29:12.268088 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_db.sqlalchemy.engines [None req-76c5b5aa-c1d3-430b-afbc-24d2e2f6433d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:29:12.268305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO dbcounter [None req-f9ba93f6-6de9-4430-9bda-fe29ae0e0a37 None None] Registered counter for database nova_cell0 Aug 24 12:29:12.273145 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writer thread running {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:29:12.275947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_db.sqlalchemy.engines [None req-f9ba93f6-6de9-4430-9bda-fe29ae0e0a37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:29:12.280552 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writer thread running {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:29:12.591911 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: WARNING keystonemiddleware.auth_token [None req-76c5b5aa-c1d3-430b-afbc-24d2e2f6433d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 12:29:12.599173 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: WARNING keystonemiddleware.auth_token [None req-76c5b5aa-c1d3-430b-afbc-24d2e2f6433d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 12:29:12.602915 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: WARNING keystonemiddleware.auth_token [None req-f9ba93f6-6de9-4430-9bda-fe29ae0e0a37 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 12:29:12.610596 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: WARNING keystonemiddleware.auth_token [None req-f9ba93f6-6de9-4430-9bda-fe29ae0e0a37 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 12:29:12.941792 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: WARNING keystonemiddleware.auth_token [None req-76c5b5aa-c1d3-430b-afbc-24d2e2f6433d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 12:29:12.948478 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: WARNING keystonemiddleware.auth_token [None req-76c5b5aa-c1d3-430b-afbc-24d2e2f6433d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 12:29:12.953802 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5629c693b9c0 pid: 121171 (default app) Aug 24 12:29:12.956883 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: WARNING keystonemiddleware.auth_token [None req-f9ba93f6-6de9-4430-9bda-fe29ae0e0a37 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 12:29:12.963387 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: WARNING keystonemiddleware.auth_token [None req-f9ba93f6-6de9-4430-9bda-fe29ae0e0a37 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 12:29:12.968701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5629c693b9c0 pid: 121170 (default app) Aug 24 12:29:48.720113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=3 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:29:48.721311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=3 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:29:48.722356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=3 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:29:48.723273 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=3 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:29:50.406866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7a8a3c51-3036-4d36-ab9c-700c6eac0b1d tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] Action: 'create', calling method: .version_select at 0x7f76f74285e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-82270494", "metadata": {"Type": "work"}}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:29:50.413886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7a8a3c51-3036-4d36-ab9c-700c6eac0b1d tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] Request method failure captured: Aug 24 12:29:50.413886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 12:29:50.413886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept: application/json Aug 24 12:29:50.413886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept-Encoding: identity Aug 24 12:29:50.413886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Connection: close Aug 24 12:29:50.413886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Length: 120 Aug 24 12:29:50.413886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Type: application/json Aug 24 12:29:50.413886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Host: 10.222.0.45 Aug 24 12:29:50.413886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Openstack-System-Scope: None Aug 24 12:29:50.413886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: User-Agent: python-urllib3/1.26.11 Aug 24 12:29:50.413886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Auth-Token: gAAAAABjBhm8OrSNLELm7BXms7XHmgEDbGVeldWm11jm5_vJLboASgE9AEoQwo7F0f7I_l7taaEFGSs3h3Sdx6WhmejTHQlZEfIWBPP6EH7svW9WZMN9ynQAEf5vqeIl6W53NcZ2ca5XEfghSaBayHiWzBfWrbZwCUTjPHDfyb12Sll85kQxepg Aug 24 12:29:50.413886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Id: None Aug 24 12:29:50.413886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Name: None Aug 24 12:29:50.413886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Identity-Status: Confirmed Aug 24 12:29:50.413886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Is-Admin-Project: True Aug 24 12:29:50.413886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Id: default Aug 24 12:29:50.413886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Name: Default Aug 24 12:29:50.413886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Id: 94e584086ede4dcfb7fa3002b1091b8e Aug 24 12:29:50.413886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Name: tempest-VolumesNegativeTest-484624126 Aug 24 12:29:50.413886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Role: member,reader Aug 24 12:29:50.413886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Roles: member,reader Aug 24 12:29:50.415367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_94e584086ede4dcfb7fa3002b1091b8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/94e584086ede4dcfb7fa3002b1091b8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/94e584086ede4dcfb7fa3002b1091b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/94e584086ede4dcfb7fa3002b1091b8e"}]}] Aug 24 12:29:50.415367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant: tempest-VolumesNegativeTest-484624126 Aug 24 12:29:50.415367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Id: 94e584086ede4dcfb7fa3002b1091b8e Aug 24 12:29:50.415367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Name: tempest-VolumesNegativeTest-484624126 Aug 24 12:29:50.415367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User: tempest-VolumesNegativeTest-484624126-project Aug 24 12:29:50.415367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Id: default Aug 24 12:29:50.415367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Name: Default Aug 24 12:29:50.415367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Id: 7750a81cb89346ecb3634daa137d0da3 Aug 24 12:29:50.415367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Name: tempest-VolumesNegativeTest-484624126-project Aug 24 12:29:50.415367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Aug 24 12:29:50.415367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-82270494", "metadata": {"Type": "work"}}} Aug 24 12:29:50.415367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: method: Aug 24 12:29:50.415367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 12:29:50.416213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-82270494', 'metadata': {'Type': 'work'}}}} Aug 24 12:29:50.416213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:29:50.416213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:29:50.416213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 12:29:50.416213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 12:29:50.416213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 12:29:50.416213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise error Aug 24 12:29:50.416213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 12:29:50.416213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:29:50.416213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 12:29:50.416213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 12:29:50.416213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:29:50.416213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 12:29:50.416213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 12:29:50.416213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:29:50.416213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:29:50.416213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:29:50.416213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:29:50.416213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:29:50.416213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:29:50.416213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:29:50.416213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:29:50.417553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:29:50.417553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:29:50.417553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:29:50.417553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:29:50.417553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 12:29:50.417553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 12:29:50.417553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 12:29:50.417553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 12:29:50.417553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 12:29:50.417553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 12:29:50.417553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 12:29:50.417553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:29:50.417553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:29:50.417553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:29:50.417553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:29:50.417553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:29:50.417553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:29:50.417553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 12:29:50.417553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 12:29:50.419949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 12:29:50.419949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:29:50.419949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7a8a3c51-3036-4d36-ab9c-700c6eac0b1d tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:29:50.419949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7a8a3c51-3036-4d36-ab9c-700c6eac0b1d tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.710808 Aug 24 12:29:50.419949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1/1] 10.222.0.45 () {60 vars in 1156 bytes} [Wed Aug 24 12:29:48 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1713 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 12:29:50.430440 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=3 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:29:50.432085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell0:SELECT=3 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:29:50.433457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=3 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:29:50.434187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell0:SELECT=3 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:29:50.650129 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7baabc4d-1a19-44f9-acb8-fe2be86db78a tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] Action: 'create', calling method: .version_select at 0x7f76f7474280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-163741819", "metadata": {"Type": "work"}}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:29:50.657939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7baabc4d-1a19-44f9-acb8-fe2be86db78a tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] Request method failure captured: Aug 24 12:29:50.657939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 12:29:50.657939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept: application/json Aug 24 12:29:50.657939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept-Encoding: identity Aug 24 12:29:50.657939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Connection: close Aug 24 12:29:50.657939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Length: 119 Aug 24 12:29:50.657939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Type: application/json Aug 24 12:29:50.657939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Host: 10.222.0.45 Aug 24 12:29:50.657939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Openstack-System-Scope: None Aug 24 12:29:50.657939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: User-Agent: python-urllib3/1.26.11 Aug 24 12:29:50.657939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Auth-Token: gAAAAABjBhm8OrSNLELm7BXms7XHmgEDbGVeldWm11jm5_vJLboASgE9AEoQwo7F0f7I_l7taaEFGSs3h3Sdx6WhmejTHQlZEfIWBPP6EH7svW9WZMN9ynQAEf5vqeIl6W53NcZ2ca5XEfghSaBayHiWzBfWrbZwCUTjPHDfyb12Sll85kQxepg Aug 24 12:29:50.657939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Id: None Aug 24 12:29:50.657939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Name: None Aug 24 12:29:50.657939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Identity-Status: Confirmed Aug 24 12:29:50.657939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Is-Admin-Project: True Aug 24 12:29:50.657939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Id: default Aug 24 12:29:50.657939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Name: Default Aug 24 12:29:50.657939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Id: 94e584086ede4dcfb7fa3002b1091b8e Aug 24 12:29:50.657939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Name: tempest-VolumesNegativeTest-484624126 Aug 24 12:29:50.657939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Role: member,reader Aug 24 12:29:50.657939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Roles: member,reader Aug 24 12:29:50.660277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_94e584086ede4dcfb7fa3002b1091b8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/94e584086ede4dcfb7fa3002b1091b8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/94e584086ede4dcfb7fa3002b1091b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/94e584086ede4dcfb7fa3002b1091b8e"}]}] Aug 24 12:29:50.660277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant: tempest-VolumesNegativeTest-484624126 Aug 24 12:29:50.660277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Id: 94e584086ede4dcfb7fa3002b1091b8e Aug 24 12:29:50.660277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Name: tempest-VolumesNegativeTest-484624126 Aug 24 12:29:50.660277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User: tempest-VolumesNegativeTest-484624126-project Aug 24 12:29:50.660277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Id: default Aug 24 12:29:50.660277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Name: Default Aug 24 12:29:50.660277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Id: 7750a81cb89346ecb3634daa137d0da3 Aug 24 12:29:50.660277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Name: tempest-VolumesNegativeTest-484624126-project Aug 24 12:29:50.660277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Aug 24 12:29:50.660277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-163741819", "metadata": {"Type": "work"}}} Aug 24 12:29:50.660277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: method: Aug 24 12:29:50.660277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 12:29:50.661075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-163741819', 'metadata': {'Type': 'work'}}}} Aug 24 12:29:50.661075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:29:50.661075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:29:50.661075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 12:29:50.661075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 12:29:50.661075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 12:29:50.661075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise error Aug 24 12:29:50.661075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 12:29:50.661075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:29:50.661075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 12:29:50.661075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 12:29:50.661075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:29:50.661075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 12:29:50.661075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi '0' Aug 24 12:29:50.661075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:29:50.661075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:29:50.661075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:29:50.661075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:29:50.661075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:29:50.661075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:29:50.661075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:29:50.661075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:29:50.662641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:29:50.662641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:29:50.662641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:29:50.662641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:29:50.662641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 12:29:50.662641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 12:29:50.662641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 12:29:50.662641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 12:29:50.662641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 12:29:50.662641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 12:29:50.662641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 12:29:50.662641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:29:50.662641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:29:50.662641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:29:50.662641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:29:50.662641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:29:50.662641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:29:50.662641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 12:29:50.662641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 12:29:50.664361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 12:29:50.664361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:29:50.664361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7baabc4d-1a19-44f9-acb8-fe2be86db78a tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:29:50.664361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7baabc4d-1a19-44f9-acb8-fe2be86db78a tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.235395 Aug 24 12:29:50.664361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1/2] 10.222.0.45 () {60 vars in 1156 bytes} [Wed Aug 24 12:29:50 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 237 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 12:29:50.670040 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-029b3008-4e25-4c87-b567-7355b03b0f42 tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] Action: 'create', calling method: .version_select at 0x7f76f7428670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-366361247", "metadata": {"Type": "work"}}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:29:50.674399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-029b3008-4e25-4c87-b567-7355b03b0f42 tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] Request method failure captured: Aug 24 12:29:50.674399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 12:29:50.674399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept: application/json Aug 24 12:29:50.674399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept-Encoding: identity Aug 24 12:29:50.674399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Connection: close Aug 24 12:29:50.674399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Length: 118 Aug 24 12:29:50.674399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Type: application/json Aug 24 12:29:50.674399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Host: 10.222.0.45 Aug 24 12:29:50.674399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Openstack-System-Scope: None Aug 24 12:29:50.674399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: User-Agent: python-urllib3/1.26.11 Aug 24 12:29:50.674399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Auth-Token: gAAAAABjBhm8OrSNLELm7BXms7XHmgEDbGVeldWm11jm5_vJLboASgE9AEoQwo7F0f7I_l7taaEFGSs3h3Sdx6WhmejTHQlZEfIWBPP6EH7svW9WZMN9ynQAEf5vqeIl6W53NcZ2ca5XEfghSaBayHiWzBfWrbZwCUTjPHDfyb12Sll85kQxepg Aug 24 12:29:50.674399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Id: None Aug 24 12:29:50.674399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Name: None Aug 24 12:29:50.674399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Identity-Status: Confirmed Aug 24 12:29:50.674399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Is-Admin-Project: True Aug 24 12:29:50.674399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Id: default Aug 24 12:29:50.674399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Name: Default Aug 24 12:29:50.674399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Id: 94e584086ede4dcfb7fa3002b1091b8e Aug 24 12:29:50.674399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Name: tempest-VolumesNegativeTest-484624126 Aug 24 12:29:50.674399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Role: member,reader Aug 24 12:29:50.674399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Roles: member,reader Aug 24 12:29:50.676046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_94e584086ede4dcfb7fa3002b1091b8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/94e584086ede4dcfb7fa3002b1091b8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/94e584086ede4dcfb7fa3002b1091b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/94e584086ede4dcfb7fa3002b1091b8e"}]}] Aug 24 12:29:50.676046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant: tempest-VolumesNegativeTest-484624126 Aug 24 12:29:50.676046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Id: 94e584086ede4dcfb7fa3002b1091b8e Aug 24 12:29:50.676046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Name: tempest-VolumesNegativeTest-484624126 Aug 24 12:29:50.676046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User: tempest-VolumesNegativeTest-484624126-project Aug 24 12:29:50.676046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Id: default Aug 24 12:29:50.676046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Name: Default Aug 24 12:29:50.676046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Id: 7750a81cb89346ecb3634daa137d0da3 Aug 24 12:29:50.676046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Name: tempest-VolumesNegativeTest-484624126-project Aug 24 12:29:50.676046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Aug 24 12:29:50.676046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-366361247", "metadata": {"Type": "work"}}} Aug 24 12:29:50.676046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: method: Aug 24 12:29:50.676046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 12:29:50.677004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-366361247', 'metadata': {'Type': 'work'}}}} Aug 24 12:29:50.677004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:29:50.677004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:29:50.677004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 12:29:50.677004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 12:29:50.677004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 12:29:50.677004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise error Aug 24 12:29:50.677004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 12:29:50.677004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:29:50.677004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 12:29:50.677004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 12:29:50.677004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:29:50.677004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 12:29:50.677004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi '' Aug 24 12:29:50.677004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:29:50.677004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:29:50.677004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:29:50.677004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:29:50.677004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:29:50.677004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:29:50.677004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:29:50.677004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:29:50.679343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:29:50.679343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:29:50.679343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:29:50.679343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:29:50.679343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 12:29:50.679343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 12:29:50.679343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 12:29:50.679343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 12:29:50.679343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 12:29:50.679343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 12:29:50.679343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 12:29:50.679343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:29:50.679343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:29:50.679343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:29:50.679343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:29:50.679343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:29:50.679343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:29:50.679343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 12:29:50.679343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 12:29:50.680648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 12:29:50.680648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:29:50.680648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-029b3008-4e25-4c87-b567-7355b03b0f42 tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:29:50.680648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-029b3008-4e25-4c87-b567-7355b03b0f42 tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011847 Aug 24 12:29:50.680648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2/3] 10.222.0.45 () {60 vars in 1156 bytes} [Wed Aug 24 12:29:50 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 12:29:50.699446 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7887ad16-3986-45f4-8753-5d77ba5ba3de tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] Calling method '.version_select at 0x7f76f7474a60>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:29:51.536247 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.wsgi [None req-7887ad16-3986-45f4-8753-5d77ba5ba3de tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] HTTP exception thrown: Volume tempest-invalid-1628742661 could not be found. Aug 24 12:29:51.543710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7887ad16-3986-45f4-8753-5d77ba5ba3de tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] Request method failure captured: Aug 24 12:29:51.543710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1628742661 HTTP/1.1 Aug 24 12:29:51.543710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept: application/json Aug 24 12:29:51.543710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept-Encoding: identity Aug 24 12:29:51.543710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Connection: close Aug 24 12:29:51.543710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Length: 0 Aug 24 12:29:51.543710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Type: application/json Aug 24 12:29:51.543710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Host: 10.222.0.45 Aug 24 12:29:51.543710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Openstack-System-Scope: None Aug 24 12:29:51.543710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: User-Agent: python-urllib3/1.26.11 Aug 24 12:29:51.543710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Auth-Token: gAAAAABjBhm8OrSNLELm7BXms7XHmgEDbGVeldWm11jm5_vJLboASgE9AEoQwo7F0f7I_l7taaEFGSs3h3Sdx6WhmejTHQlZEfIWBPP6EH7svW9WZMN9ynQAEf5vqeIl6W53NcZ2ca5XEfghSaBayHiWzBfWrbZwCUTjPHDfyb12Sll85kQxepg Aug 24 12:29:51.543710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Id: None Aug 24 12:29:51.543710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Name: None Aug 24 12:29:51.543710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Identity-Status: Confirmed Aug 24 12:29:51.543710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Is-Admin-Project: True Aug 24 12:29:51.543710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Id: default Aug 24 12:29:51.543710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Name: Default Aug 24 12:29:51.543710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Id: 94e584086ede4dcfb7fa3002b1091b8e Aug 24 12:29:51.543710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Name: tempest-VolumesNegativeTest-484624126 Aug 24 12:29:51.543710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Role: member,reader Aug 24 12:29:51.543710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Roles: member,reader Aug 24 12:29:51.545322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_94e584086ede4dcfb7fa3002b1091b8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/94e584086ede4dcfb7fa3002b1091b8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/94e584086ede4dcfb7fa3002b1091b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/94e584086ede4dcfb7fa3002b1091b8e"}]}] Aug 24 12:29:51.545322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant: tempest-VolumesNegativeTest-484624126 Aug 24 12:29:51.545322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Id: 94e584086ede4dcfb7fa3002b1091b8e Aug 24 12:29:51.545322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Name: tempest-VolumesNegativeTest-484624126 Aug 24 12:29:51.545322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User: tempest-VolumesNegativeTest-484624126-project Aug 24 12:29:51.545322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Id: default Aug 24 12:29:51.545322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Name: Default Aug 24 12:29:51.545322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Id: 7750a81cb89346ecb3634daa137d0da3 Aug 24 12:29:51.545322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Name: tempest-VolumesNegativeTest-484624126-project Aug 24 12:29:51.545322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: method: Aug 24 12:29:51.545322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: exception: Volume tempest-invalid-1628742661 could not be found. Aug 24 12:29:51.545322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: action_args: {'id': 'tempest-invalid-1628742661'} Aug 24 12:29:51.545322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:29:51.546233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:29:51.546233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:29:51.546233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:29:51.546233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 12:29:51.546233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 12:29:51.546233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 12:29:51.546233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 12:29:51.546233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 12:29:51.546233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 12:29:51.546233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 12:29:51.546233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 12:29:51.546233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:29:51.546233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:29:51.546233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:29:51.546233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:29:51.546233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1628742661 could not be found. (HTTP 404) (Request-ID: req-bbb5fe79-9ddd-4e48-866f-d472eae72fc1) Aug 24 12:29:51.546233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:29:51.546233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:29:51.546233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:29:51.548532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:29:51.548532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 12:29:51.548532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 12:29:51.548532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 12:29:51.548532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 12:29:51.548532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 12:29:51.548532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 12:29:51.548532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 12:29:51.548532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 12:29:51.548532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:29:51.548532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:29:51.548532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 12:29:51.548532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 12:29:51.548532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 12:29:51.548532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 12:29:51.548532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 12:29:51.548532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 12:29:51.548532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 12:29:51.548532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 12:29:51.550943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:29:51.550943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:29:51.550943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:29:51.550943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:29:51.550943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1628742661 could not be found. Aug 24 12:29:51.550943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:29:51.550943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:29:51.550943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:29:51.550943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:29:51.550943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:29:51.550943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:29:51.550943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:29:51.550943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:29:51.550943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:29:51.550943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:29:51.550943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:29:51.550943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:29:51.550943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 12:29:51.550943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:29:51.550943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1628742661 could not be found. Aug 24 12:29:51.553417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:29:51.553417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:29:51.553417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:29:51.553417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:29:51.553417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:29:51.553417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:29:51.553417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:29:51.553417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:29:51.553417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1628742661 could not be found. Aug 24 12:29:51.553417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:29:51.553417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7887ad16-3986-45f4-8753-5d77ba5ba3de tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] Returning 404 to user: Volume tempest-invalid-1628742661 could not be found. {{(pid=121170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:29:51.557502 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7887ad16-3986-45f4-8753-5d77ba5ba3de tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1628742661" status: 404 len: 99 microversion: 2.1 time: 0.866810 Aug 24 12:29:51.569676 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2/4] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Aug 24 12:29:50 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1628742661 => generated 99 bytes in 876 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 12:29:51.570242 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5f29d760-c0a1-478a-ae7f-c8a3e90b8533 tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005325 Aug 24 12:29:51.570953 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 3/5] 10.222.0.45 () {58 vars in 1140 bytes} [Wed Aug 24 12:29:51 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 12:29:51.582294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-22efe072-b2e9-4d01-9e4d-152e28242724 tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006401 Aug 24 12:29:51.586926 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 3/6] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Aug 24 12:29:51 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 24 12:29:51.595249 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-15421f11-f99c-4083-b228-040848cb513c tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] Calling method '.version_select at 0x7f76f7364430>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:29:51.821005 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.wsgi [None req-15421f11-f99c-4083-b228-040848cb513c tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] HTTP exception thrown: Volume 100eccb1-7a52-4476-888e-4d6ad8d1a416 could not be found. Aug 24 12:29:51.824880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-15421f11-f99c-4083-b228-040848cb513c tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] Request method failure captured: Aug 24 12:29:51.824880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: request: DELETE /compute/v2.1/os-volumes/100eccb1-7a52-4476-888e-4d6ad8d1a416 HTTP/1.1 Aug 24 12:29:51.824880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept: application/json Aug 24 12:29:51.824880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept-Encoding: identity Aug 24 12:29:51.824880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Connection: close Aug 24 12:29:51.824880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Length: 0 Aug 24 12:29:51.824880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Type: application/json Aug 24 12:29:51.824880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Host: 10.222.0.45 Aug 24 12:29:51.824880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Openstack-System-Scope: None Aug 24 12:29:51.824880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: User-Agent: python-urllib3/1.26.11 Aug 24 12:29:51.824880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Auth-Token: gAAAAABjBhm8OrSNLELm7BXms7XHmgEDbGVeldWm11jm5_vJLboASgE9AEoQwo7F0f7I_l7taaEFGSs3h3Sdx6WhmejTHQlZEfIWBPP6EH7svW9WZMN9ynQAEf5vqeIl6W53NcZ2ca5XEfghSaBayHiWzBfWrbZwCUTjPHDfyb12Sll85kQxepg Aug 24 12:29:51.824880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Id: None Aug 24 12:29:51.824880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Name: None Aug 24 12:29:51.824880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Identity-Status: Confirmed Aug 24 12:29:51.824880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Is-Admin-Project: True Aug 24 12:29:51.824880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Id: default Aug 24 12:29:51.824880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Name: Default Aug 24 12:29:51.824880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Id: 94e584086ede4dcfb7fa3002b1091b8e Aug 24 12:29:51.824880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Name: tempest-VolumesNegativeTest-484624126 Aug 24 12:29:51.824880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Role: member,reader Aug 24 12:29:51.824880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Roles: member,reader Aug 24 12:29:51.826241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_94e584086ede4dcfb7fa3002b1091b8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/94e584086ede4dcfb7fa3002b1091b8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/94e584086ede4dcfb7fa3002b1091b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/94e584086ede4dcfb7fa3002b1091b8e"}]}] Aug 24 12:29:51.826241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant: tempest-VolumesNegativeTest-484624126 Aug 24 12:29:51.826241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Id: 94e584086ede4dcfb7fa3002b1091b8e Aug 24 12:29:51.826241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Name: tempest-VolumesNegativeTest-484624126 Aug 24 12:29:51.826241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User: tempest-VolumesNegativeTest-484624126-project Aug 24 12:29:51.826241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Id: default Aug 24 12:29:51.826241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Name: Default Aug 24 12:29:51.826241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Id: 7750a81cb89346ecb3634daa137d0da3 Aug 24 12:29:51.826241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Name: tempest-VolumesNegativeTest-484624126-project Aug 24 12:29:51.826241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: method: Aug 24 12:29:51.826241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: exception: Volume 100eccb1-7a52-4476-888e-4d6ad8d1a416 could not be found. Aug 24 12:29:51.826241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: action_args: {'id': '100eccb1-7a52-4476-888e-4d6ad8d1a416'} Aug 24 12:29:51.826241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:29:51.827303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:29:51.827303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:29:51.827303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:29:51.827303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 12:29:51.827303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 12:29:51.827303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 12:29:51.827303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 12:29:51.827303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 12:29:51.827303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 12:29:51.827303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 12:29:51.827303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 12:29:51.827303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:29:51.827303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:29:51.827303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:29:51.827303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:29:51.827303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 100eccb1-7a52-4476-888e-4d6ad8d1a416 could not be found. (HTTP 404) (Request-ID: req-03262724-4846-4249-992e-3f62f544f0a2) Aug 24 12:29:51.827303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:29:51.827303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:29:51.827303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:29:51.828648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:29:51.828648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 12:29:51.828648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 12:29:51.828648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 12:29:51.828648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 12:29:51.828648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 12:29:51.828648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 12:29:51.828648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 12:29:51.828648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 12:29:51.828648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:29:51.828648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:29:51.828648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 12:29:51.828648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 12:29:51.828648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 12:29:51.828648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 12:29:51.828648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 12:29:51.828648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 12:29:51.828648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 12:29:51.828648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 12:29:51.829758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:29:51.829758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:29:51.829758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:29:51.829758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:29:51.829758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 100eccb1-7a52-4476-888e-4d6ad8d1a416 could not be found. Aug 24 12:29:51.829758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:29:51.829758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:29:51.829758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:29:51.829758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:29:51.829758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:29:51.829758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:29:51.829758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:29:51.829758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:29:51.829758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:29:51.829758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:29:51.829758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:29:51.829758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:29:51.829758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 12:29:51.829758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:29:51.841972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 100eccb1-7a52-4476-888e-4d6ad8d1a416 could not be found. Aug 24 12:29:51.841972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:29:51.841972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:29:51.841972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:29:51.841972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:29:51.841972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:29:51.841972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:29:51.841972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:29:51.841972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:29:51.841972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 100eccb1-7a52-4476-888e-4d6ad8d1a416 could not be found. Aug 24 12:29:51.841972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:29:51.841972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-15421f11-f99c-4083-b228-040848cb513c tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] Returning 404 to user: Volume 100eccb1-7a52-4476-888e-4d6ad8d1a416 could not be found. {{(pid=121171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:29:51.841972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-15421f11-f99c-4083-b228-040848cb513c tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/100eccb1-7a52-4476-888e-4d6ad8d1a416" status: 404 len: 109 microversion: 2.1 time: 0.234960 Aug 24 12:29:51.841972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 24 12:29:51 2022] DELETE /compute/v2.1/os-volumes/100eccb1-7a52-4476-888e-4d6ad8d1a416 => generated 109 bytes in 242 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:29:51.843160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-01b52578-eccd-421e-b1b4-0419f03a91a7 tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] Calling method '.version_select at 0x7f76f72e2ee0>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:29:51.883308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.wsgi [None req-01b52578-eccd-421e-b1b4-0419f03a91a7 tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] HTTP exception thrown: Volume 8763c1d3-18f7-4500-a375-b45a1565c3f0 could not be found. Aug 24 12:29:51.885277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-01b52578-eccd-421e-b1b4-0419f03a91a7 tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] Request method failure captured: Aug 24 12:29:51.885277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: request: GET /compute/v2.1/os-volumes/8763c1d3-18f7-4500-a375-b45a1565c3f0 HTTP/1.1 Aug 24 12:29:51.885277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept: application/json Aug 24 12:29:51.885277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept-Encoding: identity Aug 24 12:29:51.885277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Connection: close Aug 24 12:29:51.885277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Length: 0 Aug 24 12:29:51.885277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Type: application/json Aug 24 12:29:51.885277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Host: 10.222.0.45 Aug 24 12:29:51.885277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Openstack-System-Scope: None Aug 24 12:29:51.885277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: User-Agent: python-urllib3/1.26.11 Aug 24 12:29:51.885277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Auth-Token: gAAAAABjBhm8OrSNLELm7BXms7XHmgEDbGVeldWm11jm5_vJLboASgE9AEoQwo7F0f7I_l7taaEFGSs3h3Sdx6WhmejTHQlZEfIWBPP6EH7svW9WZMN9ynQAEf5vqeIl6W53NcZ2ca5XEfghSaBayHiWzBfWrbZwCUTjPHDfyb12Sll85kQxepg Aug 24 12:29:51.885277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Id: None Aug 24 12:29:51.885277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Name: None Aug 24 12:29:51.885277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Identity-Status: Confirmed Aug 24 12:29:51.885277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Is-Admin-Project: True Aug 24 12:29:51.885277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Id: default Aug 24 12:29:51.885277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Name: Default Aug 24 12:29:51.885277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Id: 94e584086ede4dcfb7fa3002b1091b8e Aug 24 12:29:51.885277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Name: tempest-VolumesNegativeTest-484624126 Aug 24 12:29:51.885277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Role: member,reader Aug 24 12:29:51.885277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Roles: member,reader Aug 24 12:29:51.886939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_94e584086ede4dcfb7fa3002b1091b8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/94e584086ede4dcfb7fa3002b1091b8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/94e584086ede4dcfb7fa3002b1091b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/94e584086ede4dcfb7fa3002b1091b8e"}]}] Aug 24 12:29:51.886939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant: tempest-VolumesNegativeTest-484624126 Aug 24 12:29:51.886939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Id: 94e584086ede4dcfb7fa3002b1091b8e Aug 24 12:29:51.886939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Name: tempest-VolumesNegativeTest-484624126 Aug 24 12:29:51.886939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User: tempest-VolumesNegativeTest-484624126-project Aug 24 12:29:51.886939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Id: default Aug 24 12:29:51.886939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Name: Default Aug 24 12:29:51.886939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Id: 7750a81cb89346ecb3634daa137d0da3 Aug 24 12:29:51.886939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Name: tempest-VolumesNegativeTest-484624126-project Aug 24 12:29:51.886939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: method: Aug 24 12:29:51.886939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: exception: Volume 8763c1d3-18f7-4500-a375-b45a1565c3f0 could not be found. Aug 24 12:29:51.886939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: action_args: {'id': '8763c1d3-18f7-4500-a375-b45a1565c3f0'} Aug 24 12:29:51.886939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:29:51.887700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:29:51.887700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:29:51.887700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:29:51.887700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 12:29:51.887700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 12:29:51.887700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 12:29:51.887700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 12:29:51.887700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 12:29:51.887700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 12:29:51.887700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 12:29:51.887700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 12:29:51.887700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:29:51.887700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:29:51.887700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:29:51.887700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:29:51.887700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8763c1d3-18f7-4500-a375-b45a1565c3f0 could not be found. (HTTP 404) (Request-ID: req-64b8cd38-fb3c-4d1e-880e-2266dab5aa9e) Aug 24 12:29:51.887700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:29:51.887700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:29:51.887700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:29:51.888818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:29:51.888818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 12:29:51.888818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 12:29:51.888818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 12:29:51.888818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 12:29:51.888818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 12:29:51.888818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 12:29:51.888818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 12:29:51.888818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 12:29:51.888818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:29:51.888818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:29:51.888818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 12:29:51.888818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 12:29:51.888818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 12:29:51.888818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 12:29:51.888818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 12:29:51.888818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 12:29:51.888818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 12:29:51.888818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 12:29:51.889949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:29:51.889949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:29:51.889949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:29:51.889949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:29:51.889949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8763c1d3-18f7-4500-a375-b45a1565c3f0 could not be found. Aug 24 12:29:51.889949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:29:51.889949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:29:51.889949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:29:51.889949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:29:51.889949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:29:51.889949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:29:51.889949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:29:51.889949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:29:51.889949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:29:51.889949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:29:51.889949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:29:51.889949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:29:51.889949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 12:29:51.889949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:29:51.892189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8763c1d3-18f7-4500-a375-b45a1565c3f0 could not be found. Aug 24 12:29:51.892189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:29:51.892189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:29:51.892189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:29:51.892189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:29:51.892189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:29:51.892189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:29:51.892189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:29:51.892189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:29:51.892189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8763c1d3-18f7-4500-a375-b45a1565c3f0 could not be found. Aug 24 12:29:51.892189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:29:51.910638 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-01b52578-eccd-421e-b1b4-0419f03a91a7 tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] Returning 404 to user: Volume 8763c1d3-18f7-4500-a375-b45a1565c3f0 could not be found. {{(pid=121170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:29:51.910638 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-01b52578-eccd-421e-b1b4-0419f03a91a7 tempest-VolumesNegativeTest-484624126 tempest-VolumesNegativeTest-484624126-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/8763c1d3-18f7-4500-a375-b45a1565c3f0" status: 404 len: 109 microversion: 2.1 time: 0.059767 Aug 24 12:29:51.910638 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 4/8] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 12:29:51 2022] GET /compute/v2.1/os-volumes/8763c1d3-18f7-4500-a375-b45a1565c3f0 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:29:53.779314 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c49d49a2-f7db-4fcf-b651-7b5a6c87dbde tempest-VolumesTestJSON-1723704128 tempest-VolumesTestJSON-1723704128-project] Calling method '.version_select at 0x7f76f728f040>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:29:53.894831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c49d49a2-f7db-4fcf-b651-7b5a6c87dbde tempest-VolumesTestJSON-1723704128 tempest-VolumesTestJSON-1723704128-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/4194c6ac-9580-4ebe-9d7f-ef5fc3db54db" status: 200 len: 351 microversion: 2.1 time: 0.120974 Aug 24 12:29:53.904180 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 5/9] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 12:29:53 2022] GET /compute/v2.1/os-volumes/4194c6ac-9580-4ebe-9d7f-ef5fc3db54db => generated 351 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:29:57.210439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a0c5b0d8-6405-4a89-b4af-876c4bdf19b4 tempest-VolumesTestJSON-1723704128 tempest-VolumesTestJSON-1723704128-project] Calling method '.version_select at 0x7f76f728e700>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:29:57.303898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a0c5b0d8-6405-4a89-b4af-876c4bdf19b4 tempest-VolumesTestJSON-1723704128 tempest-VolumesTestJSON-1723704128-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/0ce233e4-a6f3-48b6-b310-c995cdb74ae8" status: 200 len: 350 microversion: 2.1 time: 0.097710 Aug 24 12:29:57.314353 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 5/10] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 12:29:57 2022] GET /compute/v2.1/os-volumes/0ce233e4-a6f3-48b6-b310-c995cdb74ae8 => generated 350 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:30:00.646297 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0c95b60c-323d-4757-999d-eebaf7299372 tempest-VolumesTestJSON-1723704128 tempest-VolumesTestJSON-1723704128-project] Calling method '.version_select at 0x7f76f728f790>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:00.844750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0c95b60c-323d-4757-999d-eebaf7299372 tempest-VolumesTestJSON-1723704128 tempest-VolumesTestJSON-1723704128-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/58c7a81a-27fc-456b-899e-23e9a5177a8a" status: 200 len: 351 microversion: 2.1 time: 0.193288 Aug 24 12:30:00.852983 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 6/11] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 12:30:00 2022] GET /compute/v2.1/os-volumes/58c7a81a-27fc-456b-899e-23e9a5177a8a => generated 351 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:30:00.860323 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fb934846-6d84-4b9c-aabe-450808cdea1b tempest-VolumesTestJSON-1723704128 tempest-VolumesTestJSON-1723704128-project] Calling method '.version_select at 0x7f76f72e2dc0>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:01.020832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fb934846-6d84-4b9c-aabe-450808cdea1b tempest-VolumesTestJSON-1723704128 tempest-VolumesTestJSON-1723704128-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.164325 Aug 24 12:30:01.021515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 6/12] 10.222.0.45 () {58 vars in 1134 bytes} [Wed Aug 24 12:30:00 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:01.037454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2cbd256f-20da-48b5-81d3-ff99bf323837 tempest-VolumesTestJSON-1723704128 tempest-VolumesTestJSON-1723704128-project] Calling method '.version_select at 0x7f76f728fb80>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:01.198638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2cbd256f-20da-48b5-81d3-ff99bf323837 tempest-VolumesTestJSON-1723704128 tempest-VolumesTestJSON-1723704128-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.166623 Aug 24 12:30:01.199906 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 7/13] 10.222.0.45 () {58 vars in 1149 bytes} [Wed Aug 24 12:30:01 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:30:01.212846 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-422a5710-a606-4ec1-8572-9c98dbebe976 tempest-VolumesTestJSON-1723704128 tempest-VolumesTestJSON-1723704128-project] Calling method '.version_select at 0x7f76f728eca0>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:01.385350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-422a5710-a606-4ec1-8572-9c98dbebe976 tempest-VolumesTestJSON-1723704128 tempest-VolumesTestJSON-1723704128-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.176294 Aug 24 12:30:01.388912 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 7/14] 10.222.0.45 () {58 vars in 1134 bytes} [Wed Aug 24 12:30:01 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:01.399447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-262ce99d-6d94-4fcb-892e-589942cfcd4e tempest-VolumesTestJSON-1723704128 tempest-VolumesTestJSON-1723704128-project] Calling method '.version_select at 0x7f76f72a51f0>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:01.575786 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-262ce99d-6d94-4fcb-892e-589942cfcd4e tempest-VolumesTestJSON-1723704128 tempest-VolumesTestJSON-1723704128-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.180526 Aug 24 12:30:01.584763 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 8/15] 10.222.0.45 () {58 vars in 1167 bytes} [Wed Aug 24 12:30:01 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:30:01.591259 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6974cf95-5060-4b6e-9de1-e1cbfdc4d7c9 tempest-VolumesTestJSON-1723704128 tempest-VolumesTestJSON-1723704128-project] Calling method '.version_select at 0x7f76f728cee0>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:01.848112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6974cf95-5060-4b6e-9de1-e1cbfdc4d7c9 tempest-VolumesTestJSON-1723704128 tempest-VolumesTestJSON-1723704128-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.261874 Aug 24 12:30:01.849303 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 8/16] 10.222.0.45 () {58 vars in 1170 bytes} [Wed Aug 24 12:30:01 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:30:01.863417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ce69a42f-4545-441d-9cbf-a06fa0aca5eb tempest-VolumesTestJSON-1723704128 tempest-VolumesTestJSON-1723704128-project] Calling method '.version_select at 0x7f76f728c1f0>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:02.045498 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3208d0e6-7c3a-4bbd-bf5f-e501eb18e82a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Action: 'create', calling method: .version_select at 0x7f76f72a5b80>, body: {"keypair": {"name": "tempest-keypair-491279861", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6aUCZJlZP52zw550jU61ceMNNmyWHXAwcrL5B9ylaY71NP7MgtypKTDucT3bEkEvxNkwRSbxVVF43st0vygH/dt4N8SwTcAoOBdziS0RGBCQzo5ECHgljkxAQ6Ppg5hQ=="}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:30:02.100764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ce69a42f-4545-441d-9cbf-a06fa0aca5eb tempest-VolumesTestJSON-1723704128 tempest-VolumesTestJSON-1723704128-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.241524 Aug 24 12:30:02.101350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 9/17] 10.222.0.45 () {58 vars in 1155 bytes} [Wed Aug 24 12:30:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:02.117295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2a3b7e70-0d88-4e04-8ec1-e199fb48bc9c tempest-VolumesTestJSON-1723704128 tempest-VolumesTestJSON-1723704128-project] Calling method '.version_select at 0x7f76f7474700>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:02.189582 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-3208d0e6-7c3a-4bbd-bf5f-e501eb18e82a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Getting quotas for project 504b03560cf34426a08958b471c91646. Resources: {'key_pairs'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:30:02.212557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-3208d0e6-7c3a-4bbd-bf5f-e501eb18e82a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Getting quotas for user 6b94f244190e4af089d070ad83806c38 and project 504b03560cf34426a08958b471c91646. Resources: {'key_pairs'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:30:02.304918 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2a3b7e70-0d88-4e04-8ec1-e199fb48bc9c tempest-VolumesTestJSON-1723704128 tempest-VolumesTestJSON-1723704128-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.194114 Aug 24 12:30:02.305475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 10/18] 10.222.0.45 () {58 vars in 1188 bytes} [Wed Aug 24 12:30:02 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:30:02.318686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-79138a35-c460-4747-841b-7d330238fa33 tempest-VolumesTestJSON-1723704128 tempest-VolumesTestJSON-1723704128-project] Calling method '.version_select at 0x7f76f728ddc0>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:02.415302 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3208d0e6-7c3a-4bbd-bf5f-e501eb18e82a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.704311 Aug 24 12:30:02.416647 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 9/19] 10.222.0.45 () {62 vars in 1200 bytes} [Wed Aug 24 12:30:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 706 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 12:30:02.465035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-79138a35-c460-4747-841b-7d330238fa33 tempest-VolumesTestJSON-1723704128 tempest-VolumesTestJSON-1723704128-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.150427 Aug 24 12:30:02.465594 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 11/20] 10.222.0.45 () {58 vars in 1155 bytes} [Wed Aug 24 12:30:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:04.421319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d58a57ab-c073-454e-99aa-d4fdee995096 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Action: 'create', calling method: .version_select at 0x7f76f720e430>, body: {"keypair": {"name": "tempest-keypair-879830423", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwNxnrJon+V/ZbhLSP7z2aDaAFSLycu1poV2ly0l2sjn8LDEi4l+yAz29GttNidMnmArSEIVCQOJ7uAVyRFaazn7wWzITi78zwQTi/hXhB0CGLPxeZVzZfJhLjX2Ae6kg=="}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:30:04.515958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-d58a57ab-c073-454e-99aa-d4fdee995096 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Getting quotas for project e7a3075a9e3a47a4bcb9136ce8303173. Resources: {'key_pairs'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:30:04.553396 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-d58a57ab-c073-454e-99aa-d4fdee995096 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Getting quotas for user 751f05f1ff6c4593870073d8f47e0db9 and project e7a3075a9e3a47a4bcb9136ce8303173. Resources: {'key_pairs'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:30:04.732660 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d58a57ab-c073-454e-99aa-d4fdee995096 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.021111 Aug 24 12:30:04.737846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 10/21] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 24 12:30:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:30:08.963015 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-51beab1c-1993-4af7-9681-1b652e81c4e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-749159951", "imageRef": "62fcb2c8-bff4-46cf-9892-c43d7626629e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:30:09.258168 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.network.neutron [None req-51beab1c-1993-4af7-9681-1b652e81c4e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] validate_networks() for [('65256e65-b152-4d73-9a03-c89cc38558d4', None, None, None, None, None)] {{(pid=121170) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:30:09.337704 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c1457a37-6c5a-4ab6-8cec-9b76466384f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2091467643", "imageRef": "62fcb2c8-bff4-46cf-9892-c43d7626629e", "flavorRef": "452", "networks": [{"uuid": "8f4ba589-6739-410d-8f54-7376db95ded6"}]}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:30:09.458774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.network.neutron [None req-c1457a37-6c5a-4ab6-8cec-9b76466384f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] validate_networks() for [('8f4ba589-6739-410d-8f54-7376db95ded6', None, None, None, None, None)] {{(pid=121171) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:30:11.676555 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-51beab1c-1993-4af7-9681-1b652e81c4e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Flavor limits 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:30:11.677007 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-51beab1c-1993-4af7-9681-1b652e81c4e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Image limits 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:30:11.677453 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-51beab1c-1993-4af7-9681-1b652e81c4e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Flavor pref 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:30:11.677861 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-51beab1c-1993-4af7-9681-1b652e81c4e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Image pref 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:30:11.678279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-51beab1c-1993-4af7-9681-1b652e81c4e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:30:11.705098 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51beab1c-1993-4af7-9681-1b652e81c4e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:11.705616 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51beab1c-1993-4af7-9681-1b652e81c4e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:11.706061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51beab1c-1993-4af7-9681-1b652e81c4e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:11.708919 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51beab1c-1993-4af7-9681-1b652e81c4e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:11.709812 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51beab1c-1993-4af7-9681-1b652e81c4e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:11.711679 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51beab1c-1993-4af7-9681-1b652e81c4e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:11.771881 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-51beab1c-1993-4af7-9681-1b652e81c4e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Getting quotas for project 99f0beb902e4472eae20f0e6c8dc3340. Resources: {'instances', 'cores', 'ram'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:30:11.781057 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-51beab1c-1993-4af7-9681-1b652e81c4e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Getting quotas for user b9252893998a490689497697663ca4d2 and project 99f0beb902e4472eae20f0e6c8dc3340. Resources: {'instances', 'cores', 'ram'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:30:11.796688 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-51beab1c-1993-4af7-9681-1b652e81c4e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Going to run 1 instances... {{(pid=121170) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:30:11.800249 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-51beab1c-1993-4af7-9681-1b652e81c4e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='62fcb2c8-bff4-46cf-9892-c43d7626629e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:30:11.935709 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-c1457a37-6c5a-4ab6-8cec-9b76466384f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Flavor limits 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:30:11.942086 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-c1457a37-6c5a-4ab6-8cec-9b76466384f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Image limits 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:30:11.942994 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-c1457a37-6c5a-4ab6-8cec-9b76466384f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Flavor pref 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:30:11.946115 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-c1457a37-6c5a-4ab6-8cec-9b76466384f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Image pref 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:30:11.946758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-c1457a37-6c5a-4ab6-8cec-9b76466384f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:30:11.977829 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1457a37-6c5a-4ab6-8cec-9b76466384f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:11.977829 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1457a37-6c5a-4ab6-8cec-9b76466384f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:11.978865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1457a37-6c5a-4ab6-8cec-9b76466384f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:11.993608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1457a37-6c5a-4ab6-8cec-9b76466384f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:11.995969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1457a37-6c5a-4ab6-8cec-9b76466384f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:11.997192 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1457a37-6c5a-4ab6-8cec-9b76466384f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:12.035440 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-51beab1c-1993-4af7-9681-1b652e81c4e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.738767 Aug 24 12:30:12.041211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 12/22] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 12:30:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 3743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:30:12.055201 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a6aa884b-1de4-43e1-a0f4-9b8d96551267 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-869825053", "imageRef": "62fcb2c8-bff4-46cf-9892-c43d7626629e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0bd50a11-ed3e-433c-846d-0a63b9713335"}], "security_groups": [{"name": "tempest-securitygroup--2042046749"}], "key_name": "tempest-keypair-491279861", "user_data": "}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:30:12.081408 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-c1457a37-6c5a-4ab6-8cec-9b76466384f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Getting quotas for project 43ef4ba417014205b91496a8037540ed. Resources: {'instances', 'cores', 'ram'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:30:12.093690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-c1457a37-6c5a-4ab6-8cec-9b76466384f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Getting quotas for user 281e6cd581c54901b8feaa291db588eb and project 43ef4ba417014205b91496a8037540ed. Resources: {'instances', 'cores', 'ram'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:30:12.192629 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c1457a37-6c5a-4ab6-8cec-9b76466384f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Going to run 1 instances... {{(pid=121171) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:30:12.204924 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c1457a37-6c5a-4ab6-8cec-9b76466384f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='62fcb2c8-bff4-46cf-9892-c43d7626629e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:30:12.333889 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.network.neutron [None req-a6aa884b-1de4-43e1-a0f4-9b8d96551267 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] validate_networks() for [('0bd50a11-ed3e-433c-846d-0a63b9713335', None, None, None, None, None)] {{(pid=121170) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:30:12.509918 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c1457a37-6c5a-4ab6-8cec-9b76466384f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.364531 Aug 24 12:30:12.510558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 11/23] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 12:30:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 12:30:12.522019 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-906a042b-45e9-4f83-a4e6-b76e403cc581 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:12.523663 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-906a042b-45e9-4f83-a4e6-b76e403cc581 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:12.857923 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-906a042b-45e9-4f83-a4e6-b76e403cc581 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:12.885716 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-906a042b-45e9-4f83-a4e6-b76e403cc581 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1221 microversion: 2.1 time: 0.373125 Aug 24 12:30:12.886818 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 12/24] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:12 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1221 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:12.896383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-782c40fd-9acf-4e45-a169-9cad39532bbb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2095011054", "imageRef": "62fcb2c8-bff4-46cf-9892-c43d7626629e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f137b54-3584-4b32-aaf7-f4f4fb0dd5d8"}], "security_groups": [{"name": "tempest-securitygroup--631152011"}], "key_name": "tempest-keypair-879830423", "user_data": "}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:30:13.254238 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.network.neutron [None req-782c40fd-9acf-4e45-a169-9cad39532bbb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] validate_networks() for [('6f137b54-3584-4b32-aaf7-f4f4fb0dd5d8', None, None, None, None, None)] {{(pid=121171) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:30:13.472098 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-a6aa884b-1de4-43e1-a0f4-9b8d96551267 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Flavor limits 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:30:13.480741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-a6aa884b-1de4-43e1-a0f4-9b8d96551267 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Image limits 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:30:13.480741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-a6aa884b-1de4-43e1-a0f4-9b8d96551267 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Flavor pref 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:30:13.480741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-a6aa884b-1de4-43e1-a0f4-9b8d96551267 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Image pref 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:30:13.480741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-a6aa884b-1de4-43e1-a0f4-9b8d96551267 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:30:13.492301 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6aa884b-1de4-43e1-a0f4-9b8d96551267 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:13.499897 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6aa884b-1de4-43e1-a0f4-9b8d96551267 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:13.499897 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6aa884b-1de4-43e1-a0f4-9b8d96551267 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:13.500686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6aa884b-1de4-43e1-a0f4-9b8d96551267 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:13.504074 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6aa884b-1de4-43e1-a0f4-9b8d96551267 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:13.505951 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6aa884b-1de4-43e1-a0f4-9b8d96551267 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:13.558704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-a6aa884b-1de4-43e1-a0f4-9b8d96551267 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Getting quotas for project 504b03560cf34426a08958b471c91646. Resources: {'instances', 'cores', 'ram'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:30:13.574770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-a6aa884b-1de4-43e1-a0f4-9b8d96551267 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Getting quotas for user 6b94f244190e4af089d070ad83806c38 and project 504b03560cf34426a08958b471c91646. Resources: {'instances', 'cores', 'ram'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:30:13.607942 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a6aa884b-1de4-43e1-a0f4-9b8d96551267 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Going to run 1 instances... {{(pid=121170) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:30:13.610551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a6aa884b-1de4-43e1-a0f4-9b8d96551267 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='62fcb2c8-bff4-46cf-9892-c43d7626629e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:30:13.851895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a6aa884b-1de4-43e1-a0f4-9b8d96551267 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.811200 Aug 24 12:30:13.856814 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 13/25] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Aug 24 12:30:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 1817 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 12:30:13.878295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-591a3b0c-4773-46bd-b5e9-ae1221858f52 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:13.879291 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-591a3b0c-4773-46bd-b5e9-ae1221858f52 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:14.073666 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-591a3b0c-4773-46bd-b5e9-ae1221858f52 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:14.100394 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-591a3b0c-4773-46bd-b5e9-ae1221858f52 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1215 microversion: 2.1 time: 0.242111 Aug 24 12:30:14.102569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 14/26] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:13 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1215 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:14.110472 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3dbbe9ca-cf72-4b45-b6b9-9a8c998a2fdc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-335153585", "imageRef": "62fcb2c8-bff4-46cf-9892-c43d7626629e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:30:14.201235 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.network.neutron [None req-3dbbe9ca-cf72-4b45-b6b9-9a8c998a2fdc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] validate_networks() for [('65256e65-b152-4d73-9a03-c89cc38558d4', None, None, None, None, None)] {{(pid=121170) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:30:14.353439 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-782c40fd-9acf-4e45-a169-9cad39532bbb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Flavor limits 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:30:14.354398 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-782c40fd-9acf-4e45-a169-9cad39532bbb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Image limits 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:30:14.355105 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-782c40fd-9acf-4e45-a169-9cad39532bbb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Flavor pref 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:30:14.358191 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-782c40fd-9acf-4e45-a169-9cad39532bbb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Image pref 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:30:14.358842 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-782c40fd-9acf-4e45-a169-9cad39532bbb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:30:14.395368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-782c40fd-9acf-4e45-a169-9cad39532bbb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:14.408535 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-782c40fd-9acf-4e45-a169-9cad39532bbb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:14.409031 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-782c40fd-9acf-4e45-a169-9cad39532bbb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:14.409853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-782c40fd-9acf-4e45-a169-9cad39532bbb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:14.427125 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-782c40fd-9acf-4e45-a169-9cad39532bbb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:14.431503 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-782c40fd-9acf-4e45-a169-9cad39532bbb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:14.500215 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-782c40fd-9acf-4e45-a169-9cad39532bbb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Getting quotas for project e7a3075a9e3a47a4bcb9136ce8303173. Resources: {'instances', 'cores', 'ram'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:30:14.518696 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-782c40fd-9acf-4e45-a169-9cad39532bbb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Getting quotas for user 751f05f1ff6c4593870073d8f47e0db9 and project e7a3075a9e3a47a4bcb9136ce8303173. Resources: {'instances', 'cores', 'ram'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:30:14.552601 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-782c40fd-9acf-4e45-a169-9cad39532bbb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Going to run 1 instances... {{(pid=121171) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:30:14.565974 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-782c40fd-9acf-4e45-a169-9cad39532bbb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='62fcb2c8-bff4-46cf-9892-c43d7626629e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:30:14.803726 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-782c40fd-9acf-4e45-a169-9cad39532bbb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.915683 Aug 24 12:30:14.809930 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 13/27] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 12:30:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 1922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:30:14.834343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1305fdc5-8109-48a0-a030-a4aaafc6f377 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:14.835216 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1305fdc5-8109-48a0-a030-a4aaafc6f377 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:14.970379 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1305fdc5-8109-48a0-a030-a4aaafc6f377 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:14.991790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1305fdc5-8109-48a0-a030-a4aaafc6f377 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:14.993527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1305fdc5-8109-48a0-a030-a4aaafc6f377 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:14.994685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1305fdc5-8109-48a0-a030-a4aaafc6f377 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1280 microversion: 2.20 time: 0.182080 Aug 24 12:30:15.002080 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 14/28] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:14 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1280 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:15.009233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f6217959-671c-4612-a040-2b6315e9b088 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:15.016283 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f6217959-671c-4612-a040-2b6315e9b088 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:15.044533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-3dbbe9ca-cf72-4b45-b6b9-9a8c998a2fdc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Flavor limits 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:30:15.045485 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-3dbbe9ca-cf72-4b45-b6b9-9a8c998a2fdc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Image limits 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:30:15.045964 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-3dbbe9ca-cf72-4b45-b6b9-9a8c998a2fdc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Flavor pref 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:30:15.046526 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-3dbbe9ca-cf72-4b45-b6b9-9a8c998a2fdc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Image pref 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:30:15.047101 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-3dbbe9ca-cf72-4b45-b6b9-9a8c998a2fdc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:30:15.060947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3dbbe9ca-cf72-4b45-b6b9-9a8c998a2fdc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:15.063110 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3dbbe9ca-cf72-4b45-b6b9-9a8c998a2fdc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:15.063879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3dbbe9ca-cf72-4b45-b6b9-9a8c998a2fdc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:15.065154 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3dbbe9ca-cf72-4b45-b6b9-9a8c998a2fdc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:15.065812 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3dbbe9ca-cf72-4b45-b6b9-9a8c998a2fdc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:15.066412 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3dbbe9ca-cf72-4b45-b6b9-9a8c998a2fdc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:15.100524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-3dbbe9ca-cf72-4b45-b6b9-9a8c998a2fdc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Getting quotas for project 99f0beb902e4472eae20f0e6c8dc3340. Resources: {'instances', 'cores', 'ram'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:30:15.104591 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-3dbbe9ca-cf72-4b45-b6b9-9a8c998a2fdc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Getting quotas for user b9252893998a490689497697663ca4d2 and project 99f0beb902e4472eae20f0e6c8dc3340. Resources: {'instances', 'cores', 'ram'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:30:15.114326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f6217959-671c-4612-a040-2b6315e9b088 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:15.121269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3dbbe9ca-cf72-4b45-b6b9-9a8c998a2fdc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Going to run 1 instances... {{(pid=121170) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:30:15.123465 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3dbbe9ca-cf72-4b45-b6b9-9a8c998a2fdc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='62fcb2c8-bff4-46cf-9892-c43d7626629e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:30:15.132422 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f6217959-671c-4612-a040-2b6315e9b088 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1237 microversion: 2.1 time: 0.128458 Aug 24 12:30:15.134228 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 15/29] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:15 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1237 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:15.211067 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5fccb805-a404-4f68-b878-e985153ac3dd tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:15.211695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5fccb805-a404-4f68-b878-e985153ac3dd tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:15.384482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3dbbe9ca-cf72-4b45-b6b9-9a8c998a2fdc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.276011 Aug 24 12:30:15.388150 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 15/30] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 12:30:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 1284 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:30:15.409974 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-81116a93-d6ca-4b48-9938-8aee13f9bdeb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:15.413950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-81116a93-d6ca-4b48-9938-8aee13f9bdeb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:15.439725 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5fccb805-a404-4f68-b878-e985153ac3dd tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:15.450531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5fccb805-a404-4f68-b878-e985153ac3dd tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1215 microversion: 2.1 time: 0.261420 Aug 24 12:30:15.454285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 16/31] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:15 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1215 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:15.536407 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-81116a93-d6ca-4b48-9938-8aee13f9bdeb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:15.544200 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-81116a93-d6ca-4b48-9938-8aee13f9bdeb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1221 microversion: 2.1 time: 0.147789 Aug 24 12:30:15.545444 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 16/32] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:15 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1221 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:16.028848 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4014c562-74eb-49a1-8279-650e51eddff7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:16.028848 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4014c562-74eb-49a1-8279-650e51eddff7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:16.171036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4014c562-74eb-49a1-8279-650e51eddff7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:16.195403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-cc53f1ef-a333-41e8-a6c4-a8d8dff1a2f1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:16.196022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-cc53f1ef-a333-41e8-a6c4-a8d8dff1a2f1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:16.215625 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4014c562-74eb-49a1-8279-650e51eddff7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:16.217150 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4014c562-74eb-49a1-8279-650e51eddff7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:16.218271 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4014c562-74eb-49a1-8279-650e51eddff7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1280 microversion: 2.20 time: 0.202593 Aug 24 12:30:16.218849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 17/33] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:16 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1280 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:16.399268 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-cc53f1ef-a333-41e8-a6c4-a8d8dff1a2f1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:16.409249 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-cc53f1ef-a333-41e8-a6c4-a8d8dff1a2f1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1237 microversion: 2.1 time: 0.250157 Aug 24 12:30:16.425449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 17/34] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:16 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1237 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:16.484689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c1e92f1b-7213-4db6-a1d7-a6d23093474c tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:16.486918 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c1e92f1b-7213-4db6-a1d7-a6d23093474c tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:16.497569 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1e92f1b-7213-4db6-a1d7-a6d23093474c tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:16.497569 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1e92f1b-7213-4db6-a1d7-a6d23093474c tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:16.497821 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1e92f1b-7213-4db6-a1d7-a6d23093474c tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:16.498359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1e92f1b-7213-4db6-a1d7-a6d23093474c tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:16.499154 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1e92f1b-7213-4db6-a1d7-a6d23093474c tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:16.500047 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1e92f1b-7213-4db6-a1d7-a6d23093474c tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:16.567386 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2890b001-f18a-4d7d-9268-fe8f19101bd1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:16.567990 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2890b001-f18a-4d7d-9268-fe8f19101bd1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:16.790017 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2890b001-f18a-4d7d-9268-fe8f19101bd1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:16.800327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2890b001-f18a-4d7d-9268-fe8f19101bd1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1221 microversion: 2.1 time: 0.236732 Aug 24 12:30:16.817987 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 18/35] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:16 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1221 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:16.945272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c1e92f1b-7213-4db6-a1d7-a6d23093474c tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:16.984621 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c1e92f1b-7213-4db6-a1d7-a6d23093474c tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1219 microversion: 2.1 time: 0.508283 Aug 24 12:30:16.986601 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 18/36] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:16 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1219 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:17.254571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1eaf5ae6-cb3f-48bf-9405-291e302ec465 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:17.255901 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1eaf5ae6-cb3f-48bf-9405-291e302ec465 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:17.269813 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1eaf5ae6-cb3f-48bf-9405-291e302ec465 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:17.269813 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1eaf5ae6-cb3f-48bf-9405-291e302ec465 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:17.269813 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1eaf5ae6-cb3f-48bf-9405-291e302ec465 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:17.269813 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1eaf5ae6-cb3f-48bf-9405-291e302ec465 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:17.270568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1eaf5ae6-cb3f-48bf-9405-291e302ec465 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:17.275657 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1eaf5ae6-cb3f-48bf-9405-291e302ec465 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:17.434915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-667eacd6-bc68-4af8-8a17-1f1c41e57921 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:17.435765 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-667eacd6-bc68-4af8-8a17-1f1c41e57921 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:17.609735 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1eaf5ae6-cb3f-48bf-9405-291e302ec465 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:17.612915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-667eacd6-bc68-4af8-8a17-1f1c41e57921 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:17.623447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-667eacd6-bc68-4af8-8a17-1f1c41e57921 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1237 microversion: 2.1 time: 0.193208 Aug 24 12:30:17.628934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1eaf5ae6-cb3f-48bf-9405-291e302ec465 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:17.634416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 19/37] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:17 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1237 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:17.638331 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1eaf5ae6-cb3f-48bf-9405-291e302ec465 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:17.639597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1eaf5ae6-cb3f-48bf-9405-291e302ec465 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1284 microversion: 2.20 time: 0.397014 Aug 24 12:30:17.641679 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 19/38] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:17 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1284 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:17.829202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1abace6b-78eb-4fe7-98e4-ad2ef8665399 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:17.829202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1abace6b-78eb-4fe7-98e4-ad2ef8665399 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:17.847396 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1abace6b-78eb-4fe7-98e4-ad2ef8665399 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:17.852523 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1abace6b-78eb-4fe7-98e4-ad2ef8665399 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:17.854398 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1abace6b-78eb-4fe7-98e4-ad2ef8665399 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:17.859014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1abace6b-78eb-4fe7-98e4-ad2ef8665399 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:17.863717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1abace6b-78eb-4fe7-98e4-ad2ef8665399 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:17.866669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1abace6b-78eb-4fe7-98e4-ad2ef8665399 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:17.985519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1abace6b-78eb-4fe7-98e4-ad2ef8665399 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:18.005345 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-886161c5-271c-4180-adbd-1bac1738237a tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:18.005955 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-886161c5-271c-4180-adbd-1bac1738237a tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:18.012304 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1abace6b-78eb-4fe7-98e4-ad2ef8665399 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1225 microversion: 2.1 time: 0.190244 Aug 24 12:30:18.022643 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-886161c5-271c-4180-adbd-1bac1738237a tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:18.023991 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-886161c5-271c-4180-adbd-1bac1738237a tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:18.025560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 20/39] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:17 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1225 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:18.025982 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-886161c5-271c-4180-adbd-1bac1738237a tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:18.026780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-886161c5-271c-4180-adbd-1bac1738237a tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:18.029888 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-886161c5-271c-4180-adbd-1bac1738237a tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:18.030230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-886161c5-271c-4180-adbd-1bac1738237a tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:18.134615 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-886161c5-271c-4180-adbd-1bac1738237a tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:18.163004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-886161c5-271c-4180-adbd-1bac1738237a tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1211 microversion: 2.1 time: 0.161018 Aug 24 12:30:18.163615 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 20/40] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:18 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1211 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:18.646845 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3459d45e-f852-4699-9204-17fedaa0a681 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:18.648070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3459d45e-f852-4699-9204-17fedaa0a681 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:18.661728 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3459d45e-f852-4699-9204-17fedaa0a681 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:18.666922 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3459d45e-f852-4699-9204-17fedaa0a681 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:18.666922 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3459d45e-f852-4699-9204-17fedaa0a681 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:18.666922 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3459d45e-f852-4699-9204-17fedaa0a681 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:18.666922 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3459d45e-f852-4699-9204-17fedaa0a681 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:18.667249 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8cf0807e-64ef-436e-993b-1d2159ed656a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:18.667908 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3459d45e-f852-4699-9204-17fedaa0a681 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:18.668004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8cf0807e-64ef-436e-993b-1d2159ed656a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:18.672992 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8cf0807e-64ef-436e-993b-1d2159ed656a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:18.673482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8cf0807e-64ef-436e-993b-1d2159ed656a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:18.673922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8cf0807e-64ef-436e-993b-1d2159ed656a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:18.674616 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8cf0807e-64ef-436e-993b-1d2159ed656a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:18.680132 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8cf0807e-64ef-436e-993b-1d2159ed656a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:18.681534 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8cf0807e-64ef-436e-993b-1d2159ed656a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:18.773334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3459d45e-f852-4699-9204-17fedaa0a681 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:18.782018 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3459d45e-f852-4699-9204-17fedaa0a681 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1233 microversion: 2.1 time: 0.140520 Aug 24 12:30:18.794901 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 21/41] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:18 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1233 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:18.814834 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8cf0807e-64ef-436e-993b-1d2159ed656a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:18.826768 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8cf0807e-64ef-436e-993b-1d2159ed656a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:18.829186 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8cf0807e-64ef-436e-993b-1d2159ed656a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:18.830332 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8cf0807e-64ef-436e-993b-1d2159ed656a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1332 microversion: 2.20 time: 0.169858 Aug 24 12:30:18.830953 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 21/42] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:18 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1332 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:19.033613 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1748dd83-3d90-42b5-9ee6-8d04cdcb3357 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:19.034311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1748dd83-3d90-42b5-9ee6-8d04cdcb3357 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:19.041246 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1748dd83-3d90-42b5-9ee6-8d04cdcb3357 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:19.042110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1748dd83-3d90-42b5-9ee6-8d04cdcb3357 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:19.042437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1748dd83-3d90-42b5-9ee6-8d04cdcb3357 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:19.043750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1748dd83-3d90-42b5-9ee6-8d04cdcb3357 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:19.044368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1748dd83-3d90-42b5-9ee6-8d04cdcb3357 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:19.044947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1748dd83-3d90-42b5-9ee6-8d04cdcb3357 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:19.164195 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1748dd83-3d90-42b5-9ee6-8d04cdcb3357 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:19.173219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1748dd83-3d90-42b5-9ee6-8d04cdcb3357 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1273 microversion: 2.1 time: 0.143827 Aug 24 12:30:19.178190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 22/43] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:19 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1273 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:19.197867 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-96557cf3-1d9e-4b73-995a-a694a002ce99 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:19.198895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-96557cf3-1d9e-4b73-995a-a694a002ce99 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:19.207102 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96557cf3-1d9e-4b73-995a-a694a002ce99 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:19.208331 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96557cf3-1d9e-4b73-995a-a694a002ce99 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:19.209338 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96557cf3-1d9e-4b73-995a-a694a002ce99 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:19.210227 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96557cf3-1d9e-4b73-995a-a694a002ce99 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:19.211170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96557cf3-1d9e-4b73-995a-a694a002ce99 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:19.211806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96557cf3-1d9e-4b73-995a-a694a002ce99 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:19.349534 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-96557cf3-1d9e-4b73-995a-a694a002ce99 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:19.363385 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-96557cf3-1d9e-4b73-995a-a694a002ce99 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1267 microversion: 2.1 time: 0.168477 Aug 24 12:30:19.363385 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 22/44] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:19 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:19.803547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fec533b8-5f2c-47c2-a0aa-35b1e6be9790 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:19.804444 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fec533b8-5f2c-47c2-a0aa-35b1e6be9790 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:19.812499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fec533b8-5f2c-47c2-a0aa-35b1e6be9790 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:19.821189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fec533b8-5f2c-47c2-a0aa-35b1e6be9790 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:19.821767 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fec533b8-5f2c-47c2-a0aa-35b1e6be9790 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:19.823466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fec533b8-5f2c-47c2-a0aa-35b1e6be9790 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:19.824635 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fec533b8-5f2c-47c2-a0aa-35b1e6be9790 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:19.830107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fec533b8-5f2c-47c2-a0aa-35b1e6be9790 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:19.855288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6eba8097-7e7c-4699-90f8-7a958785f680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:19.858767 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6eba8097-7e7c-4699-90f8-7a958785f680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:19.865980 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6eba8097-7e7c-4699-90f8-7a958785f680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:19.874168 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6eba8097-7e7c-4699-90f8-7a958785f680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:19.874938 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6eba8097-7e7c-4699-90f8-7a958785f680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:19.877917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6eba8097-7e7c-4699-90f8-7a958785f680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:19.883696 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6eba8097-7e7c-4699-90f8-7a958785f680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:19.884160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6eba8097-7e7c-4699-90f8-7a958785f680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:20.100501 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fec533b8-5f2c-47c2-a0aa-35b1e6be9790 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:20.113549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fec533b8-5f2c-47c2-a0aa-35b1e6be9790 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1289 microversion: 2.1 time: 0.312119 Aug 24 12:30:20.118786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6eba8097-7e7c-4699-90f8-7a958785f680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:20.128712 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 23/45] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:19 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1289 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:20.135430 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6eba8097-7e7c-4699-90f8-7a958785f680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:20.141559 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6eba8097-7e7c-4699-90f8-7a958785f680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:20.143426 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6eba8097-7e7c-4699-90f8-7a958785f680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1340 microversion: 2.20 time: 0.291937 Aug 24 12:30:20.150876 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 23/46] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:19 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1340 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:30:20.198078 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8dd1723f-956b-46b2-80f7-dcc1a9d4ded8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:20.201890 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8dd1723f-956b-46b2-80f7-dcc1a9d4ded8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:20.209960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8dd1723f-956b-46b2-80f7-dcc1a9d4ded8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:20.211350 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8dd1723f-956b-46b2-80f7-dcc1a9d4ded8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:20.213398 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8dd1723f-956b-46b2-80f7-dcc1a9d4ded8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:20.214881 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8dd1723f-956b-46b2-80f7-dcc1a9d4ded8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:20.216180 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8dd1723f-956b-46b2-80f7-dcc1a9d4ded8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:20.217745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8dd1723f-956b-46b2-80f7-dcc1a9d4ded8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:20.383509 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ecf942c0-f1ff-467e-b48a-177d29e27af8 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:20.384446 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ecf942c0-f1ff-467e-b48a-177d29e27af8 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:20.396469 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ecf942c0-f1ff-467e-b48a-177d29e27af8 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:20.398752 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ecf942c0-f1ff-467e-b48a-177d29e27af8 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:20.399883 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ecf942c0-f1ff-467e-b48a-177d29e27af8 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:20.401584 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ecf942c0-f1ff-467e-b48a-177d29e27af8 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:20.402478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ecf942c0-f1ff-467e-b48a-177d29e27af8 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:20.405865 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ecf942c0-f1ff-467e-b48a-177d29e27af8 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:20.611326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ecf942c0-f1ff-467e-b48a-177d29e27af8 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:20.648633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ecf942c0-f1ff-467e-b48a-177d29e27af8 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1275 microversion: 2.1 time: 0.270258 Aug 24 12:30:20.652179 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 24/47] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:20 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1275 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:20.909112 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8dd1723f-956b-46b2-80f7-dcc1a9d4ded8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:20.920927 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8dd1723f-956b-46b2-80f7-dcc1a9d4ded8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1281 microversion: 2.1 time: 0.726918 Aug 24 12:30:20.921526 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 24/48] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:20 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1281 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:21.147884 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fc5017ea-fa11-4966-9be9-26932dfb7a75 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:21.149741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fc5017ea-fa11-4966-9be9-26932dfb7a75 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:21.175402 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8e48a4b6-0dcc-4cfc-b3cc-7e631b95373e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:21.176839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8e48a4b6-0dcc-4cfc-b3cc-7e631b95373e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:21.182867 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc5017ea-fa11-4966-9be9-26932dfb7a75 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:21.183399 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc5017ea-fa11-4966-9be9-26932dfb7a75 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:21.183852 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc5017ea-fa11-4966-9be9-26932dfb7a75 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:21.190476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8e48a4b6-0dcc-4cfc-b3cc-7e631b95373e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:21.191002 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8e48a4b6-0dcc-4cfc-b3cc-7e631b95373e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:21.191634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8e48a4b6-0dcc-4cfc-b3cc-7e631b95373e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:21.196263 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc5017ea-fa11-4966-9be9-26932dfb7a75 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:21.202802 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc5017ea-fa11-4966-9be9-26932dfb7a75 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:21.203739 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc5017ea-fa11-4966-9be9-26932dfb7a75 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:21.205955 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8e48a4b6-0dcc-4cfc-b3cc-7e631b95373e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:21.209560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8e48a4b6-0dcc-4cfc-b3cc-7e631b95373e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:21.213963 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8e48a4b6-0dcc-4cfc-b3cc-7e631b95373e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:21.435803 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8e48a4b6-0dcc-4cfc-b3cc-7e631b95373e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:21.450353 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8e48a4b6-0dcc-4cfc-b3cc-7e631b95373e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:21.454337 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8e48a4b6-0dcc-4cfc-b3cc-7e631b95373e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:21.459645 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8e48a4b6-0dcc-4cfc-b3cc-7e631b95373e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1338 microversion: 2.20 time: 0.289898 Aug 24 12:30:21.461136 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 25/49] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:21 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1338 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:21.496630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fc5017ea-fa11-4966-9be9-26932dfb7a75 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:21.510119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fc5017ea-fa11-4966-9be9-26932dfb7a75 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1297 microversion: 2.1 time: 0.369586 Aug 24 12:30:21.526488 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 25/50] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:21 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1297 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:21.703656 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-68a90f26-78d6-4001-857f-b509b69ec20b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:21.704320 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-68a90f26-78d6-4001-857f-b509b69ec20b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:21.743879 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68a90f26-78d6-4001-857f-b509b69ec20b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:21.744396 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68a90f26-78d6-4001-857f-b509b69ec20b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:21.749153 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68a90f26-78d6-4001-857f-b509b69ec20b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:21.750070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68a90f26-78d6-4001-857f-b509b69ec20b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:21.753509 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68a90f26-78d6-4001-857f-b509b69ec20b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:21.755537 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68a90f26-78d6-4001-857f-b509b69ec20b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:21.949660 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-63173bb5-7284-4926-9dac-7ffa2ce482a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:21.950472 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-63173bb5-7284-4926-9dac-7ffa2ce482a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:21.965095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63173bb5-7284-4926-9dac-7ffa2ce482a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:21.970263 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63173bb5-7284-4926-9dac-7ffa2ce482a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:21.971122 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63173bb5-7284-4926-9dac-7ffa2ce482a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:21.972032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63173bb5-7284-4926-9dac-7ffa2ce482a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:21.973616 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63173bb5-7284-4926-9dac-7ffa2ce482a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:21.975102 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63173bb5-7284-4926-9dac-7ffa2ce482a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:22.276198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-68a90f26-78d6-4001-857f-b509b69ec20b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:22.290390 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-68a90f26-78d6-4001-857f-b509b69ec20b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1273 microversion: 2.1 time: 0.621778 Aug 24 12:30:22.291433 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 26/51] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:21 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1273 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:22.313498 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-63173bb5-7284-4926-9dac-7ffa2ce482a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:22.330536 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-63173bb5-7284-4926-9dac-7ffa2ce482a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1279 microversion: 2.1 time: 0.385017 Aug 24 12:30:22.331167 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 26/52] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:21 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1279 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:22.489180 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8ca18087-3e7e-427d-92d5-714ddfe493b0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:22.490200 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8ca18087-3e7e-427d-92d5-714ddfe493b0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:22.493865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:30:22.508312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ca18087-3e7e-427d-92d5-714ddfe493b0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:22.509264 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ca18087-3e7e-427d-92d5-714ddfe493b0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:22.511238 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ca18087-3e7e-427d-92d5-714ddfe493b0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:22.512166 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ca18087-3e7e-427d-92d5-714ddfe493b0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:22.514078 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ca18087-3e7e-427d-92d5-714ddfe493b0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:22.514608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ca18087-3e7e-427d-92d5-714ddfe493b0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:22.534962 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a652d01f-f46b-4ff0-887b-3e5ba7d2f7d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:22.536266 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a652d01f-f46b-4ff0-887b-3e5ba7d2f7d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:22.544365 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a652d01f-f46b-4ff0-887b-3e5ba7d2f7d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:22.547118 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a652d01f-f46b-4ff0-887b-3e5ba7d2f7d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:22.547574 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a652d01f-f46b-4ff0-887b-3e5ba7d2f7d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:22.548307 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a652d01f-f46b-4ff0-887b-3e5ba7d2f7d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:22.552649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a652d01f-f46b-4ff0-887b-3e5ba7d2f7d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:22.552649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a652d01f-f46b-4ff0-887b-3e5ba7d2f7d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:22.810258 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8ca18087-3e7e-427d-92d5-714ddfe493b0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:22.837868 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8ca18087-3e7e-427d-92d5-714ddfe493b0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:22.839737 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8ca18087-3e7e-427d-92d5-714ddfe493b0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:22.844971 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8ca18087-3e7e-427d-92d5-714ddfe493b0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1338 microversion: 2.20 time: 0.360788 Aug 24 12:30:22.845540 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 27/53] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:22 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1338 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:22.867374 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a652d01f-f46b-4ff0-887b-3e5ba7d2f7d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:22.889218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a652d01f-f46b-4ff0-887b-3e5ba7d2f7d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1295 microversion: 2.1 time: 0.359437 Aug 24 12:30:22.889908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 27/54] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:22 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1295 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:23.316259 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4160ea3e-45bf-4d51-836b-0b9fcab81ffe tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:23.319732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4160ea3e-45bf-4d51-836b-0b9fcab81ffe tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:23.344649 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4160ea3e-45bf-4d51-836b-0b9fcab81ffe tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:23.348165 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4160ea3e-45bf-4d51-836b-0b9fcab81ffe tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:23.349597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4160ea3e-45bf-4d51-836b-0b9fcab81ffe tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:23.353034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4160ea3e-45bf-4d51-836b-0b9fcab81ffe tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:23.353774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4160ea3e-45bf-4d51-836b-0b9fcab81ffe tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:23.355748 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4160ea3e-45bf-4d51-836b-0b9fcab81ffe tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:23.356693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4813b38e-fdc3-4fd7-8559-70b9d948b41b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:23.357477 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4813b38e-fdc3-4fd7-8559-70b9d948b41b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:23.372211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4813b38e-fdc3-4fd7-8559-70b9d948b41b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:23.372678 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4813b38e-fdc3-4fd7-8559-70b9d948b41b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:23.373113 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4813b38e-fdc3-4fd7-8559-70b9d948b41b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:23.374014 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4813b38e-fdc3-4fd7-8559-70b9d948b41b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:23.374567 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4813b38e-fdc3-4fd7-8559-70b9d948b41b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:23.395849 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4813b38e-fdc3-4fd7-8559-70b9d948b41b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:23.761246 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4813b38e-fdc3-4fd7-8559-70b9d948b41b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:23.773864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4813b38e-fdc3-4fd7-8559-70b9d948b41b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.420994 Aug 24 12:30:23.779902 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 28/55] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:23 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:23.872138 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6084283d-89d5-458a-a378-89b08f7d6996 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:23.873033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6084283d-89d5-458a-a378-89b08f7d6996 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:23.880625 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6084283d-89d5-458a-a378-89b08f7d6996 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:23.886866 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6084283d-89d5-458a-a378-89b08f7d6996 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:23.887491 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6084283d-89d5-458a-a378-89b08f7d6996 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:23.888685 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6084283d-89d5-458a-a378-89b08f7d6996 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:23.889299 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6084283d-89d5-458a-a378-89b08f7d6996 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:23.889887 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6084283d-89d5-458a-a378-89b08f7d6996 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:24.000705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6084283d-89d5-458a-a378-89b08f7d6996 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:24.010416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6084283d-89d5-458a-a378-89b08f7d6996 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:24.013177 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6084283d-89d5-458a-a378-89b08f7d6996 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:24.014969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6084283d-89d5-458a-a378-89b08f7d6996 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1338 microversion: 2.20 time: 0.148144 Aug 24 12:30:24.017117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 29/56] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:23 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1338 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:24.047389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fce07d5b-e3d1-4ade-b2a6-95194f086e6a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:24.048042 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fce07d5b-e3d1-4ade-b2a6-95194f086e6a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:24.064294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fce07d5b-e3d1-4ade-b2a6-95194f086e6a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:24.065095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fce07d5b-e3d1-4ade-b2a6-95194f086e6a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:24.065852 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fce07d5b-e3d1-4ade-b2a6-95194f086e6a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:24.067057 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fce07d5b-e3d1-4ade-b2a6-95194f086e6a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:24.067679 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fce07d5b-e3d1-4ade-b2a6-95194f086e6a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:24.068254 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fce07d5b-e3d1-4ade-b2a6-95194f086e6a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:24.078104 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4160ea3e-45bf-4d51-836b-0b9fcab81ffe tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:24.092183 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4160ea3e-45bf-4d51-836b-0b9fcab81ffe tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1273 microversion: 2.1 time: 0.779043 Aug 24 12:30:24.093237 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 28/57] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:23 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1273 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:24.241176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fce07d5b-e3d1-4ade-b2a6-95194f086e6a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:24.252367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fce07d5b-e3d1-4ade-b2a6-95194f086e6a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.218400 Aug 24 12:30:24.255562 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 30/58] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:24 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:24.813568 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7ea441fb-672f-4fbc-b99c-4d1382d2c20a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:24.814202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7ea441fb-672f-4fbc-b99c-4d1382d2c20a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:24.826076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=4 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:30:24.831185 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7ea441fb-672f-4fbc-b99c-4d1382d2c20a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:24.837930 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7ea441fb-672f-4fbc-b99c-4d1382d2c20a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:24.840222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7ea441fb-672f-4fbc-b99c-4d1382d2c20a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:24.841926 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7ea441fb-672f-4fbc-b99c-4d1382d2c20a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:24.844905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7ea441fb-672f-4fbc-b99c-4d1382d2c20a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:24.847331 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7ea441fb-672f-4fbc-b99c-4d1382d2c20a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:25.046477 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-17b64014-a818-4d4d-808e-bd2f37a6d913 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:25.050640 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-17b64014-a818-4d4d-808e-bd2f37a6d913 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:25.053735 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-17b64014-a818-4d4d-808e-bd2f37a6d913 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:25.054228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-17b64014-a818-4d4d-808e-bd2f37a6d913 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:25.054681 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-17b64014-a818-4d4d-808e-bd2f37a6d913 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:25.055392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-17b64014-a818-4d4d-808e-bd2f37a6d913 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:25.055851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-17b64014-a818-4d4d-808e-bd2f37a6d913 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:25.056288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-17b64014-a818-4d4d-808e-bd2f37a6d913 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:25.091401 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell0:SELECT=6 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:30:25.539910 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-17b64014-a818-4d4d-808e-bd2f37a6d913 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:25.557004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-17b64014-a818-4d4d-808e-bd2f37a6d913 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:25.566620 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-17b64014-a818-4d4d-808e-bd2f37a6d913 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:25.571074 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-17b64014-a818-4d4d-808e-bd2f37a6d913 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.528430 Aug 24 12:30:25.572773 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 31/59] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:25 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:25.581184 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-500914a3-49cc-460b-8b68-cf95a0d30268 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:25.583483 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-500914a3-49cc-460b-8b68-cf95a0d30268 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:25.597084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-500914a3-49cc-460b-8b68-cf95a0d30268 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:25.602899 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-500914a3-49cc-460b-8b68-cf95a0d30268 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:25.603645 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-500914a3-49cc-460b-8b68-cf95a0d30268 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:25.604586 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-500914a3-49cc-460b-8b68-cf95a0d30268 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:25.605242 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-500914a3-49cc-460b-8b68-cf95a0d30268 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:25.606061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-500914a3-49cc-460b-8b68-cf95a0d30268 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:25.779843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7ea441fb-672f-4fbc-b99c-4d1382d2c20a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:25.793485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7ea441fb-672f-4fbc-b99c-4d1382d2c20a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.985991 Aug 24 12:30:25.817103 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 29/60] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:24 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:25.823370 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fa5a1af2-d817-4f0c-8fa1-18471d60e77b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:25.824310 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fa5a1af2-d817-4f0c-8fa1-18471d60e77b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:25.842510 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa5a1af2-d817-4f0c-8fa1-18471d60e77b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:25.847361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa5a1af2-d817-4f0c-8fa1-18471d60e77b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:25.848560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa5a1af2-d817-4f0c-8fa1-18471d60e77b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:25.856855 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa5a1af2-d817-4f0c-8fa1-18471d60e77b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:25.858318 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa5a1af2-d817-4f0c-8fa1-18471d60e77b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:25.859014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa5a1af2-d817-4f0c-8fa1-18471d60e77b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:26.341086 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fa5a1af2-d817-4f0c-8fa1-18471d60e77b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:26.352680 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fa5a1af2-d817-4f0c-8fa1-18471d60e77b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.539698 Aug 24 12:30:26.357214 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 30/61] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:25 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:26.599545 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c68f9a3a-9826-4022-a4fd-9f2c0d2389d7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:26.605181 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c68f9a3a-9826-4022-a4fd-9f2c0d2389d7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:26.609235 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c68f9a3a-9826-4022-a4fd-9f2c0d2389d7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:26.609870 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c68f9a3a-9826-4022-a4fd-9f2c0d2389d7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:26.610307 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c68f9a3a-9826-4022-a4fd-9f2c0d2389d7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:26.611995 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c68f9a3a-9826-4022-a4fd-9f2c0d2389d7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:26.612598 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c68f9a3a-9826-4022-a4fd-9f2c0d2389d7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:26.613035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c68f9a3a-9826-4022-a4fd-9f2c0d2389d7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:26.730075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-500914a3-49cc-460b-8b68-cf95a0d30268 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:26.746449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-500914a3-49cc-460b-8b68-cf95a0d30268 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 1.172362 Aug 24 12:30:26.747222 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 32/62] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:25 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:26.820603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-262fce9b-c2c1-45f2-a7c6-4ee5387d823f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:26.821246 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-262fce9b-c2c1-45f2-a7c6-4ee5387d823f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:26.823339 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell0:SELECT=26 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:30:26.824612 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c68f9a3a-9826-4022-a4fd-9f2c0d2389d7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:26.828420 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-262fce9b-c2c1-45f2-a7c6-4ee5387d823f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:26.828978 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-262fce9b-c2c1-45f2-a7c6-4ee5387d823f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:26.829519 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-262fce9b-c2c1-45f2-a7c6-4ee5387d823f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:26.830214 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-262fce9b-c2c1-45f2-a7c6-4ee5387d823f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:26.830856 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-262fce9b-c2c1-45f2-a7c6-4ee5387d823f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:26.831433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-262fce9b-c2c1-45f2-a7c6-4ee5387d823f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:26.835360 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c68f9a3a-9826-4022-a4fd-9f2c0d2389d7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:26.840349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c68f9a3a-9826-4022-a4fd-9f2c0d2389d7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:26.841509 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c68f9a3a-9826-4022-a4fd-9f2c0d2389d7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.248331 Aug 24 12:30:26.842235 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 31/63] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:26 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:26.969809 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-262fce9b-c2c1-45f2-a7c6-4ee5387d823f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:26.977491 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-262fce9b-c2c1-45f2-a7c6-4ee5387d823f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.161873 Aug 24 12:30:26.978050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 33/64] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:26 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:27.384058 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c7bf07b9-1980-443a-ac63-b00994d567c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:27.385020 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c7bf07b9-1980-443a-ac63-b00994d567c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:27.407707 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7bf07b9-1980-443a-ac63-b00994d567c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:27.408231 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7bf07b9-1980-443a-ac63-b00994d567c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:27.408680 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7bf07b9-1980-443a-ac63-b00994d567c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:27.409414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7bf07b9-1980-443a-ac63-b00994d567c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:27.409868 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7bf07b9-1980-443a-ac63-b00994d567c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:27.410753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7bf07b9-1980-443a-ac63-b00994d567c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:27.437683 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:30:27.586339 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-43e9182e-bd2c-487b-a116-63765e1d5ea8 req-ca66019f-1fff-4d37-8d47-8ad98c3eb483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "720992f6-0031-4c2a-801d-07a71dd87158", "tag": "ffb749d1-7131-4112-a58f-5f3e9cc94cd1"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:30:27.600793 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c7bf07b9-1980-443a-ac63-b00994d567c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:27.612374 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c7bf07b9-1980-443a-ac63-b00994d567c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.232029 Aug 24 12:30:27.612944 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 34/65] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:27 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:27.616014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-43e9182e-bd2c-487b-a116-63765e1d5ea8 req-ca66019f-1fff-4d37-8d47-8ad98c3eb483 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:27.619093 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-43e9182e-bd2c-487b-a116-63765e1d5ea8 req-ca66019f-1fff-4d37-8d47-8ad98c3eb483 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:27.619651 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-43e9182e-bd2c-487b-a116-63765e1d5ea8 req-ca66019f-1fff-4d37-8d47-8ad98c3eb483 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:27.626373 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=32 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:30:27.669852 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-43e9182e-bd2c-487b-a116-63765e1d5ea8 req-ca66019f-1fff-4d37-8d47-8ad98c3eb483 service nova] Creating event network-changed:ffb749d1-7131-4112-a58f-5f3e9cc94cd1 for instance 720992f6-0031-4c2a-801d-07a71dd87158 on hv-cinder-84889 Aug 24 12:30:27.675493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-43e9182e-bd2c-487b-a116-63765e1d5ea8 req-ca66019f-1fff-4d37-8d47-8ad98c3eb483 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121171) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 12:30:27.676802 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-43e9182e-bd2c-487b-a116-63765e1d5ea8 req-ca66019f-1fff-4d37-8d47-8ad98c3eb483 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121171) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 12:30:27.679082 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4e5408e5-dda2-4c59-970b-3b43f7577179 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:27.679634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4e5408e5-dda2-4c59-970b-3b43f7577179 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:27.680163 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4e5408e5-dda2-4c59-970b-3b43f7577179 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:27.681219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4e5408e5-dda2-4c59-970b-3b43f7577179 None None] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:27.681878 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4e5408e5-dda2-4c59-970b-3b43f7577179 None None] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:27.682520 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4e5408e5-dda2-4c59-970b-3b43f7577179 None None] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:27.696925 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.compute.rpcapi [None req-4e5408e5-dda2-4c59-970b-3b43f7577179 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 12:30:27.696925 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4e5408e5-dda2-4c59-970b-3b43f7577179 None None] Releasing lock "compute-rpcapi-router" {{(pid=121171) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 12:30:27.722171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4e5408e5-dda2-4c59-970b-3b43f7577179 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.391978 Aug 24 12:30:27.727845 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 32/66] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:30:27.770514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-19449fe6-0838-4a79-9037-52cc0939d759 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:27.771242 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-19449fe6-0838-4a79-9037-52cc0939d759 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:27.777358 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19449fe6-0838-4a79-9037-52cc0939d759 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:27.779651 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19449fe6-0838-4a79-9037-52cc0939d759 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:27.779651 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19449fe6-0838-4a79-9037-52cc0939d759 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:27.779651 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19449fe6-0838-4a79-9037-52cc0939d759 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:27.779651 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19449fe6-0838-4a79-9037-52cc0939d759 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:27.782849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19449fe6-0838-4a79-9037-52cc0939d759 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:27.785188 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-5fc4f4df-2228-422a-8ad5-494a276f0334 req-865f7721-543a-4c58-af0f-556187828b98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfbf55c1-60d6-43b4-8a03-84d8ae291daf", "tag": "3af0c2af-a730-4f85-a3a0-41267820e2f3"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:30:27.793650 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:30:27.797660 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-5fc4f4df-2228-422a-8ad5-494a276f0334 req-865f7721-543a-4c58-af0f-556187828b98 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:27.798294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-5fc4f4df-2228-422a-8ad5-494a276f0334 req-865f7721-543a-4c58-af0f-556187828b98 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:27.798920 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-5fc4f4df-2228-422a-8ad5-494a276f0334 req-865f7721-543a-4c58-af0f-556187828b98 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:27.820283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-5fc4f4df-2228-422a-8ad5-494a276f0334 req-865f7721-543a-4c58-af0f-556187828b98 service nova] Creating event network-changed:3af0c2af-a730-4f85-a3a0-41267820e2f3 for instance cfbf55c1-60d6-43b4-8a03-84d8ae291daf on hv-cinder-84889 Aug 24 12:30:27.820806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-5fc4f4df-2228-422a-8ad5-494a276f0334 req-865f7721-543a-4c58-af0f-556187828b98 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121170) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 12:30:27.821195 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-5fc4f4df-2228-422a-8ad5-494a276f0334 req-865f7721-543a-4c58-af0f-556187828b98 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121170) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 12:30:27.822213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c8477cde-c488-4adf-8324-778306ac4467 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:27.822730 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c8477cde-c488-4adf-8324-778306ac4467 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:27.823283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c8477cde-c488-4adf-8324-778306ac4467 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:27.824052 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c8477cde-c488-4adf-8324-778306ac4467 None None] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:27.824499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c8477cde-c488-4adf-8324-778306ac4467 None None] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:27.824919 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c8477cde-c488-4adf-8324-778306ac4467 None None] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:27.837160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.compute.rpcapi [None req-c8477cde-c488-4adf-8324-778306ac4467 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 12:30:27.837160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c8477cde-c488-4adf-8324-778306ac4467 None None] Releasing lock "compute-rpcapi-router" {{(pid=121170) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 12:30:27.851039 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c8477cde-c488-4adf-8324-778306ac4467 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126918 Aug 24 12:30:27.851936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 35/67] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:30:27.865078 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-049450ab-0b81-49b9-90e8-90012e498635 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:27.865780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-049450ab-0b81-49b9-90e8-90012e498635 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:27.871797 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-049450ab-0b81-49b9-90e8-90012e498635 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:27.872276 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-049450ab-0b81-49b9-90e8-90012e498635 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:27.872711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-049450ab-0b81-49b9-90e8-90012e498635 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:27.873530 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-049450ab-0b81-49b9-90e8-90012e498635 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:27.873838 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-049450ab-0b81-49b9-90e8-90012e498635 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:27.874271 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-049450ab-0b81-49b9-90e8-90012e498635 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:27.928896 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-19449fe6-0838-4a79-9037-52cc0939d759 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:27.937258 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-19449fe6-0838-4a79-9037-52cc0939d759 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.171614 Aug 24 12:30:27.937827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 33/68] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:27 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:27.997746 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-43336eed-b1c6-4cad-86ba-1c131bb2dac0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:27.998454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-43336eed-b1c6-4cad-86ba-1c131bb2dac0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:28.005283 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43336eed-b1c6-4cad-86ba-1c131bb2dac0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:28.005853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43336eed-b1c6-4cad-86ba-1c131bb2dac0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:28.006481 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43336eed-b1c6-4cad-86ba-1c131bb2dac0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:28.007196 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43336eed-b1c6-4cad-86ba-1c131bb2dac0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:28.007675 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43336eed-b1c6-4cad-86ba-1c131bb2dac0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:28.008257 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43336eed-b1c6-4cad-86ba-1c131bb2dac0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:28.015535 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-049450ab-0b81-49b9-90e8-90012e498635 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:28.023670 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-049450ab-0b81-49b9-90e8-90012e498635 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:28.025169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-049450ab-0b81-49b9-90e8-90012e498635 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:28.026458 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-049450ab-0b81-49b9-90e8-90012e498635 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.166375 Aug 24 12:30:28.027049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 36/69] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:27 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:30:28.145670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-43336eed-b1c6-4cad-86ba-1c131bb2dac0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:28.159298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-43336eed-b1c6-4cad-86ba-1c131bb2dac0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.159959 Aug 24 12:30:28.159298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 34/70] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:27 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:28.633663 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-212ce45d-732a-4c3c-84e1-d5d1aa015765 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:28.634394 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-212ce45d-732a-4c3c-84e1-d5d1aa015765 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:28.643633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-212ce45d-732a-4c3c-84e1-d5d1aa015765 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:28.644152 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-212ce45d-732a-4c3c-84e1-d5d1aa015765 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:28.645106 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-212ce45d-732a-4c3c-84e1-d5d1aa015765 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:28.645812 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-212ce45d-732a-4c3c-84e1-d5d1aa015765 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:28.646239 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-212ce45d-732a-4c3c-84e1-d5d1aa015765 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:28.646641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-212ce45d-732a-4c3c-84e1-d5d1aa015765 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:28.789093 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-212ce45d-732a-4c3c-84e1-d5d1aa015765 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:28.798267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-212ce45d-732a-4c3c-84e1-d5d1aa015765 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.168682 Aug 24 12:30:28.799234 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 37/71] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:28 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:28.959311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5d7b6046-7d7a-4f42-a1f9-2d0e923ef6f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:28.960664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5d7b6046-7d7a-4f42-a1f9-2d0e923ef6f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:28.967904 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d7b6046-7d7a-4f42-a1f9-2d0e923ef6f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:28.972866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d7b6046-7d7a-4f42-a1f9-2d0e923ef6f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:28.972866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d7b6046-7d7a-4f42-a1f9-2d0e923ef6f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:28.972866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d7b6046-7d7a-4f42-a1f9-2d0e923ef6f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:28.972866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d7b6046-7d7a-4f42-a1f9-2d0e923ef6f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:28.973234 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d7b6046-7d7a-4f42-a1f9-2d0e923ef6f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:28.976361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:30:29.048426 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-034c1d7d-4c52-4014-a33a-2d3f0b462d5a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:29.049750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-034c1d7d-4c52-4014-a33a-2d3f0b462d5a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:29.059733 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-034c1d7d-4c52-4014-a33a-2d3f0b462d5a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:29.059733 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-034c1d7d-4c52-4014-a33a-2d3f0b462d5a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:29.059733 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-034c1d7d-4c52-4014-a33a-2d3f0b462d5a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:29.059733 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-034c1d7d-4c52-4014-a33a-2d3f0b462d5a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:29.060300 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-034c1d7d-4c52-4014-a33a-2d3f0b462d5a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:29.060382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-034c1d7d-4c52-4014-a33a-2d3f0b462d5a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:29.113713 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5d7b6046-7d7a-4f42-a1f9-2d0e923ef6f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:29.123027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5d7b6046-7d7a-4f42-a1f9-2d0e923ef6f4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.168381 Aug 24 12:30:29.126006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 35/72] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:28 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:29.177668 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-154f70f9-b20d-4040-9f91-7d3a1b3249d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:29.177668 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-154f70f9-b20d-4040-9f91-7d3a1b3249d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:29.181089 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-154f70f9-b20d-4040-9f91-7d3a1b3249d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:29.181578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-154f70f9-b20d-4040-9f91-7d3a1b3249d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:29.182357 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-154f70f9-b20d-4040-9f91-7d3a1b3249d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:29.182952 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-154f70f9-b20d-4040-9f91-7d3a1b3249d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:29.183407 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-154f70f9-b20d-4040-9f91-7d3a1b3249d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:29.183883 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-154f70f9-b20d-4040-9f91-7d3a1b3249d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:29.203583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-034c1d7d-4c52-4014-a33a-2d3f0b462d5a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:29.213265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-034c1d7d-4c52-4014-a33a-2d3f0b462d5a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:29.215012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-034c1d7d-4c52-4014-a33a-2d3f0b462d5a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:29.216378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-034c1d7d-4c52-4014-a33a-2d3f0b462d5a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.171747 Aug 24 12:30:29.219819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 38/73] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:29 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:30:29.337958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-154f70f9-b20d-4040-9f91-7d3a1b3249d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:29.345728 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-154f70f9-b20d-4040-9f91-7d3a1b3249d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.175670 Aug 24 12:30:29.346286 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 36/74] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:29 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:29.740840 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-0fa62b17-6514-417d-a43f-8cac73c9cfe0 req-b0e139b5-f00c-4ed1-a0e2-4b6652255276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ddbf1cc-0de1-41f8-978c-26dd51882ff6", "tag": "8204f260-00d2-4dec-9d81-53db68f227e8"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:30:29.750111 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-0fa62b17-6514-417d-a43f-8cac73c9cfe0 req-b0e139b5-f00c-4ed1-a0e2-4b6652255276 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:29.751384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-0fa62b17-6514-417d-a43f-8cac73c9cfe0 req-b0e139b5-f00c-4ed1-a0e2-4b6652255276 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:29.751384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-0fa62b17-6514-417d-a43f-8cac73c9cfe0 req-b0e139b5-f00c-4ed1-a0e2-4b6652255276 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:29.761326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-0fa62b17-6514-417d-a43f-8cac73c9cfe0 req-b0e139b5-f00c-4ed1-a0e2-4b6652255276 service nova] Creating event network-changed:8204f260-00d2-4dec-9d81-53db68f227e8 for instance 1ddbf1cc-0de1-41f8-978c-26dd51882ff6 on hv-cinder-84889 Aug 24 12:30:29.766078 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-0fa62b17-6514-417d-a43f-8cac73c9cfe0 req-b0e139b5-f00c-4ed1-a0e2-4b6652255276 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030139 Aug 24 12:30:29.766635 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 39/75] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:30:29.820290 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-de04e0bb-fc29-4dd0-831e-abbc87714f79 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:29.825649 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-de04e0bb-fc29-4dd0-831e-abbc87714f79 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:29.827131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de04e0bb-fc29-4dd0-831e-abbc87714f79 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:29.827620 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de04e0bb-fc29-4dd0-831e-abbc87714f79 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:29.828061 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de04e0bb-fc29-4dd0-831e-abbc87714f79 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:29.828756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de04e0bb-fc29-4dd0-831e-abbc87714f79 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:29.829211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de04e0bb-fc29-4dd0-831e-abbc87714f79 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:29.829767 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de04e0bb-fc29-4dd0-831e-abbc87714f79 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:29.962826 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-de04e0bb-fc29-4dd0-831e-abbc87714f79 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:29.970525 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-de04e0bb-fc29-4dd0-831e-abbc87714f79 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.154738 Aug 24 12:30:29.971104 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 37/76] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:29 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:30.145424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-918dab5e-81a2-4772-ad63-2734ba5ccf8b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:30.146113 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-918dab5e-81a2-4772-ad63-2734ba5ccf8b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:30.152521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-918dab5e-81a2-4772-ad63-2734ba5ccf8b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:30.153005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-918dab5e-81a2-4772-ad63-2734ba5ccf8b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:30.153552 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-918dab5e-81a2-4772-ad63-2734ba5ccf8b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:30.154290 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-918dab5e-81a2-4772-ad63-2734ba5ccf8b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:30.154996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-918dab5e-81a2-4772-ad63-2734ba5ccf8b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:30.155425 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-918dab5e-81a2-4772-ad63-2734ba5ccf8b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:30.242214 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f4b00dae-b46c-484b-986a-58aa9fe41687 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:30.243096 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f4b00dae-b46c-484b-986a-58aa9fe41687 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:30.250169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4b00dae-b46c-484b-986a-58aa9fe41687 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:30.250690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4b00dae-b46c-484b-986a-58aa9fe41687 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:30.251134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4b00dae-b46c-484b-986a-58aa9fe41687 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:30.251830 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4b00dae-b46c-484b-986a-58aa9fe41687 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:30.252286 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4b00dae-b46c-484b-986a-58aa9fe41687 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:30.252711 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4b00dae-b46c-484b-986a-58aa9fe41687 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:30.304961 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-918dab5e-81a2-4772-ad63-2734ba5ccf8b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:30.316063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-918dab5e-81a2-4772-ad63-2734ba5ccf8b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.175259 Aug 24 12:30:30.320919 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 40/77] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:30 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:30.366498 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-82ed2541-100d-4e36-9dcf-8eed1b027362 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:30.367629 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-82ed2541-100d-4e36-9dcf-8eed1b027362 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:30.380476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-82ed2541-100d-4e36-9dcf-8eed1b027362 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:30.380700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-82ed2541-100d-4e36-9dcf-8eed1b027362 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:30.381251 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-82ed2541-100d-4e36-9dcf-8eed1b027362 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:30.381959 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-82ed2541-100d-4e36-9dcf-8eed1b027362 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:30.382415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-82ed2541-100d-4e36-9dcf-8eed1b027362 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:30.383095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-82ed2541-100d-4e36-9dcf-8eed1b027362 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:30.436994 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f4b00dae-b46c-484b-986a-58aa9fe41687 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:30.447889 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f4b00dae-b46c-484b-986a-58aa9fe41687 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:30.450141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f4b00dae-b46c-484b-986a-58aa9fe41687 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:30.451468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f4b00dae-b46c-484b-986a-58aa9fe41687 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.213393 Aug 24 12:30:30.452334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 38/78] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:30 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:30:30.526887 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-82ed2541-100d-4e36-9dcf-8eed1b027362 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:30.534571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-82ed2541-100d-4e36-9dcf-8eed1b027362 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.173002 Aug 24 12:30:30.535189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 41/79] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:30 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:30.998886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-88e093c8-51e5-4ffb-9e7a-ebe3a2650430 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:30.999526 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-88e093c8-51e5-4ffb-9e7a-ebe3a2650430 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:31.006588 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88e093c8-51e5-4ffb-9e7a-ebe3a2650430 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:31.007617 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88e093c8-51e5-4ffb-9e7a-ebe3a2650430 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:31.008232 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88e093c8-51e5-4ffb-9e7a-ebe3a2650430 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:31.009349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88e093c8-51e5-4ffb-9e7a-ebe3a2650430 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:31.011356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88e093c8-51e5-4ffb-9e7a-ebe3a2650430 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:31.013322 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88e093c8-51e5-4ffb-9e7a-ebe3a2650430 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:31.180416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-88e093c8-51e5-4ffb-9e7a-ebe3a2650430 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:31.193773 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-88e093c8-51e5-4ffb-9e7a-ebe3a2650430 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.201993 Aug 24 12:30:31.194940 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 39/80] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:30 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:31.344362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-13d0f362-50f2-4d25-a8e5-023c886d2881 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:31.344983 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-13d0f362-50f2-4d25-a8e5-023c886d2881 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:31.354539 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13d0f362-50f2-4d25-a8e5-023c886d2881 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:31.355071 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13d0f362-50f2-4d25-a8e5-023c886d2881 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:31.355751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13d0f362-50f2-4d25-a8e5-023c886d2881 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:31.356473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13d0f362-50f2-4d25-a8e5-023c886d2881 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:31.356948 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13d0f362-50f2-4d25-a8e5-023c886d2881 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:31.358549 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13d0f362-50f2-4d25-a8e5-023c886d2881 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:31.477119 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3cdde377-6a95-4e10-a175-f4553b231fbe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:31.477942 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3cdde377-6a95-4e10-a175-f4553b231fbe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:31.486213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3cdde377-6a95-4e10-a175-f4553b231fbe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:31.486851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3cdde377-6a95-4e10-a175-f4553b231fbe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:31.487472 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3cdde377-6a95-4e10-a175-f4553b231fbe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:31.489210 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3cdde377-6a95-4e10-a175-f4553b231fbe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:31.490812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3cdde377-6a95-4e10-a175-f4553b231fbe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:31.491389 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3cdde377-6a95-4e10-a175-f4553b231fbe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:31.519986 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-13d0f362-50f2-4d25-a8e5-023c886d2881 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:31.558709 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-13d0f362-50f2-4d25-a8e5-023c886d2881 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.224030 Aug 24 12:30:31.559626 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 42/81] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:31 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:31.568317 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-77248b8e-8d79-4289-bcec-31f780c6f45c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:31.569715 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-77248b8e-8d79-4289-bcec-31f780c6f45c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:31.587033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-77248b8e-8d79-4289-bcec-31f780c6f45c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:31.589080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-77248b8e-8d79-4289-bcec-31f780c6f45c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:31.591482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-77248b8e-8d79-4289-bcec-31f780c6f45c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:31.594989 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-77248b8e-8d79-4289-bcec-31f780c6f45c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:31.595471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-77248b8e-8d79-4289-bcec-31f780c6f45c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:31.598187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-77248b8e-8d79-4289-bcec-31f780c6f45c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:31.699004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3cdde377-6a95-4e10-a175-f4553b231fbe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:31.731821 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3cdde377-6a95-4e10-a175-f4553b231fbe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:31.734347 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3cdde377-6a95-4e10-a175-f4553b231fbe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:31.745277 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3cdde377-6a95-4e10-a175-f4553b231fbe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.263868 Aug 24 12:30:31.746103 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 40/82] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:31 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:31.842708 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-77248b8e-8d79-4289-bcec-31f780c6f45c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:31.852226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-77248b8e-8d79-4289-bcec-31f780c6f45c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.289637 Aug 24 12:30:31.853602 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 43/83] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:31 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:32.216967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-95b836ea-1446-453f-ae06-208415500639 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:32.217571 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-95b836ea-1446-453f-ae06-208415500639 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:32.225083 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-95b836ea-1446-453f-ae06-208415500639 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:32.225851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-95b836ea-1446-453f-ae06-208415500639 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:32.226288 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-95b836ea-1446-453f-ae06-208415500639 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:32.227450 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-95b836ea-1446-453f-ae06-208415500639 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:32.227450 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-95b836ea-1446-453f-ae06-208415500639 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:32.227855 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-95b836ea-1446-453f-ae06-208415500639 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:32.428115 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-95b836ea-1446-453f-ae06-208415500639 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:32.428115 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-95b836ea-1446-453f-ae06-208415500639 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.195722 Aug 24 12:30:32.428115 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 41/84] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:32 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:32.582491 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-edb08760-8948-42b2-992c-a5c176e16aad tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:32.583843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-edb08760-8948-42b2-992c-a5c176e16aad tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:32.595555 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edb08760-8948-42b2-992c-a5c176e16aad tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:32.596044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edb08760-8948-42b2-992c-a5c176e16aad tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:32.597157 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edb08760-8948-42b2-992c-a5c176e16aad tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:32.598818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edb08760-8948-42b2-992c-a5c176e16aad tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:32.600806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edb08760-8948-42b2-992c-a5c176e16aad tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:32.601292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edb08760-8948-42b2-992c-a5c176e16aad tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:32.766430 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-edb08760-8948-42b2-992c-a5c176e16aad tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:32.768553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-14d3d5d8-c1c7-4fdb-839c-1d31f159e508 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:32.769376 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-14d3d5d8-c1c7-4fdb-839c-1d31f159e508 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:32.777033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14d3d5d8-c1c7-4fdb-839c-1d31f159e508 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:32.781233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14d3d5d8-c1c7-4fdb-839c-1d31f159e508 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:32.781945 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14d3d5d8-c1c7-4fdb-839c-1d31f159e508 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:32.782911 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14d3d5d8-c1c7-4fdb-839c-1d31f159e508 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:32.783526 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14d3d5d8-c1c7-4fdb-839c-1d31f159e508 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:32.784120 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14d3d5d8-c1c7-4fdb-839c-1d31f159e508 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:32.784250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-edb08760-8948-42b2-992c-a5c176e16aad tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.207630 Aug 24 12:30:32.790511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 44/85] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:32 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:32.875697 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1b9bfa33-d519-4011-bb28-eb77642ac380 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:32.876585 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1b9bfa33-d519-4011-bb28-eb77642ac380 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:32.891783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b9bfa33-d519-4011-bb28-eb77642ac380 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:32.893780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b9bfa33-d519-4011-bb28-eb77642ac380 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:32.893780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b9bfa33-d519-4011-bb28-eb77642ac380 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:32.895763 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b9bfa33-d519-4011-bb28-eb77642ac380 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:32.896467 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b9bfa33-d519-4011-bb28-eb77642ac380 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:32.897056 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b9bfa33-d519-4011-bb28-eb77642ac380 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:32.995370 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-14d3d5d8-c1c7-4fdb-839c-1d31f159e508 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:33.005081 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-14d3d5d8-c1c7-4fdb-839c-1d31f159e508 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:33.021095 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-14d3d5d8-c1c7-4fdb-839c-1d31f159e508 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:33.021095 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-14d3d5d8-c1c7-4fdb-839c-1d31f159e508 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.252424 Aug 24 12:30:33.021095 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 42/86] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:32 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:30:33.078737 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1b9bfa33-d519-4011-bb28-eb77642ac380 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:33.087340 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1b9bfa33-d519-4011-bb28-eb77642ac380 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.216354 Aug 24 12:30:33.088507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 45/87] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:32 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:33.432601 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4ccc3474-8aaf-4aee-9cea-8e84ef6bdf84 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:33.434429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4ccc3474-8aaf-4aee-9cea-8e84ef6bdf84 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:33.442091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ccc3474-8aaf-4aee-9cea-8e84ef6bdf84 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:33.444618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ccc3474-8aaf-4aee-9cea-8e84ef6bdf84 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:33.444618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ccc3474-8aaf-4aee-9cea-8e84ef6bdf84 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:33.444618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ccc3474-8aaf-4aee-9cea-8e84ef6bdf84 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:33.444618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ccc3474-8aaf-4aee-9cea-8e84ef6bdf84 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:33.445178 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ccc3474-8aaf-4aee-9cea-8e84ef6bdf84 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:33.729904 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4ccc3474-8aaf-4aee-9cea-8e84ef6bdf84 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:33.746186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4ccc3474-8aaf-4aee-9cea-8e84ef6bdf84 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.312281 Aug 24 12:30:33.759527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 43/88] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:33 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:33.809215 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-274d0ef9-5ac6-44c6-a25b-ebaf03070260 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:33.811632 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-274d0ef9-5ac6-44c6-a25b-ebaf03070260 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:33.820387 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-274d0ef9-5ac6-44c6-a25b-ebaf03070260 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:33.823647 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-274d0ef9-5ac6-44c6-a25b-ebaf03070260 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:33.824347 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-274d0ef9-5ac6-44c6-a25b-ebaf03070260 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:33.828077 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-274d0ef9-5ac6-44c6-a25b-ebaf03070260 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:33.828824 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-274d0ef9-5ac6-44c6-a25b-ebaf03070260 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:33.831445 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-274d0ef9-5ac6-44c6-a25b-ebaf03070260 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:34.046675 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-066946da-b3f2-4a48-913b-84c2d0e0883d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:34.047294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-066946da-b3f2-4a48-913b-84c2d0e0883d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:34.055924 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-066946da-b3f2-4a48-913b-84c2d0e0883d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:34.056423 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-066946da-b3f2-4a48-913b-84c2d0e0883d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:34.060185 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-066946da-b3f2-4a48-913b-84c2d0e0883d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:34.060185 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-066946da-b3f2-4a48-913b-84c2d0e0883d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:34.060476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-066946da-b3f2-4a48-913b-84c2d0e0883d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:34.060644 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-066946da-b3f2-4a48-913b-84c2d0e0883d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:34.077645 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-274d0ef9-5ac6-44c6-a25b-ebaf03070260 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:34.088719 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-274d0ef9-5ac6-44c6-a25b-ebaf03070260 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.283662 Aug 24 12:30:34.095134 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 46/89] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:33 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:34.121922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ed5e014c-20c5-4a77-bbca-790a3600c51a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:34.123864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ed5e014c-20c5-4a77-bbca-790a3600c51a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:34.136366 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ed5e014c-20c5-4a77-bbca-790a3600c51a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:34.136692 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ed5e014c-20c5-4a77-bbca-790a3600c51a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:34.137122 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ed5e014c-20c5-4a77-bbca-790a3600c51a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:34.138085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ed5e014c-20c5-4a77-bbca-790a3600c51a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:34.138532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ed5e014c-20c5-4a77-bbca-790a3600c51a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:34.139020 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ed5e014c-20c5-4a77-bbca-790a3600c51a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:34.377739 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-066946da-b3f2-4a48-913b-84c2d0e0883d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:34.398215 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-066946da-b3f2-4a48-913b-84c2d0e0883d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:34.412624 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-066946da-b3f2-4a48-913b-84c2d0e0883d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:34.413888 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-066946da-b3f2-4a48-913b-84c2d0e0883d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.377231 Aug 24 12:30:34.426765 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 44/90] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:34 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:34.479280 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ed5e014c-20c5-4a77-bbca-790a3600c51a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:34.492710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ed5e014c-20c5-4a77-bbca-790a3600c51a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.384787 Aug 24 12:30:34.520355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 47/91] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:34 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:34.773530 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-72add86a-1ef8-49c7-a521-0d1f8bfd7aa8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:34.774860 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-72add86a-1ef8-49c7-a521-0d1f8bfd7aa8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:34.790967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-72add86a-1ef8-49c7-a521-0d1f8bfd7aa8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:34.792131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-72add86a-1ef8-49c7-a521-0d1f8bfd7aa8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:34.792738 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-72add86a-1ef8-49c7-a521-0d1f8bfd7aa8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:34.794585 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-72add86a-1ef8-49c7-a521-0d1f8bfd7aa8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:34.795077 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-72add86a-1ef8-49c7-a521-0d1f8bfd7aa8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:34.795511 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-72add86a-1ef8-49c7-a521-0d1f8bfd7aa8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:34.961145 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-72add86a-1ef8-49c7-a521-0d1f8bfd7aa8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:34.971452 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-72add86a-1ef8-49c7-a521-0d1f8bfd7aa8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.204938 Aug 24 12:30:34.972029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 45/92] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:34 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:35.118991 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e7bf6136-2a05-4346-837c-e978065b4099 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:35.120442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e7bf6136-2a05-4346-837c-e978065b4099 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:35.126471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e7bf6136-2a05-4346-837c-e978065b4099 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:35.127083 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e7bf6136-2a05-4346-837c-e978065b4099 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:35.127602 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e7bf6136-2a05-4346-837c-e978065b4099 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:35.128365 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e7bf6136-2a05-4346-837c-e978065b4099 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:35.129446 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e7bf6136-2a05-4346-837c-e978065b4099 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:35.130100 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e7bf6136-2a05-4346-837c-e978065b4099 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:35.289178 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e7bf6136-2a05-4346-837c-e978065b4099 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:35.299861 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e7bf6136-2a05-4346-837c-e978065b4099 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.186547 Aug 24 12:30:35.313260 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 48/93] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:35 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:35.443003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-19f8ab2b-863c-46dd-89a7-38de7cbbd2aa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:35.443732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-19f8ab2b-863c-46dd-89a7-38de7cbbd2aa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:35.450035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19f8ab2b-863c-46dd-89a7-38de7cbbd2aa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:35.452027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19f8ab2b-863c-46dd-89a7-38de7cbbd2aa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:35.452027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19f8ab2b-863c-46dd-89a7-38de7cbbd2aa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:35.452630 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19f8ab2b-863c-46dd-89a7-38de7cbbd2aa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:35.453207 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19f8ab2b-863c-46dd-89a7-38de7cbbd2aa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:35.454160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19f8ab2b-863c-46dd-89a7-38de7cbbd2aa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:35.513927 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ec1c9cf1-afe8-4b37-806c-799fab87d4f4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:35.515487 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ec1c9cf1-afe8-4b37-806c-799fab87d4f4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:35.522517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec1c9cf1-afe8-4b37-806c-799fab87d4f4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:35.523361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec1c9cf1-afe8-4b37-806c-799fab87d4f4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:35.524626 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec1c9cf1-afe8-4b37-806c-799fab87d4f4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:35.530743 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec1c9cf1-afe8-4b37-806c-799fab87d4f4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:35.533691 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec1c9cf1-afe8-4b37-806c-799fab87d4f4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:35.536259 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec1c9cf1-afe8-4b37-806c-799fab87d4f4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:35.637240 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-19f8ab2b-863c-46dd-89a7-38de7cbbd2aa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:35.647484 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-19f8ab2b-863c-46dd-89a7-38de7cbbd2aa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:35.649282 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-19f8ab2b-863c-46dd-89a7-38de7cbbd2aa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:35.650773 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-19f8ab2b-863c-46dd-89a7-38de7cbbd2aa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.216384 Aug 24 12:30:35.663400 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 46/94] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:35 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:30:35.733928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ec1c9cf1-afe8-4b37-806c-799fab87d4f4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:35.754338 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ec1c9cf1-afe8-4b37-806c-799fab87d4f4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.245032 Aug 24 12:30:35.759136 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 49/95] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:35 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:35.999748 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3690c331-f16f-4616-b798-d9730210389b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:36.001039 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3690c331-f16f-4616-b798-d9730210389b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:36.012589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3690c331-f16f-4616-b798-d9730210389b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:36.018075 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3690c331-f16f-4616-b798-d9730210389b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:36.018075 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3690c331-f16f-4616-b798-d9730210389b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:36.018075 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3690c331-f16f-4616-b798-d9730210389b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:36.018075 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3690c331-f16f-4616-b798-d9730210389b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:36.018570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3690c331-f16f-4616-b798-d9730210389b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:36.298554 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3690c331-f16f-4616-b798-d9730210389b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:36.310488 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3690c331-f16f-4616-b798-d9730210389b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.319418 Aug 24 12:30:36.311271 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 47/96] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:35 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:36.332158 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d912a8f1-2a05-43d3-bc09-c89ff238d957 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:36.332158 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d912a8f1-2a05-43d3-bc09-c89ff238d957 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:36.336578 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d912a8f1-2a05-43d3-bc09-c89ff238d957 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:36.337071 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d912a8f1-2a05-43d3-bc09-c89ff238d957 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:36.337513 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d912a8f1-2a05-43d3-bc09-c89ff238d957 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:36.338217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d912a8f1-2a05-43d3-bc09-c89ff238d957 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:36.338685 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d912a8f1-2a05-43d3-bc09-c89ff238d957 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:36.339143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d912a8f1-2a05-43d3-bc09-c89ff238d957 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:36.443276 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-9784e5fd-aefa-4c51-9948-d73dbab8099d req-b4710df7-fa01-42f0-9fe9-600a401b029d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e5a10ee-202a-453e-b3ff-6c5c05ec72f3", "tag": "65aeb21b-342d-4c27-963d-8c021915548c"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:30:36.473130 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-9784e5fd-aefa-4c51-9948-d73dbab8099d req-b4710df7-fa01-42f0-9fe9-600a401b029d service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:36.473544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-9784e5fd-aefa-4c51-9948-d73dbab8099d req-b4710df7-fa01-42f0-9fe9-600a401b029d service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:36.473988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-9784e5fd-aefa-4c51-9948-d73dbab8099d req-b4710df7-fa01-42f0-9fe9-600a401b029d service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:36.516538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-9784e5fd-aefa-4c51-9948-d73dbab8099d req-b4710df7-fa01-42f0-9fe9-600a401b029d service nova] Creating event network-changed:65aeb21b-342d-4c27-963d-8c021915548c for instance 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 on hv-cinder-84889 Aug 24 12:30:36.524835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-9784e5fd-aefa-4c51-9948-d73dbab8099d req-b4710df7-fa01-42f0-9fe9-600a401b029d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089435 Aug 24 12:30:36.525701 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 48/97] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:30:36.540741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d912a8f1-2a05-43d3-bc09-c89ff238d957 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:36.553447 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d912a8f1-2a05-43d3-bc09-c89ff238d957 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.236843 Aug 24 12:30:36.554458 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 50/98] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:36 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:36.674519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a2f3469f-bb49-4241-9884-7eeeb490bebb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:36.675301 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a2f3469f-bb49-4241-9884-7eeeb490bebb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:36.682014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2f3469f-bb49-4241-9884-7eeeb490bebb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:36.682497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2f3469f-bb49-4241-9884-7eeeb490bebb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:36.682960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2f3469f-bb49-4241-9884-7eeeb490bebb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:36.683649 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2f3469f-bb49-4241-9884-7eeeb490bebb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:36.684100 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2f3469f-bb49-4241-9884-7eeeb490bebb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:36.684527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2f3469f-bb49-4241-9884-7eeeb490bebb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:36.779386 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-92d1832b-a2a1-4107-8274-d7da3dc3fedb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:36.779998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-92d1832b-a2a1-4107-8274-d7da3dc3fedb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:36.789341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92d1832b-a2a1-4107-8274-d7da3dc3fedb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:36.790086 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92d1832b-a2a1-4107-8274-d7da3dc3fedb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:36.790912 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92d1832b-a2a1-4107-8274-d7da3dc3fedb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:36.791782 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92d1832b-a2a1-4107-8274-d7da3dc3fedb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:36.792485 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92d1832b-a2a1-4107-8274-d7da3dc3fedb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:36.792818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92d1832b-a2a1-4107-8274-d7da3dc3fedb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:36.830060 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a2f3469f-bb49-4241-9884-7eeeb490bebb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:36.844275 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a2f3469f-bb49-4241-9884-7eeeb490bebb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:36.846958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a2f3469f-bb49-4241-9884-7eeeb490bebb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:36.847076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a2f3469f-bb49-4241-9884-7eeeb490bebb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.176595 Aug 24 12:30:36.854196 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 49/99] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:36 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:36.983470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-92d1832b-a2a1-4107-8274-d7da3dc3fedb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:36.992681 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-92d1832b-a2a1-4107-8274-d7da3dc3fedb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.217362 Aug 24 12:30:36.993245 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 51/100] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:36 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:37.332750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fa553e66-7c4a-4021-ab94-23ca3140e20a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:37.333341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fa553e66-7c4a-4021-ab94-23ca3140e20a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:37.347985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa553e66-7c4a-4021-ab94-23ca3140e20a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:37.348837 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa553e66-7c4a-4021-ab94-23ca3140e20a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:37.349465 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa553e66-7c4a-4021-ab94-23ca3140e20a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:37.350983 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa553e66-7c4a-4021-ab94-23ca3140e20a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:37.352234 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa553e66-7c4a-4021-ab94-23ca3140e20a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:37.352819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa553e66-7c4a-4021-ab94-23ca3140e20a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:37.574538 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-74efd0d3-30f8-457a-9ee0-3871e454e222 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:37.580703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-74efd0d3-30f8-457a-9ee0-3871e454e222 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:37.607031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-74efd0d3-30f8-457a-9ee0-3871e454e222 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:37.607535 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-74efd0d3-30f8-457a-9ee0-3871e454e222 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:37.607977 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-74efd0d3-30f8-457a-9ee0-3871e454e222 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:37.608687 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-74efd0d3-30f8-457a-9ee0-3871e454e222 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:37.609145 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-74efd0d3-30f8-457a-9ee0-3871e454e222 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:37.609572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-74efd0d3-30f8-457a-9ee0-3871e454e222 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:37.690591 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:30:37.692517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=2 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:30:37.832363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell0:SELECT=2 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:30:37.865448 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fa553e66-7c4a-4021-ab94-23ca3140e20a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:37.885476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fa553e66-7c4a-4021-ab94-23ca3140e20a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.556970 Aug 24 12:30:37.886885 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 50/101] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:37 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:37.892001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2f26c9cd-0707-4c02-aca5-d4849bd17ff7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:37.892609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2f26c9cd-0707-4c02-aca5-d4849bd17ff7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:37.902730 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f26c9cd-0707-4c02-aca5-d4849bd17ff7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:37.903233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f26c9cd-0707-4c02-aca5-d4849bd17ff7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:37.903675 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f26c9cd-0707-4c02-aca5-d4849bd17ff7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:37.904376 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f26c9cd-0707-4c02-aca5-d4849bd17ff7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:37.904828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f26c9cd-0707-4c02-aca5-d4849bd17ff7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:37.905253 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f26c9cd-0707-4c02-aca5-d4849bd17ff7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:37.918921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-74efd0d3-30f8-457a-9ee0-3871e454e222 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:37.942045 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-74efd0d3-30f8-457a-9ee0-3871e454e222 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.370398 Aug 24 12:30:37.942045 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 52/102] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:37 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:38.013781 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-edd96d51-85b8-47bc-af9c-54fe393882b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:38.014457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-edd96d51-85b8-47bc-af9c-54fe393882b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:38.022187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edd96d51-85b8-47bc-af9c-54fe393882b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:38.022605 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edd96d51-85b8-47bc-af9c-54fe393882b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:38.031560 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edd96d51-85b8-47bc-af9c-54fe393882b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:38.032340 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edd96d51-85b8-47bc-af9c-54fe393882b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:38.032818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edd96d51-85b8-47bc-af9c-54fe393882b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:38.033741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edd96d51-85b8-47bc-af9c-54fe393882b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:38.154612 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2f26c9cd-0707-4c02-aca5-d4849bd17ff7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:38.163932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2f26c9cd-0707-4c02-aca5-d4849bd17ff7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:38.166711 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2f26c9cd-0707-4c02-aca5-d4849bd17ff7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:38.168525 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2f26c9cd-0707-4c02-aca5-d4849bd17ff7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.280078 Aug 24 12:30:38.170941 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 51/103] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:37 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:38.261178 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-edd96d51-85b8-47bc-af9c-54fe393882b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:38.270461 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-edd96d51-85b8-47bc-af9c-54fe393882b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.261201 Aug 24 12:30:38.271263 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 53/104] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:38 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:38.907230 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0ed3c469-b6d1-4a14-91eb-f9cd8ecff80b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:38.908527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0ed3c469-b6d1-4a14-91eb-f9cd8ecff80b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:38.917528 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ed3c469-b6d1-4a14-91eb-f9cd8ecff80b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:38.918014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ed3c469-b6d1-4a14-91eb-f9cd8ecff80b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:38.918443 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ed3c469-b6d1-4a14-91eb-f9cd8ecff80b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:38.919167 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ed3c469-b6d1-4a14-91eb-f9cd8ecff80b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:38.919832 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ed3c469-b6d1-4a14-91eb-f9cd8ecff80b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:38.920259 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ed3c469-b6d1-4a14-91eb-f9cd8ecff80b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:38.939441 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:30:38.965726 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e8cff4fe-a276-43b3-8c3c-f12952b60fa0 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:38.970496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e8cff4fe-a276-43b3-8c3c-f12952b60fa0 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:38.989429 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8cff4fe-a276-43b3-8c3c-f12952b60fa0 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:38.999548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8cff4fe-a276-43b3-8c3c-f12952b60fa0 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:38.999548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8cff4fe-a276-43b3-8c3c-f12952b60fa0 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:38.999548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8cff4fe-a276-43b3-8c3c-f12952b60fa0 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:38.999548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8cff4fe-a276-43b3-8c3c-f12952b60fa0 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:39.000380 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8cff4fe-a276-43b3-8c3c-f12952b60fa0 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:39.118321 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0ed3c469-b6d1-4a14-91eb-f9cd8ecff80b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:39.126106 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0ed3c469-b6d1-4a14-91eb-f9cd8ecff80b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.223485 Aug 24 12:30:39.127805 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 52/105] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:38 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:39.191526 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d73f00d8-3758-430e-8569-a4082f8e98f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:39.192291 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d73f00d8-3758-430e-8569-a4082f8e98f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:39.198565 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d73f00d8-3758-430e-8569-a4082f8e98f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:39.199268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d73f00d8-3758-430e-8569-a4082f8e98f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:39.200432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d73f00d8-3758-430e-8569-a4082f8e98f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:39.200546 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d73f00d8-3758-430e-8569-a4082f8e98f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:39.201015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d73f00d8-3758-430e-8569-a4082f8e98f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:39.201438 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d73f00d8-3758-430e-8569-a4082f8e98f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:39.211661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e8cff4fe-a276-43b3-8c3c-f12952b60fa0 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:39.219713 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e8cff4fe-a276-43b3-8c3c-f12952b60fa0 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.258003 Aug 24 12:30:39.220286 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 54/106] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:38 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:39.291583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f9df3154-d26e-4574-9387-8d8e7ef20695 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:39.292182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f9df3154-d26e-4574-9387-8d8e7ef20695 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:39.304176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9df3154-d26e-4574-9387-8d8e7ef20695 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:39.304176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9df3154-d26e-4574-9387-8d8e7ef20695 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:39.304176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9df3154-d26e-4574-9387-8d8e7ef20695 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:39.304176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9df3154-d26e-4574-9387-8d8e7ef20695 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:39.304627 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9df3154-d26e-4574-9387-8d8e7ef20695 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:39.304627 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9df3154-d26e-4574-9387-8d8e7ef20695 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:39.355034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d73f00d8-3758-430e-8569-a4082f8e98f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:39.365006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d73f00d8-3758-430e-8569-a4082f8e98f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:39.366675 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d73f00d8-3758-430e-8569-a4082f8e98f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:39.367788 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d73f00d8-3758-430e-8569-a4082f8e98f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.180162 Aug 24 12:30:39.368540 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 53/107] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:39 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:39.469790 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f9df3154-d26e-4574-9387-8d8e7ef20695 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:39.477450 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f9df3154-d26e-4574-9387-8d8e7ef20695 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.190047 Aug 24 12:30:39.479928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 55/108] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:39 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:40.157668 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a40b67cc-9f1f-4f5b-93c4-58c45504a2da tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:40.157668 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a40b67cc-9f1f-4f5b-93c4-58c45504a2da tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:40.160895 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a40b67cc-9f1f-4f5b-93c4-58c45504a2da tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:40.161439 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a40b67cc-9f1f-4f5b-93c4-58c45504a2da tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:40.161947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a40b67cc-9f1f-4f5b-93c4-58c45504a2da tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:40.162740 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a40b67cc-9f1f-4f5b-93c4-58c45504a2da tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:40.163265 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a40b67cc-9f1f-4f5b-93c4-58c45504a2da tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:40.163696 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a40b67cc-9f1f-4f5b-93c4-58c45504a2da tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:40.247723 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9295313b-43c0-4c67-b3aa-65a5953942d7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:40.248376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9295313b-43c0-4c67-b3aa-65a5953942d7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:40.254629 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9295313b-43c0-4c67-b3aa-65a5953942d7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:40.257199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9295313b-43c0-4c67-b3aa-65a5953942d7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:40.257823 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9295313b-43c0-4c67-b3aa-65a5953942d7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:40.258615 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9295313b-43c0-4c67-b3aa-65a5953942d7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:40.259136 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9295313b-43c0-4c67-b3aa-65a5953942d7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:40.259501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9295313b-43c0-4c67-b3aa-65a5953942d7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:40.413013 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9295313b-43c0-4c67-b3aa-65a5953942d7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:40.426624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9295313b-43c0-4c67-b3aa-65a5953942d7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.184845 Aug 24 12:30:40.428777 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 56/109] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:40 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:40.443017 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-96578630-e7e0-4fd2-bbaa-049e193fe5bf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:40.443749 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-96578630-e7e0-4fd2-bbaa-049e193fe5bf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:40.450419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96578630-e7e0-4fd2-bbaa-049e193fe5bf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:40.451301 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96578630-e7e0-4fd2-bbaa-049e193fe5bf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:40.451876 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96578630-e7e0-4fd2-bbaa-049e193fe5bf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:40.452970 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96578630-e7e0-4fd2-bbaa-049e193fe5bf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:40.453420 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96578630-e7e0-4fd2-bbaa-049e193fe5bf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:40.453839 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96578630-e7e0-4fd2-bbaa-049e193fe5bf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:40.491350 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a40b67cc-9f1f-4f5b-93c4-58c45504a2da tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:40.504440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a40b67cc-9f1f-4f5b-93c4-58c45504a2da tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.355344 Aug 24 12:30:40.506412 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 54/110] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:40 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:40.516429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e169afb4-b480-4c82-bde0-798e9fc31b81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:40.517334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e169afb4-b480-4c82-bde0-798e9fc31b81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:40.524959 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e169afb4-b480-4c82-bde0-798e9fc31b81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:40.526301 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e169afb4-b480-4c82-bde0-798e9fc31b81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:40.527075 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e169afb4-b480-4c82-bde0-798e9fc31b81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:40.528077 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e169afb4-b480-4c82-bde0-798e9fc31b81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:40.528663 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e169afb4-b480-4c82-bde0-798e9fc31b81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:40.529311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e169afb4-b480-4c82-bde0-798e9fc31b81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:40.637956 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-96578630-e7e0-4fd2-bbaa-049e193fe5bf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:40.646845 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-96578630-e7e0-4fd2-bbaa-049e193fe5bf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:40.648572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-96578630-e7e0-4fd2-bbaa-049e193fe5bf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:40.649690 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-96578630-e7e0-4fd2-bbaa-049e193fe5bf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.219734 Aug 24 12:30:40.650241 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 57/111] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:40 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:40.925098 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e169afb4-b480-4c82-bde0-798e9fc31b81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:40.935080 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e169afb4-b480-4c82-bde0-798e9fc31b81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.426011 Aug 24 12:30:40.940505 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 55/112] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:40 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:41.448448 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9db92e52-20c4-494f-872e-791b5f1bf47e tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:41.449111 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9db92e52-20c4-494f-872e-791b5f1bf47e tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:41.459941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9db92e52-20c4-494f-872e-791b5f1bf47e tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:41.460988 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9db92e52-20c4-494f-872e-791b5f1bf47e tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:41.461922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9db92e52-20c4-494f-872e-791b5f1bf47e tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:41.464641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9db92e52-20c4-494f-872e-791b5f1bf47e tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:41.465277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9db92e52-20c4-494f-872e-791b5f1bf47e tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:41.465957 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9db92e52-20c4-494f-872e-791b5f1bf47e tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:41.533886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ba5d354d-8458-4caa-8395-fae81743d104 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:41.534530 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ba5d354d-8458-4caa-8395-fae81743d104 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:41.544675 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ba5d354d-8458-4caa-8395-fae81743d104 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:41.546431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ba5d354d-8458-4caa-8395-fae81743d104 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:41.547275 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ba5d354d-8458-4caa-8395-fae81743d104 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:41.548131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ba5d354d-8458-4caa-8395-fae81743d104 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:41.548971 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ba5d354d-8458-4caa-8395-fae81743d104 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:41.549717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ba5d354d-8458-4caa-8395-fae81743d104 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:41.742861 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9db92e52-20c4-494f-872e-791b5f1bf47e tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:41.758265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9db92e52-20c4-494f-872e-791b5f1bf47e tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.313519 Aug 24 12:30:41.777048 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 58/113] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:41 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:41.777048 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-c76d5abd-528f-4395-844f-ce5d101514e2 req-4eaf0bd2-7c4a-4efc-bfb1-a058cb51617f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7228012-d37e-4a5c-bc05-791ad60259e3", "tag": "e9ca9e07-b749-44a3-bfea-cce9e380dd63"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:30:41.797353 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-c76d5abd-528f-4395-844f-ce5d101514e2 req-4eaf0bd2-7c4a-4efc-bfb1-a058cb51617f service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:41.797831 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-c76d5abd-528f-4395-844f-ce5d101514e2 req-4eaf0bd2-7c4a-4efc-bfb1-a058cb51617f service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:41.798272 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-c76d5abd-528f-4395-844f-ce5d101514e2 req-4eaf0bd2-7c4a-4efc-bfb1-a058cb51617f service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:41.805723 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ba5d354d-8458-4caa-8395-fae81743d104 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:41.813929 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-c76d5abd-528f-4395-844f-ce5d101514e2 req-4eaf0bd2-7c4a-4efc-bfb1-a058cb51617f service nova] Creating event network-changed:e9ca9e07-b749-44a3-bfea-cce9e380dd63 for instance e7228012-d37e-4a5c-bc05-791ad60259e3 on hv-cinder-84889 Aug 24 12:30:41.814224 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ba5d354d-8458-4caa-8395-fae81743d104 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.288409 Aug 24 12:30:41.816946 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 56/114] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:41 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:41.819998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-c76d5abd-528f-4395-844f-ce5d101514e2 req-4eaf0bd2-7c4a-4efc-bfb1-a058cb51617f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054138 Aug 24 12:30:41.820578 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 59/115] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:30:41.825184 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cfc253c1-15ae-48dc-bdd2-147e294f7075 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:41.825873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cfc253c1-15ae-48dc-bdd2-147e294f7075 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:41.834788 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfc253c1-15ae-48dc-bdd2-147e294f7075 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:41.835330 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfc253c1-15ae-48dc-bdd2-147e294f7075 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:41.839865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfc253c1-15ae-48dc-bdd2-147e294f7075 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:41.839865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfc253c1-15ae-48dc-bdd2-147e294f7075 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:41.839865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfc253c1-15ae-48dc-bdd2-147e294f7075 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:41.839865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfc253c1-15ae-48dc-bdd2-147e294f7075 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:41.963706 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ebef363c-2783-4eb7-9d48-bbf9ed1ad8bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:41.965496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ebef363c-2783-4eb7-9d48-bbf9ed1ad8bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:41.973750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ebef363c-2783-4eb7-9d48-bbf9ed1ad8bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:41.974407 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ebef363c-2783-4eb7-9d48-bbf9ed1ad8bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:41.974937 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ebef363c-2783-4eb7-9d48-bbf9ed1ad8bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:41.975755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ebef363c-2783-4eb7-9d48-bbf9ed1ad8bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:41.976308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ebef363c-2783-4eb7-9d48-bbf9ed1ad8bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:41.976799 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ebef363c-2783-4eb7-9d48-bbf9ed1ad8bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:42.039084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cfc253c1-15ae-48dc-bdd2-147e294f7075 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:42.071627 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cfc253c1-15ae-48dc-bdd2-147e294f7075 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:42.073532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cfc253c1-15ae-48dc-bdd2-147e294f7075 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:42.083117 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cfc253c1-15ae-48dc-bdd2-147e294f7075 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.256932 Aug 24 12:30:42.084221 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 57/116] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:41 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:42.164150 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ebef363c-2783-4eb7-9d48-bbf9ed1ad8bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:42.167966 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ebef363c-2783-4eb7-9d48-bbf9ed1ad8bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.209356 Aug 24 12:30:42.169600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 60/117] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:41 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:42.785543 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-de412a6a-6eb5-485e-9ce4-5db820263f6f tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:42.791286 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-de412a6a-6eb5-485e-9ce4-5db820263f6f tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:42.792812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de412a6a-6eb5-485e-9ce4-5db820263f6f tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:42.799155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de412a6a-6eb5-485e-9ce4-5db820263f6f tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:42.799603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de412a6a-6eb5-485e-9ce4-5db820263f6f tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:42.801058 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de412a6a-6eb5-485e-9ce4-5db820263f6f tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:42.801518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de412a6a-6eb5-485e-9ce4-5db820263f6f tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:42.801948 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de412a6a-6eb5-485e-9ce4-5db820263f6f tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:42.844847 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-df9a07fc-9748-4769-a9b8-70a7b1d4720e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:42.845454 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-df9a07fc-9748-4769-a9b8-70a7b1d4720e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:42.857608 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df9a07fc-9748-4769-a9b8-70a7b1d4720e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:42.858095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df9a07fc-9748-4769-a9b8-70a7b1d4720e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:42.859732 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df9a07fc-9748-4769-a9b8-70a7b1d4720e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:42.860449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df9a07fc-9748-4769-a9b8-70a7b1d4720e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:42.860908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df9a07fc-9748-4769-a9b8-70a7b1d4720e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:42.861336 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df9a07fc-9748-4769-a9b8-70a7b1d4720e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:42.960054 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-de412a6a-6eb5-485e-9ce4-5db820263f6f tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:42.968179 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-de412a6a-6eb5-485e-9ce4-5db820263f6f tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.187999 Aug 24 12:30:42.968829 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 58/118] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:42 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:43.009649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-df9a07fc-9748-4769-a9b8-70a7b1d4720e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:43.018446 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-df9a07fc-9748-4769-a9b8-70a7b1d4720e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.181537 Aug 24 12:30:43.020194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 61/119] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:42 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:43.105757 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-62918f1f-9da0-4145-b4d0-e85e5ec94b20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:43.108199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-62918f1f-9da0-4145-b4d0-e85e5ec94b20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:43.115647 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62918f1f-9da0-4145-b4d0-e85e5ec94b20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:43.116137 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62918f1f-9da0-4145-b4d0-e85e5ec94b20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:43.116617 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62918f1f-9da0-4145-b4d0-e85e5ec94b20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:43.117302 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62918f1f-9da0-4145-b4d0-e85e5ec94b20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:43.117777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62918f1f-9da0-4145-b4d0-e85e5ec94b20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:43.118218 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62918f1f-9da0-4145-b4d0-e85e5ec94b20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:43.188461 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dca8226a-e15f-48c9-8839-4fbf1b5652fd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:43.189057 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dca8226a-e15f-48c9-8839-4fbf1b5652fd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:43.197814 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dca8226a-e15f-48c9-8839-4fbf1b5652fd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:43.198300 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dca8226a-e15f-48c9-8839-4fbf1b5652fd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:43.198926 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dca8226a-e15f-48c9-8839-4fbf1b5652fd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:43.199876 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dca8226a-e15f-48c9-8839-4fbf1b5652fd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:43.200537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dca8226a-e15f-48c9-8839-4fbf1b5652fd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:43.201111 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dca8226a-e15f-48c9-8839-4fbf1b5652fd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:43.300736 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-62918f1f-9da0-4145-b4d0-e85e5ec94b20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:43.311269 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-62918f1f-9da0-4145-b4d0-e85e5ec94b20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:43.316433 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-62918f1f-9da0-4145-b4d0-e85e5ec94b20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:43.316433 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-62918f1f-9da0-4145-b4d0-e85e5ec94b20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.212068 Aug 24 12:30:43.316433 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 59/120] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:43 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:30:43.370696 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-dca8226a-e15f-48c9-8839-4fbf1b5652fd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:43.379144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dca8226a-e15f-48c9-8839-4fbf1b5652fd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.193909 Aug 24 12:30:43.380327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 62/121] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:43 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:43.990460 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cbd2e012-8f4e-4ac6-a051-d887ad32fe7a tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:43.991100 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cbd2e012-8f4e-4ac6-a051-d887ad32fe7a tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:43.997046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cbd2e012-8f4e-4ac6-a051-d887ad32fe7a tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:43.997518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cbd2e012-8f4e-4ac6-a051-d887ad32fe7a tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:43.997947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cbd2e012-8f4e-4ac6-a051-d887ad32fe7a tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:43.998618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cbd2e012-8f4e-4ac6-a051-d887ad32fe7a tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:43.999087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cbd2e012-8f4e-4ac6-a051-d887ad32fe7a tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:43.999503 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cbd2e012-8f4e-4ac6-a051-d887ad32fe7a tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:44.040351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b1f01bda-5cfa-415a-8988-4c5e9ad434da tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:44.040951 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b1f01bda-5cfa-415a-8988-4c5e9ad434da tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:44.047143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1f01bda-5cfa-415a-8988-4c5e9ad434da tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:44.047634 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1f01bda-5cfa-415a-8988-4c5e9ad434da tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:44.048067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1f01bda-5cfa-415a-8988-4c5e9ad434da tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:44.048782 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1f01bda-5cfa-415a-8988-4c5e9ad434da tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:44.049236 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1f01bda-5cfa-415a-8988-4c5e9ad434da tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:44.049663 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1f01bda-5cfa-415a-8988-4c5e9ad434da tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:44.130211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cbd2e012-8f4e-4ac6-a051-d887ad32fe7a tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:44.138258 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cbd2e012-8f4e-4ac6-a051-d887ad32fe7a tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.152477 Aug 24 12:30:44.138940 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 60/122] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:43 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:44.190853 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b1f01bda-5cfa-415a-8988-4c5e9ad434da tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:44.198385 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b1f01bda-5cfa-415a-8988-4c5e9ad434da tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.161793 Aug 24 12:30:44.198972 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 63/123] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:44 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:44.337268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-882d92fc-2548-44f7-91fe-42ab30f157b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:44.338026 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-882d92fc-2548-44f7-91fe-42ab30f157b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:44.344003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-882d92fc-2548-44f7-91fe-42ab30f157b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:44.344589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-882d92fc-2548-44f7-91fe-42ab30f157b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:44.345038 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-882d92fc-2548-44f7-91fe-42ab30f157b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:44.345714 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-882d92fc-2548-44f7-91fe-42ab30f157b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:44.346155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-882d92fc-2548-44f7-91fe-42ab30f157b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:44.346569 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-882d92fc-2548-44f7-91fe-42ab30f157b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:44.400204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-62a1169d-fe4e-4943-91ac-54433e35f116 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:44.400850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-62a1169d-fe4e-4943-91ac-54433e35f116 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:44.406828 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-62a1169d-fe4e-4943-91ac-54433e35f116 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:44.407311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-62a1169d-fe4e-4943-91ac-54433e35f116 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:44.407741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-62a1169d-fe4e-4943-91ac-54433e35f116 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:44.408481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-62a1169d-fe4e-4943-91ac-54433e35f116 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:44.408925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-62a1169d-fe4e-4943-91ac-54433e35f116 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:44.409343 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-62a1169d-fe4e-4943-91ac-54433e35f116 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:44.497401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-882d92fc-2548-44f7-91fe-42ab30f157b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:44.506154 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-882d92fc-2548-44f7-91fe-42ab30f157b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:44.507693 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-882d92fc-2548-44f7-91fe-42ab30f157b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:44.508801 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-882d92fc-2548-44f7-91fe-42ab30f157b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.175545 Aug 24 12:30:44.509352 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 61/124] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:44 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:44.557603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-62a1169d-fe4e-4943-91ac-54433e35f116 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:44.565128 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-62a1169d-fe4e-4943-91ac-54433e35f116 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.168987 Aug 24 12:30:44.568727 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 64/125] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:44 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:45.159374 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cf1fedb2-091c-418f-9b64-2c5114b225df tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:45.160172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cf1fedb2-091c-418f-9b64-2c5114b225df tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:45.167955 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf1fedb2-091c-418f-9b64-2c5114b225df tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:45.168449 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf1fedb2-091c-418f-9b64-2c5114b225df tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:45.168888 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf1fedb2-091c-418f-9b64-2c5114b225df tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:45.169854 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf1fedb2-091c-418f-9b64-2c5114b225df tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:45.170998 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf1fedb2-091c-418f-9b64-2c5114b225df tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:45.171614 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf1fedb2-091c-418f-9b64-2c5114b225df tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:45.224746 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-06b85c8e-5828-41ae-9eb1-cdc84a22016e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:45.226097 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-06b85c8e-5828-41ae-9eb1-cdc84a22016e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:45.247304 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06b85c8e-5828-41ae-9eb1-cdc84a22016e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:45.248058 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06b85c8e-5828-41ae-9eb1-cdc84a22016e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:45.249516 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06b85c8e-5828-41ae-9eb1-cdc84a22016e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:45.250384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06b85c8e-5828-41ae-9eb1-cdc84a22016e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:45.251942 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06b85c8e-5828-41ae-9eb1-cdc84a22016e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:45.252546 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06b85c8e-5828-41ae-9eb1-cdc84a22016e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:45.419685 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-06b85c8e-5828-41ae-9eb1-cdc84a22016e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:45.437750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-06b85c8e-5828-41ae-9eb1-cdc84a22016e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.213668 Aug 24 12:30:45.437750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 65/126] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:45 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:45.497622 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cf1fedb2-091c-418f-9b64-2c5114b225df tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:45.505335 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cf1fedb2-091c-418f-9b64-2c5114b225df tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.350064 Aug 24 12:30:45.506017 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 62/127] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:45 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:45.531572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3ac7d204-e8c0-44ee-b61e-a2ed4266cad6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:45.532205 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3ac7d204-e8c0-44ee-b61e-a2ed4266cad6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:45.538563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ac7d204-e8c0-44ee-b61e-a2ed4266cad6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:45.539068 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ac7d204-e8c0-44ee-b61e-a2ed4266cad6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:45.539493 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ac7d204-e8c0-44ee-b61e-a2ed4266cad6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:45.540164 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ac7d204-e8c0-44ee-b61e-a2ed4266cad6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:45.540609 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ac7d204-e8c0-44ee-b61e-a2ed4266cad6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:45.541051 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ac7d204-e8c0-44ee-b61e-a2ed4266cad6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:45.585502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-958b1c9a-2547-494c-8661-6714fa4d6d1d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:45.586223 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-958b1c9a-2547-494c-8661-6714fa4d6d1d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:45.593285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-958b1c9a-2547-494c-8661-6714fa4d6d1d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:45.594036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-958b1c9a-2547-494c-8661-6714fa4d6d1d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:45.594469 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-958b1c9a-2547-494c-8661-6714fa4d6d1d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:45.595332 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-958b1c9a-2547-494c-8661-6714fa4d6d1d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:45.595822 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-958b1c9a-2547-494c-8661-6714fa4d6d1d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:45.596229 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-958b1c9a-2547-494c-8661-6714fa4d6d1d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:45.978293 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3ac7d204-e8c0-44ee-b61e-a2ed4266cad6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:45.978293 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3ac7d204-e8c0-44ee-b61e-a2ed4266cad6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:45.978555 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3ac7d204-e8c0-44ee-b61e-a2ed4266cad6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:45.978555 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3ac7d204-e8c0-44ee-b61e-a2ed4266cad6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.428158 Aug 24 12:30:45.978555 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 66/128] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:45 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:46.012918 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-958b1c9a-2547-494c-8661-6714fa4d6d1d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:46.019746 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-958b1c9a-2547-494c-8661-6714fa4d6d1d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.438305 Aug 24 12:30:46.020286 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 63/129] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:45 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:46.449000 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-70c21e70-7cec-409e-bc37-c1718a995dc7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:46.449598 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-70c21e70-7cec-409e-bc37-c1718a995dc7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:46.455439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70c21e70-7cec-409e-bc37-c1718a995dc7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:46.455930 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70c21e70-7cec-409e-bc37-c1718a995dc7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:46.456961 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70c21e70-7cec-409e-bc37-c1718a995dc7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:46.457637 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70c21e70-7cec-409e-bc37-c1718a995dc7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:46.458082 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70c21e70-7cec-409e-bc37-c1718a995dc7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:46.458497 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70c21e70-7cec-409e-bc37-c1718a995dc7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:46.525813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0cf83d66-ec83-4928-89de-4dbca1e309ae tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:46.526536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0cf83d66-ec83-4928-89de-4dbca1e309ae tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:46.532525 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0cf83d66-ec83-4928-89de-4dbca1e309ae tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:46.533091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0cf83d66-ec83-4928-89de-4dbca1e309ae tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:46.533613 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0cf83d66-ec83-4928-89de-4dbca1e309ae tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:46.534396 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0cf83d66-ec83-4928-89de-4dbca1e309ae tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:46.535374 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0cf83d66-ec83-4928-89de-4dbca1e309ae tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:46.535466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0cf83d66-ec83-4928-89de-4dbca1e309ae tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:46.587808 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-70c21e70-7cec-409e-bc37-c1718a995dc7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:46.595937 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-70c21e70-7cec-409e-bc37-c1718a995dc7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.150659 Aug 24 12:30:46.602917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 67/130] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:46 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:46.671695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0cf83d66-ec83-4928-89de-4dbca1e309ae tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:46.679761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0cf83d66-ec83-4928-89de-4dbca1e309ae tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.157728 Aug 24 12:30:46.680254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 64/131] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:46 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:46.979668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c518be1f-b301-46b4-895d-774246d07ee6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:46.980190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c518be1f-b301-46b4-895d-774246d07ee6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:46.986200 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c518be1f-b301-46b4-895d-774246d07ee6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:46.986709 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c518be1f-b301-46b4-895d-774246d07ee6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:46.987143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c518be1f-b301-46b4-895d-774246d07ee6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:46.988502 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c518be1f-b301-46b4-895d-774246d07ee6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:46.988954 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c518be1f-b301-46b4-895d-774246d07ee6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:46.989373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c518be1f-b301-46b4-895d-774246d07ee6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:47.044052 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-00798e00-a043-4e2d-8e26-5b16bf0dd9ef tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:47.044651 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-00798e00-a043-4e2d-8e26-5b16bf0dd9ef tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:47.051464 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00798e00-a043-4e2d-8e26-5b16bf0dd9ef tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:47.052032 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00798e00-a043-4e2d-8e26-5b16bf0dd9ef tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:47.052537 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00798e00-a043-4e2d-8e26-5b16bf0dd9ef tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:47.053335 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00798e00-a043-4e2d-8e26-5b16bf0dd9ef tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:47.053885 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00798e00-a043-4e2d-8e26-5b16bf0dd9ef tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:47.054482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00798e00-a043-4e2d-8e26-5b16bf0dd9ef tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:47.131108 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c518be1f-b301-46b4-895d-774246d07ee6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:47.139197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c518be1f-b301-46b4-895d-774246d07ee6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:47.140679 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c518be1f-b301-46b4-895d-774246d07ee6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:47.141780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c518be1f-b301-46b4-895d-774246d07ee6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.166181 Aug 24 12:30:47.142330 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 68/132] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:46 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:47.183253 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-00798e00-a043-4e2d-8e26-5b16bf0dd9ef tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:47.190911 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-00798e00-a043-4e2d-8e26-5b16bf0dd9ef tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.150549 Aug 24 12:30:47.191463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 65/133] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:47 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:47.623368 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9615ed4b-9320-49cf-8631-7d45c7a5d4cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:47.623967 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9615ed4b-9320-49cf-8631-7d45c7a5d4cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:47.629728 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9615ed4b-9320-49cf-8631-7d45c7a5d4cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:47.630201 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9615ed4b-9320-49cf-8631-7d45c7a5d4cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:47.630625 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9615ed4b-9320-49cf-8631-7d45c7a5d4cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:47.631326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9615ed4b-9320-49cf-8631-7d45c7a5d4cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:47.631770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9615ed4b-9320-49cf-8631-7d45c7a5d4cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:47.632185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9615ed4b-9320-49cf-8631-7d45c7a5d4cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:47.650237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:30:47.700937 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-511e60e5-cbdd-4c61-8a78-fe5efb398cc7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:47.701727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-511e60e5-cbdd-4c61-8a78-fe5efb398cc7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:47.708170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-511e60e5-cbdd-4c61-8a78-fe5efb398cc7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:47.708768 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-511e60e5-cbdd-4c61-8a78-fe5efb398cc7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:47.709068 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-511e60e5-cbdd-4c61-8a78-fe5efb398cc7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:47.709755 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-511e60e5-cbdd-4c61-8a78-fe5efb398cc7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:47.710206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-511e60e5-cbdd-4c61-8a78-fe5efb398cc7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:47.710628 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-511e60e5-cbdd-4c61-8a78-fe5efb398cc7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:47.760616 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9615ed4b-9320-49cf-8631-7d45c7a5d4cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:47.768741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9615ed4b-9320-49cf-8631-7d45c7a5d4cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.148961 Aug 24 12:30:47.769886 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 69/134] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:47 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:47.843412 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-511e60e5-cbdd-4c61-8a78-fe5efb398cc7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:47.851418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-511e60e5-cbdd-4c61-8a78-fe5efb398cc7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.154435 Aug 24 12:30:47.851977 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 66/135] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:47 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:48.164398 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-57e99871-85f7-4344-8a2f-3d536d145fe7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:48.164923 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-57e99871-85f7-4344-8a2f-3d536d145fe7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:48.170897 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57e99871-85f7-4344-8a2f-3d536d145fe7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:48.171378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57e99871-85f7-4344-8a2f-3d536d145fe7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:48.171820 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57e99871-85f7-4344-8a2f-3d536d145fe7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:48.172493 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57e99871-85f7-4344-8a2f-3d536d145fe7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:48.172943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57e99871-85f7-4344-8a2f-3d536d145fe7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:48.173365 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57e99871-85f7-4344-8a2f-3d536d145fe7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:48.210141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3783f273-8637-4632-9859-f50c73115467 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:48.210774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3783f273-8637-4632-9859-f50c73115467 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:48.216790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3783f273-8637-4632-9859-f50c73115467 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:48.217285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3783f273-8637-4632-9859-f50c73115467 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:48.217725 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3783f273-8637-4632-9859-f50c73115467 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:48.218412 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3783f273-8637-4632-9859-f50c73115467 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:48.218889 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3783f273-8637-4632-9859-f50c73115467 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:48.219316 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3783f273-8637-4632-9859-f50c73115467 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:48.299540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-57e99871-85f7-4344-8a2f-3d536d145fe7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:48.308589 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-57e99871-85f7-4344-8a2f-3d536d145fe7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:48.310169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-57e99871-85f7-4344-8a2f-3d536d145fe7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:48.311392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-57e99871-85f7-4344-8a2f-3d536d145fe7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.150976 Aug 24 12:30:48.312061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 70/136] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:48 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:48.346852 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3783f273-8637-4632-9859-f50c73115467 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:48.354434 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3783f273-8637-4632-9859-f50c73115467 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.148041 Aug 24 12:30:48.363625 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 67/137] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:48 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:48.790573 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-95047f77-b1ca-4c9d-b517-e1fa5d247b6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:48.791218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-95047f77-b1ca-4c9d-b517-e1fa5d247b6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:48.797129 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95047f77-b1ca-4c9d-b517-e1fa5d247b6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:48.797615 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95047f77-b1ca-4c9d-b517-e1fa5d247b6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:48.798049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95047f77-b1ca-4c9d-b517-e1fa5d247b6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:48.798765 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95047f77-b1ca-4c9d-b517-e1fa5d247b6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:48.799225 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95047f77-b1ca-4c9d-b517-e1fa5d247b6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:48.799654 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95047f77-b1ca-4c9d-b517-e1fa5d247b6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:48.871780 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-be599d09-cf62-4a44-a953-4101cda34824 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:48.872411 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-be599d09-cf62-4a44-a953-4101cda34824 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:48.879035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be599d09-cf62-4a44-a953-4101cda34824 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:48.879255 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be599d09-cf62-4a44-a953-4101cda34824 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:48.879685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be599d09-cf62-4a44-a953-4101cda34824 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:48.880576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be599d09-cf62-4a44-a953-4101cda34824 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:48.881265 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be599d09-cf62-4a44-a953-4101cda34824 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:48.881693 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be599d09-cf62-4a44-a953-4101cda34824 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:48.936017 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-95047f77-b1ca-4c9d-b517-e1fa5d247b6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:48.943806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-95047f77-b1ca-4c9d-b517-e1fa5d247b6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.157074 Aug 24 12:30:48.944482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 71/138] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:48 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:49.020223 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-be599d09-cf62-4a44-a953-4101cda34824 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:49.028439 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-be599d09-cf62-4a44-a953-4101cda34824 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.160641 Aug 24 12:30:49.028994 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 68/139] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:48 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:49.335230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2f80ac90-1650-482e-8068-885772d94cbf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:49.335836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2f80ac90-1650-482e-8068-885772d94cbf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:49.341689 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f80ac90-1650-482e-8068-885772d94cbf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:49.342157 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f80ac90-1650-482e-8068-885772d94cbf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:49.342580 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f80ac90-1650-482e-8068-885772d94cbf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:49.343283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f80ac90-1650-482e-8068-885772d94cbf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:49.343726 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f80ac90-1650-482e-8068-885772d94cbf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:49.344147 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f80ac90-1650-482e-8068-885772d94cbf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:49.381665 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4a11538f-50a3-401e-bb48-2ab3d047ccc0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:49.382262 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4a11538f-50a3-401e-bb48-2ab3d047ccc0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:49.388172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a11538f-50a3-401e-bb48-2ab3d047ccc0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:49.388642 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a11538f-50a3-401e-bb48-2ab3d047ccc0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:49.389072 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a11538f-50a3-401e-bb48-2ab3d047ccc0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:49.389745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a11538f-50a3-401e-bb48-2ab3d047ccc0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:49.390189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a11538f-50a3-401e-bb48-2ab3d047ccc0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:49.390606 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a11538f-50a3-401e-bb48-2ab3d047ccc0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:49.395295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:30:49.474801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2f80ac90-1650-482e-8068-885772d94cbf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:49.482919 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2f80ac90-1650-482e-8068-885772d94cbf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:49.484419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2f80ac90-1650-482e-8068-885772d94cbf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:49.485507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2f80ac90-1650-482e-8068-885772d94cbf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.154854 Aug 24 12:30:49.486056 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 72/140] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:49 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:49.525248 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4a11538f-50a3-401e-bb48-2ab3d047ccc0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:49.532868 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4a11538f-50a3-401e-bb48-2ab3d047ccc0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.155474 Aug 24 12:30:49.533412 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 69/141] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:49 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:49.965061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4972694c-3028-4079-8346-ded92583e899 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:49.965596 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4972694c-3028-4079-8346-ded92583e899 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:49.971515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4972694c-3028-4079-8346-ded92583e899 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:49.972495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4972694c-3028-4079-8346-ded92583e899 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:49.972923 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4972694c-3028-4079-8346-ded92583e899 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:49.973598 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4972694c-3028-4079-8346-ded92583e899 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:49.974046 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4972694c-3028-4079-8346-ded92583e899 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:49.974466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4972694c-3028-4079-8346-ded92583e899 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:50.049131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e2509e59-b82f-424e-8462-17f0d15d0ca1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:50.049766 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e2509e59-b82f-424e-8462-17f0d15d0ca1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:50.056490 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2509e59-b82f-424e-8462-17f0d15d0ca1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:50.056970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2509e59-b82f-424e-8462-17f0d15d0ca1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:50.057402 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2509e59-b82f-424e-8462-17f0d15d0ca1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:50.058114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2509e59-b82f-424e-8462-17f0d15d0ca1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:50.058560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2509e59-b82f-424e-8462-17f0d15d0ca1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:50.059012 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2509e59-b82f-424e-8462-17f0d15d0ca1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:50.107722 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4972694c-3028-4079-8346-ded92583e899 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:50.117335 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4972694c-3028-4079-8346-ded92583e899 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.156091 Aug 24 12:30:50.117896 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 73/142] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:49 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:50.350469 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e2509e59-b82f-424e-8462-17f0d15d0ca1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:50.365254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e2509e59-b82f-424e-8462-17f0d15d0ca1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.319654 Aug 24 12:30:50.368558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 70/143] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:50 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:50.508997 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c57ca701-0217-4d5b-b922-8648e2e0eb0c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:50.509522 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c57ca701-0217-4d5b-b922-8648e2e0eb0c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:50.515545 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c57ca701-0217-4d5b-b922-8648e2e0eb0c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:50.516026 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c57ca701-0217-4d5b-b922-8648e2e0eb0c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:50.516458 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c57ca701-0217-4d5b-b922-8648e2e0eb0c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:50.517147 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c57ca701-0217-4d5b-b922-8648e2e0eb0c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:50.517604 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c57ca701-0217-4d5b-b922-8648e2e0eb0c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:50.518025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c57ca701-0217-4d5b-b922-8648e2e0eb0c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:50.553045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5c105dd7-d3a1-4926-b7ed-6222edbe77df tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:50.553655 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5c105dd7-d3a1-4926-b7ed-6222edbe77df tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:50.559861 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c105dd7-d3a1-4926-b7ed-6222edbe77df tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:50.560394 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c105dd7-d3a1-4926-b7ed-6222edbe77df tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:50.560791 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c105dd7-d3a1-4926-b7ed-6222edbe77df tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:50.561489 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c105dd7-d3a1-4926-b7ed-6222edbe77df tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:50.561940 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c105dd7-d3a1-4926-b7ed-6222edbe77df tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:50.562363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c105dd7-d3a1-4926-b7ed-6222edbe77df tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:51.072164 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c57ca701-0217-4d5b-b922-8648e2e0eb0c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:51.085065 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c57ca701-0217-4d5b-b922-8648e2e0eb0c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:51.089420 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c57ca701-0217-4d5b-b922-8648e2e0eb0c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:51.093436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c57ca701-0217-4d5b-b922-8648e2e0eb0c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.585978 Aug 24 12:30:51.097323 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 74/144] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:50 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:51.153272 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8c61dada-7c81-4f65-8227-71c08e390c86 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:51.154687 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8c61dada-7c81-4f65-8227-71c08e390c86 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:51.173488 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8c61dada-7c81-4f65-8227-71c08e390c86 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:51.175819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8c61dada-7c81-4f65-8227-71c08e390c86 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:51.176283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8c61dada-7c81-4f65-8227-71c08e390c86 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:51.177047 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8c61dada-7c81-4f65-8227-71c08e390c86 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:51.177500 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8c61dada-7c81-4f65-8227-71c08e390c86 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:51.178838 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8c61dada-7c81-4f65-8227-71c08e390c86 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:51.243465 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5c105dd7-d3a1-4926-b7ed-6222edbe77df tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:51.251133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5c105dd7-d3a1-4926-b7ed-6222edbe77df tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.701801 Aug 24 12:30:51.264588 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 71/145] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:50 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:51.386595 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8624aa22-8487-4cc6-b467-bdea1776f779 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:51.387239 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8624aa22-8487-4cc6-b467-bdea1776f779 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:51.393280 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8624aa22-8487-4cc6-b467-bdea1776f779 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:51.393788 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8624aa22-8487-4cc6-b467-bdea1776f779 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:51.394225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8624aa22-8487-4cc6-b467-bdea1776f779 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:51.399313 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8624aa22-8487-4cc6-b467-bdea1776f779 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:51.399313 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8624aa22-8487-4cc6-b467-bdea1776f779 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:51.399313 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8624aa22-8487-4cc6-b467-bdea1776f779 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:51.419217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8c61dada-7c81-4f65-8227-71c08e390c86 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:51.428683 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8c61dada-7c81-4f65-8227-71c08e390c86 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.291945 Aug 24 12:30:51.432163 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 75/146] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:51 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:51.538764 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8624aa22-8487-4cc6-b467-bdea1776f779 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:51.546546 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8624aa22-8487-4cc6-b467-bdea1776f779 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.164006 Aug 24 12:30:51.547188 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 72/147] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:51 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:52.118729 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0cd54a86-5ab1-4aed-ad75-a3ee6d499157 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:52.119317 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0cd54a86-5ab1-4aed-ad75-a3ee6d499157 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:52.125182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0cd54a86-5ab1-4aed-ad75-a3ee6d499157 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:52.125655 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0cd54a86-5ab1-4aed-ad75-a3ee6d499157 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:52.126078 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0cd54a86-5ab1-4aed-ad75-a3ee6d499157 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:52.126785 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0cd54a86-5ab1-4aed-ad75-a3ee6d499157 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:52.127230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0cd54a86-5ab1-4aed-ad75-a3ee6d499157 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:52.127655 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0cd54a86-5ab1-4aed-ad75-a3ee6d499157 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:52.260854 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0cd54a86-5ab1-4aed-ad75-a3ee6d499157 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:52.268963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0cd54a86-5ab1-4aed-ad75-a3ee6d499157 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:52.271143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0cd54a86-5ab1-4aed-ad75-a3ee6d499157 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:52.272263 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0cd54a86-5ab1-4aed-ad75-a3ee6d499157 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.157700 Aug 24 12:30:52.272747 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3a5afc26-74a9-4c92-963e-c89cb8057dcd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:52.273936 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3a5afc26-74a9-4c92-963e-c89cb8057dcd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:52.277233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 76/148] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:52 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:52.280967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a5afc26-74a9-4c92-963e-c89cb8057dcd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:52.281619 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a5afc26-74a9-4c92-963e-c89cb8057dcd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:52.282153 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a5afc26-74a9-4c92-963e-c89cb8057dcd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:52.283058 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a5afc26-74a9-4c92-963e-c89cb8057dcd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:52.283520 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a5afc26-74a9-4c92-963e-c89cb8057dcd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:52.283948 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a5afc26-74a9-4c92-963e-c89cb8057dcd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:52.430056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3a5afc26-74a9-4c92-963e-c89cb8057dcd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:52.437776 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3a5afc26-74a9-4c92-963e-c89cb8057dcd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.169766 Aug 24 12:30:52.438325 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 73/149] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:52 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:52.451671 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c2680f3b-d7ac-45a2-9595-1db9c21fc937 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:52.452287 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c2680f3b-d7ac-45a2-9595-1db9c21fc937 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:52.459102 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c2680f3b-d7ac-45a2-9595-1db9c21fc937 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:52.461929 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c2680f3b-d7ac-45a2-9595-1db9c21fc937 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:52.461929 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c2680f3b-d7ac-45a2-9595-1db9c21fc937 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:52.461929 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c2680f3b-d7ac-45a2-9595-1db9c21fc937 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:52.461929 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c2680f3b-d7ac-45a2-9595-1db9c21fc937 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:52.462261 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c2680f3b-d7ac-45a2-9595-1db9c21fc937 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:52.570478 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bb93cb15-734f-431a-8ade-e2be0010efa2 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:52.571179 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-bb93cb15-734f-431a-8ade-e2be0010efa2 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:52.577112 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb93cb15-734f-431a-8ade-e2be0010efa2 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:52.577602 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb93cb15-734f-431a-8ade-e2be0010efa2 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:52.578039 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb93cb15-734f-431a-8ade-e2be0010efa2 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:52.578757 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb93cb15-734f-431a-8ade-e2be0010efa2 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:52.579212 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb93cb15-734f-431a-8ade-e2be0010efa2 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:52.579632 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb93cb15-734f-431a-8ade-e2be0010efa2 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:52.600842 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c2680f3b-d7ac-45a2-9595-1db9c21fc937 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:52.608870 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c2680f3b-d7ac-45a2-9595-1db9c21fc937 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.161011 Aug 24 12:30:52.609861 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 77/150] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:52 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:52.717505 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-bb93cb15-734f-431a-8ade-e2be0010efa2 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:52.725809 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bb93cb15-734f-431a-8ade-e2be0010efa2 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.159976 Aug 24 12:30:52.726378 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 74/151] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:52 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:53.295182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dd1af298-fddf-4428-96b7-858eaefbc685 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:53.295775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dd1af298-fddf-4428-96b7-858eaefbc685 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:53.302418 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dd1af298-fddf-4428-96b7-858eaefbc685 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:53.302918 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dd1af298-fddf-4428-96b7-858eaefbc685 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:53.303356 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dd1af298-fddf-4428-96b7-858eaefbc685 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:53.304038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dd1af298-fddf-4428-96b7-858eaefbc685 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:53.304488 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dd1af298-fddf-4428-96b7-858eaefbc685 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:53.304913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dd1af298-fddf-4428-96b7-858eaefbc685 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:53.437544 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-dd1af298-fddf-4428-96b7-858eaefbc685 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:53.446694 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-dd1af298-fddf-4428-96b7-858eaefbc685 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:53.448239 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-dd1af298-fddf-4428-96b7-858eaefbc685 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:53.455482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dd1af298-fddf-4428-96b7-858eaefbc685 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.158186 Aug 24 12:30:53.455482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 78/152] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:53 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:53.458329 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-32335158-3f01-4ac5-85fa-287b7a8daaa3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:53.459002 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-32335158-3f01-4ac5-85fa-287b7a8daaa3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:53.465263 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-32335158-3f01-4ac5-85fa-287b7a8daaa3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:53.465796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-32335158-3f01-4ac5-85fa-287b7a8daaa3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:53.466249 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-32335158-3f01-4ac5-85fa-287b7a8daaa3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:53.467002 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-32335158-3f01-4ac5-85fa-287b7a8daaa3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:53.467571 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-32335158-3f01-4ac5-85fa-287b7a8daaa3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:53.467850 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-32335158-3f01-4ac5-85fa-287b7a8daaa3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:53.601736 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-32335158-3f01-4ac5-85fa-287b7a8daaa3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:53.609258 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-32335158-3f01-4ac5-85fa-287b7a8daaa3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.155267 Aug 24 12:30:53.609821 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 75/153] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:53 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:53.635341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ff25a3bf-6304-4972-a326-166e5f00fe5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:53.635341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ff25a3bf-6304-4972-a326-166e5f00fe5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:53.640089 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ff25a3bf-6304-4972-a326-166e5f00fe5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:53.640731 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ff25a3bf-6304-4972-a326-166e5f00fe5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:53.641171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ff25a3bf-6304-4972-a326-166e5f00fe5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:53.642006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ff25a3bf-6304-4972-a326-166e5f00fe5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:53.642486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ff25a3bf-6304-4972-a326-166e5f00fe5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:53.642938 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ff25a3bf-6304-4972-a326-166e5f00fe5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:53.747533 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a518c881-ac82-48d5-9904-037b50e1b4da tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:53.748416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a518c881-ac82-48d5-9904-037b50e1b4da tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:53.755281 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a518c881-ac82-48d5-9904-037b50e1b4da tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:53.755764 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a518c881-ac82-48d5-9904-037b50e1b4da tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:53.756213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a518c881-ac82-48d5-9904-037b50e1b4da tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:53.756908 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a518c881-ac82-48d5-9904-037b50e1b4da tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:53.757357 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a518c881-ac82-48d5-9904-037b50e1b4da tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:53.757968 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a518c881-ac82-48d5-9904-037b50e1b4da tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:53.778457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ff25a3bf-6304-4972-a326-166e5f00fe5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:53.786040 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ff25a3bf-6304-4972-a326-166e5f00fe5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.160372 Aug 24 12:30:53.786599 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 79/154] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:53 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:53.886062 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a518c881-ac82-48d5-9904-037b50e1b4da tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:53.894200 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a518c881-ac82-48d5-9904-037b50e1b4da tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.150457 Aug 24 12:30:53.895350 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 76/155] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:53 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:54.474078 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d765e5dc-a7c7-48aa-a227-58c7995b187a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:54.474709 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d765e5dc-a7c7-48aa-a227-58c7995b187a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:54.480545 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d765e5dc-a7c7-48aa-a227-58c7995b187a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:54.481022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d765e5dc-a7c7-48aa-a227-58c7995b187a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:54.481446 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d765e5dc-a7c7-48aa-a227-58c7995b187a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:54.482186 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d765e5dc-a7c7-48aa-a227-58c7995b187a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:54.482570 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d765e5dc-a7c7-48aa-a227-58c7995b187a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:54.483010 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d765e5dc-a7c7-48aa-a227-58c7995b187a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:54.630277 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c7a56912-2230-43d6-bc3e-d6e1e8ad7922 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:54.630925 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c7a56912-2230-43d6-bc3e-d6e1e8ad7922 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:54.632844 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=99 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:30:54.637586 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7a56912-2230-43d6-bc3e-d6e1e8ad7922 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:54.638104 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7a56912-2230-43d6-bc3e-d6e1e8ad7922 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:54.638540 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7a56912-2230-43d6-bc3e-d6e1e8ad7922 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:54.639271 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7a56912-2230-43d6-bc3e-d6e1e8ad7922 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:54.639722 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7a56912-2230-43d6-bc3e-d6e1e8ad7922 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:54.640144 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7a56912-2230-43d6-bc3e-d6e1e8ad7922 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:54.649192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d765e5dc-a7c7-48aa-a227-58c7995b187a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:54.657610 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d765e5dc-a7c7-48aa-a227-58c7995b187a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:54.659107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d765e5dc-a7c7-48aa-a227-58c7995b187a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:54.660707 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d765e5dc-a7c7-48aa-a227-58c7995b187a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.190880 Aug 24 12:30:54.661293 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 80/156] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:54 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:30:54.792643 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c7a56912-2230-43d6-bc3e-d6e1e8ad7922 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:54.801220 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c7a56912-2230-43d6-bc3e-d6e1e8ad7922 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.174300 Aug 24 12:30:54.807277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0b5fed23-2512-453f-94b8-b1d43001dab5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:54.807872 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0b5fed23-2512-453f-94b8-b1d43001dab5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:54.810713 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 77/157] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:54 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:54.814049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b5fed23-2512-453f-94b8-b1d43001dab5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:54.814531 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b5fed23-2512-453f-94b8-b1d43001dab5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:54.815022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b5fed23-2512-453f-94b8-b1d43001dab5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:54.815657 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b5fed23-2512-453f-94b8-b1d43001dab5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:54.816128 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b5fed23-2512-453f-94b8-b1d43001dab5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:54.816545 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b5fed23-2512-453f-94b8-b1d43001dab5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:54.915942 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-00631c71-ab52-49b8-ac7c-9d371587ac9b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:54.916776 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-00631c71-ab52-49b8-ac7c-9d371587ac9b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:54.922875 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00631c71-ab52-49b8-ac7c-9d371587ac9b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:54.923359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00631c71-ab52-49b8-ac7c-9d371587ac9b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:54.923799 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00631c71-ab52-49b8-ac7c-9d371587ac9b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:54.924482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00631c71-ab52-49b8-ac7c-9d371587ac9b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:54.924932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00631c71-ab52-49b8-ac7c-9d371587ac9b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:54.925396 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00631c71-ab52-49b8-ac7c-9d371587ac9b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:54.954925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0b5fed23-2512-453f-94b8-b1d43001dab5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:54.964759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0b5fed23-2512-453f-94b8-b1d43001dab5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.161206 Aug 24 12:30:54.965327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 81/158] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:54 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:55.059090 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-00631c71-ab52-49b8-ac7c-9d371587ac9b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:55.066850 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-00631c71-ab52-49b8-ac7c-9d371587ac9b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.154766 Aug 24 12:30:55.067403 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 78/159] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:54 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:55.683856 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-df0692f2-881b-4d12-b7b8-159d7db6907f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:55.684452 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-df0692f2-881b-4d12-b7b8-159d7db6907f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:55.693709 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df0692f2-881b-4d12-b7b8-159d7db6907f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:55.694182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df0692f2-881b-4d12-b7b8-159d7db6907f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:55.694610 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df0692f2-881b-4d12-b7b8-159d7db6907f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:55.695305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df0692f2-881b-4d12-b7b8-159d7db6907f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:55.695755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df0692f2-881b-4d12-b7b8-159d7db6907f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:55.696172 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df0692f2-881b-4d12-b7b8-159d7db6907f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:55.823473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e04789c8-a31f-429b-b3b3-ff3d45276bf2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:55.824147 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e04789c8-a31f-429b-b3b3-ff3d45276bf2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:55.840700 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e04789c8-a31f-429b-b3b3-ff3d45276bf2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:55.841368 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-df0692f2-881b-4d12-b7b8-159d7db6907f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:55.841539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e04789c8-a31f-429b-b3b3-ff3d45276bf2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:55.841797 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e04789c8-a31f-429b-b3b3-ff3d45276bf2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:55.842519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e04789c8-a31f-429b-b3b3-ff3d45276bf2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:55.842996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e04789c8-a31f-429b-b3b3-ff3d45276bf2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:55.843876 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e04789c8-a31f-429b-b3b3-ff3d45276bf2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:55.851051 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-df0692f2-881b-4d12-b7b8-159d7db6907f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:55.852674 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-df0692f2-881b-4d12-b7b8-159d7db6907f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:55.854085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-df0692f2-881b-4d12-b7b8-159d7db6907f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.173979 Aug 24 12:30:55.854964 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 82/160] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:55 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:55.984364 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e04789c8-a31f-429b-b3b3-ff3d45276bf2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:55.985419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d3d34e19-811e-4655-b9e4-e04d8ea68d47 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:55.986023 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d3d34e19-811e-4655-b9e4-e04d8ea68d47 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:55.992939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3d34e19-811e-4655-b9e4-e04d8ea68d47 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:55.993087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e04789c8-a31f-429b-b3b3-ff3d45276bf2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.174834 Aug 24 12:30:56.004549 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3d34e19-811e-4655-b9e4-e04d8ea68d47 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:56.004854 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 79/161] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:55 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:56.004931 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3d34e19-811e-4655-b9e4-e04d8ea68d47 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:56.004931 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3d34e19-811e-4655-b9e4-e04d8ea68d47 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:56.004931 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3d34e19-811e-4655-b9e4-e04d8ea68d47 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:56.004931 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3d34e19-811e-4655-b9e4-e04d8ea68d47 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:56.088742 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-eab29c41-db35-4c9c-bc82-83ffef1288b5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:56.089356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-eab29c41-db35-4c9c-bc82-83ffef1288b5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:56.095782 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eab29c41-db35-4c9c-bc82-83ffef1288b5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:56.096405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eab29c41-db35-4c9c-bc82-83ffef1288b5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:56.107877 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eab29c41-db35-4c9c-bc82-83ffef1288b5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:56.107877 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eab29c41-db35-4c9c-bc82-83ffef1288b5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:56.107877 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eab29c41-db35-4c9c-bc82-83ffef1288b5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:56.107877 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eab29c41-db35-4c9c-bc82-83ffef1288b5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:56.135407 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d3d34e19-811e-4655-b9e4-e04d8ea68d47 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:56.148956 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d3d34e19-811e-4655-b9e4-e04d8ea68d47 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.167220 Aug 24 12:30:56.152915 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 83/162] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:55 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:56.237915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-eab29c41-db35-4c9c-bc82-83ffef1288b5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:56.246722 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-eab29c41-db35-4c9c-bc82-83ffef1288b5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.163203 Aug 24 12:30:56.247382 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 80/163] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:56 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:56.877081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f85e73a6-06b3-49f3-a7a9-aee375fe2ba2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:56.877710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f85e73a6-06b3-49f3-a7a9-aee375fe2ba2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:56.884025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f85e73a6-06b3-49f3-a7a9-aee375fe2ba2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:56.884497 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f85e73a6-06b3-49f3-a7a9-aee375fe2ba2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:56.884926 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f85e73a6-06b3-49f3-a7a9-aee375fe2ba2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:56.885607 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f85e73a6-06b3-49f3-a7a9-aee375fe2ba2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:56.886058 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f85e73a6-06b3-49f3-a7a9-aee375fe2ba2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:56.886481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f85e73a6-06b3-49f3-a7a9-aee375fe2ba2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:57.015591 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-96791706-22c2-48e9-9838-d0858799d307 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:57.016204 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-96791706-22c2-48e9-9838-d0858799d307 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:57.022377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f85e73a6-06b3-49f3-a7a9-aee375fe2ba2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:57.028825 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96791706-22c2-48e9-9838-d0858799d307 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:57.029495 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96791706-22c2-48e9-9838-d0858799d307 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:57.030042 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96791706-22c2-48e9-9838-d0858799d307 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:57.030891 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f85e73a6-06b3-49f3-a7a9-aee375fe2ba2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:57.031023 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96791706-22c2-48e9-9838-d0858799d307 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:57.031347 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96791706-22c2-48e9-9838-d0858799d307 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:57.031767 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96791706-22c2-48e9-9838-d0858799d307 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:57.032381 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f85e73a6-06b3-49f3-a7a9-aee375fe2ba2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:57.033511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f85e73a6-06b3-49f3-a7a9-aee375fe2ba2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.160184 Aug 24 12:30:57.034476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 84/164] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:56 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:57.165969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-96791706-22c2-48e9-9838-d0858799d307 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:57.178892 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-96791706-22c2-48e9-9838-d0858799d307 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.168257 Aug 24 12:30:57.179071 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-11c3acf4-bbd1-44b9-8409-19e587e7b5ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:57.179507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-11c3acf4-bbd1-44b9-8409-19e587e7b5ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:57.179945 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 81/165] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:57 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:57.182449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:30:57.185904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11c3acf4-bbd1-44b9-8409-19e587e7b5ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:57.186428 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11c3acf4-bbd1-44b9-8409-19e587e7b5ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:57.187175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11c3acf4-bbd1-44b9-8409-19e587e7b5ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:57.188018 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11c3acf4-bbd1-44b9-8409-19e587e7b5ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:57.188480 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11c3acf4-bbd1-44b9-8409-19e587e7b5ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:57.188905 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11c3acf4-bbd1-44b9-8409-19e587e7b5ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:57.267672 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7ce60a19-bf08-434b-879b-e5e29727d542 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:57.268273 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7ce60a19-bf08-434b-879b-e5e29727d542 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:57.274307 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7ce60a19-bf08-434b-879b-e5e29727d542 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:57.274819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7ce60a19-bf08-434b-879b-e5e29727d542 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:57.275247 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7ce60a19-bf08-434b-879b-e5e29727d542 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:57.275925 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7ce60a19-bf08-434b-879b-e5e29727d542 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:57.276368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7ce60a19-bf08-434b-879b-e5e29727d542 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:57.276787 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7ce60a19-bf08-434b-879b-e5e29727d542 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:57.329893 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-11c3acf4-bbd1-44b9-8409-19e587e7b5ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:57.339033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-11c3acf4-bbd1-44b9-8409-19e587e7b5ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.165265 Aug 24 12:30:57.340320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 85/166] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:57 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:57.416737 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7ce60a19-bf08-434b-879b-e5e29727d542 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:57.423883 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7ce60a19-bf08-434b-879b-e5e29727d542 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.159990 Aug 24 12:30:57.424449 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 82/167] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:57 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:58.055842 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9926c1d8-186e-4202-9154-8c8059bc59f9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:58.056444 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9926c1d8-186e-4202-9154-8c8059bc59f9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:58.062319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9926c1d8-186e-4202-9154-8c8059bc59f9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:58.062824 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9926c1d8-186e-4202-9154-8c8059bc59f9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:58.063254 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9926c1d8-186e-4202-9154-8c8059bc59f9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:58.063924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9926c1d8-186e-4202-9154-8c8059bc59f9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:58.064369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9926c1d8-186e-4202-9154-8c8059bc59f9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:58.064784 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9926c1d8-186e-4202-9154-8c8059bc59f9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:58.069340 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:30:58.198209 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9926c1d8-186e-4202-9154-8c8059bc59f9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:58.199501 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f5628a68-7d45-4929-bc25-25ec95a8bf2d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:58.205396 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f5628a68-7d45-4929-bc25-25ec95a8bf2d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:58.205855 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5628a68-7d45-4929-bc25-25ec95a8bf2d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:58.206347 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5628a68-7d45-4929-bc25-25ec95a8bf2d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:58.207236 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9926c1d8-186e-4202-9154-8c8059bc59f9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:58.207393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5628a68-7d45-4929-bc25-25ec95a8bf2d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:58.208049 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5628a68-7d45-4929-bc25-25ec95a8bf2d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:58.208502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5628a68-7d45-4929-bc25-25ec95a8bf2d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:58.208925 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5628a68-7d45-4929-bc25-25ec95a8bf2d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:58.209024 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9926c1d8-186e-4202-9154-8c8059bc59f9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:58.210107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9926c1d8-186e-4202-9154-8c8059bc59f9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.158218 Aug 24 12:30:58.210657 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 86/168] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:58 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:30:58.349777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f5628a68-7d45-4929-bc25-25ec95a8bf2d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:58.357967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f5628a68-7d45-4929-bc25-25ec95a8bf2d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.162189 Aug 24 12:30:58.358524 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 83/169] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:58 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:58.359410 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2171a178-c9de-41e6-8d3a-a058eea9d7ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:58.360196 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2171a178-c9de-41e6-8d3a-a058eea9d7ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:58.366638 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2171a178-c9de-41e6-8d3a-a058eea9d7ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:58.367202 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2171a178-c9de-41e6-8d3a-a058eea9d7ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:58.367638 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2171a178-c9de-41e6-8d3a-a058eea9d7ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:58.368476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2171a178-c9de-41e6-8d3a-a058eea9d7ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:58.368940 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2171a178-c9de-41e6-8d3a-a058eea9d7ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:58.369367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2171a178-c9de-41e6-8d3a-a058eea9d7ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:58.446106 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d8be3a9a-cfe8-46a2-b983-f138fea2a464 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:58.447027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d8be3a9a-cfe8-46a2-b983-f138fea2a464 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:58.453870 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8be3a9a-cfe8-46a2-b983-f138fea2a464 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:58.458574 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8be3a9a-cfe8-46a2-b983-f138fea2a464 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:58.458574 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8be3a9a-cfe8-46a2-b983-f138fea2a464 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:58.458574 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8be3a9a-cfe8-46a2-b983-f138fea2a464 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:58.458574 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8be3a9a-cfe8-46a2-b983-f138fea2a464 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:58.459029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8be3a9a-cfe8-46a2-b983-f138fea2a464 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:58.504001 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2171a178-c9de-41e6-8d3a-a058eea9d7ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:58.512686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2171a178-c9de-41e6-8d3a-a058eea9d7ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.156986 Aug 24 12:30:58.513452 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 87/170] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:58 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:58.600110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d8be3a9a-cfe8-46a2-b983-f138fea2a464 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:58.607730 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d8be3a9a-cfe8-46a2-b983-f138fea2a464 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.165573 Aug 24 12:30:58.608290 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 84/171] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:58 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:30:59.232564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-cdad0d30-c61e-460b-ac51-9900c3f915e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:59.233164 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-cdad0d30-c61e-460b-ac51-9900c3f915e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:59.239807 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cdad0d30-c61e-460b-ac51-9900c3f915e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:59.240294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cdad0d30-c61e-460b-ac51-9900c3f915e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:59.240719 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cdad0d30-c61e-460b-ac51-9900c3f915e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:59.241398 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cdad0d30-c61e-460b-ac51-9900c3f915e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:59.241845 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cdad0d30-c61e-460b-ac51-9900c3f915e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:59.242262 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cdad0d30-c61e-460b-ac51-9900c3f915e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:59.379127 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-08a8b116-b408-4e5f-a5ed-90c41e3fab54 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:59.379618 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-cdad0d30-c61e-460b-ac51-9900c3f915e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:59.380702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-08a8b116-b408-4e5f-a5ed-90c41e3fab54 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:59.387718 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-08a8b116-b408-4e5f-a5ed-90c41e3fab54 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:59.388325 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-08a8b116-b408-4e5f-a5ed-90c41e3fab54 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:59.388840 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-08a8b116-b408-4e5f-a5ed-90c41e3fab54 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:59.389611 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-08a8b116-b408-4e5f-a5ed-90c41e3fab54 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:59.390141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-08a8b116-b408-4e5f-a5ed-90c41e3fab54 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:59.390727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-08a8b116-b408-4e5f-a5ed-90c41e3fab54 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:59.391279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-cdad0d30-c61e-460b-ac51-9900c3f915e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:59.392803 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-cdad0d30-c61e-460b-ac51-9900c3f915e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:59.394635 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-cdad0d30-c61e-460b-ac51-9900c3f915e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.165279 Aug 24 12:30:59.395128 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 88/172] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:30:59 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:59.527791 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-08a8b116-b408-4e5f-a5ed-90c41e3fab54 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:59.531487 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:30:59.533535 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2fecff2e-7a37-46bc-aeaa-17e1a41ae390 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:59.534147 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2fecff2e-7a37-46bc-aeaa-17e1a41ae390 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:59.536804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-08a8b116-b408-4e5f-a5ed-90c41e3fab54 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.161948 Aug 24 12:30:59.537496 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 85/173] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:59 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:59.542170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2fecff2e-7a37-46bc-aeaa-17e1a41ae390 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:59.542740 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2fecff2e-7a37-46bc-aeaa-17e1a41ae390 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:59.548784 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2fecff2e-7a37-46bc-aeaa-17e1a41ae390 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:59.548784 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2fecff2e-7a37-46bc-aeaa-17e1a41ae390 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:59.548784 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2fecff2e-7a37-46bc-aeaa-17e1a41ae390 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:59.548784 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2fecff2e-7a37-46bc-aeaa-17e1a41ae390 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:59.630110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-38b09215-14c9-4ecd-a128-91f704c27a3c tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:59.630938 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-38b09215-14c9-4ecd-a128-91f704c27a3c tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:30:59.637604 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-38b09215-14c9-4ecd-a128-91f704c27a3c tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:59.638092 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-38b09215-14c9-4ecd-a128-91f704c27a3c tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:59.638518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-38b09215-14c9-4ecd-a128-91f704c27a3c tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:59.639809 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-38b09215-14c9-4ecd-a128-91f704c27a3c tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:59.640553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-38b09215-14c9-4ecd-a128-91f704c27a3c tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:59.641155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-38b09215-14c9-4ecd-a128-91f704c27a3c tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:59.691943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2fecff2e-7a37-46bc-aeaa-17e1a41ae390 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:59.700937 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2fecff2e-7a37-46bc-aeaa-17e1a41ae390 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.171120 Aug 24 12:30:59.710536 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 89/174] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:59 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:59.800460 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-38b09215-14c9-4ecd-a128-91f704c27a3c tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:30:59.808727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-38b09215-14c9-4ecd-a128-91f704c27a3c tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.183493 Aug 24 12:30:59.822705 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 86/175] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:30:59 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:00.442014 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a0ad3734-d284-4aaa-9f13-c76f7c18eefd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:00.443389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a0ad3734-d284-4aaa-9f13-c76f7c18eefd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:00.449713 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0ad3734-d284-4aaa-9f13-c76f7c18eefd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:00.450197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0ad3734-d284-4aaa-9f13-c76f7c18eefd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:00.450764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0ad3734-d284-4aaa-9f13-c76f7c18eefd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:00.451456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0ad3734-d284-4aaa-9f13-c76f7c18eefd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:00.451913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0ad3734-d284-4aaa-9f13-c76f7c18eefd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:00.452389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0ad3734-d284-4aaa-9f13-c76f7c18eefd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:00.563089 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c9b668cd-f375-418f-b25f-0496f1402ab6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:00.563089 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c9b668cd-f375-418f-b25f-0496f1402ab6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:00.564967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c9b668cd-f375-418f-b25f-0496f1402ab6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:00.565516 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c9b668cd-f375-418f-b25f-0496f1402ab6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:00.566192 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c9b668cd-f375-418f-b25f-0496f1402ab6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:00.566923 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c9b668cd-f375-418f-b25f-0496f1402ab6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:00.567573 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c9b668cd-f375-418f-b25f-0496f1402ab6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:00.568017 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c9b668cd-f375-418f-b25f-0496f1402ab6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:00.595634 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a0ad3734-d284-4aaa-9f13-c76f7c18eefd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:00.604622 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a0ad3734-d284-4aaa-9f13-c76f7c18eefd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:00.606155 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a0ad3734-d284-4aaa-9f13-c76f7c18eefd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:00.607324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a0ad3734-d284-4aaa-9f13-c76f7c18eefd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.176475 Aug 24 12:31:00.607958 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 90/176] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:31:00 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:31:00.702753 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c9b668cd-f375-418f-b25f-0496f1402ab6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:00.710351 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c9b668cd-f375-418f-b25f-0496f1402ab6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.156806 Aug 24 12:31:00.710939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 87/177] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:00 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:00.723539 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e9915d94-6d78-419f-b8e8-3cfd7a5caa9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:00.724269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e9915d94-6d78-419f-b8e8-3cfd7a5caa9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:00.730336 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9915d94-6d78-419f-b8e8-3cfd7a5caa9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:00.730864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9915d94-6d78-419f-b8e8-3cfd7a5caa9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:00.731303 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9915d94-6d78-419f-b8e8-3cfd7a5caa9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:00.731987 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9915d94-6d78-419f-b8e8-3cfd7a5caa9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:00.732443 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9915d94-6d78-419f-b8e8-3cfd7a5caa9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:00.732868 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9915d94-6d78-419f-b8e8-3cfd7a5caa9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:00.830538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f79744e4-5ebc-4b70-bb75-72aba914f3e3 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:00.832858 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f79744e4-5ebc-4b70-bb75-72aba914f3e3 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:00.839483 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f79744e4-5ebc-4b70-bb75-72aba914f3e3 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:00.839965 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f79744e4-5ebc-4b70-bb75-72aba914f3e3 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:00.840395 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f79744e4-5ebc-4b70-bb75-72aba914f3e3 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:00.841147 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f79744e4-5ebc-4b70-bb75-72aba914f3e3 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:00.841759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f79744e4-5ebc-4b70-bb75-72aba914f3e3 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:00.842177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f79744e4-5ebc-4b70-bb75-72aba914f3e3 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:00.874222 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e9915d94-6d78-419f-b8e8-3cfd7a5caa9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:00.882112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e9915d94-6d78-419f-b8e8-3cfd7a5caa9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.162934 Aug 24 12:31:00.882694 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 91/178] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:00 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:00.976373 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f79744e4-5ebc-4b70-bb75-72aba914f3e3 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:00.983989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f79744e4-5ebc-4b70-bb75-72aba914f3e3 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.158405 Aug 24 12:31:00.984552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 88/179] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:00 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:01.631179 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-32287779-72dd-4ed2-a517-f4ed55455096 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:01.631698 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-32287779-72dd-4ed2-a517-f4ed55455096 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:01.639395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-32287779-72dd-4ed2-a517-f4ed55455096 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:01.639879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-32287779-72dd-4ed2-a517-f4ed55455096 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:01.640313 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-32287779-72dd-4ed2-a517-f4ed55455096 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:01.641165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-32287779-72dd-4ed2-a517-f4ed55455096 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:01.641630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-32287779-72dd-4ed2-a517-f4ed55455096 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:01.642052 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-32287779-72dd-4ed2-a517-f4ed55455096 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:01.738340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e47c9d47-5462-44d4-bd04-5bc36d0a02b0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:01.741545 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e47c9d47-5462-44d4-bd04-5bc36d0a02b0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:01.748395 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e47c9d47-5462-44d4-bd04-5bc36d0a02b0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:01.749691 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e47c9d47-5462-44d4-bd04-5bc36d0a02b0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:01.750291 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e47c9d47-5462-44d4-bd04-5bc36d0a02b0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:01.751435 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e47c9d47-5462-44d4-bd04-5bc36d0a02b0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:01.752072 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e47c9d47-5462-44d4-bd04-5bc36d0a02b0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:01.752817 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e47c9d47-5462-44d4-bd04-5bc36d0a02b0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:01.813629 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-32287779-72dd-4ed2-a517-f4ed55455096 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:01.824416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-32287779-72dd-4ed2-a517-f4ed55455096 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:01.826303 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-32287779-72dd-4ed2-a517-f4ed55455096 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:01.827697 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-32287779-72dd-4ed2-a517-f4ed55455096 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.201374 Aug 24 12:31:01.842965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 92/180] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:31:01 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:31:01.918292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-09dbb1f6-91d9-40c6-99fd-121819c823a2 req-b0a68b1f-8e4f-45a5-b3aa-6991d484c983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfbf55c1-60d6-43b4-8a03-84d8ae291daf", "name": "network-vif-plugged", "status": "completed", "tag": "3af0c2af-a730-4f85-a3a0-41267820e2f3"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:31:01.927983 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e47c9d47-5462-44d4-bd04-5bc36d0a02b0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:01.928545 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-09dbb1f6-91d9-40c6-99fd-121819c823a2 req-b0a68b1f-8e4f-45a5-b3aa-6991d484c983 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:01.929030 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-09dbb1f6-91d9-40c6-99fd-121819c823a2 req-b0a68b1f-8e4f-45a5-b3aa-6991d484c983 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:01.929582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-09dbb1f6-91d9-40c6-99fd-121819c823a2 req-b0a68b1f-8e4f-45a5-b3aa-6991d484c983 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:01.936084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e47c9d47-5462-44d4-bd04-5bc36d0a02b0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.208409 Aug 24 12:31:01.943460 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-09dbb1f6-91d9-40c6-99fd-121819c823a2 req-b0a68b1f-8e4f-45a5-b3aa-6991d484c983 service nova] Creating event network-vif-plugged:3af0c2af-a730-4f85-a3a0-41267820e2f3 for instance cfbf55c1-60d6-43b4-8a03-84d8ae291daf on hv-cinder-84889 Aug 24 12:31:01.949232 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 89/181] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:01 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:01.950322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-09dbb1f6-91d9-40c6-99fd-121819c823a2 req-b0a68b1f-8e4f-45a5-b3aa-6991d484c983 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119905 Aug 24 12:31:01.951391 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 93/182] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:31:01.954624 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8c2c5856-e887-470b-9fbf-a255213f53c3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:01.955254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8c2c5856-e887-470b-9fbf-a255213f53c3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:01.962639 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c2c5856-e887-470b-9fbf-a255213f53c3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:01.963148 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c2c5856-e887-470b-9fbf-a255213f53c3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:01.963642 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c2c5856-e887-470b-9fbf-a255213f53c3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:01.964250 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c2c5856-e887-470b-9fbf-a255213f53c3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:01.964726 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c2c5856-e887-470b-9fbf-a255213f53c3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:01.965167 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c2c5856-e887-470b-9fbf-a255213f53c3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:02.005311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-be792c2a-81c5-40b6-8179-3a26bcc47663 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:02.006275 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-be792c2a-81c5-40b6-8179-3a26bcc47663 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:02.012920 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be792c2a-81c5-40b6-8179-3a26bcc47663 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:02.013486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be792c2a-81c5-40b6-8179-3a26bcc47663 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:02.013874 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be792c2a-81c5-40b6-8179-3a26bcc47663 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:02.014573 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be792c2a-81c5-40b6-8179-3a26bcc47663 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:02.015053 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be792c2a-81c5-40b6-8179-3a26bcc47663 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:02.015477 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be792c2a-81c5-40b6-8179-3a26bcc47663 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:02.104430 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8c2c5856-e887-470b-9fbf-a255213f53c3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:02.112407 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8c2c5856-e887-470b-9fbf-a255213f53c3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.161880 Aug 24 12:31:02.113677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 90/183] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:01 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:02.162264 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-be792c2a-81c5-40b6-8179-3a26bcc47663 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:02.173489 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-be792c2a-81c5-40b6-8179-3a26bcc47663 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.172262 Aug 24 12:31:02.174234 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 94/184] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:01 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:02.850679 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ea1b4b1f-2ac8-4703-93c7-bff462566690 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:02.851345 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ea1b4b1f-2ac8-4703-93c7-bff462566690 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:02.859279 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea1b4b1f-2ac8-4703-93c7-bff462566690 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:02.859860 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea1b4b1f-2ac8-4703-93c7-bff462566690 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:02.860300 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea1b4b1f-2ac8-4703-93c7-bff462566690 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:02.860996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea1b4b1f-2ac8-4703-93c7-bff462566690 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:02.861453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea1b4b1f-2ac8-4703-93c7-bff462566690 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:02.861877 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea1b4b1f-2ac8-4703-93c7-bff462566690 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:02.956325 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0966f135-0a5b-4105-98f4-b32adbf7b8b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:02.957583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0966f135-0a5b-4105-98f4-b32adbf7b8b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:02.971482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0966f135-0a5b-4105-98f4-b32adbf7b8b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:02.971984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0966f135-0a5b-4105-98f4-b32adbf7b8b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:02.972488 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0966f135-0a5b-4105-98f4-b32adbf7b8b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:02.973192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0966f135-0a5b-4105-98f4-b32adbf7b8b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:02.973646 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0966f135-0a5b-4105-98f4-b32adbf7b8b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:02.975358 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0966f135-0a5b-4105-98f4-b32adbf7b8b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:03.013898 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ea1b4b1f-2ac8-4703-93c7-bff462566690 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:03.023192 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ea1b4b1f-2ac8-4703-93c7-bff462566690 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:03.024800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ea1b4b1f-2ac8-4703-93c7-bff462566690 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:03.025944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ea1b4b1f-2ac8-4703-93c7-bff462566690 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.179183 Aug 24 12:31:03.026534 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 91/185] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:31:02 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:31:03.123185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0966f135-0a5b-4105-98f4-b32adbf7b8b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:03.131428 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0966f135-0a5b-4105-98f4-b32adbf7b8b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.178953 Aug 24 12:31:03.131985 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 95/186] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:02 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:03.138095 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fdfb1b8d-7c24-4ab9-88b1-4a227e1a6f8f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:03.138808 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fdfb1b8d-7c24-4ab9-88b1-4a227e1a6f8f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:03.145049 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fdfb1b8d-7c24-4ab9-88b1-4a227e1a6f8f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:03.145539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fdfb1b8d-7c24-4ab9-88b1-4a227e1a6f8f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:03.146171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fdfb1b8d-7c24-4ab9-88b1-4a227e1a6f8f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:03.146898 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fdfb1b8d-7c24-4ab9-88b1-4a227e1a6f8f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:03.147356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fdfb1b8d-7c24-4ab9-88b1-4a227e1a6f8f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:03.147779 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fdfb1b8d-7c24-4ab9-88b1-4a227e1a6f8f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:03.197065 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e73d3beb-5a27-495c-81b6-ae580392d5f1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:03.198015 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e73d3beb-5a27-495c-81b6-ae580392d5f1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:03.205557 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e73d3beb-5a27-495c-81b6-ae580392d5f1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:03.206052 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e73d3beb-5a27-495c-81b6-ae580392d5f1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:03.206519 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e73d3beb-5a27-495c-81b6-ae580392d5f1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:03.207249 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e73d3beb-5a27-495c-81b6-ae580392d5f1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:03.207701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e73d3beb-5a27-495c-81b6-ae580392d5f1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:03.208347 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e73d3beb-5a27-495c-81b6-ae580392d5f1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:03.326462 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fdfb1b8d-7c24-4ab9-88b1-4a227e1a6f8f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:03.335167 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fdfb1b8d-7c24-4ab9-88b1-4a227e1a6f8f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.201448 Aug 24 12:31:03.335976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 92/187] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:03 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:03.384313 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e73d3beb-5a27-495c-81b6-ae580392d5f1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:03.392834 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e73d3beb-5a27-495c-81b6-ae580392d5f1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.201643 Aug 24 12:31:03.393481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 96/188] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:03 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:04.049255 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-32b6f322-567c-47cc-bba7-66ca3f37bba0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:04.049980 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-32b6f322-567c-47cc-bba7-66ca3f37bba0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:04.055721 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-32b6f322-567c-47cc-bba7-66ca3f37bba0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:04.056211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-32b6f322-567c-47cc-bba7-66ca3f37bba0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:04.056650 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-32b6f322-567c-47cc-bba7-66ca3f37bba0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:04.057331 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-32b6f322-567c-47cc-bba7-66ca3f37bba0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:04.057785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-32b6f322-567c-47cc-bba7-66ca3f37bba0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:04.058209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-32b6f322-567c-47cc-bba7-66ca3f37bba0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:04.151719 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-92a14d86-19cb-4c33-bdb3-997b5750bf5f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:04.152322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-92a14d86-19cb-4c33-bdb3-997b5750bf5f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:04.158229 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92a14d86-19cb-4c33-bdb3-997b5750bf5f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:04.158869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92a14d86-19cb-4c33-bdb3-997b5750bf5f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:04.160151 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92a14d86-19cb-4c33-bdb3-997b5750bf5f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:04.161073 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92a14d86-19cb-4c33-bdb3-997b5750bf5f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:04.163959 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92a14d86-19cb-4c33-bdb3-997b5750bf5f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:04.163959 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92a14d86-19cb-4c33-bdb3-997b5750bf5f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:04.192810 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-32b6f322-567c-47cc-bba7-66ca3f37bba0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:04.201383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-32b6f322-567c-47cc-bba7-66ca3f37bba0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:04.202941 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-32b6f322-567c-47cc-bba7-66ca3f37bba0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:04.204048 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-32b6f322-567c-47cc-bba7-66ca3f37bba0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.158616 Aug 24 12:31:04.204793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 93/189] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:31:04 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:31:04.311177 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-92a14d86-19cb-4c33-bdb3-997b5750bf5f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:04.319649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-92a14d86-19cb-4c33-bdb3-997b5750bf5f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.171869 Aug 24 12:31:04.320214 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 97/190] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:04 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:04.357224 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-dfce5a0c-9109-4e66-b539-5b902a0482ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:04.357829 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-dfce5a0c-9109-4e66-b539-5b902a0482ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:04.363639 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dfce5a0c-9109-4e66-b539-5b902a0482ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:04.364121 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dfce5a0c-9109-4e66-b539-5b902a0482ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:04.364820 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dfce5a0c-9109-4e66-b539-5b902a0482ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:04.365501 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dfce5a0c-9109-4e66-b539-5b902a0482ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:04.365957 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dfce5a0c-9109-4e66-b539-5b902a0482ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:04.366379 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dfce5a0c-9109-4e66-b539-5b902a0482ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:04.420491 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f520b048-d0d8-482c-ac08-b3c0407bbebb tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:04.421101 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f520b048-d0d8-482c-ac08-b3c0407bbebb tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:04.433688 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f520b048-d0d8-482c-ac08-b3c0407bbebb tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:04.434462 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f520b048-d0d8-482c-ac08-b3c0407bbebb tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:04.435288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f520b048-d0d8-482c-ac08-b3c0407bbebb tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:04.436208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f520b048-d0d8-482c-ac08-b3c0407bbebb tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:04.436917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f520b048-d0d8-482c-ac08-b3c0407bbebb tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:04.437463 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f520b048-d0d8-482c-ac08-b3c0407bbebb tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:04.514922 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-dfce5a0c-9109-4e66-b539-5b902a0482ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:04.523115 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-dfce5a0c-9109-4e66-b539-5b902a0482ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.169642 Aug 24 12:31:04.523675 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 94/191] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:04 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:04.573325 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f520b048-d0d8-482c-ac08-b3c0407bbebb tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:04.581083 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f520b048-d0d8-482c-ac08-b3c0407bbebb tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.170354 Aug 24 12:31:04.582185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 98/192] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:04 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:05.228584 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-77548b79-11cc-4e30-be79-341b4912dfc4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:05.229184 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-77548b79-11cc-4e30-be79-341b4912dfc4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:05.235479 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-77548b79-11cc-4e30-be79-341b4912dfc4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:05.235960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-77548b79-11cc-4e30-be79-341b4912dfc4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:05.236388 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-77548b79-11cc-4e30-be79-341b4912dfc4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:05.237070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-77548b79-11cc-4e30-be79-341b4912dfc4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:05.237516 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-77548b79-11cc-4e30-be79-341b4912dfc4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:05.238506 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-77548b79-11cc-4e30-be79-341b4912dfc4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:05.340981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6079b35b-bcfb-4d76-89bb-d94695ac6d3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:05.341706 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6079b35b-bcfb-4d76-89bb-d94695ac6d3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:05.349133 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6079b35b-bcfb-4d76-89bb-d94695ac6d3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:05.349616 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6079b35b-bcfb-4d76-89bb-d94695ac6d3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:05.350051 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6079b35b-bcfb-4d76-89bb-d94695ac6d3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:05.350775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6079b35b-bcfb-4d76-89bb-d94695ac6d3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:05.351354 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6079b35b-bcfb-4d76-89bb-d94695ac6d3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:05.354042 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6079b35b-bcfb-4d76-89bb-d94695ac6d3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:05.390728 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-77548b79-11cc-4e30-be79-341b4912dfc4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:05.404250 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-77548b79-11cc-4e30-be79-341b4912dfc4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:05.405758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-77548b79-11cc-4e30-be79-341b4912dfc4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:05.407075 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-77548b79-11cc-4e30-be79-341b4912dfc4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.182132 Aug 24 12:31:05.410951 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 95/193] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:31:05 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:31:05.504712 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6079b35b-bcfb-4d76-89bb-d94695ac6d3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:05.513089 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6079b35b-bcfb-4d76-89bb-d94695ac6d3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.176114 Aug 24 12:31:05.513675 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 99/194] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:05 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:05.544610 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b70b804d-9880-41b8-b6e6-5fa33e414036 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:05.545213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b70b804d-9880-41b8-b6e6-5fa33e414036 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:05.551598 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b70b804d-9880-41b8-b6e6-5fa33e414036 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:05.552077 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b70b804d-9880-41b8-b6e6-5fa33e414036 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:05.552508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b70b804d-9880-41b8-b6e6-5fa33e414036 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:05.553198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b70b804d-9880-41b8-b6e6-5fa33e414036 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:05.553645 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b70b804d-9880-41b8-b6e6-5fa33e414036 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:05.554184 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b70b804d-9880-41b8-b6e6-5fa33e414036 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:05.601983 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-27fc6765-6923-4578-a1be-3f2cd9d078d9 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:05.602776 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-27fc6765-6923-4578-a1be-3f2cd9d078d9 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:05.609012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-27fc6765-6923-4578-a1be-3f2cd9d078d9 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:05.609775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-27fc6765-6923-4578-a1be-3f2cd9d078d9 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:05.610277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-27fc6765-6923-4578-a1be-3f2cd9d078d9 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:05.611077 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-27fc6765-6923-4578-a1be-3f2cd9d078d9 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:05.611853 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-27fc6765-6923-4578-a1be-3f2cd9d078d9 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:05.612298 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-27fc6765-6923-4578-a1be-3f2cd9d078d9 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:05.707601 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b70b804d-9880-41b8-b6e6-5fa33e414036 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:05.715561 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b70b804d-9880-41b8-b6e6-5fa33e414036 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.174876 Aug 24 12:31:05.716280 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 96/195] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:05 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:05.765811 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-27fc6765-6923-4578-a1be-3f2cd9d078d9 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:05.774316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-27fc6765-6923-4578-a1be-3f2cd9d078d9 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.176162 Aug 24 12:31:05.775002 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 100/196] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:05 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:06.430200 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-93ccf3a6-c45b-4d4a-abd0-4618cfa6596e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:06.431186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-93ccf3a6-c45b-4d4a-abd0-4618cfa6596e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:06.436737 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-93ccf3a6-c45b-4d4a-abd0-4618cfa6596e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:06.437212 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-93ccf3a6-c45b-4d4a-abd0-4618cfa6596e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:06.437688 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-93ccf3a6-c45b-4d4a-abd0-4618cfa6596e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:06.438317 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-93ccf3a6-c45b-4d4a-abd0-4618cfa6596e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:06.438787 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-93ccf3a6-c45b-4d4a-abd0-4618cfa6596e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:06.439211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-93ccf3a6-c45b-4d4a-abd0-4618cfa6596e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:06.533176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a39ce1ce-c7b1-4386-94f9-f49ec6a7d4a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:06.533777 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a39ce1ce-c7b1-4386-94f9-f49ec6a7d4a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:06.540322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a39ce1ce-c7b1-4386-94f9-f49ec6a7d4a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:06.540803 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a39ce1ce-c7b1-4386-94f9-f49ec6a7d4a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:06.541237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a39ce1ce-c7b1-4386-94f9-f49ec6a7d4a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:06.541924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a39ce1ce-c7b1-4386-94f9-f49ec6a7d4a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:06.542372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a39ce1ce-c7b1-4386-94f9-f49ec6a7d4a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:06.542826 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a39ce1ce-c7b1-4386-94f9-f49ec6a7d4a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:06.570378 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-93ccf3a6-c45b-4d4a-abd0-4618cfa6596e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:06.579982 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-93ccf3a6-c45b-4d4a-abd0-4618cfa6596e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:06.581462 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-93ccf3a6-c45b-4d4a-abd0-4618cfa6596e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:06.582559 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-93ccf3a6-c45b-4d4a-abd0-4618cfa6596e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.156934 Aug 24 12:31:06.586718 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 97/197] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:31:06 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:31:06.684687 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a39ce1ce-c7b1-4386-94f9-f49ec6a7d4a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:06.695582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a39ce1ce-c7b1-4386-94f9-f49ec6a7d4a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.163028 Aug 24 12:31:06.695582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 101/198] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:06 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:06.735980 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-28f349a2-4a7a-4c7c-9377-3525f3093655 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:06.736594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-28f349a2-4a7a-4c7c-9377-3525f3093655 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:06.743643 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28f349a2-4a7a-4c7c-9377-3525f3093655 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:06.743864 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28f349a2-4a7a-4c7c-9377-3525f3093655 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:06.744301 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28f349a2-4a7a-4c7c-9377-3525f3093655 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:06.744991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28f349a2-4a7a-4c7c-9377-3525f3093655 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:06.745449 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28f349a2-4a7a-4c7c-9377-3525f3093655 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:06.746033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28f349a2-4a7a-4c7c-9377-3525f3093655 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:06.795162 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e58ab8ee-118d-4afc-bd8b-378783ef40a7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:06.795775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e58ab8ee-118d-4afc-bd8b-378783ef40a7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:06.802290 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e58ab8ee-118d-4afc-bd8b-378783ef40a7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:06.802799 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e58ab8ee-118d-4afc-bd8b-378783ef40a7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:06.803232 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e58ab8ee-118d-4afc-bd8b-378783ef40a7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:06.803913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e58ab8ee-118d-4afc-bd8b-378783ef40a7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:06.804364 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e58ab8ee-118d-4afc-bd8b-378783ef40a7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:06.804788 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e58ab8ee-118d-4afc-bd8b-378783ef40a7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:06.883262 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-28f349a2-4a7a-4c7c-9377-3525f3093655 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:06.898351 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-28f349a2-4a7a-4c7c-9377-3525f3093655 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.159334 Aug 24 12:31:06.898351 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 98/199] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:06 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:06.956485 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e58ab8ee-118d-4afc-bd8b-378783ef40a7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:06.964764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e58ab8ee-118d-4afc-bd8b-378783ef40a7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.173475 Aug 24 12:31:06.968403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 102/200] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:06 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:07.607730 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-15ed54c3-6daf-4c47-8635-f74e3d3f7956 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:07.608361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-15ed54c3-6daf-4c47-8635-f74e3d3f7956 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:07.614367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15ed54c3-6daf-4c47-8635-f74e3d3f7956 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:07.615132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15ed54c3-6daf-4c47-8635-f74e3d3f7956 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:07.616070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15ed54c3-6daf-4c47-8635-f74e3d3f7956 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:07.616752 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15ed54c3-6daf-4c47-8635-f74e3d3f7956 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:07.617206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15ed54c3-6daf-4c47-8635-f74e3d3f7956 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:07.617630 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15ed54c3-6daf-4c47-8635-f74e3d3f7956 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:07.712739 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6ae76857-dd3d-4ec0-a772-46d5ee356636 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:07.713386 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6ae76857-dd3d-4ec0-a772-46d5ee356636 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:07.719273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6ae76857-dd3d-4ec0-a772-46d5ee356636 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:07.719752 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6ae76857-dd3d-4ec0-a772-46d5ee356636 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:07.720180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6ae76857-dd3d-4ec0-a772-46d5ee356636 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:07.720863 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6ae76857-dd3d-4ec0-a772-46d5ee356636 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:07.721313 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6ae76857-dd3d-4ec0-a772-46d5ee356636 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:07.721736 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6ae76857-dd3d-4ec0-a772-46d5ee356636 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:07.739349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:31:07.747024 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-15ed54c3-6daf-4c47-8635-f74e3d3f7956 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:07.756094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-15ed54c3-6daf-4c47-8635-f74e3d3f7956 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:07.758236 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-15ed54c3-6daf-4c47-8635-f74e3d3f7956 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:07.759465 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-15ed54c3-6daf-4c47-8635-f74e3d3f7956 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.155570 Aug 24 12:31:07.759965 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 99/201] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:31:07 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:31:07.850904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6ae76857-dd3d-4ec0-a772-46d5ee356636 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:07.858628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6ae76857-dd3d-4ec0-a772-46d5ee356636 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.149632 Aug 24 12:31:07.859197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 103/202] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:07 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:07.912994 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2c30a9ab-770b-4a0c-ad88-82f9b7741eaf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:07.913606 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2c30a9ab-770b-4a0c-ad88-82f9b7741eaf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:07.919529 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c30a9ab-770b-4a0c-ad88-82f9b7741eaf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:07.920015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c30a9ab-770b-4a0c-ad88-82f9b7741eaf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:07.920453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c30a9ab-770b-4a0c-ad88-82f9b7741eaf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:07.921157 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c30a9ab-770b-4a0c-ad88-82f9b7741eaf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:07.921614 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c30a9ab-770b-4a0c-ad88-82f9b7741eaf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:07.922043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c30a9ab-770b-4a0c-ad88-82f9b7741eaf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:07.986102 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-171b4e90-42a5-44a9-a3fa-4512f56c4618 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:07.986713 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-171b4e90-42a5-44a9-a3fa-4512f56c4618 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:07.994145 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-171b4e90-42a5-44a9-a3fa-4512f56c4618 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:07.994693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-171b4e90-42a5-44a9-a3fa-4512f56c4618 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:07.995285 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-171b4e90-42a5-44a9-a3fa-4512f56c4618 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:07.996046 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-171b4e90-42a5-44a9-a3fa-4512f56c4618 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:07.996565 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-171b4e90-42a5-44a9-a3fa-4512f56c4618 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:07.997181 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-171b4e90-42a5-44a9-a3fa-4512f56c4618 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:08.056914 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2c30a9ab-770b-4a0c-ad88-82f9b7741eaf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:08.065226 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2c30a9ab-770b-4a0c-ad88-82f9b7741eaf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.156465 Aug 24 12:31:08.065853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 100/203] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:07 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:08.135143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-171b4e90-42a5-44a9-a3fa-4512f56c4618 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:08.142615 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-171b4e90-42a5-44a9-a3fa-4512f56c4618 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.160545 Aug 24 12:31:08.143197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 104/204] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:07 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:08.781315 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5aa92a2e-ce54-4ee2-8e82-ddca37b13bf7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:08.781916 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5aa92a2e-ce54-4ee2-8e82-ddca37b13bf7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:08.787877 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5aa92a2e-ce54-4ee2-8e82-ddca37b13bf7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:08.788354 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5aa92a2e-ce54-4ee2-8e82-ddca37b13bf7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:08.788786 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5aa92a2e-ce54-4ee2-8e82-ddca37b13bf7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:08.789468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5aa92a2e-ce54-4ee2-8e82-ddca37b13bf7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:08.789918 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5aa92a2e-ce54-4ee2-8e82-ddca37b13bf7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:08.790340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5aa92a2e-ce54-4ee2-8e82-ddca37b13bf7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:08.882021 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c1521173-0b22-4c63-b40d-911a2fc6de67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:08.882712 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c1521173-0b22-4c63-b40d-911a2fc6de67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:08.889036 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1521173-0b22-4c63-b40d-911a2fc6de67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:08.889583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1521173-0b22-4c63-b40d-911a2fc6de67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:08.890025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1521173-0b22-4c63-b40d-911a2fc6de67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:08.890765 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1521173-0b22-4c63-b40d-911a2fc6de67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:08.891251 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1521173-0b22-4c63-b40d-911a2fc6de67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:08.891844 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1521173-0b22-4c63-b40d-911a2fc6de67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:08.937489 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5aa92a2e-ce54-4ee2-8e82-ddca37b13bf7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:08.946569 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5aa92a2e-ce54-4ee2-8e82-ddca37b13bf7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:08.948196 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5aa92a2e-ce54-4ee2-8e82-ddca37b13bf7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:08.949308 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5aa92a2e-ce54-4ee2-8e82-ddca37b13bf7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.171893 Aug 24 12:31:08.949864 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 101/205] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:31:08 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:31:09.047930 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c1521173-0b22-4c63-b40d-911a2fc6de67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:09.056396 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c1521173-0b22-4c63-b40d-911a2fc6de67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.180036 Aug 24 12:31:09.067791 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 105/206] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:08 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:09.085591 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7abfc189-d7d6-471c-8968-d15e80d0cf98 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:09.086195 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7abfc189-d7d6-471c-8968-d15e80d0cf98 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:09.092062 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7abfc189-d7d6-471c-8968-d15e80d0cf98 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:09.092542 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7abfc189-d7d6-471c-8968-d15e80d0cf98 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:09.092975 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7abfc189-d7d6-471c-8968-d15e80d0cf98 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:09.093657 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7abfc189-d7d6-471c-8968-d15e80d0cf98 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:09.094117 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7abfc189-d7d6-471c-8968-d15e80d0cf98 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:09.094540 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7abfc189-d7d6-471c-8968-d15e80d0cf98 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:09.112793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:31:09.163775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d30b0d46-cbd2-41c6-8dec-826fb9cd9469 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:09.164389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d30b0d46-cbd2-41c6-8dec-826fb9cd9469 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:09.170355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d30b0d46-cbd2-41c6-8dec-826fb9cd9469 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:09.170882 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d30b0d46-cbd2-41c6-8dec-826fb9cd9469 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:09.171379 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d30b0d46-cbd2-41c6-8dec-826fb9cd9469 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:09.172116 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d30b0d46-cbd2-41c6-8dec-826fb9cd9469 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:09.172629 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d30b0d46-cbd2-41c6-8dec-826fb9cd9469 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:09.173082 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d30b0d46-cbd2-41c6-8dec-826fb9cd9469 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:09.230991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7abfc189-d7d6-471c-8968-d15e80d0cf98 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:09.239321 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7abfc189-d7d6-471c-8968-d15e80d0cf98 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.157531 Aug 24 12:31:09.241221 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 102/207] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:09 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:09.322861 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d30b0d46-cbd2-41c6-8dec-826fb9cd9469 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:09.330749 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d30b0d46-cbd2-41c6-8dec-826fb9cd9469 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.171035 Aug 24 12:31:09.331308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 106/208] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:09 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:09.972086 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-65559b86-11e3-456d-a8ec-e97a6a74de91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:09.972664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-65559b86-11e3-456d-a8ec-e97a6a74de91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:09.979126 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-65559b86-11e3-456d-a8ec-e97a6a74de91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:09.979688 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-65559b86-11e3-456d-a8ec-e97a6a74de91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:09.980175 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-65559b86-11e3-456d-a8ec-e97a6a74de91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:09.981094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-65559b86-11e3-456d-a8ec-e97a6a74de91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:09.981481 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-65559b86-11e3-456d-a8ec-e97a6a74de91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:09.981958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-65559b86-11e3-456d-a8ec-e97a6a74de91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:10.079361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-298a8f9b-5e60-4b95-aaaa-910290facc4c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:10.079815 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-298a8f9b-5e60-4b95-aaaa-910290facc4c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:10.094720 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-298a8f9b-5e60-4b95-aaaa-910290facc4c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:10.095651 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-298a8f9b-5e60-4b95-aaaa-910290facc4c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:10.096176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-298a8f9b-5e60-4b95-aaaa-910290facc4c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:10.097232 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-298a8f9b-5e60-4b95-aaaa-910290facc4c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:10.097886 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-298a8f9b-5e60-4b95-aaaa-910290facc4c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:10.098582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-298a8f9b-5e60-4b95-aaaa-910290facc4c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:10.148242 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-65559b86-11e3-456d-a8ec-e97a6a74de91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:10.160409 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-65559b86-11e3-456d-a8ec-e97a6a74de91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:10.162215 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-65559b86-11e3-456d-a8ec-e97a6a74de91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:10.164172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-65559b86-11e3-456d-a8ec-e97a6a74de91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.196023 Aug 24 12:31:10.175532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 103/209] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:31:09 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:31:10.207289 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-f64c8983-7dc3-4c10-8931-25ff93d16465 req-bed65ac2-6c42-4a3c-af9d-8b52b9dc8b1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e5a10ee-202a-453e-b3ff-6c5c05ec72f3", "name": "network-vif-plugged", "status": "completed", "tag": "65aeb21b-342d-4c27-963d-8c021915548c"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:31:10.217786 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-f64c8983-7dc3-4c10-8931-25ff93d16465 req-bed65ac2-6c42-4a3c-af9d-8b52b9dc8b1c service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:10.218269 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-f64c8983-7dc3-4c10-8931-25ff93d16465 req-bed65ac2-6c42-4a3c-af9d-8b52b9dc8b1c service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:10.218762 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-f64c8983-7dc3-4c10-8931-25ff93d16465 req-bed65ac2-6c42-4a3c-af9d-8b52b9dc8b1c service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:10.230519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-f64c8983-7dc3-4c10-8931-25ff93d16465 req-bed65ac2-6c42-4a3c-af9d-8b52b9dc8b1c service nova] Creating event network-vif-plugged:65aeb21b-342d-4c27-963d-8c021915548c for instance 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 on hv-cinder-84889 Aug 24 12:31:10.235975 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-f64c8983-7dc3-4c10-8931-25ff93d16465 req-bed65ac2-6c42-4a3c-af9d-8b52b9dc8b1c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037426 Aug 24 12:31:10.236567 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 104/210] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:31:10.252260 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-298a8f9b-5e60-4b95-aaaa-910290facc4c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:10.261809 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c6105b3f-9e74-4c8c-8c80-c14daff811b2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:10.278708 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c6105b3f-9e74-4c8c-8c80-c14daff811b2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:10.278928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-298a8f9b-5e60-4b95-aaaa-910290facc4c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.189274 Aug 24 12:31:10.278928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 107/211] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:10 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:10.279097 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c6105b3f-9e74-4c8c-8c80-c14daff811b2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:10.279097 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c6105b3f-9e74-4c8c-8c80-c14daff811b2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:10.279097 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c6105b3f-9e74-4c8c-8c80-c14daff811b2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:10.279097 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c6105b3f-9e74-4c8c-8c80-c14daff811b2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:10.279412 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c6105b3f-9e74-4c8c-8c80-c14daff811b2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:10.279412 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c6105b3f-9e74-4c8c-8c80-c14daff811b2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:10.360466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-613be22e-1313-44d3-9ee4-19aa1e11673d tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:10.363617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-613be22e-1313-44d3-9ee4-19aa1e11673d tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:10.374460 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-613be22e-1313-44d3-9ee4-19aa1e11673d tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:10.375944 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-613be22e-1313-44d3-9ee4-19aa1e11673d tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:10.376523 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-613be22e-1313-44d3-9ee4-19aa1e11673d tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:10.377359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-613be22e-1313-44d3-9ee4-19aa1e11673d tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:10.377921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-613be22e-1313-44d3-9ee4-19aa1e11673d tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:10.378497 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-613be22e-1313-44d3-9ee4-19aa1e11673d tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:10.444991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c6105b3f-9e74-4c8c-8c80-c14daff811b2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:10.457240 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c6105b3f-9e74-4c8c-8c80-c14daff811b2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.199525 Aug 24 12:31:10.457824 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 105/212] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:10 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:10.564677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-613be22e-1313-44d3-9ee4-19aa1e11673d tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:10.574498 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-613be22e-1313-44d3-9ee4-19aa1e11673d tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.225638 Aug 24 12:31:10.575404 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 108/213] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:10 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:11.190770 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d299645d-2239-4e1f-82ec-d37858677f3d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:11.190770 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d299645d-2239-4e1f-82ec-d37858677f3d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:11.196593 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d299645d-2239-4e1f-82ec-d37858677f3d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:11.197173 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d299645d-2239-4e1f-82ec-d37858677f3d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:11.197618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d299645d-2239-4e1f-82ec-d37858677f3d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:11.198317 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d299645d-2239-4e1f-82ec-d37858677f3d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:11.198804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d299645d-2239-4e1f-82ec-d37858677f3d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:11.199227 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d299645d-2239-4e1f-82ec-d37858677f3d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:11.285827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-36c08cc6-246f-4434-ab78-b0e58e955abd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:11.287059 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-36c08cc6-246f-4434-ab78-b0e58e955abd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:11.301563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-36c08cc6-246f-4434-ab78-b0e58e955abd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:11.302177 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-36c08cc6-246f-4434-ab78-b0e58e955abd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:11.306770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-36c08cc6-246f-4434-ab78-b0e58e955abd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:11.306770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-36c08cc6-246f-4434-ab78-b0e58e955abd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:11.306770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-36c08cc6-246f-4434-ab78-b0e58e955abd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:11.306770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-36c08cc6-246f-4434-ab78-b0e58e955abd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:11.406644 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d299645d-2239-4e1f-82ec-d37858677f3d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:11.420706 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d299645d-2239-4e1f-82ec-d37858677f3d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:11.422633 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d299645d-2239-4e1f-82ec-d37858677f3d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:11.424772 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d299645d-2239-4e1f-82ec-d37858677f3d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.241293 Aug 24 12:31:11.437868 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 106/214] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:31:11 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:31:11.484836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-153ade6f-824b-4441-b66c-ab4b19094b32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:11.484836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-153ade6f-824b-4441-b66c-ab4b19094b32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:11.491052 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-153ade6f-824b-4441-b66c-ab4b19094b32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:11.491824 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-153ade6f-824b-4441-b66c-ab4b19094b32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:11.492432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-153ade6f-824b-4441-b66c-ab4b19094b32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:11.493297 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-153ade6f-824b-4441-b66c-ab4b19094b32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:11.493625 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-153ade6f-824b-4441-b66c-ab4b19094b32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:11.494137 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-153ade6f-824b-4441-b66c-ab4b19094b32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:11.507514 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-36c08cc6-246f-4434-ab78-b0e58e955abd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:11.510771 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-36c08cc6-246f-4434-ab78-b0e58e955abd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.228837 Aug 24 12:31:11.511727 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 109/215] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:11 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:11.596214 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-756a7e77-b94f-4af9-89c0-c60fe7a80b6d tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:11.597293 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-756a7e77-b94f-4af9-89c0-c60fe7a80b6d tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:11.603308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-756a7e77-b94f-4af9-89c0-c60fe7a80b6d tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:11.603801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-756a7e77-b94f-4af9-89c0-c60fe7a80b6d tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:11.604235 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-756a7e77-b94f-4af9-89c0-c60fe7a80b6d tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:11.605137 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-756a7e77-b94f-4af9-89c0-c60fe7a80b6d tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:11.605765 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-756a7e77-b94f-4af9-89c0-c60fe7a80b6d tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:11.606197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-756a7e77-b94f-4af9-89c0-c60fe7a80b6d tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:11.653409 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-153ade6f-824b-4441-b66c-ab4b19094b32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:11.661267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-153ade6f-824b-4441-b66c-ab4b19094b32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.181468 Aug 24 12:31:11.661860 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 107/216] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:11 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:11.744553 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-756a7e77-b94f-4af9-89c0-c60fe7a80b6d tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:11.752247 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-756a7e77-b94f-4af9-89c0-c60fe7a80b6d tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.160309 Aug 24 12:31:11.755505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 110/217] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:11 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:12.447756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bb4f744b-a4fd-44f6-97e3-f176a5f1abb7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:12.448351 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-bb4f744b-a4fd-44f6-97e3-f176a5f1abb7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:12.454206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb4f744b-a4fd-44f6-97e3-f176a5f1abb7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:12.454720 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb4f744b-a4fd-44f6-97e3-f176a5f1abb7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:12.455150 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb4f744b-a4fd-44f6-97e3-f176a5f1abb7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:12.455818 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb4f744b-a4fd-44f6-97e3-f176a5f1abb7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:12.456262 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb4f744b-a4fd-44f6-97e3-f176a5f1abb7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:12.456677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb4f744b-a4fd-44f6-97e3-f176a5f1abb7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:12.531431 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-33871468-8159-4b02-a147-f38798d95c62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:12.532029 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-33871468-8159-4b02-a147-f38798d95c62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:12.538130 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33871468-8159-4b02-a147-f38798d95c62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:12.538611 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33871468-8159-4b02-a147-f38798d95c62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:12.539089 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33871468-8159-4b02-a147-f38798d95c62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:12.540904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33871468-8159-4b02-a147-f38798d95c62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:12.541356 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33871468-8159-4b02-a147-f38798d95c62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:12.541772 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33871468-8159-4b02-a147-f38798d95c62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:12.600067 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-bb4f744b-a4fd-44f6-97e3-f176a5f1abb7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:12.609831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-bb4f744b-a4fd-44f6-97e3-f176a5f1abb7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:12.610454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-bb4f744b-a4fd-44f6-97e3-f176a5f1abb7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:12.611597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bb4f744b-a4fd-44f6-97e3-f176a5f1abb7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.167721 Aug 24 12:31:12.612629 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 108/218] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:31:12 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:31:12.676173 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-33871468-8159-4b02-a147-f38798d95c62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:12.681641 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c1c1546a-03ea-4d9e-82ec-7c7f56c852de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:12.682460 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c1c1546a-03ea-4d9e-82ec-7c7f56c852de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:12.684220 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-33871468-8159-4b02-a147-f38798d95c62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.156927 Aug 24 12:31:12.684814 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 111/219] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:12 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:12.688442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1c1546a-03ea-4d9e-82ec-7c7f56c852de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:12.696367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1c1546a-03ea-4d9e-82ec-7c7f56c852de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:12.696367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1c1546a-03ea-4d9e-82ec-7c7f56c852de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:12.696367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1c1546a-03ea-4d9e-82ec-7c7f56c852de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:12.696367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1c1546a-03ea-4d9e-82ec-7c7f56c852de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:12.696799 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1c1546a-03ea-4d9e-82ec-7c7f56c852de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:12.775054 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-093492aa-4024-4c27-8762-7b88c4d56950 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:12.775800 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-093492aa-4024-4c27-8762-7b88c4d56950 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:12.782088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-093492aa-4024-4c27-8762-7b88c4d56950 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:12.782835 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-093492aa-4024-4c27-8762-7b88c4d56950 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:12.783450 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-093492aa-4024-4c27-8762-7b88c4d56950 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:12.784145 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-093492aa-4024-4c27-8762-7b88c4d56950 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:12.784596 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-093492aa-4024-4c27-8762-7b88c4d56950 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:12.785018 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-093492aa-4024-4c27-8762-7b88c4d56950 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:12.823582 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c1c1546a-03ea-4d9e-82ec-7c7f56c852de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:12.831426 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c1c1546a-03ea-4d9e-82ec-7c7f56c852de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.153673 Aug 24 12:31:12.831997 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 109/220] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:12 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:12.923078 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-093492aa-4024-4c27-8762-7b88c4d56950 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:12.930585 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-093492aa-4024-4c27-8762-7b88c4d56950 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.159982 Aug 24 12:31:12.931164 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 112/221] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:12 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:13.635377 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f7d12223-1149-4244-99ae-4403ce692272 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:13.635983 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f7d12223-1149-4244-99ae-4403ce692272 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:13.641800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f7d12223-1149-4244-99ae-4403ce692272 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:13.642307 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f7d12223-1149-4244-99ae-4403ce692272 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:13.642765 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f7d12223-1149-4244-99ae-4403ce692272 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:13.643443 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f7d12223-1149-4244-99ae-4403ce692272 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:13.643892 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f7d12223-1149-4244-99ae-4403ce692272 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:13.644319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f7d12223-1149-4244-99ae-4403ce692272 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:13.704974 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0d8c9bba-bfb5-44a6-9d7d-7bb554dd3b07 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:13.705712 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0d8c9bba-bfb5-44a6-9d7d-7bb554dd3b07 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:13.711608 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0d8c9bba-bfb5-44a6-9d7d-7bb554dd3b07 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:13.712155 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0d8c9bba-bfb5-44a6-9d7d-7bb554dd3b07 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:13.712656 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0d8c9bba-bfb5-44a6-9d7d-7bb554dd3b07 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:13.713402 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0d8c9bba-bfb5-44a6-9d7d-7bb554dd3b07 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:13.713891 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0d8c9bba-bfb5-44a6-9d7d-7bb554dd3b07 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:13.714702 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0d8c9bba-bfb5-44a6-9d7d-7bb554dd3b07 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:13.783763 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f7d12223-1149-4244-99ae-4403ce692272 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:13.796252 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f7d12223-1149-4244-99ae-4403ce692272 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:13.797712 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f7d12223-1149-4244-99ae-4403ce692272 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:13.798985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f7d12223-1149-4244-99ae-4403ce692272 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.168034 Aug 24 12:31:13.799557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 110/222] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:31:13 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:31:13.853016 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0b2c10b4-b62c-4327-af1a-930b13de8b01 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:13.853703 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0b2c10b4-b62c-4327-af1a-930b13de8b01 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:13.859569 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0b2c10b4-b62c-4327-af1a-930b13de8b01 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:13.860044 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0b2c10b4-b62c-4327-af1a-930b13de8b01 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:13.860470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0b2c10b4-b62c-4327-af1a-930b13de8b01 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:13.861147 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0b2c10b4-b62c-4327-af1a-930b13de8b01 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:13.861592 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0b2c10b4-b62c-4327-af1a-930b13de8b01 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:13.862008 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0b2c10b4-b62c-4327-af1a-930b13de8b01 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:13.867745 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0d8c9bba-bfb5-44a6-9d7d-7bb554dd3b07 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:13.876226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0d8c9bba-bfb5-44a6-9d7d-7bb554dd3b07 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.175152 Aug 24 12:31:13.876895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 113/223] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:13 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:13.950892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-df7ecf8e-f97f-415f-95e7-7346cf2eb0ac tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:13.951499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-df7ecf8e-f97f-415f-95e7-7346cf2eb0ac tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:13.957288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df7ecf8e-f97f-415f-95e7-7346cf2eb0ac tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:13.957770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df7ecf8e-f97f-415f-95e7-7346cf2eb0ac tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:13.958194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df7ecf8e-f97f-415f-95e7-7346cf2eb0ac tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:13.958905 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df7ecf8e-f97f-415f-95e7-7346cf2eb0ac tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:13.959356 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df7ecf8e-f97f-415f-95e7-7346cf2eb0ac tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:13.959778 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df7ecf8e-f97f-415f-95e7-7346cf2eb0ac tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:13.991277 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0b2c10b4-b62c-4327-af1a-930b13de8b01 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:13.999687 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0b2c10b4-b62c-4327-af1a-930b13de8b01 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.151060 Aug 24 12:31:14.000396 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 111/224] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:13 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:14.086266 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-df7ecf8e-f97f-415f-95e7-7346cf2eb0ac tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:14.094266 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-df7ecf8e-f97f-415f-95e7-7346cf2eb0ac tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.147229 Aug 24 12:31:14.094851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 114/225] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:13 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:14.822310 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4fbb3005-da88-40a9-82eb-108d1b2b3ac3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:14.822966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4fbb3005-da88-40a9-82eb-108d1b2b3ac3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:14.828967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4fbb3005-da88-40a9-82eb-108d1b2b3ac3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:14.829445 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4fbb3005-da88-40a9-82eb-108d1b2b3ac3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:14.829880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4fbb3005-da88-40a9-82eb-108d1b2b3ac3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:14.830561 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4fbb3005-da88-40a9-82eb-108d1b2b3ac3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:14.831034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4fbb3005-da88-40a9-82eb-108d1b2b3ac3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:14.831455 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4fbb3005-da88-40a9-82eb-108d1b2b3ac3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:14.896553 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3d7e2712-77ea-49cb-9714-473813da0866 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:14.897153 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3d7e2712-77ea-49cb-9714-473813da0866 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:14.903592 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d7e2712-77ea-49cb-9714-473813da0866 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:14.904072 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d7e2712-77ea-49cb-9714-473813da0866 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:14.904499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d7e2712-77ea-49cb-9714-473813da0866 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:14.905180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d7e2712-77ea-49cb-9714-473813da0866 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:14.905628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d7e2712-77ea-49cb-9714-473813da0866 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:14.906043 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d7e2712-77ea-49cb-9714-473813da0866 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:14.965419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4fbb3005-da88-40a9-82eb-108d1b2b3ac3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:14.973414 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4fbb3005-da88-40a9-82eb-108d1b2b3ac3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:14.974917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4fbb3005-da88-40a9-82eb-108d1b2b3ac3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:14.976137 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4fbb3005-da88-40a9-82eb-108d1b2b3ac3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.157747 Aug 24 12:31:14.976686 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 112/226] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:31:14 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:31:15.020974 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2a422c0b-b43a-40f7-97b6-8a8014cd2e7e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:15.021574 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2a422c0b-b43a-40f7-97b6-8a8014cd2e7e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:15.028054 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a422c0b-b43a-40f7-97b6-8a8014cd2e7e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:15.028529 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a422c0b-b43a-40f7-97b6-8a8014cd2e7e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:15.029437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a422c0b-b43a-40f7-97b6-8a8014cd2e7e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:15.029971 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a422c0b-b43a-40f7-97b6-8a8014cd2e7e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:15.030420 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a422c0b-b43a-40f7-97b6-8a8014cd2e7e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:15.030865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a422c0b-b43a-40f7-97b6-8a8014cd2e7e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:15.033001 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3d7e2712-77ea-49cb-9714-473813da0866 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:15.041409 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3d7e2712-77ea-49cb-9714-473813da0866 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.148682 Aug 24 12:31:15.042054 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 115/227] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:14 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:15.115349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fef05bab-671d-4a3c-9d8c-bd556665c054 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:15.115945 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fef05bab-671d-4a3c-9d8c-bd556665c054 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:15.121796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fef05bab-671d-4a3c-9d8c-bd556665c054 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:15.122317 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fef05bab-671d-4a3c-9d8c-bd556665c054 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:15.122867 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fef05bab-671d-4a3c-9d8c-bd556665c054 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:15.123540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fef05bab-671d-4a3c-9d8c-bd556665c054 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:15.124085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fef05bab-671d-4a3c-9d8c-bd556665c054 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:15.124516 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fef05bab-671d-4a3c-9d8c-bd556665c054 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:15.163010 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2a422c0b-b43a-40f7-97b6-8a8014cd2e7e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:15.171381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2a422c0b-b43a-40f7-97b6-8a8014cd2e7e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.154111 Aug 24 12:31:15.171881 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 113/228] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:15 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:15.254277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fef05bab-671d-4a3c-9d8c-bd556665c054 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:15.261861 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fef05bab-671d-4a3c-9d8c-bd556665c054 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.150810 Aug 24 12:31:15.262414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 116/229] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:15 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:15.999644 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-73106fb4-9784-42a6-90aa-890a3a6b96bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:16.000248 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-73106fb4-9784-42a6-90aa-890a3a6b96bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:16.006050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-73106fb4-9784-42a6-90aa-890a3a6b96bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:16.006522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-73106fb4-9784-42a6-90aa-890a3a6b96bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:16.006998 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-73106fb4-9784-42a6-90aa-890a3a6b96bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:16.007673 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-73106fb4-9784-42a6-90aa-890a3a6b96bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:16.008121 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-73106fb4-9784-42a6-90aa-890a3a6b96bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:16.009183 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-73106fb4-9784-42a6-90aa-890a3a6b96bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:16.061909 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d2041761-5c18-4860-bcd7-576fc3300439 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:16.062538 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d2041761-5c18-4860-bcd7-576fc3300439 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:16.069294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d2041761-5c18-4860-bcd7-576fc3300439 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:16.069901 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d2041761-5c18-4860-bcd7-576fc3300439 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:16.070412 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d2041761-5c18-4860-bcd7-576fc3300439 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:16.071258 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d2041761-5c18-4860-bcd7-576fc3300439 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:16.071805 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d2041761-5c18-4860-bcd7-576fc3300439 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:16.072306 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d2041761-5c18-4860-bcd7-576fc3300439 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:16.137625 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-73106fb4-9784-42a6-90aa-890a3a6b96bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:16.146045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-73106fb4-9784-42a6-90aa-890a3a6b96bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:16.148165 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-73106fb4-9784-42a6-90aa-890a3a6b96bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:16.148791 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-73106fb4-9784-42a6-90aa-890a3a6b96bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.153041 Aug 24 12:31:16.149436 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 114/230] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:31:15 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:31:16.192073 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6d1eb1d8-2770-429b-b124-57d09292e2b3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:16.196478 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6d1eb1d8-2770-429b-b124-57d09292e2b3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:16.198727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d1eb1d8-2770-429b-b124-57d09292e2b3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:16.199164 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d1eb1d8-2770-429b-b124-57d09292e2b3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:16.199626 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d1eb1d8-2770-429b-b124-57d09292e2b3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:16.200312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d1eb1d8-2770-429b-b124-57d09292e2b3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:16.200702 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d2041761-5c18-4860-bcd7-576fc3300439 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:16.200817 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d1eb1d8-2770-429b-b124-57d09292e2b3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:16.201174 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d1eb1d8-2770-429b-b124-57d09292e2b3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:16.208809 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d2041761-5c18-4860-bcd7-576fc3300439 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.150756 Aug 24 12:31:16.209376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 117/231] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:16 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:16.282725 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-30bf190d-066b-41b6-981d-0e781031c763 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:16.283431 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-30bf190d-066b-41b6-981d-0e781031c763 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:16.289332 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30bf190d-066b-41b6-981d-0e781031c763 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:16.290444 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30bf190d-066b-41b6-981d-0e781031c763 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:16.290905 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30bf190d-066b-41b6-981d-0e781031c763 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:16.291581 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30bf190d-066b-41b6-981d-0e781031c763 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:16.292026 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30bf190d-066b-41b6-981d-0e781031c763 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:16.292443 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30bf190d-066b-41b6-981d-0e781031c763 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:16.331898 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6d1eb1d8-2770-429b-b124-57d09292e2b3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:16.349801 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6d1eb1d8-2770-429b-b124-57d09292e2b3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.161457 Aug 24 12:31:16.350381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 115/232] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:16 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:16.423463 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-30bf190d-066b-41b6-981d-0e781031c763 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:16.431231 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-30bf190d-066b-41b6-981d-0e781031c763 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.152263 Aug 24 12:31:16.431794 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 118/233] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:16 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:17.171436 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5920fe09-db79-42ab-bb52-09a1bbacd82a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:17.172033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5920fe09-db79-42ab-bb52-09a1bbacd82a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:17.177802 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5920fe09-db79-42ab-bb52-09a1bbacd82a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:17.178270 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5920fe09-db79-42ab-bb52-09a1bbacd82a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:17.178725 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5920fe09-db79-42ab-bb52-09a1bbacd82a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:17.179435 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5920fe09-db79-42ab-bb52-09a1bbacd82a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:17.179873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5920fe09-db79-42ab-bb52-09a1bbacd82a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:17.180283 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5920fe09-db79-42ab-bb52-09a1bbacd82a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:17.230008 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ad3088a1-4122-4cfc-b76a-70daa5e4d7d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:17.230679 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ad3088a1-4122-4cfc-b76a-70daa5e4d7d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:17.236482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad3088a1-4122-4cfc-b76a-70daa5e4d7d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:17.236954 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad3088a1-4122-4cfc-b76a-70daa5e4d7d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:17.237378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad3088a1-4122-4cfc-b76a-70daa5e4d7d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:17.238059 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad3088a1-4122-4cfc-b76a-70daa5e4d7d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:17.238503 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad3088a1-4122-4cfc-b76a-70daa5e4d7d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:17.238943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad3088a1-4122-4cfc-b76a-70daa5e4d7d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:17.312415 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5920fe09-db79-42ab-bb52-09a1bbacd82a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:17.320782 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5920fe09-db79-42ab-bb52-09a1bbacd82a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:17.322255 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5920fe09-db79-42ab-bb52-09a1bbacd82a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:17.323367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5920fe09-db79-42ab-bb52-09a1bbacd82a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.155889 Aug 24 12:31:17.323949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 116/234] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:31:17 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:31:17.367019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ad3088a1-4122-4cfc-b76a-70daa5e4d7d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:17.370891 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f93cf75d-36a9-4615-be5b-777e73a4be87 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:17.371496 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f93cf75d-36a9-4615-be5b-777e73a4be87 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:17.374644 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ad3088a1-4122-4cfc-b76a-70daa5e4d7d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.149342 Aug 24 12:31:17.375220 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 119/235] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:17 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:17.377462 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f93cf75d-36a9-4615-be5b-777e73a4be87 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:17.377947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f93cf75d-36a9-4615-be5b-777e73a4be87 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:17.378386 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f93cf75d-36a9-4615-be5b-777e73a4be87 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:17.379103 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f93cf75d-36a9-4615-be5b-777e73a4be87 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:17.379555 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f93cf75d-36a9-4615-be5b-777e73a4be87 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:17.379979 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f93cf75d-36a9-4615-be5b-777e73a4be87 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:17.451737 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b38fca32-037d-49e0-8d32-b7a43a6235d7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:17.452344 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b38fca32-037d-49e0-8d32-b7a43a6235d7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:17.458591 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b38fca32-037d-49e0-8d32-b7a43a6235d7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:17.459162 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b38fca32-037d-49e0-8d32-b7a43a6235d7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:17.459678 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b38fca32-037d-49e0-8d32-b7a43a6235d7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:17.460363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b38fca32-037d-49e0-8d32-b7a43a6235d7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:17.460984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b38fca32-037d-49e0-8d32-b7a43a6235d7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:17.461409 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b38fca32-037d-49e0-8d32-b7a43a6235d7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:17.466121 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:31:17.532140 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f93cf75d-36a9-4615-be5b-777e73a4be87 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:17.534192 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f93cf75d-36a9-4615-be5b-777e73a4be87 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.166945 Aug 24 12:31:17.535199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 117/236] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:17 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:17.607231 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b38fca32-037d-49e0-8d32-b7a43a6235d7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:17.614979 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b38fca32-037d-49e0-8d32-b7a43a6235d7 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.166979 Aug 24 12:31:17.615533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 120/237] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:17 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:18.346192 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9414c8a9-9393-420d-90aa-c97391720801 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:18.346831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9414c8a9-9393-420d-90aa-c97391720801 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:18.352710 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9414c8a9-9393-420d-90aa-c97391720801 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:18.353745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9414c8a9-9393-420d-90aa-c97391720801 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:18.354206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9414c8a9-9393-420d-90aa-c97391720801 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:18.354913 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9414c8a9-9393-420d-90aa-c97391720801 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:18.355365 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9414c8a9-9393-420d-90aa-c97391720801 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:18.355792 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9414c8a9-9393-420d-90aa-c97391720801 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:18.394948 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e1de0eca-2cfa-43d1-b88c-75f3503f0ceb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:18.395477 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e1de0eca-2cfa-43d1-b88c-75f3503f0ceb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:18.401451 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e1de0eca-2cfa-43d1-b88c-75f3503f0ceb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:18.401978 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e1de0eca-2cfa-43d1-b88c-75f3503f0ceb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:18.402406 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e1de0eca-2cfa-43d1-b88c-75f3503f0ceb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:18.403107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e1de0eca-2cfa-43d1-b88c-75f3503f0ceb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:18.403552 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e1de0eca-2cfa-43d1-b88c-75f3503f0ceb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:18.403965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e1de0eca-2cfa-43d1-b88c-75f3503f0ceb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:18.490627 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9414c8a9-9393-420d-90aa-c97391720801 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:18.499770 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9414c8a9-9393-420d-90aa-c97391720801 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:18.501302 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9414c8a9-9393-420d-90aa-c97391720801 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:18.502400 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9414c8a9-9393-420d-90aa-c97391720801 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.160234 Aug 24 12:31:18.503014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 118/238] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:31:18 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:31:18.540890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e1de0eca-2cfa-43d1-b88c-75f3503f0ceb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:18.549904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e1de0eca-2cfa-43d1-b88c-75f3503f0ceb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.157297 Aug 24 12:31:18.549904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 121/239] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:18 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:18.554334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4b42b340-a199-4b09-b095-1a8f0b9149b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:18.554973 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4b42b340-a199-4b09-b095-1a8f0b9149b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:18.561725 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b42b340-a199-4b09-b095-1a8f0b9149b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:18.562201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b42b340-a199-4b09-b095-1a8f0b9149b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:18.562629 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b42b340-a199-4b09-b095-1a8f0b9149b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:18.563333 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b42b340-a199-4b09-b095-1a8f0b9149b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:18.563804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b42b340-a199-4b09-b095-1a8f0b9149b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:18.564220 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b42b340-a199-4b09-b095-1a8f0b9149b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:18.634917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-105d32ef-223b-4628-8a62-2279fe782091 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:18.635529 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-105d32ef-223b-4628-8a62-2279fe782091 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:18.641769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-105d32ef-223b-4628-8a62-2279fe782091 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:18.642356 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-105d32ef-223b-4628-8a62-2279fe782091 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:18.643004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-105d32ef-223b-4628-8a62-2279fe782091 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:18.643869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-105d32ef-223b-4628-8a62-2279fe782091 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:18.644490 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-105d32ef-223b-4628-8a62-2279fe782091 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:18.645122 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-105d32ef-223b-4628-8a62-2279fe782091 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:18.700557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4b42b340-a199-4b09-b095-1a8f0b9149b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:18.704270 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:31:18.708762 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4b42b340-a199-4b09-b095-1a8f0b9149b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.158132 Aug 24 12:31:18.709341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 119/240] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:18 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:18.776311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-105d32ef-223b-4628-8a62-2279fe782091 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:18.783936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-105d32ef-223b-4628-8a62-2279fe782091 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.152839 Aug 24 12:31:18.784501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 122/241] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:18 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:18.830086 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-a4ad2595-1106-40d3-9471-0d5f063296b5 req-b9b1814b-b24b-4d49-807d-fccad80f6cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720992f6-0031-4c2a-801d-07a71dd87158", "name": "network-vif-plugged", "status": "completed", "tag": "ffb749d1-7131-4112-a58f-5f3e9cc94cd1"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:31:18.839976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-a4ad2595-1106-40d3-9471-0d5f063296b5 req-b9b1814b-b24b-4d49-807d-fccad80f6cc4 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:18.840571 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-a4ad2595-1106-40d3-9471-0d5f063296b5 req-b9b1814b-b24b-4d49-807d-fccad80f6cc4 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:18.841091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-a4ad2595-1106-40d3-9471-0d5f063296b5 req-b9b1814b-b24b-4d49-807d-fccad80f6cc4 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:18.852389 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-a4ad2595-1106-40d3-9471-0d5f063296b5 req-b9b1814b-b24b-4d49-807d-fccad80f6cc4 service nova] Creating event network-vif-plugged:ffb749d1-7131-4112-a58f-5f3e9cc94cd1 for instance 720992f6-0031-4c2a-801d-07a71dd87158 on hv-cinder-84889 Aug 24 12:31:18.858152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-a4ad2595-1106-40d3-9471-0d5f063296b5 req-b9b1814b-b24b-4d49-807d-fccad80f6cc4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032183 Aug 24 12:31:18.858777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 120/242] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:31:19.526501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e0d43053-292b-4b6a-bcca-326870b88e6c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:19.527133 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e0d43053-292b-4b6a-bcca-326870b88e6c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:19.533263 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0d43053-292b-4b6a-bcca-326870b88e6c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:19.533737 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0d43053-292b-4b6a-bcca-326870b88e6c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:19.534161 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0d43053-292b-4b6a-bcca-326870b88e6c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:19.534882 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0d43053-292b-4b6a-bcca-326870b88e6c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:19.535329 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0d43053-292b-4b6a-bcca-326870b88e6c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:19.535746 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0d43053-292b-4b6a-bcca-326870b88e6c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:19.570295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ba9bc258-1f06-401d-9ad9-d7a5a1e74a24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:19.571011 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ba9bc258-1f06-401d-9ad9-d7a5a1e74a24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:19.578736 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ba9bc258-1f06-401d-9ad9-d7a5a1e74a24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:19.579217 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ba9bc258-1f06-401d-9ad9-d7a5a1e74a24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:19.579728 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ba9bc258-1f06-401d-9ad9-d7a5a1e74a24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:19.580638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ba9bc258-1f06-401d-9ad9-d7a5a1e74a24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:19.581084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ba9bc258-1f06-401d-9ad9-d7a5a1e74a24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:19.581504 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ba9bc258-1f06-401d-9ad9-d7a5a1e74a24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:19.676097 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e0d43053-292b-4b6a-bcca-326870b88e6c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:19.690710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e0d43053-292b-4b6a-bcca-326870b88e6c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:19.690710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e0d43053-292b-4b6a-bcca-326870b88e6c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:19.690710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e0d43053-292b-4b6a-bcca-326870b88e6c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.165860 Aug 24 12:31:19.691165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 123/243] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:31:19 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:31:19.729703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-814785c7-0a80-4721-bf3b-0e801677ccd2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:19.730313 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-814785c7-0a80-4721-bf3b-0e801677ccd2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:19.730803 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ba9bc258-1f06-401d-9ad9-d7a5a1e74a24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:19.736272 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-814785c7-0a80-4721-bf3b-0e801677ccd2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:19.736750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-814785c7-0a80-4721-bf3b-0e801677ccd2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:19.737183 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-814785c7-0a80-4721-bf3b-0e801677ccd2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:19.738099 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-814785c7-0a80-4721-bf3b-0e801677ccd2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:19.738258 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ba9bc258-1f06-401d-9ad9-d7a5a1e74a24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.173110 Aug 24 12:31:19.738556 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-814785c7-0a80-4721-bf3b-0e801677ccd2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:19.738866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 121/244] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:19 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:19.739005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-814785c7-0a80-4721-bf3b-0e801677ccd2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:19.804245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2561b54d-cb90-45db-9f4d-886170ed31b1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:19.804854 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2561b54d-cb90-45db-9f4d-886170ed31b1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:19.811729 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2561b54d-cb90-45db-9f4d-886170ed31b1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:19.812214 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2561b54d-cb90-45db-9f4d-886170ed31b1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:19.812643 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2561b54d-cb90-45db-9f4d-886170ed31b1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:19.813338 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2561b54d-cb90-45db-9f4d-886170ed31b1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:19.813778 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2561b54d-cb90-45db-9f4d-886170ed31b1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:19.814195 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2561b54d-cb90-45db-9f4d-886170ed31b1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:19.885087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-814785c7-0a80-4721-bf3b-0e801677ccd2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:19.892634 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-814785c7-0a80-4721-bf3b-0e801677ccd2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.167154 Aug 24 12:31:19.893197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 124/245] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:19 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:19.949655 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2561b54d-cb90-45db-9f4d-886170ed31b1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:19.957124 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2561b54d-cb90-45db-9f4d-886170ed31b1 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.156765 Aug 24 12:31:19.957692 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 122/246] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:19 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:20.711323 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6a44391b-5797-4886-955e-bfc4cd1d5ef6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:20.713049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6a44391b-5797-4886-955e-bfc4cd1d5ef6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:20.720133 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a44391b-5797-4886-955e-bfc4cd1d5ef6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:20.720663 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a44391b-5797-4886-955e-bfc4cd1d5ef6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:20.721318 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a44391b-5797-4886-955e-bfc4cd1d5ef6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:20.722184 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a44391b-5797-4886-955e-bfc4cd1d5ef6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:20.722759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a44391b-5797-4886-955e-bfc4cd1d5ef6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:20.723192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a44391b-5797-4886-955e-bfc4cd1d5ef6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:20.761314 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-91ed7b46-4f5a-4054-974e-9c2d13e399e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:20.762058 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-91ed7b46-4f5a-4054-974e-9c2d13e399e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:20.768815 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91ed7b46-4f5a-4054-974e-9c2d13e399e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:20.771376 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91ed7b46-4f5a-4054-974e-9c2d13e399e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:20.771904 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91ed7b46-4f5a-4054-974e-9c2d13e399e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:20.772708 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91ed7b46-4f5a-4054-974e-9c2d13e399e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:20.773242 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91ed7b46-4f5a-4054-974e-9c2d13e399e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:20.773728 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91ed7b46-4f5a-4054-974e-9c2d13e399e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:20.866192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6a44391b-5797-4886-955e-bfc4cd1d5ef6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:20.874350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6a44391b-5797-4886-955e-bfc4cd1d5ef6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:20.875895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6a44391b-5797-4886-955e-bfc4cd1d5ef6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:20.877265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6a44391b-5797-4886-955e-bfc4cd1d5ef6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.170442 Aug 24 12:31:20.877978 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 125/247] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:31:20 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:31:20.912876 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0feaac56-aefe-4cd4-a60d-83d56a2b907c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:20.913743 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0feaac56-aefe-4cd4-a60d-83d56a2b907c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:20.921547 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0feaac56-aefe-4cd4-a60d-83d56a2b907c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:20.922107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0feaac56-aefe-4cd4-a60d-83d56a2b907c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:20.922743 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0feaac56-aefe-4cd4-a60d-83d56a2b907c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:20.923995 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0feaac56-aefe-4cd4-a60d-83d56a2b907c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:20.924693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0feaac56-aefe-4cd4-a60d-83d56a2b907c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:20.925604 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0feaac56-aefe-4cd4-a60d-83d56a2b907c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:20.930774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-91ed7b46-4f5a-4054-974e-9c2d13e399e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:20.937342 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-91ed7b46-4f5a-4054-974e-9c2d13e399e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.181613 Aug 24 12:31:20.938177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 123/248] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:20 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:20.977506 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0d83ef93-ec2c-4bad-993e-f108860a86ef tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:20.978232 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0d83ef93-ec2c-4bad-993e-f108860a86ef tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:20.984713 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d83ef93-ec2c-4bad-993e-f108860a86ef tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:20.985444 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d83ef93-ec2c-4bad-993e-f108860a86ef tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:20.985919 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d83ef93-ec2c-4bad-993e-f108860a86ef tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:20.986603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d83ef93-ec2c-4bad-993e-f108860a86ef tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:20.987075 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d83ef93-ec2c-4bad-993e-f108860a86ef tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:20.987668 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d83ef93-ec2c-4bad-993e-f108860a86ef tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:21.136277 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0d83ef93-ec2c-4bad-993e-f108860a86ef tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:21.147347 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0d83ef93-ec2c-4bad-993e-f108860a86ef tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.173794 Aug 24 12:31:21.148181 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 124/249] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:20 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:21.294344 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0feaac56-aefe-4cd4-a60d-83d56a2b907c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:21.302058 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0feaac56-aefe-4cd4-a60d-83d56a2b907c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.392964 Aug 24 12:31:21.302625 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 126/250] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:20 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:21.900773 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9832d987-d50a-49fc-972a-5e9c10d2283f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:21.901365 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9832d987-d50a-49fc-972a-5e9c10d2283f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:21.907416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9832d987-d50a-49fc-972a-5e9c10d2283f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:21.907902 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9832d987-d50a-49fc-972a-5e9c10d2283f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:21.908338 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9832d987-d50a-49fc-972a-5e9c10d2283f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:21.909018 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9832d987-d50a-49fc-972a-5e9c10d2283f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:21.909468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9832d987-d50a-49fc-972a-5e9c10d2283f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:21.909887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9832d987-d50a-49fc-972a-5e9c10d2283f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:21.960001 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ef991b7f-cb3a-4462-8637-495b307c6c0c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:21.960600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ef991b7f-cb3a-4462-8637-495b307c6c0c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:21.966981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef991b7f-cb3a-4462-8637-495b307c6c0c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:21.967456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef991b7f-cb3a-4462-8637-495b307c6c0c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:21.967882 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef991b7f-cb3a-4462-8637-495b307c6c0c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:21.968602 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef991b7f-cb3a-4462-8637-495b307c6c0c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:21.969052 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef991b7f-cb3a-4462-8637-495b307c6c0c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:21.969467 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef991b7f-cb3a-4462-8637-495b307c6c0c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:22.049945 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9832d987-d50a-49fc-972a-5e9c10d2283f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:22.058447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9832d987-d50a-49fc-972a-5e9c10d2283f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:22.059982 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9832d987-d50a-49fc-972a-5e9c10d2283f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:22.061095 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9832d987-d50a-49fc-972a-5e9c10d2283f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.164772 Aug 24 12:31:22.061650 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 125/251] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:31:21 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:31:22.107955 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ef991b7f-cb3a-4462-8637-495b307c6c0c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:22.115710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ef991b7f-cb3a-4462-8637-495b307c6c0c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.160166 Aug 24 12:31:22.116245 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 127/252] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:21 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:22.171076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c5b5df40-ee6f-4535-9361-81da4b9687bc tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:22.171688 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c5b5df40-ee6f-4535-9361-81da4b9687bc tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:22.177474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5b5df40-ee6f-4535-9361-81da4b9687bc tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:22.177959 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5b5df40-ee6f-4535-9361-81da4b9687bc tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:22.178394 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5b5df40-ee6f-4535-9361-81da4b9687bc tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:22.179106 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5b5df40-ee6f-4535-9361-81da4b9687bc tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:22.179558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5b5df40-ee6f-4535-9361-81da4b9687bc tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:22.179995 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5b5df40-ee6f-4535-9361-81da4b9687bc tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:22.310209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c5b5df40-ee6f-4535-9361-81da4b9687bc tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:22.317919 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c5b5df40-ee6f-4535-9361-81da4b9687bc tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.150684 Aug 24 12:31:22.318476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 126/253] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:22 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:22.322846 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-45c95b79-8862-4c5b-9783-1549460a6063 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:22.323461 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-45c95b79-8862-4c5b-9783-1549460a6063 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:22.329265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45c95b79-8862-4c5b-9783-1549460a6063 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:22.333904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45c95b79-8862-4c5b-9783-1549460a6063 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:22.333904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45c95b79-8862-4c5b-9783-1549460a6063 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:22.333904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45c95b79-8862-4c5b-9783-1549460a6063 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:22.333904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45c95b79-8862-4c5b-9783-1549460a6063 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:22.334240 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45c95b79-8862-4c5b-9783-1549460a6063 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:22.464428 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-45c95b79-8862-4c5b-9783-1549460a6063 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:22.471997 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-45c95b79-8862-4c5b-9783-1549460a6063 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.153114 Aug 24 12:31:22.472552 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 128/254] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:22 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:23.083570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-744c43d2-b471-445a-bd95-018080451654 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:23.084122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-744c43d2-b471-445a-bd95-018080451654 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:23.086448 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:31:23.093036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-744c43d2-b471-445a-bd95-018080451654 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:23.093551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-744c43d2-b471-445a-bd95-018080451654 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:23.098820 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-1fd288fc-a6a5-4d6c-b7fb-bfc45dcbedda req-41bda913-2628-410c-83d1-8fe57141ec33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ddbf1cc-0de1-41f8-978c-26dd51882ff6", "name": "network-vif-plugged", "status": "completed", "tag": "8204f260-00d2-4dec-9d81-53db68f227e8"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:31:23.105424 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-744c43d2-b471-445a-bd95-018080451654 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:23.106263 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-744c43d2-b471-445a-bd95-018080451654 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:23.106772 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-744c43d2-b471-445a-bd95-018080451654 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:23.107203 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-744c43d2-b471-445a-bd95-018080451654 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:23.115153 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-1fd288fc-a6a5-4d6c-b7fb-bfc45dcbedda req-41bda913-2628-410c-83d1-8fe57141ec33 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:23.115629 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-1fd288fc-a6a5-4d6c-b7fb-bfc45dcbedda req-41bda913-2628-410c-83d1-8fe57141ec33 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:23.116057 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-1fd288fc-a6a5-4d6c-b7fb-bfc45dcbedda req-41bda913-2628-410c-83d1-8fe57141ec33 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:23.127683 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-1fd288fc-a6a5-4d6c-b7fb-bfc45dcbedda req-41bda913-2628-410c-83d1-8fe57141ec33 service nova] Creating event network-vif-plugged:8204f260-00d2-4dec-9d81-53db68f227e8 for instance 1ddbf1cc-0de1-41f8-978c-26dd51882ff6 on hv-cinder-84889 Aug 24 12:31:23.133046 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-1fd288fc-a6a5-4d6c-b7fb-bfc45dcbedda req-41bda913-2628-410c-83d1-8fe57141ec33 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037852 Aug 24 12:31:23.133791 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 129/255] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:31:23.139835 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7ec840ab-6589-41e7-8aaa-12f5636e5733 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:23.140535 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7ec840ab-6589-41e7-8aaa-12f5636e5733 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:23.146767 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7ec840ab-6589-41e7-8aaa-12f5636e5733 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:23.148894 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7ec840ab-6589-41e7-8aaa-12f5636e5733 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:23.148894 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7ec840ab-6589-41e7-8aaa-12f5636e5733 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:23.148894 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7ec840ab-6589-41e7-8aaa-12f5636e5733 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:23.148894 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7ec840ab-6589-41e7-8aaa-12f5636e5733 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:23.149241 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7ec840ab-6589-41e7-8aaa-12f5636e5733 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:23.267999 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-744c43d2-b471-445a-bd95-018080451654 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:23.276973 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-744c43d2-b471-445a-bd95-018080451654 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:23.278965 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-744c43d2-b471-445a-bd95-018080451654 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:23.280168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-744c43d2-b471-445a-bd95-018080451654 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.200623 Aug 24 12:31:23.280808 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 127/256] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:31:23 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:31:23.290935 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7ec840ab-6589-41e7-8aaa-12f5636e5733 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:23.298476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7ec840ab-6589-41e7-8aaa-12f5636e5733 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.162743 Aug 24 12:31:23.299063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 130/257] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:23 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:23.337814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-95b9ea00-2f4b-4c0a-8411-8a76377a865b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:23.338351 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-95b9ea00-2f4b-4c0a-8411-8a76377a865b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:23.344211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-95b9ea00-2f4b-4c0a-8411-8a76377a865b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:23.351149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-95b9ea00-2f4b-4c0a-8411-8a76377a865b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:23.351149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-95b9ea00-2f4b-4c0a-8411-8a76377a865b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:23.351149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-95b9ea00-2f4b-4c0a-8411-8a76377a865b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:23.351149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-95b9ea00-2f4b-4c0a-8411-8a76377a865b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:23.351548 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-95b9ea00-2f4b-4c0a-8411-8a76377a865b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:23.476474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-95b9ea00-2f4b-4c0a-8411-8a76377a865b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:23.487348 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-95b9ea00-2f4b-4c0a-8411-8a76377a865b tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.153926 Aug 24 12:31:23.488363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 128/258] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:23 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:23.493651 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c05bb0a1-0e31-4690-808d-c16e9b1bd305 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:23.494260 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c05bb0a1-0e31-4690-808d-c16e9b1bd305 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:23.500574 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c05bb0a1-0e31-4690-808d-c16e9b1bd305 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:23.501055 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c05bb0a1-0e31-4690-808d-c16e9b1bd305 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:23.501488 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c05bb0a1-0e31-4690-808d-c16e9b1bd305 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:23.502176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c05bb0a1-0e31-4690-808d-c16e9b1bd305 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:23.502623 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c05bb0a1-0e31-4690-808d-c16e9b1bd305 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:23.503071 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c05bb0a1-0e31-4690-808d-c16e9b1bd305 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:23.637131 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c05bb0a1-0e31-4690-808d-c16e9b1bd305 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:23.645251 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c05bb0a1-0e31-4690-808d-c16e9b1bd305 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.155925 Aug 24 12:31:23.645814 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 131/259] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:23 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:24.303272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2e1dfdf9-c735-40ec-bf3b-d88f496d07ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:24.303865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2e1dfdf9-c735-40ec-bf3b-d88f496d07ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:24.310213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2e1dfdf9-c735-40ec-bf3b-d88f496d07ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:24.311369 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2e1dfdf9-c735-40ec-bf3b-d88f496d07ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:24.311369 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2e1dfdf9-c735-40ec-bf3b-d88f496d07ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:24.311791 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2e1dfdf9-c735-40ec-bf3b-d88f496d07ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:24.312259 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2e1dfdf9-c735-40ec-bf3b-d88f496d07ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:24.312671 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2e1dfdf9-c735-40ec-bf3b-d88f496d07ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:24.318627 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bfa57346-b8ee-4643-a25c-c50c583b2731 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:24.319287 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bfa57346-b8ee-4643-a25c-c50c583b2731 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:24.325207 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bfa57346-b8ee-4643-a25c-c50c583b2731 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:24.325694 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bfa57346-b8ee-4643-a25c-c50c583b2731 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:24.326131 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bfa57346-b8ee-4643-a25c-c50c583b2731 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:24.326919 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bfa57346-b8ee-4643-a25c-c50c583b2731 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:24.327378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bfa57346-b8ee-4643-a25c-c50c583b2731 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:24.327804 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bfa57346-b8ee-4643-a25c-c50c583b2731 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:24.457395 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2e1dfdf9-c735-40ec-bf3b-d88f496d07ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:24.465743 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2e1dfdf9-c735-40ec-bf3b-d88f496d07ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:24.467885 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2e1dfdf9-c735-40ec-bf3b-d88f496d07ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:24.468393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2e1dfdf9-c735-40ec-bf3b-d88f496d07ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.169033 Aug 24 12:31:24.468943 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 129/260] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:31:24 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:31:24.474425 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bfa57346-b8ee-4643-a25c-c50c583b2731 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:24.486173 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bfa57346-b8ee-4643-a25c-c50c583b2731 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.171370 Aug 24 12:31:24.490975 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 132/261] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:24 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:24.510316 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a5ae7fd3-a705-4aac-ad50-ec81baaac868 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:24.510953 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a5ae7fd3-a705-4aac-ad50-ec81baaac868 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:24.516894 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5ae7fd3-a705-4aac-ad50-ec81baaac868 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:24.517374 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5ae7fd3-a705-4aac-ad50-ec81baaac868 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:24.517804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5ae7fd3-a705-4aac-ad50-ec81baaac868 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:24.518548 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5ae7fd3-a705-4aac-ad50-ec81baaac868 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:24.519025 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5ae7fd3-a705-4aac-ad50-ec81baaac868 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:24.519447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5ae7fd3-a705-4aac-ad50-ec81baaac868 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:24.659075 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a5ae7fd3-a705-4aac-ad50-ec81baaac868 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:24.668186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a5ae7fd3-a705-4aac-ad50-ec81baaac868 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1315 microversion: 2.1 time: 0.161583 Aug 24 12:31:24.669314 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 130/262] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:24 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:24.670378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bee34653-e391-42c5-be5b-ce56363664a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:24.671483 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bee34653-e391-42c5-be5b-ce56363664a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:24.682099 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bee34653-e391-42c5-be5b-ce56363664a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:24.683003 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bee34653-e391-42c5-be5b-ce56363664a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:24.683789 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bee34653-e391-42c5-be5b-ce56363664a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:24.685014 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bee34653-e391-42c5-be5b-ce56363664a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:24.685847 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bee34653-e391-42c5-be5b-ce56363664a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:24.686628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bee34653-e391-42c5-be5b-ce56363664a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:24.849103 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bee34653-e391-42c5-be5b-ce56363664a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:24.861294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bee34653-e391-42c5-be5b-ce56363664a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.198369 Aug 24 12:31:24.863974 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 133/263] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:24 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:25.491980 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ea6c0d54-548c-40a2-8815-f97689d46bea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:25.492607 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ea6c0d54-548c-40a2-8815-f97689d46bea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:25.498974 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea6c0d54-548c-40a2-8815-f97689d46bea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:25.499446 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea6c0d54-548c-40a2-8815-f97689d46bea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:25.499871 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea6c0d54-548c-40a2-8815-f97689d46bea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:25.500540 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea6c0d54-548c-40a2-8815-f97689d46bea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:25.500979 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea6c0d54-548c-40a2-8815-f97689d46bea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:25.501391 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea6c0d54-548c-40a2-8815-f97689d46bea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:25.509835 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-81e82855-b4f3-4110-a63e-7acdb6cb33d8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:25.510556 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-81e82855-b4f3-4110-a63e-7acdb6cb33d8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:25.516604 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81e82855-b4f3-4110-a63e-7acdb6cb33d8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:25.517086 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81e82855-b4f3-4110-a63e-7acdb6cb33d8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:25.517516 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81e82855-b4f3-4110-a63e-7acdb6cb33d8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:25.518205 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81e82855-b4f3-4110-a63e-7acdb6cb33d8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:25.518730 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81e82855-b4f3-4110-a63e-7acdb6cb33d8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:25.519110 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81e82855-b4f3-4110-a63e-7acdb6cb33d8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:25.666688 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ea6c0d54-548c-40a2-8815-f97689d46bea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:25.675490 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ea6c0d54-548c-40a2-8815-f97689d46bea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:25.677151 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ea6c0d54-548c-40a2-8815-f97689d46bea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:25.678357 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ea6c0d54-548c-40a2-8815-f97689d46bea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1406 microversion: 2.20 time: 0.190606 Aug 24 12:31:25.678978 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-81e82855-b4f3-4110-a63e-7acdb6cb33d8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:25.679146 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 131/264] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:31:25 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:31:25.688208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-81e82855-b4f3-4110-a63e-7acdb6cb33d8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.182819 Aug 24 12:31:25.688795 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 134/265] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:25 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:25.701774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f9dfba6c-5f7b-46e6-8f85-1a553aa186cd tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:25.702383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f9dfba6c-5f7b-46e6-8f85-1a553aa186cd tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:25.708308 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f9dfba6c-5f7b-46e6-8f85-1a553aa186cd tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:25.708793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f9dfba6c-5f7b-46e6-8f85-1a553aa186cd tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:25.709231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f9dfba6c-5f7b-46e6-8f85-1a553aa186cd tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:25.709918 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f9dfba6c-5f7b-46e6-8f85-1a553aa186cd tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:25.710378 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f9dfba6c-5f7b-46e6-8f85-1a553aa186cd tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:25.710837 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f9dfba6c-5f7b-46e6-8f85-1a553aa186cd tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:25.852228 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f9dfba6c-5f7b-46e6-8f85-1a553aa186cd tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:25.860592 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f9dfba6c-5f7b-46e6-8f85-1a553aa186cd tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1502 microversion: 2.1 time: 0.162484 Aug 24 12:31:25.861021 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 132/266] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:25 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:25.889036 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a882fb4a-95df-4b10-a587-943de67bf8ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:25.890306 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a882fb4a-95df-4b10-a587-943de67bf8ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:25.900976 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:31:25.900976 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a882fb4a-95df-4b10-a587-943de67bf8ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:25.900976 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a882fb4a-95df-4b10-a587-943de67bf8ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:25.900976 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a882fb4a-95df-4b10-a587-943de67bf8ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:25.901333 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a882fb4a-95df-4b10-a587-943de67bf8ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:25.902171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a882fb4a-95df-4b10-a587-943de67bf8ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:25.903088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a882fb4a-95df-4b10-a587-943de67bf8ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:26.069023 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a882fb4a-95df-4b10-a587-943de67bf8ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:26.077213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a882fb4a-95df-4b10-a587-943de67bf8ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1362 microversion: 2.1 time: 0.194815 Aug 24 12:31:26.077777 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 135/267] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:25 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:26.096695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-9df76c26-5eee-4f92-a184-86a98502c87f req-d953b02a-0ef5-4272-a78f-57ebcc0bc3e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7228012-d37e-4a5c-bc05-791ad60259e3", "name": "network-vif-plugged", "status": "completed", "tag": "e9ca9e07-b749-44a3-bfea-cce9e380dd63"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:31:26.109922 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-9df76c26-5eee-4f92-a184-86a98502c87f req-d953b02a-0ef5-4272-a78f-57ebcc0bc3e1 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:26.110380 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-9df76c26-5eee-4f92-a184-86a98502c87f req-d953b02a-0ef5-4272-a78f-57ebcc0bc3e1 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:26.110841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-9df76c26-5eee-4f92-a184-86a98502c87f req-d953b02a-0ef5-4272-a78f-57ebcc0bc3e1 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:26.123110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-9df76c26-5eee-4f92-a184-86a98502c87f req-d953b02a-0ef5-4272-a78f-57ebcc0bc3e1 service nova] Creating event network-vif-plugged:e9ca9e07-b749-44a3-bfea-cce9e380dd63 for instance e7228012-d37e-4a5c-bc05-791ad60259e3 on hv-cinder-84889 Aug 24 12:31:26.130916 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-9df76c26-5eee-4f92-a184-86a98502c87f req-d953b02a-0ef5-4272-a78f-57ebcc0bc3e1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036708 Aug 24 12:31:26.130916 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 133/268] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:31:26.703940 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-806c3ea0-8775-420d-8c63-e0a7a853826e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:26.703940 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-806c3ea0-8775-420d-8c63-e0a7a853826e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:26.710042 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3c8ef5b9-46fb-43f7-84cf-94358cc6cff9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:26.711451 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3c8ef5b9-46fb-43f7-84cf-94358cc6cff9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:26.720892 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c8ef5b9-46fb-43f7-84cf-94358cc6cff9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:26.724535 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-806c3ea0-8775-420d-8c63-e0a7a853826e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:26.725025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-806c3ea0-8775-420d-8c63-e0a7a853826e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:26.725458 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-806c3ea0-8775-420d-8c63-e0a7a853826e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:26.726155 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-806c3ea0-8775-420d-8c63-e0a7a853826e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:26.726605 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-806c3ea0-8775-420d-8c63-e0a7a853826e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:26.727060 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-806c3ea0-8775-420d-8c63-e0a7a853826e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:26.731534 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c8ef5b9-46fb-43f7-84cf-94358cc6cff9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:26.732192 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c8ef5b9-46fb-43f7-84cf-94358cc6cff9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:26.733151 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c8ef5b9-46fb-43f7-84cf-94358cc6cff9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:26.733606 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c8ef5b9-46fb-43f7-84cf-94358cc6cff9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:26.734043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c8ef5b9-46fb-43f7-84cf-94358cc6cff9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:26.868287 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-806c3ea0-8775-420d-8c63-e0a7a853826e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:26.877471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-806c3ea0-8775-420d-8c63-e0a7a853826e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:26.879028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-806c3ea0-8775-420d-8c63-e0a7a853826e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:26.880771 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-806c3ea0-8775-420d-8c63-e0a7a853826e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1599 microversion: 2.20 time: 0.183078 Aug 24 12:31:26.881322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 136/269] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:31:26 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1599 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:31:26.904316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f82e5d66-417a-40e0-ab1d-eae05d5c7747 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:26.905070 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f82e5d66-417a-40e0-ab1d-eae05d5c7747 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:26.911328 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f82e5d66-417a-40e0-ab1d-eae05d5c7747 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:26.911784 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f82e5d66-417a-40e0-ab1d-eae05d5c7747 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:26.912235 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f82e5d66-417a-40e0-ab1d-eae05d5c7747 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:26.912922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f82e5d66-417a-40e0-ab1d-eae05d5c7747 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:26.913543 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f82e5d66-417a-40e0-ab1d-eae05d5c7747 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:26.914126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f82e5d66-417a-40e0-ab1d-eae05d5c7747 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:26.920313 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3c8ef5b9-46fb-43f7-84cf-94358cc6cff9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:26.932124 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3c8ef5b9-46fb-43f7-84cf-94358cc6cff9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.226394 Aug 24 12:31:26.937075 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 134/270] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:26 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:26.980996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:31:27.057825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f82e5d66-417a-40e0-ab1d-eae05d5c7747 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.158212 Aug 24 12:31:27.058414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 137/271] 10.222.0.45 () {60 vars in 1316 bytes} [Wed Aug 24 12:31:26 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-interface => generated 285 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:31:27.099608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c9629651-427c-4925-a4fc-ccefb33ded32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:27.100244 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c9629651-427c-4925-a4fc-ccefb33ded32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:27.106459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c9629651-427c-4925-a4fc-ccefb33ded32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:27.106968 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c9629651-427c-4925-a4fc-ccefb33ded32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:27.112246 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c9629651-427c-4925-a4fc-ccefb33ded32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:27.112246 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c9629651-427c-4925-a4fc-ccefb33ded32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:27.112246 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c9629651-427c-4925-a4fc-ccefb33ded32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:27.112246 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c9629651-427c-4925-a4fc-ccefb33ded32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:27.449320 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c9629651-427c-4925-a4fc-ccefb33ded32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:27.457308 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c9629651-427c-4925-a4fc-ccefb33ded32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1548 microversion: 2.1 time: 0.361763 Aug 24 12:31:27.457863 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 135/272] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:27 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1548 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:27.483598 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-549ab689-4016-4048-9607-b9a26f6aeed9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:27.484079 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-549ab689-4016-4048-9607-b9a26f6aeed9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:27.490128 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-549ab689-4016-4048-9607-b9a26f6aeed9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:27.490602 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-549ab689-4016-4048-9607-b9a26f6aeed9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:27.491081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-549ab689-4016-4048-9607-b9a26f6aeed9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:27.493069 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-549ab689-4016-4048-9607-b9a26f6aeed9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:27.494106 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-549ab689-4016-4048-9607-b9a26f6aeed9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:27.494528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-549ab689-4016-4048-9607-b9a26f6aeed9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:27.660748 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-549ab689-4016-4048-9607-b9a26f6aeed9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.181373 Aug 24 12:31:27.661711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 138/273] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 24 12:31:27 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-interface => generated 284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:31:27.952726 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d3e1f6b8-3f08-4183-bd48-4d5666f3d129 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:27.953418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d3e1f6b8-3f08-4183-bd48-4d5666f3d129 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:27.960421 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3e1f6b8-3f08-4183-bd48-4d5666f3d129 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:27.961244 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3e1f6b8-3f08-4183-bd48-4d5666f3d129 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:27.963793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3e1f6b8-3f08-4183-bd48-4d5666f3d129 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:27.965393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3e1f6b8-3f08-4183-bd48-4d5666f3d129 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:27.966678 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3e1f6b8-3f08-4183-bd48-4d5666f3d129 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:27.967494 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3e1f6b8-3f08-4183-bd48-4d5666f3d129 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:28.194621 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d3e1f6b8-3f08-4183-bd48-4d5666f3d129 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:28.207632 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d3e1f6b8-3f08-4183-bd48-4d5666f3d129 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.257327 Aug 24 12:31:28.224789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 136/274] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:27 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:28.554548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-08d66784-ab02-4e0c-9410-e9f587cdf8c8 req-7346af25-3d16-4603-bf2a-52e37e0e49b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e5a10ee-202a-453e-b3ff-6c5c05ec72f3", "tag": "65aeb21b-342d-4c27-963d-8c021915548c"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:31:28.569561 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-08d66784-ab02-4e0c-9410-e9f587cdf8c8 req-7346af25-3d16-4603-bf2a-52e37e0e49b5 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:28.570219 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-08d66784-ab02-4e0c-9410-e9f587cdf8c8 req-7346af25-3d16-4603-bf2a-52e37e0e49b5 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:28.570785 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-08d66784-ab02-4e0c-9410-e9f587cdf8c8 req-7346af25-3d16-4603-bf2a-52e37e0e49b5 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:28.583276 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-08d66784-ab02-4e0c-9410-e9f587cdf8c8 req-7346af25-3d16-4603-bf2a-52e37e0e49b5 service nova] Creating event network-changed:65aeb21b-342d-4c27-963d-8c021915548c for instance 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 on hv-cinder-84889 Aug 24 12:31:28.590123 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-08d66784-ab02-4e0c-9410-e9f587cdf8c8 req-7346af25-3d16-4603-bf2a-52e37e0e49b5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039935 Aug 24 12:31:28.591204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 139/275] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:31:29.069183 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-fc3fccb6-48c2-4ac3-a8df-d681ebb3cf6e req-48a65ba4-49de-45cc-a446-9ec7c7db21c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "720992f6-0031-4c2a-801d-07a71dd87158", "tag": "ffb749d1-7131-4112-a58f-5f3e9cc94cd1"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:31:29.085775 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-fc3fccb6-48c2-4ac3-a8df-d681ebb3cf6e req-48a65ba4-49de-45cc-a446-9ec7c7db21c8 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:29.086247 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-fc3fccb6-48c2-4ac3-a8df-d681ebb3cf6e req-48a65ba4-49de-45cc-a446-9ec7c7db21c8 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:29.086793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-fc3fccb6-48c2-4ac3-a8df-d681ebb3cf6e req-48a65ba4-49de-45cc-a446-9ec7c7db21c8 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:29.108628 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-fc3fccb6-48c2-4ac3-a8df-d681ebb3cf6e req-48a65ba4-49de-45cc-a446-9ec7c7db21c8 service nova] Creating event network-changed:ffb749d1-7131-4112-a58f-5f3e9cc94cd1 for instance 720992f6-0031-4c2a-801d-07a71dd87158 on hv-cinder-84889 Aug 24 12:31:29.122599 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-fc3fccb6-48c2-4ac3-a8df-d681ebb3cf6e req-48a65ba4-49de-45cc-a446-9ec7c7db21c8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055810 Aug 24 12:31:29.123514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 137/276] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:31:29.239274 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a180ccd9-283f-498f-8f9d-baa318ab38d9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:29.240585 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a180ccd9-283f-498f-8f9d-baa318ab38d9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:29.252332 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a180ccd9-283f-498f-8f9d-baa318ab38d9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:29.253014 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a180ccd9-283f-498f-8f9d-baa318ab38d9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:29.253734 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a180ccd9-283f-498f-8f9d-baa318ab38d9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:29.257437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a180ccd9-283f-498f-8f9d-baa318ab38d9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:29.258189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a180ccd9-283f-498f-8f9d-baa318ab38d9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:29.260295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a180ccd9-283f-498f-8f9d-baa318ab38d9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:29.489077 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a180ccd9-283f-498f-8f9d-baa318ab38d9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:29.499742 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a180ccd9-283f-498f-8f9d-baa318ab38d9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.271484 Aug 24 12:31:29.509437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 140/277] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:29 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:30.522235 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-de361ff0-b18a-49c6-aec5-05f9e1942151 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:30.522952 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-de361ff0-b18a-49c6-aec5-05f9e1942151 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:30.529185 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de361ff0-b18a-49c6-aec5-05f9e1942151 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:30.530260 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de361ff0-b18a-49c6-aec5-05f9e1942151 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:30.530879 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de361ff0-b18a-49c6-aec5-05f9e1942151 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:30.531902 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de361ff0-b18a-49c6-aec5-05f9e1942151 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:30.532514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de361ff0-b18a-49c6-aec5-05f9e1942151 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:30.533084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de361ff0-b18a-49c6-aec5-05f9e1942151 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:30.557361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:31:30.679049 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-de361ff0-b18a-49c6-aec5-05f9e1942151 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:30.687168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-de361ff0-b18a-49c6-aec5-05f9e1942151 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.169693 Aug 24 12:31:30.687756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 138/278] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:30 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:31.708102 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-95e4c147-d697-40e6-b020-3b09ef49536e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:31.708668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-95e4c147-d697-40e6-b020-3b09ef49536e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:31.715480 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95e4c147-d697-40e6-b020-3b09ef49536e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:31.720280 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95e4c147-d697-40e6-b020-3b09ef49536e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:31.720280 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95e4c147-d697-40e6-b020-3b09ef49536e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:31.720280 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95e4c147-d697-40e6-b020-3b09ef49536e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:31.720280 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95e4c147-d697-40e6-b020-3b09ef49536e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:31.720620 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95e4c147-d697-40e6-b020-3b09ef49536e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:31.850560 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-95e4c147-d697-40e6-b020-3b09ef49536e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:31.859479 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-95e4c147-d697-40e6-b020-3b09ef49536e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.155325 Aug 24 12:31:31.860048 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 141/279] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:31 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:32.880548 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ace6997f-d1d4-4696-8884-27f44ef6e77f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:32.881153 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ace6997f-d1d4-4696-8884-27f44ef6e77f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:32.887536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ace6997f-d1d4-4696-8884-27f44ef6e77f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:32.888014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ace6997f-d1d4-4696-8884-27f44ef6e77f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:32.888440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ace6997f-d1d4-4696-8884-27f44ef6e77f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:32.889117 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ace6997f-d1d4-4696-8884-27f44ef6e77f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:32.889558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ace6997f-d1d4-4696-8884-27f44ef6e77f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:32.889978 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ace6997f-d1d4-4696-8884-27f44ef6e77f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:33.019759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ace6997f-d1d4-4696-8884-27f44ef6e77f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:33.028119 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ace6997f-d1d4-4696-8884-27f44ef6e77f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.151495 Aug 24 12:31:33.028808 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 139/280] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:32 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:34.048040 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-019658e4-fc1b-40cf-b3a8-e4fe2597f0c6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:34.048656 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-019658e4-fc1b-40cf-b3a8-e4fe2597f0c6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:34.054765 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-019658e4-fc1b-40cf-b3a8-e4fe2597f0c6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:34.055328 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-019658e4-fc1b-40cf-b3a8-e4fe2597f0c6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:34.055835 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-019658e4-fc1b-40cf-b3a8-e4fe2597f0c6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:34.056710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-019658e4-fc1b-40cf-b3a8-e4fe2597f0c6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:34.057232 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-019658e4-fc1b-40cf-b3a8-e4fe2597f0c6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:34.057724 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-019658e4-fc1b-40cf-b3a8-e4fe2597f0c6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:34.188772 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-019658e4-fc1b-40cf-b3a8-e4fe2597f0c6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:34.196390 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-019658e4-fc1b-40cf-b3a8-e4fe2597f0c6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.152171 Aug 24 12:31:34.196996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 142/281] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:34 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:35.216742 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-61a25714-b032-4273-aaeb-998ee8b07c20 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:35.217565 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-61a25714-b032-4273-aaeb-998ee8b07c20 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:35.224065 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61a25714-b032-4273-aaeb-998ee8b07c20 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:35.224639 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61a25714-b032-4273-aaeb-998ee8b07c20 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:35.225134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61a25714-b032-4273-aaeb-998ee8b07c20 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:35.225814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61a25714-b032-4273-aaeb-998ee8b07c20 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:35.226262 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61a25714-b032-4273-aaeb-998ee8b07c20 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:35.226691 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61a25714-b032-4273-aaeb-998ee8b07c20 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:35.426550 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-61a25714-b032-4273-aaeb-998ee8b07c20 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:35.435734 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-61a25714-b032-4273-aaeb-998ee8b07c20 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.223149 Aug 24 12:31:35.436314 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 140/282] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:35 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:36.218875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b540052f-c944-430c-8303-e85dde97bd41 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "071a9819-8fcc-4417-adf2-77ebef7b8a0f"}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:31:36.221398 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b540052f-c944-430c-8303-e85dde97bd41 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:36.227360 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b540052f-c944-430c-8303-e85dde97bd41 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:36.229206 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b540052f-c944-430c-8303-e85dde97bd41 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:36.229206 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b540052f-c944-430c-8303-e85dde97bd41 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:36.229812 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b540052f-c944-430c-8303-e85dde97bd41 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:36.230435 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b540052f-c944-430c-8303-e85dde97bd41 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:36.230890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b540052f-c944-430c-8303-e85dde97bd41 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:36.456778 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2607df49-c590-4874-b666-73c56a20c672 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:36.457384 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2607df49-c590-4874-b666-73c56a20c672 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:36.463954 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2607df49-c590-4874-b666-73c56a20c672 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:36.464690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2607df49-c590-4874-b666-73c56a20c672 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:36.465048 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2607df49-c590-4874-b666-73c56a20c672 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:36.465742 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2607df49-c590-4874-b666-73c56a20c672 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:36.466195 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2607df49-c590-4874-b666-73c56a20c672 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:36.466618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2607df49-c590-4874-b666-73c56a20c672 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:36.591849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2607df49-c590-4874-b666-73c56a20c672 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:36.599496 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2607df49-c590-4874-b666-73c56a20c672 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.146652 Aug 24 12:31:36.600055 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 141/283] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:36 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:37.620746 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d39dd33b-739b-40e6-a6f9-702807772b57 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:37.621377 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d39dd33b-739b-40e6-a6f9-702807772b57 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:37.627020 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d39dd33b-739b-40e6-a6f9-702807772b57 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:37.627499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d39dd33b-739b-40e6-a6f9-702807772b57 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:37.627922 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d39dd33b-739b-40e6-a6f9-702807772b57 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:37.628594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d39dd33b-739b-40e6-a6f9-702807772b57 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:37.629039 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d39dd33b-739b-40e6-a6f9-702807772b57 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:37.629458 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d39dd33b-739b-40e6-a6f9-702807772b57 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:37.763998 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d39dd33b-739b-40e6-a6f9-702807772b57 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:37.771521 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d39dd33b-739b-40e6-a6f9-702807772b57 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.154557 Aug 24 12:31:37.772095 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 142/284] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:37 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:38.792112 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9770f6ba-1deb-4185-bc9b-61d4e2d520ef tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:38.792789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9770f6ba-1deb-4185-bc9b-61d4e2d520ef tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:38.798532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9770f6ba-1deb-4185-bc9b-61d4e2d520ef tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:38.799038 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9770f6ba-1deb-4185-bc9b-61d4e2d520ef tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:38.799462 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9770f6ba-1deb-4185-bc9b-61d4e2d520ef tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:38.800132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9770f6ba-1deb-4185-bc9b-61d4e2d520ef tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:38.800574 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9770f6ba-1deb-4185-bc9b-61d4e2d520ef tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:38.800991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9770f6ba-1deb-4185-bc9b-61d4e2d520ef tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:38.929772 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9770f6ba-1deb-4185-bc9b-61d4e2d520ef tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:38.937904 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9770f6ba-1deb-4185-bc9b-61d4e2d520ef tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.150084 Aug 24 12:31:38.938465 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 143/285] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:38 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:39.961230 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-aff0c2a7-a305-4e52-a447-9e1ce9bd1bc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:39.961874 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-aff0c2a7-a305-4e52-a447-9e1ce9bd1bc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:39.968357 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aff0c2a7-a305-4e52-a447-9e1ce9bd1bc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:39.968841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aff0c2a7-a305-4e52-a447-9e1ce9bd1bc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:39.969258 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aff0c2a7-a305-4e52-a447-9e1ce9bd1bc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:39.969932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aff0c2a7-a305-4e52-a447-9e1ce9bd1bc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:39.970375 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aff0c2a7-a305-4e52-a447-9e1ce9bd1bc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:39.970899 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aff0c2a7-a305-4e52-a447-9e1ce9bd1bc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:40.094927 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-aff0c2a7-a305-4e52-a447-9e1ce9bd1bc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:40.102390 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-aff0c2a7-a305-4e52-a447-9e1ce9bd1bc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.145019 Aug 24 12:31:40.103597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 144/286] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:39 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:41.124638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ededacc1-5907-4a83-935a-3623ee5c632b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:41.125331 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ededacc1-5907-4a83-935a-3623ee5c632b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:41.131502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ededacc1-5907-4a83-935a-3623ee5c632b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:41.132001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ededacc1-5907-4a83-935a-3623ee5c632b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:41.132438 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ededacc1-5907-4a83-935a-3623ee5c632b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:41.133143 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ededacc1-5907-4a83-935a-3623ee5c632b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:41.133596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ededacc1-5907-4a83-935a-3623ee5c632b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:41.134045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ededacc1-5907-4a83-935a-3623ee5c632b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:41.453775 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ededacc1-5907-4a83-935a-3623ee5c632b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:41.461526 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ededacc1-5907-4a83-935a-3623ee5c632b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.341043 Aug 24 12:31:41.462168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 145/287] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:41 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:42.481480 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9e9b4833-8e2e-4c4d-ad40-927e72f67cab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:42.482207 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9e9b4833-8e2e-4c4d-ad40-927e72f67cab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:42.488269 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9e9b4833-8e2e-4c4d-ad40-927e72f67cab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:42.488751 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9e9b4833-8e2e-4c4d-ad40-927e72f67cab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:42.489371 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9e9b4833-8e2e-4c4d-ad40-927e72f67cab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:42.490333 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9e9b4833-8e2e-4c4d-ad40-927e72f67cab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:42.490884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9e9b4833-8e2e-4c4d-ad40-927e72f67cab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:42.491316 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9e9b4833-8e2e-4c4d-ad40-927e72f67cab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:42.753474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9e9b4833-8e2e-4c4d-ad40-927e72f67cab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:42.767196 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9e9b4833-8e2e-4c4d-ad40-927e72f67cab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1321 microversion: 2.1 time: 0.289472 Aug 24 12:31:42.772427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 146/288] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:42 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:43.791348 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f9c24ddd-134d-4f4c-85e3-84438dd5da86 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:43.791965 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f9c24ddd-134d-4f4c-85e3-84438dd5da86 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:43.799177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f9c24ddd-134d-4f4c-85e3-84438dd5da86 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:43.800078 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f9c24ddd-134d-4f4c-85e3-84438dd5da86 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:43.800512 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f9c24ddd-134d-4f4c-85e3-84438dd5da86 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:43.801448 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f9c24ddd-134d-4f4c-85e3-84438dd5da86 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:43.801999 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f9c24ddd-134d-4f4c-85e3-84438dd5da86 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:43.802422 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f9c24ddd-134d-4f4c-85e3-84438dd5da86 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:43.935039 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f9c24ddd-134d-4f4c-85e3-84438dd5da86 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:43.942901 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f9c24ddd-134d-4f4c-85e3-84438dd5da86 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1515 microversion: 2.1 time: 0.158371 Aug 24 12:31:43.944228 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 147/289] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:43 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:43.962826 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-609e0f29-9b4f-4699-acc0-26d13f2703ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:31:43.964961 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-609e0f29-9b4f-4699-acc0-26d13f2703ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:43.971058 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-609e0f29-9b4f-4699-acc0-26d13f2703ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:43.973069 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-609e0f29-9b4f-4699-acc0-26d13f2703ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:43.973069 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-609e0f29-9b4f-4699-acc0-26d13f2703ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:43.973069 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-609e0f29-9b4f-4699-acc0-26d13f2703ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:43.973362 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-609e0f29-9b4f-4699-acc0-26d13f2703ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:43.973980 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-609e0f29-9b4f-4699-acc0-26d13f2703ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:44.043975 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.objects.instance [None req-609e0f29-9b4f-4699-acc0-26d13f2703ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lazy-loading 'flavor' on Instance uuid 1ddbf1cc-0de1-41f8-978c-26dd51882ff6 {{(pid=121171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:31:44.245917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b540052f-c944-430c-8303-e85dde97bd41 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "POST /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.031214 Aug 24 12:31:44.251668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 143/290] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 24 12:31:36 2022] POST /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf/os-volume_attachments => generated 194 bytes in 8033 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:31:44.366302 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-609e0f29-9b4f-4699-acc0-26d13f2703ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "POST /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6/action" status: 200 len: 32 microversion: 2.1 time: 0.407245 Aug 24 12:31:44.366933 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 148/291] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 12:31:43 2022] POST /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6/action => generated 32 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 12:31:44.379375 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-78637eda-d161-4e08-b5e8-53f0724fc513 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:44.380072 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-78637eda-d161-4e08-b5e8-53f0724fc513 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:44.386893 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-78637eda-d161-4e08-b5e8-53f0724fc513 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:44.387422 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-78637eda-d161-4e08-b5e8-53f0724fc513 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:44.387858 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-78637eda-d161-4e08-b5e8-53f0724fc513 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:44.388550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-78637eda-d161-4e08-b5e8-53f0724fc513 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:44.389055 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-78637eda-d161-4e08-b5e8-53f0724fc513 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:44.389547 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-78637eda-d161-4e08-b5e8-53f0724fc513 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:44.589388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-78637eda-d161-4e08-b5e8-53f0724fc513 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:44.597944 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-78637eda-d161-4e08-b5e8-53f0724fc513 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.223038 Aug 24 12:31:44.611949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 144/292] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:44 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:31:45.620423 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a6e39bee-57f2-4977-bd31-b9b9f5e1205c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:45.621188 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a6e39bee-57f2-4977-bd31-b9b9f5e1205c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:45.628483 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a6e39bee-57f2-4977-bd31-b9b9f5e1205c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:45.630136 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a6e39bee-57f2-4977-bd31-b9b9f5e1205c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:45.630824 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a6e39bee-57f2-4977-bd31-b9b9f5e1205c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:45.634917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a6e39bee-57f2-4977-bd31-b9b9f5e1205c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:45.634917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a6e39bee-57f2-4977-bd31-b9b9f5e1205c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:45.634917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a6e39bee-57f2-4977-bd31-b9b9f5e1205c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:45.769919 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a6e39bee-57f2-4977-bd31-b9b9f5e1205c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:45.778193 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a6e39bee-57f2-4977-bd31-b9b9f5e1205c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.163889 Aug 24 12:31:45.778756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 149/293] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:45 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:46.799282 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-089b8e9c-99a9-4f33-9d6e-42a150cc3d4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:46.799884 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-089b8e9c-99a9-4f33-9d6e-42a150cc3d4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:46.806859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-089b8e9c-99a9-4f33-9d6e-42a150cc3d4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:46.807343 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-089b8e9c-99a9-4f33-9d6e-42a150cc3d4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:46.807776 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-089b8e9c-99a9-4f33-9d6e-42a150cc3d4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:46.808456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-089b8e9c-99a9-4f33-9d6e-42a150cc3d4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:46.808906 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-089b8e9c-99a9-4f33-9d6e-42a150cc3d4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:46.809340 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-089b8e9c-99a9-4f33-9d6e-42a150cc3d4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:46.953483 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-089b8e9c-99a9-4f33-9d6e-42a150cc3d4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:46.961581 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-089b8e9c-99a9-4f33-9d6e-42a150cc3d4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.166133 Aug 24 12:31:46.962246 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 145/294] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:46 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:47.982979 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-91625e4f-caab-442c-8ab6-baefaebcf559 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:47.984259 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-91625e4f-caab-442c-8ab6-baefaebcf559 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:47.991326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91625e4f-caab-442c-8ab6-baefaebcf559 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:47.991860 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91625e4f-caab-442c-8ab6-baefaebcf559 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:47.992308 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91625e4f-caab-442c-8ab6-baefaebcf559 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:47.993035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91625e4f-caab-442c-8ab6-baefaebcf559 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:47.993483 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91625e4f-caab-442c-8ab6-baefaebcf559 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:47.994133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91625e4f-caab-442c-8ab6-baefaebcf559 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:48.131961 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-91625e4f-caab-442c-8ab6-baefaebcf559 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:48.141468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-91625e4f-caab-442c-8ab6-baefaebcf559 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.162356 Aug 24 12:31:48.141468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 150/295] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:47 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:49.163110 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d3889370-8924-41db-958c-064f26351973 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:49.163652 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d3889370-8924-41db-958c-064f26351973 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:49.171327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3889370-8924-41db-958c-064f26351973 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:49.172311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3889370-8924-41db-958c-064f26351973 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:49.173186 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3889370-8924-41db-958c-064f26351973 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:49.174067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3889370-8924-41db-958c-064f26351973 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:49.175601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3889370-8924-41db-958c-064f26351973 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:49.176043 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3889370-8924-41db-958c-064f26351973 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:49.353634 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d3889370-8924-41db-958c-064f26351973 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:49.362564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d3889370-8924-41db-958c-064f26351973 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.204881 Aug 24 12:31:49.363168 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 146/296] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:49 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:50.383267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-32675eee-9b2e-4ad1-851f-e55f7a3ea6bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:50.386212 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-32675eee-9b2e-4ad1-851f-e55f7a3ea6bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:50.390399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-32675eee-9b2e-4ad1-851f-e55f7a3ea6bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:50.390922 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-32675eee-9b2e-4ad1-851f-e55f7a3ea6bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:50.391359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-32675eee-9b2e-4ad1-851f-e55f7a3ea6bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:50.392239 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-32675eee-9b2e-4ad1-851f-e55f7a3ea6bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:50.392971 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-32675eee-9b2e-4ad1-851f-e55f7a3ea6bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:50.393118 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-32675eee-9b2e-4ad1-851f-e55f7a3ea6bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:50.561821 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-32675eee-9b2e-4ad1-851f-e55f7a3ea6bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:50.582526 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-32675eee-9b2e-4ad1-851f-e55f7a3ea6bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.202991 Aug 24 12:31:50.588211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 151/297] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:50 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:51.604789 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-be249c8c-98ba-4679-b111-7716d599be7f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:51.605398 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-be249c8c-98ba-4679-b111-7716d599be7f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:51.612763 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be249c8c-98ba-4679-b111-7716d599be7f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:51.613250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be249c8c-98ba-4679-b111-7716d599be7f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:51.615341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be249c8c-98ba-4679-b111-7716d599be7f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:51.615341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be249c8c-98ba-4679-b111-7716d599be7f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:51.615341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be249c8c-98ba-4679-b111-7716d599be7f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:51.615711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be249c8c-98ba-4679-b111-7716d599be7f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:51.787572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-be249c8c-98ba-4679-b111-7716d599be7f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:51.795711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-be249c8c-98ba-4679-b111-7716d599be7f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.195166 Aug 24 12:31:51.796632 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 147/298] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:51 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:52.816924 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-06667432-4e2d-41f5-b32a-d233ab028ff8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:52.817525 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-06667432-4e2d-41f5-b32a-d233ab028ff8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:52.824325 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-06667432-4e2d-41f5-b32a-d233ab028ff8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:52.824927 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-06667432-4e2d-41f5-b32a-d233ab028ff8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:52.825368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-06667432-4e2d-41f5-b32a-d233ab028ff8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:52.826060 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-06667432-4e2d-41f5-b32a-d233ab028ff8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:52.826621 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-06667432-4e2d-41f5-b32a-d233ab028ff8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:52.827143 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-06667432-4e2d-41f5-b32a-d233ab028ff8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:52.960988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-06667432-4e2d-41f5-b32a-d233ab028ff8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:52.969238 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-06667432-4e2d-41f5-b32a-d233ab028ff8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.156216 Aug 24 12:31:52.969815 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 152/299] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:52 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:53.989836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7aa66f6b-7d47-4d7f-87e4-495a59ae4020 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:53.990548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7aa66f6b-7d47-4d7f-87e4-495a59ae4020 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:53.997335 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7aa66f6b-7d47-4d7f-87e4-495a59ae4020 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:53.997886 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7aa66f6b-7d47-4d7f-87e4-495a59ae4020 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:53.998392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7aa66f6b-7d47-4d7f-87e4-495a59ae4020 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:53.999204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7aa66f6b-7d47-4d7f-87e4-495a59ae4020 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:53.999864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7aa66f6b-7d47-4d7f-87e4-495a59ae4020 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:54.000374 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7aa66f6b-7d47-4d7f-87e4-495a59ae4020 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:54.130913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7aa66f6b-7d47-4d7f-87e4-495a59ae4020 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:54.138739 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7aa66f6b-7d47-4d7f-87e4-495a59ae4020 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.153199 Aug 24 12:31:54.139298 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 148/300] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:53 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:55.159405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d6afe02c-4538-4365-89be-17641a791d92 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:55.160134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d6afe02c-4538-4365-89be-17641a791d92 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:55.162205 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=52 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:31:55.167388 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d6afe02c-4538-4365-89be-17641a791d92 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:55.168380 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d6afe02c-4538-4365-89be-17641a791d92 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:55.168808 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d6afe02c-4538-4365-89be-17641a791d92 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:55.169918 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d6afe02c-4538-4365-89be-17641a791d92 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:55.169918 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d6afe02c-4538-4365-89be-17641a791d92 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:55.170327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d6afe02c-4538-4365-89be-17641a791d92 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:55.174482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:31:55.300418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d6afe02c-4538-4365-89be-17641a791d92 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:55.307865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d6afe02c-4538-4365-89be-17641a791d92 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.152470 Aug 24 12:31:55.309010 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 153/301] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:55 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:55.454809 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b09cb56b-3db6-4a98-ab5f-a51a18f91dcc tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:55.455335 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b09cb56b-3db6-4a98-ab5f-a51a18f91dcc tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:55.461485 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b09cb56b-3db6-4a98-ab5f-a51a18f91dcc tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:55.461961 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b09cb56b-3db6-4a98-ab5f-a51a18f91dcc tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:55.462392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b09cb56b-3db6-4a98-ab5f-a51a18f91dcc tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:55.463111 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b09cb56b-3db6-4a98-ab5f-a51a18f91dcc tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:55.463544 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b09cb56b-3db6-4a98-ab5f-a51a18f91dcc tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:55.463958 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b09cb56b-3db6-4a98-ab5f-a51a18f91dcc tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:55.500759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b09cb56b-3db6-4a98-ab5f-a51a18f91dcc tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Going to try to terminate instance {{(pid=121170) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:31:55.803725 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b09cb56b-3db6-4a98-ab5f-a51a18f91dcc tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "DELETE /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 204 len: 0 microversion: 2.1 time: 0.352391 Aug 24 12:31:55.804340 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 149/302] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 12:31:55 2022] DELETE /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:31:55.812538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-efc12560-2972-481a-9d64-ad327aaf34dd tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:55.813159 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-efc12560-2972-481a-9d64-ad327aaf34dd tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:55.819121 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-efc12560-2972-481a-9d64-ad327aaf34dd tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:55.819719 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-efc12560-2972-481a-9d64-ad327aaf34dd tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:55.820151 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-efc12560-2972-481a-9d64-ad327aaf34dd tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:55.820828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-efc12560-2972-481a-9d64-ad327aaf34dd tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:55.821278 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-efc12560-2972-481a-9d64-ad327aaf34dd tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:55.821704 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-efc12560-2972-481a-9d64-ad327aaf34dd tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:55.960662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-efc12560-2972-481a-9d64-ad327aaf34dd tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:55.969438 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-efc12560-2972-481a-9d64-ad327aaf34dd tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1554 microversion: 2.1 time: 0.160797 Aug 24 12:31:55.970042 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 154/303] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:55 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:56.336753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b0c72013-2a71-4996-9fb2-05af40e57876 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:56.337346 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b0c72013-2a71-4996-9fb2-05af40e57876 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:56.344111 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0c72013-2a71-4996-9fb2-05af40e57876 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:56.344621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0c72013-2a71-4996-9fb2-05af40e57876 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:56.345048 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0c72013-2a71-4996-9fb2-05af40e57876 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:56.345725 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0c72013-2a71-4996-9fb2-05af40e57876 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:56.346173 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0c72013-2a71-4996-9fb2-05af40e57876 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:56.346590 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0c72013-2a71-4996-9fb2-05af40e57876 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:56.483202 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b0c72013-2a71-4996-9fb2-05af40e57876 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:56.491476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b0c72013-2a71-4996-9fb2-05af40e57876 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.158967 Aug 24 12:31:56.492069 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 150/304] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:56 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:56.996482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-693ddec4-114d-4ab3-ac18-c8db0fbf4657 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:56.997078 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-693ddec4-114d-4ab3-ac18-c8db0fbf4657 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:57.002989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-693ddec4-114d-4ab3-ac18-c8db0fbf4657 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:57.003463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-693ddec4-114d-4ab3-ac18-c8db0fbf4657 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:57.003890 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-693ddec4-114d-4ab3-ac18-c8db0fbf4657 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:57.004558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-693ddec4-114d-4ab3-ac18-c8db0fbf4657 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:57.004999 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-693ddec4-114d-4ab3-ac18-c8db0fbf4657 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:57.005425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-693ddec4-114d-4ab3-ac18-c8db0fbf4657 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:57.132791 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-693ddec4-114d-4ab3-ac18-c8db0fbf4657 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:57.141042 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-693ddec4-114d-4ab3-ac18-c8db0fbf4657 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1554 microversion: 2.1 time: 0.148377 Aug 24 12:31:57.141589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 155/305] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:56 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:57.513152 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-898670ef-d37f-4a30-83b1-c88be21a9126 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:57.513750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-898670ef-d37f-4a30-83b1-c88be21a9126 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:57.516129 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:31:57.520750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-898670ef-d37f-4a30-83b1-c88be21a9126 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:57.527695 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-898670ef-d37f-4a30-83b1-c88be21a9126 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:57.527695 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-898670ef-d37f-4a30-83b1-c88be21a9126 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:57.527695 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-898670ef-d37f-4a30-83b1-c88be21a9126 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:57.527695 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-898670ef-d37f-4a30-83b1-c88be21a9126 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:57.528142 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-898670ef-d37f-4a30-83b1-c88be21a9126 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:57.528142 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:31:57.656139 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-898670ef-d37f-4a30-83b1-c88be21a9126 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:57.663959 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-898670ef-d37f-4a30-83b1-c88be21a9126 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.155110 Aug 24 12:31:57.664513 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 151/306] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:57 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:58.161396 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-39d5bdcc-aa32-4355-861b-9b41f26541ac tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:58.161999 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-39d5bdcc-aa32-4355-861b-9b41f26541ac tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:58.168279 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-39d5bdcc-aa32-4355-861b-9b41f26541ac tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:58.168755 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-39d5bdcc-aa32-4355-861b-9b41f26541ac tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:58.169184 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-39d5bdcc-aa32-4355-861b-9b41f26541ac tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:58.169863 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-39d5bdcc-aa32-4355-861b-9b41f26541ac tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:58.170311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-39d5bdcc-aa32-4355-861b-9b41f26541ac tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:58.170748 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-39d5bdcc-aa32-4355-861b-9b41f26541ac tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:58.298441 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-39d5bdcc-aa32-4355-861b-9b41f26541ac tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:58.306333 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-39d5bdcc-aa32-4355-861b-9b41f26541ac tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1554 microversion: 2.1 time: 0.148773 Aug 24 12:31:58.306915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 156/307] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:58 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:58.684376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3d92b9b1-c071-419b-9072-cde98c94e07f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:58.684904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3d92b9b1-c071-419b-9072-cde98c94e07f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:58.691238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d92b9b1-c071-419b-9072-cde98c94e07f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:58.691721 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d92b9b1-c071-419b-9072-cde98c94e07f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:58.692255 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d92b9b1-c071-419b-9072-cde98c94e07f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:58.692962 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d92b9b1-c071-419b-9072-cde98c94e07f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:58.693418 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d92b9b1-c071-419b-9072-cde98c94e07f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:58.693841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d92b9b1-c071-419b-9072-cde98c94e07f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:58.821826 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3d92b9b1-c071-419b-9072-cde98c94e07f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:58.829825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3d92b9b1-c071-419b-9072-cde98c94e07f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.149587 Aug 24 12:31:58.830372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 152/308] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:58 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:59.327929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-18c81202-64c3-45dd-8cdb-363aa09c8728 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:59.328563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-18c81202-64c3-45dd-8cdb-363aa09c8728 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:59.334317 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18c81202-64c3-45dd-8cdb-363aa09c8728 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:59.334836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18c81202-64c3-45dd-8cdb-363aa09c8728 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:59.335263 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18c81202-64c3-45dd-8cdb-363aa09c8728 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:59.335939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18c81202-64c3-45dd-8cdb-363aa09c8728 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:59.336383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18c81202-64c3-45dd-8cdb-363aa09c8728 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:59.336799 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18c81202-64c3-45dd-8cdb-363aa09c8728 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:59.471786 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-18c81202-64c3-45dd-8cdb-363aa09c8728 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:59.479774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-18c81202-64c3-45dd-8cdb-363aa09c8728 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1554 microversion: 2.1 time: 0.156297 Aug 24 12:31:59.480317 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 157/309] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:59 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:31:59.850625 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-94344c79-b7a7-485d-84db-78b01aa2740b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:31:59.851262 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-94344c79-b7a7-485d-84db-78b01aa2740b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:31:59.857652 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94344c79-b7a7-485d-84db-78b01aa2740b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:59.858131 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94344c79-b7a7-485d-84db-78b01aa2740b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:59.858568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94344c79-b7a7-485d-84db-78b01aa2740b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:59.859271 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94344c79-b7a7-485d-84db-78b01aa2740b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:59.859729 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94344c79-b7a7-485d-84db-78b01aa2740b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:59.860152 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94344c79-b7a7-485d-84db-78b01aa2740b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:59.987091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-94344c79-b7a7-485d-84db-78b01aa2740b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:31:59.995052 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-94344c79-b7a7-485d-84db-78b01aa2740b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.148247 Aug 24 12:31:59.995611 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 153/310] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:31:59 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:00.500185 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0b73565a-4ed7-426b-adec-64749848f713 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:00.500814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0b73565a-4ed7-426b-adec-64749848f713 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:00.506664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0b73565a-4ed7-426b-adec-64749848f713 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:00.507140 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0b73565a-4ed7-426b-adec-64749848f713 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:00.507565 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0b73565a-4ed7-426b-adec-64749848f713 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:00.508233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0b73565a-4ed7-426b-adec-64749848f713 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:00.508675 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0b73565a-4ed7-426b-adec-64749848f713 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:00.509088 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0b73565a-4ed7-426b-adec-64749848f713 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:00.639648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0b73565a-4ed7-426b-adec-64749848f713 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:00.647525 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0b73565a-4ed7-426b-adec-64749848f713 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1554 microversion: 2.1 time: 0.151654 Aug 24 12:32:00.648071 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 158/311] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:00 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:01.016711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f4501a11-bc9f-4be5-ab57-b6d1a9c68af8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:01.017345 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f4501a11-bc9f-4be5-ab57-b6d1a9c68af8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:01.023759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4501a11-bc9f-4be5-ab57-b6d1a9c68af8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:01.024247 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4501a11-bc9f-4be5-ab57-b6d1a9c68af8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:01.024687 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4501a11-bc9f-4be5-ab57-b6d1a9c68af8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:01.025375 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4501a11-bc9f-4be5-ab57-b6d1a9c68af8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:01.025830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4501a11-bc9f-4be5-ab57-b6d1a9c68af8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:01.026259 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4501a11-bc9f-4be5-ab57-b6d1a9c68af8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:01.158419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f4501a11-bc9f-4be5-ab57-b6d1a9c68af8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:01.166114 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f4501a11-bc9f-4be5-ab57-b6d1a9c68af8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.153683 Aug 24 12:32:01.166720 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 154/312] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:01 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:01.667459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8aec5d7f-b27b-4653-860e-d935d81ef107 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:01.668602 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8aec5d7f-b27b-4653-860e-d935d81ef107 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:01.675053 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8aec5d7f-b27b-4653-860e-d935d81ef107 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:01.682588 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8aec5d7f-b27b-4653-860e-d935d81ef107 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:01.682588 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8aec5d7f-b27b-4653-860e-d935d81ef107 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:01.682588 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8aec5d7f-b27b-4653-860e-d935d81ef107 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:01.682588 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8aec5d7f-b27b-4653-860e-d935d81ef107 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:01.683112 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8aec5d7f-b27b-4653-860e-d935d81ef107 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:01.818706 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8aec5d7f-b27b-4653-860e-d935d81ef107 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:01.827170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8aec5d7f-b27b-4653-860e-d935d81ef107 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1554 microversion: 2.1 time: 0.163330 Aug 24 12:32:01.827772 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 159/313] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:01 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:02.186361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4cf3f6c5-65f7-4cf7-99c1-83773ab7e7fb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:02.186996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4cf3f6c5-65f7-4cf7-99c1-83773ab7e7fb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:02.193500 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4cf3f6c5-65f7-4cf7-99c1-83773ab7e7fb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:02.193981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4cf3f6c5-65f7-4cf7-99c1-83773ab7e7fb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:02.194416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4cf3f6c5-65f7-4cf7-99c1-83773ab7e7fb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:02.195142 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4cf3f6c5-65f7-4cf7-99c1-83773ab7e7fb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:02.195648 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4cf3f6c5-65f7-4cf7-99c1-83773ab7e7fb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:02.196070 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4cf3f6c5-65f7-4cf7-99c1-83773ab7e7fb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:02.332070 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4cf3f6c5-65f7-4cf7-99c1-83773ab7e7fb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:02.340181 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4cf3f6c5-65f7-4cf7-99c1-83773ab7e7fb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.157632 Aug 24 12:32:02.340826 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 155/314] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:02 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:02.847632 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5eb40137-07f9-4edd-a50f-813928428092 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:02.848423 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5eb40137-07f9-4edd-a50f-813928428092 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:02.854819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5eb40137-07f9-4edd-a50f-813928428092 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:02.855308 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5eb40137-07f9-4edd-a50f-813928428092 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:02.855836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5eb40137-07f9-4edd-a50f-813928428092 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:02.856527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5eb40137-07f9-4edd-a50f-813928428092 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:02.856976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5eb40137-07f9-4edd-a50f-813928428092 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:02.857481 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5eb40137-07f9-4edd-a50f-813928428092 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:02.989658 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5eb40137-07f9-4edd-a50f-813928428092 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:02.998282 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5eb40137-07f9-4edd-a50f-813928428092 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1554 microversion: 2.1 time: 0.154015 Aug 24 12:32:02.998868 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 160/315] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:02 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:03.363571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f038fda7-d507-4f80-80f3-1190c12f1ca9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:03.364187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f038fda7-d507-4f80-80f3-1190c12f1ca9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:03.371277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f038fda7-d507-4f80-80f3-1190c12f1ca9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:03.371765 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f038fda7-d507-4f80-80f3-1190c12f1ca9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:03.372195 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f038fda7-d507-4f80-80f3-1190c12f1ca9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:03.373717 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f038fda7-d507-4f80-80f3-1190c12f1ca9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:03.374179 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f038fda7-d507-4f80-80f3-1190c12f1ca9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:03.374608 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f038fda7-d507-4f80-80f3-1190c12f1ca9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:03.507048 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f038fda7-d507-4f80-80f3-1190c12f1ca9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:03.514529 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f038fda7-d507-4f80-80f3-1190c12f1ca9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.156274 Aug 24 12:32:03.515347 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 156/316] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:03 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:04.020247 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8d46af8e-3a36-4c81-9b3b-c8882c61a9b4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:04.020859 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8d46af8e-3a36-4c81-9b3b-c8882c61a9b4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:04.026785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8d46af8e-3a36-4c81-9b3b-c8882c61a9b4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:04.027269 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8d46af8e-3a36-4c81-9b3b-c8882c61a9b4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:04.027705 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8d46af8e-3a36-4c81-9b3b-c8882c61a9b4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:04.028390 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8d46af8e-3a36-4c81-9b3b-c8882c61a9b4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:04.029648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8d46af8e-3a36-4c81-9b3b-c8882c61a9b4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:04.030081 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8d46af8e-3a36-4c81-9b3b-c8882c61a9b4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:04.225695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8d46af8e-3a36-4c81-9b3b-c8882c61a9b4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:04.234090 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8d46af8e-3a36-4c81-9b3b-c8882c61a9b4 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1554 microversion: 2.1 time: 0.217703 Aug 24 12:32:04.234713 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 161/317] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:04 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1554 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:04.535439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-517aaef4-22a9-4fc4-9bc3-3dfcd2b18ac2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:04.535984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-517aaef4-22a9-4fc4-9bc3-3dfcd2b18ac2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:04.542464 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-517aaef4-22a9-4fc4-9bc3-3dfcd2b18ac2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:04.542977 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-517aaef4-22a9-4fc4-9bc3-3dfcd2b18ac2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:04.543410 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-517aaef4-22a9-4fc4-9bc3-3dfcd2b18ac2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:04.544087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-517aaef4-22a9-4fc4-9bc3-3dfcd2b18ac2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:04.544657 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-517aaef4-22a9-4fc4-9bc3-3dfcd2b18ac2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:04.545079 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-517aaef4-22a9-4fc4-9bc3-3dfcd2b18ac2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:04.631669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-6c1201d1-3273-4230-9289-cfb8a4139889 req-88f9698d-d77b-425c-b2c1-fd4bd792d9ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfbf55c1-60d6-43b4-8a03-84d8ae291daf", "name": "network-vif-deleted", "tag": "3af0c2af-a730-4f85-a3a0-41267820e2f3"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:32:04.641899 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-6c1201d1-3273-4230-9289-cfb8a4139889 req-88f9698d-d77b-425c-b2c1-fd4bd792d9ab service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:04.642553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-6c1201d1-3273-4230-9289-cfb8a4139889 req-88f9698d-d77b-425c-b2c1-fd4bd792d9ab service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:04.643154 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-6c1201d1-3273-4230-9289-cfb8a4139889 req-88f9698d-d77b-425c-b2c1-fd4bd792d9ab service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:04.656967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-6c1201d1-3273-4230-9289-cfb8a4139889 req-88f9698d-d77b-425c-b2c1-fd4bd792d9ab service nova] Creating event network-vif-deleted:3af0c2af-a730-4f85-a3a0-41267820e2f3 for instance cfbf55c1-60d6-43b4-8a03-84d8ae291daf on hv-cinder-84889 Aug 24 12:32:04.662474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-6c1201d1-3273-4230-9289-cfb8a4139889 req-88f9698d-d77b-425c-b2c1-fd4bd792d9ab service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034331 Aug 24 12:32:04.663417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 162/318] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:32:04.720777 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-517aaef4-22a9-4fc4-9bc3-3dfcd2b18ac2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:04.734362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-517aaef4-22a9-4fc4-9bc3-3dfcd2b18ac2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.202705 Aug 24 12:32:04.735175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 157/319] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:04 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:05.255537 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e5be72de-51ed-4c56-8d06-8e101ed8bca5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:05.256356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e5be72de-51ed-4c56-8d06-8e101ed8bca5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:05.263009 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e5be72de-51ed-4c56-8d06-8e101ed8bca5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:05.263756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e5be72de-51ed-4c56-8d06-8e101ed8bca5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:05.264269 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e5be72de-51ed-4c56-8d06-8e101ed8bca5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:05.265059 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e5be72de-51ed-4c56-8d06-8e101ed8bca5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:05.265617 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e5be72de-51ed-4c56-8d06-8e101ed8bca5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:05.266098 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e5be72de-51ed-4c56-8d06-8e101ed8bca5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:05.483176 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e5be72de-51ed-4c56-8d06-8e101ed8bca5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281e6cd581c54901b8feaa291db588eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ef4ba417014205b91496a8037540ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:05.492255 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e5be72de-51ed-4c56-8d06-8e101ed8bca5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 200 len: 1346 microversion: 2.1 time: 0.240815 Aug 24 12:32:05.493278 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 163/320] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:05 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 1346 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:05.756043 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f39c1fb8-960e-4541-a214-c4e55c0949da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:05.757050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f39c1fb8-960e-4541-a214-c4e55c0949da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:05.768628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f39c1fb8-960e-4541-a214-c4e55c0949da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:05.769421 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f39c1fb8-960e-4541-a214-c4e55c0949da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:05.770020 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f39c1fb8-960e-4541-a214-c4e55c0949da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:05.771264 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f39c1fb8-960e-4541-a214-c4e55c0949da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:05.771369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f39c1fb8-960e-4541-a214-c4e55c0949da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:05.771796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f39c1fb8-960e-4541-a214-c4e55c0949da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:06.052288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f39c1fb8-960e-4541-a214-c4e55c0949da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:06.063796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f39c1fb8-960e-4541-a214-c4e55c0949da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.308141 Aug 24 12:32:06.063796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 158/321] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:05 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:06.519089 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e1c9c2a2-abcc-4fd9-95b7-9aac6e33d119 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:06.519089 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e1c9c2a2-abcc-4fd9-95b7-9aac6e33d119 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:06.522641 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1c9c2a2-abcc-4fd9-95b7-9aac6e33d119 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:06.523169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1c9c2a2-abcc-4fd9-95b7-9aac6e33d119 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:06.523627 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1c9c2a2-abcc-4fd9-95b7-9aac6e33d119 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:06.524393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1c9c2a2-abcc-4fd9-95b7-9aac6e33d119 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:06.524868 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1c9c2a2-abcc-4fd9-95b7-9aac6e33d119 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:06.525311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1c9c2a2-abcc-4fd9-95b7-9aac6e33d119 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:06.554599 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.wsgi [None req-e1c9c2a2-abcc-4fd9-95b7-9aac6e33d119 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] HTTP exception thrown: Instance cfbf55c1-60d6-43b4-8a03-84d8ae291daf could not be found. Aug 24 12:32:06.568853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e1c9c2a2-abcc-4fd9-95b7-9aac6e33d119 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Request method failure captured: Aug 24 12:32:06.568853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: request: GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf HTTP/1.1 Aug 24 12:32:06.568853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept: application/json Aug 24 12:32:06.568853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept-Encoding: identity Aug 24 12:32:06.568853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Connection: close Aug 24 12:32:06.568853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Length: 0 Aug 24 12:32:06.568853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Type: application/json Aug 24 12:32:06.568853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Host: 10.222.0.45 Aug 24 12:32:06.568853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Openstack-System-Scope: None Aug 24 12:32:06.568853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: User-Agent: python-urllib3/1.26.11 Aug 24 12:32:06.568853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Auth-Token: gAAAAABjBhnQt7ZeEvaLtTEoPGQbXfDgnr-aYkSnLs_aZ4FtH1P-ooP641Y_GNJ3zKekoMBnDpA7h7YoO46CpDML978BEN2IgfRm7bHYCX6Gfz2aTQygo0jtn2anqAcpP4K0xA2t6faOpD6Cv46y5yE1j1x3l02zbX9tC5sDjdybKmpP5yMxY28 Aug 24 12:32:06.568853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Id: None Aug 24 12:32:06.568853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Name: None Aug 24 12:32:06.568853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Identity-Status: Confirmed Aug 24 12:32:06.568853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Is-Admin-Project: True Aug 24 12:32:06.568853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Id: default Aug 24 12:32:06.568853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Name: Default Aug 24 12:32:06.568853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Id: 43ef4ba417014205b91496a8037540ed Aug 24 12:32:06.568853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Name: tempest-DeleteServersTestJSON-116655351 Aug 24 12:32:06.568853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Role: member,reader Aug 24 12:32:06.568853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Roles: member,reader Aug 24 12:32:06.570383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_43ef4ba417014205b91496a8037540ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/43ef4ba417014205b91496a8037540ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/43ef4ba417014205b91496a8037540ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/43ef4ba417014205b91496a8037540ed"}]}] Aug 24 12:32:06.570383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant: tempest-DeleteServersTestJSON-116655351 Aug 24 12:32:06.570383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Id: 43ef4ba417014205b91496a8037540ed Aug 24 12:32:06.570383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Name: tempest-DeleteServersTestJSON-116655351 Aug 24 12:32:06.570383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User: tempest-DeleteServersTestJSON-116655351-project Aug 24 12:32:06.570383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Id: default Aug 24 12:32:06.570383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Name: Default Aug 24 12:32:06.570383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Id: 281e6cd581c54901b8feaa291db588eb Aug 24 12:32:06.570383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Name: tempest-DeleteServersTestJSON-116655351-project Aug 24 12:32:06.570383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: method: > Aug 24 12:32:06.570383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: exception: Instance cfbf55c1-60d6-43b4-8a03-84d8ae291daf could not be found. Aug 24 12:32:06.570383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: action_args: {'id': 'cfbf55c1-60d6-43b4-8a03-84d8ae291daf'} Aug 24 12:32:06.571160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:32:06.571160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:06.571160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:32:06.571160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:32:06.571160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:32:06.571160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:32:06.571160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:32:06.571160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:32:06.571160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:32:06.571160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:32:06.571160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfbf55c1-60d6-43b4-8a03-84d8ae291daf could not be found. Aug 24 12:32:06.571160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:32:06.571160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:06.571160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:32:06.571160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:06.571160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:06.571160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:06.571160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:32:06.571160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:32:06.571160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:32:06.572222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:32:06.572222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:32:06.572222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:32:06.572222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:32:06.572222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:32:06.572222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:32:06.572222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:32:06.572222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfbf55c1-60d6-43b4-8a03-84d8ae291daf could not be found. Aug 24 12:32:06.572222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:32:06.572222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:06.572222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:32:06.572222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:06.572222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:06.572222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:06.572222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:32:06.572222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:32:06.572222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfbf55c1-60d6-43b4-8a03-84d8ae291daf could not be found. Aug 24 12:32:06.572222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:32:06.573210 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e1c9c2a2-abcc-4fd9-95b7-9aac6e33d119 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Returning 404 to user: Instance cfbf55c1-60d6-43b4-8a03-84d8ae291daf could not be found. {{(pid=121171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:32:06.573210 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e1c9c2a2-abcc-4fd9-95b7-9aac6e33d119 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 404 len: 111 microversion: 2.1 time: 0.060800 Aug 24 12:32:06.573210 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 164/322] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:06 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:32:06.684145 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6bfd0c88-2193-441f-98e6-2c5bc51e69e9 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:06.686911 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6bfd0c88-2193-441f-98e6-2c5bc51e69e9 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:06.693003 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6bfd0c88-2193-441f-98e6-2c5bc51e69e9 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:06.693477 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6bfd0c88-2193-441f-98e6-2c5bc51e69e9 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:06.693900 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6bfd0c88-2193-441f-98e6-2c5bc51e69e9 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:06.694572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6bfd0c88-2193-441f-98e6-2c5bc51e69e9 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:06.695049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6bfd0c88-2193-441f-98e6-2c5bc51e69e9 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:06.695464 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6bfd0c88-2193-441f-98e6-2c5bc51e69e9 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:06.708419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.wsgi [None req-6bfd0c88-2193-441f-98e6-2c5bc51e69e9 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] HTTP exception thrown: Instance cfbf55c1-60d6-43b4-8a03-84d8ae291daf could not be found. Aug 24 12:32:06.712327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6bfd0c88-2193-441f-98e6-2c5bc51e69e9 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Request method failure captured: Aug 24 12:32:06.712327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: request: GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf/os-volume_attachments HTTP/1.1 Aug 24 12:32:06.712327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept: application/json Aug 24 12:32:06.712327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept-Encoding: identity Aug 24 12:32:06.712327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Connection: close Aug 24 12:32:06.712327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Length: 0 Aug 24 12:32:06.712327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Type: application/json Aug 24 12:32:06.712327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Host: 10.222.0.45 Aug 24 12:32:06.712327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Openstack-System-Scope: None Aug 24 12:32:06.712327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: User-Agent: python-urllib3/1.26.11 Aug 24 12:32:06.712327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Auth-Token: gAAAAABjBhnQt7ZeEvaLtTEoPGQbXfDgnr-aYkSnLs_aZ4FtH1P-ooP641Y_GNJ3zKekoMBnDpA7h7YoO46CpDML978BEN2IgfRm7bHYCX6Gfz2aTQygo0jtn2anqAcpP4K0xA2t6faOpD6Cv46y5yE1j1x3l02zbX9tC5sDjdybKmpP5yMxY28 Aug 24 12:32:06.712327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Id: None Aug 24 12:32:06.712327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Name: None Aug 24 12:32:06.712327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Identity-Status: Confirmed Aug 24 12:32:06.712327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Is-Admin-Project: True Aug 24 12:32:06.712327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Id: default Aug 24 12:32:06.712327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Name: Default Aug 24 12:32:06.712327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Id: 43ef4ba417014205b91496a8037540ed Aug 24 12:32:06.712327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Name: tempest-DeleteServersTestJSON-116655351 Aug 24 12:32:06.712327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Role: member,reader Aug 24 12:32:06.712327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Roles: member,reader Aug 24 12:32:06.713786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_43ef4ba417014205b91496a8037540ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/43ef4ba417014205b91496a8037540ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/43ef4ba417014205b91496a8037540ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/43ef4ba417014205b91496a8037540ed"}]}] Aug 24 12:32:06.713786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant: tempest-DeleteServersTestJSON-116655351 Aug 24 12:32:06.713786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Id: 43ef4ba417014205b91496a8037540ed Aug 24 12:32:06.713786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Name: tempest-DeleteServersTestJSON-116655351 Aug 24 12:32:06.713786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User: tempest-DeleteServersTestJSON-116655351-project Aug 24 12:32:06.713786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Id: default Aug 24 12:32:06.713786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Name: Default Aug 24 12:32:06.713786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Id: 281e6cd581c54901b8feaa291db588eb Aug 24 12:32:06.713786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Name: tempest-DeleteServersTestJSON-116655351-project Aug 24 12:32:06.713786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: method: > Aug 24 12:32:06.713786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: exception: Instance cfbf55c1-60d6-43b4-8a03-84d8ae291daf could not be found. Aug 24 12:32:06.713786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: action_args: {'server_id': 'cfbf55c1-60d6-43b4-8a03-84d8ae291daf'} Aug 24 12:32:06.714716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:32:06.714716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:06.714716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:32:06.714716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:32:06.714716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:32:06.714716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:32:06.714716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:32:06.714716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:32:06.714716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:32:06.714716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:32:06.714716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfbf55c1-60d6-43b4-8a03-84d8ae291daf could not be found. Aug 24 12:32:06.714716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:32:06.714716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:06.714716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:32:06.714716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:06.714716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:06.714716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:06.714716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:32:06.714716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:32:06.714716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:32:06.716112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:32:06.716112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 12:32:06.716112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 12:32:06.716112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 12:32:06.716112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 12:32:06.716112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 12:32:06.716112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 12:32:06.716112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:32:06.716112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:32:06.716112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfbf55c1-60d6-43b4-8a03-84d8ae291daf could not be found. Aug 24 12:32:06.716112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:32:06.716112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:06.716112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:32:06.716112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:06.716112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:06.716112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:06.716112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:32:06.716112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:32:06.716112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfbf55c1-60d6-43b4-8a03-84d8ae291daf could not be found. Aug 24 12:32:06.716112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:32:06.717702 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6bfd0c88-2193-441f-98e6-2c5bc51e69e9 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Returning 404 to user: Instance cfbf55c1-60d6-43b4-8a03-84d8ae291daf could not be found. {{(pid=121170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:32:06.717702 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6bfd0c88-2193-441f-98e6-2c5bc51e69e9 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033665 Aug 24 12:32:06.717702 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 159/323] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:32:06 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:32:07.081223 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-26c7ade8-885e-4513-b1ff-f82e2618ed0d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:07.081907 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-26c7ade8-885e-4513-b1ff-f82e2618ed0d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:07.087811 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26c7ade8-885e-4513-b1ff-f82e2618ed0d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:07.088428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26c7ade8-885e-4513-b1ff-f82e2618ed0d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:07.088733 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26c7ade8-885e-4513-b1ff-f82e2618ed0d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:07.089431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26c7ade8-885e-4513-b1ff-f82e2618ed0d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:07.089884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26c7ade8-885e-4513-b1ff-f82e2618ed0d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:07.090313 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26c7ade8-885e-4513-b1ff-f82e2618ed0d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:07.253179 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-26c7ade8-885e-4513-b1ff-f82e2618ed0d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:07.261151 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-26c7ade8-885e-4513-b1ff-f82e2618ed0d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.183849 Aug 24 12:32:07.261701 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 165/324] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:07 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:08.281571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-aaf44e83-212c-4d1b-a3eb-2bc05c701d6b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:08.282111 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-aaf44e83-212c-4d1b-a3eb-2bc05c701d6b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:08.288768 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aaf44e83-212c-4d1b-a3eb-2bc05c701d6b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:08.289248 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aaf44e83-212c-4d1b-a3eb-2bc05c701d6b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:08.289679 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aaf44e83-212c-4d1b-a3eb-2bc05c701d6b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:08.290361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aaf44e83-212c-4d1b-a3eb-2bc05c701d6b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:08.290838 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aaf44e83-212c-4d1b-a3eb-2bc05c701d6b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:08.291256 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aaf44e83-212c-4d1b-a3eb-2bc05c701d6b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:08.443222 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-aaf44e83-212c-4d1b-a3eb-2bc05c701d6b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:08.451182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-aaf44e83-212c-4d1b-a3eb-2bc05c701d6b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.173530 Aug 24 12:32:08.451742 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 160/325] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:08 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:09.079593 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f4645856-b2bc-4e58-8819-880c640e09c5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:09.080150 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f4645856-b2bc-4e58-8819-880c640e09c5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:09.086416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4645856-b2bc-4e58-8819-880c640e09c5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:09.086940 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4645856-b2bc-4e58-8819-880c640e09c5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:09.087381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4645856-b2bc-4e58-8819-880c640e09c5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:09.088079 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4645856-b2bc-4e58-8819-880c640e09c5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:09.092477 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4645856-b2bc-4e58-8819-880c640e09c5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:09.092477 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4645856-b2bc-4e58-8819-880c640e09c5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:09.102229 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.wsgi [None req-f4645856-b2bc-4e58-8819-880c640e09c5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] HTTP exception thrown: Instance cfbf55c1-60d6-43b4-8a03-84d8ae291daf could not be found. Aug 24 12:32:09.103851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f4645856-b2bc-4e58-8819-880c640e09c5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Request method failure captured: Aug 24 12:32:09.103851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: request: DELETE /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf HTTP/1.1 Aug 24 12:32:09.103851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept: application/json Aug 24 12:32:09.103851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept-Encoding: identity Aug 24 12:32:09.103851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Connection: close Aug 24 12:32:09.103851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Length: 0 Aug 24 12:32:09.103851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Type: application/json Aug 24 12:32:09.103851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Host: 10.222.0.45 Aug 24 12:32:09.103851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Openstack-System-Scope: None Aug 24 12:32:09.103851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: User-Agent: python-urllib3/1.26.11 Aug 24 12:32:09.103851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Auth-Token: gAAAAABjBhnQt7ZeEvaLtTEoPGQbXfDgnr-aYkSnLs_aZ4FtH1P-ooP641Y_GNJ3zKekoMBnDpA7h7YoO46CpDML978BEN2IgfRm7bHYCX6Gfz2aTQygo0jtn2anqAcpP4K0xA2t6faOpD6Cv46y5yE1j1x3l02zbX9tC5sDjdybKmpP5yMxY28 Aug 24 12:32:09.103851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Id: None Aug 24 12:32:09.103851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Name: None Aug 24 12:32:09.103851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Identity-Status: Confirmed Aug 24 12:32:09.103851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Is-Admin-Project: True Aug 24 12:32:09.103851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Id: default Aug 24 12:32:09.103851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Name: Default Aug 24 12:32:09.103851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Id: 43ef4ba417014205b91496a8037540ed Aug 24 12:32:09.103851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Name: tempest-DeleteServersTestJSON-116655351 Aug 24 12:32:09.103851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Role: member,reader Aug 24 12:32:09.103851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Roles: member,reader Aug 24 12:32:09.105046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_43ef4ba417014205b91496a8037540ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/43ef4ba417014205b91496a8037540ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/43ef4ba417014205b91496a8037540ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/43ef4ba417014205b91496a8037540ed"}]}] Aug 24 12:32:09.105046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant: tempest-DeleteServersTestJSON-116655351 Aug 24 12:32:09.105046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Id: 43ef4ba417014205b91496a8037540ed Aug 24 12:32:09.105046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Name: tempest-DeleteServersTestJSON-116655351 Aug 24 12:32:09.105046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User: tempest-DeleteServersTestJSON-116655351-project Aug 24 12:32:09.105046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Id: default Aug 24 12:32:09.105046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Name: Default Aug 24 12:32:09.105046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Id: 281e6cd581c54901b8feaa291db588eb Aug 24 12:32:09.105046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Name: tempest-DeleteServersTestJSON-116655351-project Aug 24 12:32:09.105046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: method: > Aug 24 12:32:09.105046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: exception: Instance cfbf55c1-60d6-43b4-8a03-84d8ae291daf could not be found. Aug 24 12:32:09.105046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: action_args: {'id': 'cfbf55c1-60d6-43b4-8a03-84d8ae291daf'} Aug 24 12:32:09.105689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:32:09.105689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:09.105689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:32:09.105689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:32:09.105689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:32:09.105689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:32:09.105689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:32:09.105689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:32:09.105689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:32:09.105689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:32:09.105689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfbf55c1-60d6-43b4-8a03-84d8ae291daf could not be found. Aug 24 12:32:09.105689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:32:09.105689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:09.105689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:32:09.105689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:09.105689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:09.105689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:09.105689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:32:09.105689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:32:09.105689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:32:09.108189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:32:09.108189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 12:32:09.108189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 12:32:09.108189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 12:32:09.108189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 12:32:09.108189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:32:09.108189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:32:09.108189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:32:09.108189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:32:09.108189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfbf55c1-60d6-43b4-8a03-84d8ae291daf could not be found. Aug 24 12:32:09.108189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:32:09.108189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:09.108189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:32:09.108189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:09.108189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:09.108189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:09.108189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:32:09.108189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:32:09.108189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfbf55c1-60d6-43b4-8a03-84d8ae291daf could not be found. Aug 24 12:32:09.108189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:32:09.109634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f4645856-b2bc-4e58-8819-880c640e09c5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Returning 404 to user: Instance cfbf55c1-60d6-43b4-8a03-84d8ae291daf could not be found. {{(pid=121171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:32:09.109634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f4645856-b2bc-4e58-8819-880c640e09c5 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "DELETE /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 404 len: 111 microversion: 2.1 time: 0.030724 Aug 24 12:32:09.109634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 166/326] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 12:32:09 2022] DELETE /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:32:09.114612 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-08971be3-60b2-43ed-99d4-77f80fcd0135 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:09.115387 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-08971be3-60b2-43ed-99d4-77f80fcd0135 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] [instance: cfbf55c1-60d6-43b4-8a03-84d8ae291daf] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:09.121518 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-08971be3-60b2-43ed-99d4-77f80fcd0135 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:09.121997 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-08971be3-60b2-43ed-99d4-77f80fcd0135 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:09.122427 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-08971be3-60b2-43ed-99d4-77f80fcd0135 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:09.124316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-08971be3-60b2-43ed-99d4-77f80fcd0135 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:09.125238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-08971be3-60b2-43ed-99d4-77f80fcd0135 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:09.126110 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-08971be3-60b2-43ed-99d4-77f80fcd0135 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:09.141114 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.wsgi [None req-08971be3-60b2-43ed-99d4-77f80fcd0135 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] HTTP exception thrown: Instance cfbf55c1-60d6-43b4-8a03-84d8ae291daf could not be found. Aug 24 12:32:09.143312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-08971be3-60b2-43ed-99d4-77f80fcd0135 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Request method failure captured: Aug 24 12:32:09.143312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: request: GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf HTTP/1.1 Aug 24 12:32:09.143312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept: application/json Aug 24 12:32:09.143312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept-Encoding: identity Aug 24 12:32:09.143312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Connection: close Aug 24 12:32:09.143312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Length: 0 Aug 24 12:32:09.143312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Type: application/json Aug 24 12:32:09.143312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Host: 10.222.0.45 Aug 24 12:32:09.143312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Openstack-System-Scope: None Aug 24 12:32:09.143312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: User-Agent: python-urllib3/1.26.11 Aug 24 12:32:09.143312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Auth-Token: gAAAAABjBhnQt7ZeEvaLtTEoPGQbXfDgnr-aYkSnLs_aZ4FtH1P-ooP641Y_GNJ3zKekoMBnDpA7h7YoO46CpDML978BEN2IgfRm7bHYCX6Gfz2aTQygo0jtn2anqAcpP4K0xA2t6faOpD6Cv46y5yE1j1x3l02zbX9tC5sDjdybKmpP5yMxY28 Aug 24 12:32:09.143312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Id: None Aug 24 12:32:09.143312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Name: None Aug 24 12:32:09.143312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Identity-Status: Confirmed Aug 24 12:32:09.143312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Is-Admin-Project: True Aug 24 12:32:09.143312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Id: default Aug 24 12:32:09.143312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Name: Default Aug 24 12:32:09.143312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Id: 43ef4ba417014205b91496a8037540ed Aug 24 12:32:09.143312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Name: tempest-DeleteServersTestJSON-116655351 Aug 24 12:32:09.143312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Role: member,reader Aug 24 12:32:09.143312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Roles: member,reader Aug 24 12:32:09.144857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_43ef4ba417014205b91496a8037540ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/43ef4ba417014205b91496a8037540ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/43ef4ba417014205b91496a8037540ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/43ef4ba417014205b91496a8037540ed"}]}] Aug 24 12:32:09.144857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant: tempest-DeleteServersTestJSON-116655351 Aug 24 12:32:09.144857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Id: 43ef4ba417014205b91496a8037540ed Aug 24 12:32:09.144857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Name: tempest-DeleteServersTestJSON-116655351 Aug 24 12:32:09.144857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User: tempest-DeleteServersTestJSON-116655351-project Aug 24 12:32:09.144857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Id: default Aug 24 12:32:09.144857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Name: Default Aug 24 12:32:09.144857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Id: 281e6cd581c54901b8feaa291db588eb Aug 24 12:32:09.144857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Name: tempest-DeleteServersTestJSON-116655351-project Aug 24 12:32:09.144857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: method: > Aug 24 12:32:09.144857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: exception: Instance cfbf55c1-60d6-43b4-8a03-84d8ae291daf could not be found. Aug 24 12:32:09.144857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: action_args: {'id': 'cfbf55c1-60d6-43b4-8a03-84d8ae291daf'} Aug 24 12:32:09.146250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:32:09.146250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:09.146250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:32:09.146250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:32:09.146250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:32:09.146250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:32:09.146250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:32:09.146250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:32:09.146250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:32:09.146250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:32:09.146250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfbf55c1-60d6-43b4-8a03-84d8ae291daf could not be found. Aug 24 12:32:09.146250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:32:09.146250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:09.146250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:32:09.146250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:09.146250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:09.146250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:09.146250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:32:09.146250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:32:09.146250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:32:09.148875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:32:09.148875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:32:09.148875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:32:09.148875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:32:09.148875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:32:09.148875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:32:09.148875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:32:09.148875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfbf55c1-60d6-43b4-8a03-84d8ae291daf could not be found. Aug 24 12:32:09.148875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:32:09.148875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:09.148875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:32:09.148875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:09.148875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:09.148875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:09.148875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:32:09.148875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:32:09.148875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfbf55c1-60d6-43b4-8a03-84d8ae291daf could not be found. Aug 24 12:32:09.148875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:32:09.155760 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-08971be3-60b2-43ed-99d4-77f80fcd0135 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] Returning 404 to user: Instance cfbf55c1-60d6-43b4-8a03-84d8ae291daf could not be found. {{(pid=121170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:32:09.155760 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-08971be3-60b2-43ed-99d4-77f80fcd0135 tempest-DeleteServersTestJSON-116655351 tempest-DeleteServersTestJSON-116655351-project] 10.222.0.45 "GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf" status: 404 len: 111 microversion: 2.1 time: 0.034224 Aug 24 12:32:09.155760 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 161/327] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:09 2022] GET /compute/v2.1/servers/cfbf55c1-60d6-43b4-8a03-84d8ae291daf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:32:09.471694 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a1fa3c03-cf89-41f3-9b44-d879fdd92ed0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:09.472337 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a1fa3c03-cf89-41f3-9b44-d879fdd92ed0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:09.480140 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1fa3c03-cf89-41f3-9b44-d879fdd92ed0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:09.481412 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1fa3c03-cf89-41f3-9b44-d879fdd92ed0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:09.481766 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1fa3c03-cf89-41f3-9b44-d879fdd92ed0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:09.482999 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1fa3c03-cf89-41f3-9b44-d879fdd92ed0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:09.483462 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1fa3c03-cf89-41f3-9b44-d879fdd92ed0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:09.483884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1fa3c03-cf89-41f3-9b44-d879fdd92ed0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:09.741508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a1fa3c03-cf89-41f3-9b44-d879fdd92ed0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:09.754688 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a1fa3c03-cf89-41f3-9b44-d879fdd92ed0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.286843 Aug 24 12:32:09.755603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 167/328] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:09 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:32:10.777758 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c282ddd3-0ad7-431d-abfd-b12bd95a511b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:10.778377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c282ddd3-0ad7-431d-abfd-b12bd95a511b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:10.786320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c282ddd3-0ad7-431d-abfd-b12bd95a511b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:10.786865 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c282ddd3-0ad7-431d-abfd-b12bd95a511b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:10.787333 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c282ddd3-0ad7-431d-abfd-b12bd95a511b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:10.788034 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c282ddd3-0ad7-431d-abfd-b12bd95a511b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:10.788491 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c282ddd3-0ad7-431d-abfd-b12bd95a511b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:10.788924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c282ddd3-0ad7-431d-abfd-b12bd95a511b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:10.984063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c282ddd3-0ad7-431d-abfd-b12bd95a511b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:10.992879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c282ddd3-0ad7-431d-abfd-b12bd95a511b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.218555 Aug 24 12:32:10.993653 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 162/329] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:10 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:32:12.014148 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c44f57b8-31e4-48c9-809b-b81888b0b73b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:12.014783 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c44f57b8-31e4-48c9-809b-b81888b0b73b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:12.020854 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c44f57b8-31e4-48c9-809b-b81888b0b73b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:12.021339 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c44f57b8-31e4-48c9-809b-b81888b0b73b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:12.021776 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c44f57b8-31e4-48c9-809b-b81888b0b73b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:12.022505 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c44f57b8-31e4-48c9-809b-b81888b0b73b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:12.022966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c44f57b8-31e4-48c9-809b-b81888b0b73b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:12.023391 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c44f57b8-31e4-48c9-809b-b81888b0b73b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:12.224545 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c44f57b8-31e4-48c9-809b-b81888b0b73b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:12.232583 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c44f57b8-31e4-48c9-809b-b81888b0b73b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.222224 Aug 24 12:32:12.233125 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 168/330] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:12 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:13.258772 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ab65a1e2-3c5b-4cc9-9345-3424f99795c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:13.259427 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ab65a1e2-3c5b-4cc9-9345-3424f99795c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:13.271228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab65a1e2-3c5b-4cc9-9345-3424f99795c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:13.271999 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab65a1e2-3c5b-4cc9-9345-3424f99795c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:13.272913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab65a1e2-3c5b-4cc9-9345-3424f99795c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:13.275653 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab65a1e2-3c5b-4cc9-9345-3424f99795c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:13.276562 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab65a1e2-3c5b-4cc9-9345-3424f99795c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:13.277258 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab65a1e2-3c5b-4cc9-9345-3424f99795c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:13.777707 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ab65a1e2-3c5b-4cc9-9345-3424f99795c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:13.786318 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ab65a1e2-3c5b-4cc9-9345-3424f99795c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.533070 Aug 24 12:32:13.787240 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 163/331] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:13 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:14.807559 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f6256722-99e7-4c9c-9285-0f0c60441863 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:14.813093 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f6256722-99e7-4c9c-9285-0f0c60441863 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:14.816493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f6256722-99e7-4c9c-9285-0f0c60441863 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:14.817049 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f6256722-99e7-4c9c-9285-0f0c60441863 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:14.817550 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f6256722-99e7-4c9c-9285-0f0c60441863 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:14.818393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f6256722-99e7-4c9c-9285-0f0c60441863 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:14.819002 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f6256722-99e7-4c9c-9285-0f0c60441863 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:14.819492 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f6256722-99e7-4c9c-9285-0f0c60441863 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:15.002198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f6256722-99e7-4c9c-9285-0f0c60441863 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:15.011710 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f6256722-99e7-4c9c-9285-0f0c60441863 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.207395 Aug 24 12:32:15.014731 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 169/332] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:14 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:15.856370 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-350bb189-fb4b-4534-935f-154354e6419a tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] Action: 'create', calling method: .version_select at 0x7f76f5e20280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-429633553", "metadata": {"Type": "work"}}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:32:16.033759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bf78a6a1-6326-4feb-a843-5d89a49b4058 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:16.034681 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-bf78a6a1-6326-4feb-a843-5d89a49b4058 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:16.040583 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf78a6a1-6326-4feb-a843-5d89a49b4058 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:16.041046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf78a6a1-6326-4feb-a843-5d89a49b4058 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:16.041476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf78a6a1-6326-4feb-a843-5d89a49b4058 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:16.042161 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf78a6a1-6326-4feb-a843-5d89a49b4058 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:16.042606 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf78a6a1-6326-4feb-a843-5d89a49b4058 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:16.043053 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf78a6a1-6326-4feb-a843-5d89a49b4058 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:16.178807 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-bf78a6a1-6326-4feb-a843-5d89a49b4058 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:16.186972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bf78a6a1-6326-4feb-a843-5d89a49b4058 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.157041 Aug 24 12:32:16.187524 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 170/333] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:16 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:32:16.664694 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-350bb189-fb4b-4534-935f-154354e6419a tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.950652 Aug 24 12:32:16.665312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 164/334] 10.222.0.45 () {60 vars in 1156 bytes} [Wed Aug 24 12:32:15 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 952 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 12:32:16.677502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5ed1da55-a6a0-4188-9d79-5c66bdb198f3 tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] Calling method '.version_select at 0x7f76f55a4d30>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:16.727940 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5ed1da55-a6a0-4188-9d79-5c66bdb198f3 tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1" status: 200 len: 352 microversion: 2.1 time: 0.054187 Aug 24 12:32:16.728493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 171/335] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 12:32:16 2022] GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:17.208499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-06676671-9478-4cf4-856f-a2653be597bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:17.209113 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-06676671-9478-4cf4-856f-a2653be597bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:17.215642 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06676671-9478-4cf4-856f-a2653be597bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:17.216143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06676671-9478-4cf4-856f-a2653be597bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:17.216601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06676671-9478-4cf4-856f-a2653be597bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:17.217293 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06676671-9478-4cf4-856f-a2653be597bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:17.217749 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06676671-9478-4cf4-856f-a2653be597bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:17.218180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06676671-9478-4cf4-856f-a2653be597bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:17.346585 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-06676671-9478-4cf4-856f-a2653be597bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:17.354831 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-06676671-9478-4cf4-856f-a2653be597bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.150606 Aug 24 12:32:17.358762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 165/336] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:17 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:17.741860 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d6d3debc-621a-4275-bf36-1365cce18b3d tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] Calling method '.version_select at 0x7f76f561f310>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:17.787401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d6d3debc-621a-4275-bf36-1365cce18b3d tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1" status: 200 len: 352 microversion: 2.1 time: 0.049783 Aug 24 12:32:17.787958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 172/337] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 12:32:17 2022] GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:18.376393 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9e7428d6-8ec7-4743-92bc-f5e71a5b4e06 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:18.377030 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9e7428d6-8ec7-4743-92bc-f5e71a5b4e06 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:18.383317 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e7428d6-8ec7-4743-92bc-f5e71a5b4e06 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:18.383794 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e7428d6-8ec7-4743-92bc-f5e71a5b4e06 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:18.384228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e7428d6-8ec7-4743-92bc-f5e71a5b4e06 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:18.384903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e7428d6-8ec7-4743-92bc-f5e71a5b4e06 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:18.385355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e7428d6-8ec7-4743-92bc-f5e71a5b4e06 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:18.385775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e7428d6-8ec7-4743-92bc-f5e71a5b4e06 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:18.525589 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9e7428d6-8ec7-4743-92bc-f5e71a5b4e06 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:18.534609 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9e7428d6-8ec7-4743-92bc-f5e71a5b4e06 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.162110 Aug 24 12:32:18.535799 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 166/338] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:18 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:18.801058 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0bbc1eb4-2db5-49f7-8018-3ddca5ae82dc tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] Calling method '.version_select at 0x7f76f561a4c0>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:18.850925 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0bbc1eb4-2db5-49f7-8018-3ddca5ae82dc tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1" status: 200 len: 352 microversion: 2.1 time: 0.053480 Aug 24 12:32:18.851511 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 173/339] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 12:32:18 2022] GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:19.555731 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-882c407d-7376-4c4d-a5ac-12920f4a2459 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:19.556481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-882c407d-7376-4c4d-a5ac-12920f4a2459 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:19.563134 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-882c407d-7376-4c4d-a5ac-12920f4a2459 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:19.563664 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-882c407d-7376-4c4d-a5ac-12920f4a2459 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:19.564104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-882c407d-7376-4c4d-a5ac-12920f4a2459 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:19.564800 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-882c407d-7376-4c4d-a5ac-12920f4a2459 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:19.565312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-882c407d-7376-4c4d-a5ac-12920f4a2459 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:19.565713 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-882c407d-7376-4c4d-a5ac-12920f4a2459 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:19.701149 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-882c407d-7376-4c4d-a5ac-12920f4a2459 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:19.708723 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-882c407d-7376-4c4d-a5ac-12920f4a2459 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.156987 Aug 24 12:32:19.709283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 167/340] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:19 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:19.865240 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2b9ff5fc-ce30-4774-b503-b573fc2aee2b tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] Calling method '.version_select at 0x7f76f561a160>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:19.911586 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2b9ff5fc-ce30-4774-b503-b573fc2aee2b tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1" status: 200 len: 352 microversion: 2.1 time: 0.050522 Aug 24 12:32:19.912169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 174/341] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 12:32:19 2022] GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:20.729110 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-cadf8344-9614-4b4f-bdf5-6a972ac177d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:20.729754 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-cadf8344-9614-4b4f-bdf5-6a972ac177d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:20.736608 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cadf8344-9614-4b4f-bdf5-6a972ac177d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:20.737094 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cadf8344-9614-4b4f-bdf5-6a972ac177d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:20.737537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cadf8344-9614-4b4f-bdf5-6a972ac177d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:20.738222 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cadf8344-9614-4b4f-bdf5-6a972ac177d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:20.738727 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cadf8344-9614-4b4f-bdf5-6a972ac177d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:20.739168 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cadf8344-9614-4b4f-bdf5-6a972ac177d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:20.863946 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-cadf8344-9614-4b4f-bdf5-6a972ac177d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:20.871842 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-cadf8344-9614-4b4f-bdf5-6a972ac177d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.146531 Aug 24 12:32:20.872389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 168/342] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:20 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:20.924816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f07d2195-c8e8-469a-b9b8-fc98c733f3ad tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] Calling method '.version_select at 0x7f76f55a4790>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:20.970416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f07d2195-c8e8-469a-b9b8-fc98c733f3ad tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1" status: 200 len: 352 microversion: 2.1 time: 0.049303 Aug 24 12:32:20.971001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 175/343] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 12:32:20 2022] GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:21.892525 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b3c8dbd7-396c-4bf4-8b77-cb37a7a19d06 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:21.893074 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b3c8dbd7-396c-4bf4-8b77-cb37a7a19d06 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:21.899899 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3c8dbd7-396c-4bf4-8b77-cb37a7a19d06 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:21.900383 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3c8dbd7-396c-4bf4-8b77-cb37a7a19d06 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:21.900849 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3c8dbd7-396c-4bf4-8b77-cb37a7a19d06 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:21.901576 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3c8dbd7-396c-4bf4-8b77-cb37a7a19d06 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:21.902030 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3c8dbd7-396c-4bf4-8b77-cb37a7a19d06 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:21.902456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3c8dbd7-396c-4bf4-8b77-cb37a7a19d06 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:21.984397 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a2565751-b185-46c7-bb47-22a0577a3d2f tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] Calling method '.version_select at 0x7f76f5670040>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:22.031127 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a2565751-b185-46c7-bb47-22a0577a3d2f tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1" status: 200 len: 352 microversion: 2.1 time: 0.050965 Aug 24 12:32:22.031680 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 176/344] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 12:32:21 2022] GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:32:22.033606 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b3c8dbd7-396c-4bf4-8b77-cb37a7a19d06 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:22.041220 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b3c8dbd7-396c-4bf4-8b77-cb37a7a19d06 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.152681 Aug 24 12:32:22.041758 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 169/345] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:21 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:23.044899 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-915a0d77-6822-4518-9576-2c00f2595959 tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] Calling method '.version_select at 0x7f76f561f1f0>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:23.062434 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9dbb075d-2771-42f8-8d41-b764572f7383 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:23.063187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9dbb075d-2771-42f8-8d41-b764572f7383 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:23.069393 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9dbb075d-2771-42f8-8d41-b764572f7383 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:23.069874 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9dbb075d-2771-42f8-8d41-b764572f7383 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:23.070307 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9dbb075d-2771-42f8-8d41-b764572f7383 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:23.071028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9dbb075d-2771-42f8-8d41-b764572f7383 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:23.071477 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9dbb075d-2771-42f8-8d41-b764572f7383 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:23.071899 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9dbb075d-2771-42f8-8d41-b764572f7383 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:23.074399 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:32:23.102201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-915a0d77-6822-4518-9576-2c00f2595959 tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1" status: 200 len: 352 microversion: 2.1 time: 0.049977 Aug 24 12:32:23.102201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 177/346] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 12:32:23 2022] GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:23.199508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9dbb075d-2771-42f8-8d41-b764572f7383 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:23.207666 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9dbb075d-2771-42f8-8d41-b764572f7383 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.149546 Aug 24 12:32:23.208217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 170/347] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:23 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:32:24.115876 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fbb9b5e4-ba78-4908-8c48-f7322488bf8c tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] Calling method '.version_select at 0x7f76f561a820>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:24.161016 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fbb9b5e4-ba78-4908-8c48-f7322488bf8c tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1" status: 200 len: 352 microversion: 2.1 time: 0.049277 Aug 24 12:32:24.161549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 178/348] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 12:32:24 2022] GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1 => generated 352 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:24.228019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a2bf5c42-513b-477b-8775-1840bbbe06bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:24.228561 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a2bf5c42-513b-477b-8775-1840bbbe06bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:24.234938 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a2bf5c42-513b-477b-8775-1840bbbe06bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:24.235413 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a2bf5c42-513b-477b-8775-1840bbbe06bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:24.235839 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a2bf5c42-513b-477b-8775-1840bbbe06bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:24.236517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a2bf5c42-513b-477b-8775-1840bbbe06bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:24.236969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a2bf5c42-513b-477b-8775-1840bbbe06bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:24.237387 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a2bf5c42-513b-477b-8775-1840bbbe06bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:24.362126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a2bf5c42-513b-477b-8775-1840bbbe06bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:24.370080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a2bf5c42-513b-477b-8775-1840bbbe06bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.145913 Aug 24 12:32:24.370636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 171/349] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:24 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:25.174812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f08c1a7a-bd33-4230-9f3a-5c6e65efe653 tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] Calling method '.version_select at 0x7f76f561f4c0>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:25.222890 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f08c1a7a-bd33-4230-9f3a-5c6e65efe653 tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1" status: 200 len: 352 microversion: 2.1 time: 0.051794 Aug 24 12:32:25.223457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 179/350] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 12:32:25 2022] GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:25.390526 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5e1d78fb-fe23-4f88-a8df-e2fabdcfbc55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:25.391116 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5e1d78fb-fe23-4f88-a8df-e2fabdcfbc55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:25.397432 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e1d78fb-fe23-4f88-a8df-e2fabdcfbc55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:25.397945 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e1d78fb-fe23-4f88-a8df-e2fabdcfbc55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:25.398382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e1d78fb-fe23-4f88-a8df-e2fabdcfbc55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:25.399105 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e1d78fb-fe23-4f88-a8df-e2fabdcfbc55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:25.399560 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e1d78fb-fe23-4f88-a8df-e2fabdcfbc55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:25.399987 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e1d78fb-fe23-4f88-a8df-e2fabdcfbc55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:25.531155 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5e1d78fb-fe23-4f88-a8df-e2fabdcfbc55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:25.539204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5e1d78fb-fe23-4f88-a8df-e2fabdcfbc55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.152372 Aug 24 12:32:25.541985 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 172/351] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:25 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:26.233077 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=35 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:32:26.233841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=94 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:32:26.237715 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6b163330-8d29-4cac-b8dd-2276754d9894 tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] Calling method '.version_select at 0x7f76f588c940>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:26.285801 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6b163330-8d29-4cac-b8dd-2276754d9894 tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1" status: 200 len: 352 microversion: 2.1 time: 0.053628 Aug 24 12:32:26.286371 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 180/352] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 12:32:26 2022] GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:26.560786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-cb02a49b-af95-4475-8883-582a2d5c1da3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:26.561482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-cb02a49b-af95-4475-8883-582a2d5c1da3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:26.567778 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cb02a49b-af95-4475-8883-582a2d5c1da3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:26.568264 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cb02a49b-af95-4475-8883-582a2d5c1da3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:26.568699 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cb02a49b-af95-4475-8883-582a2d5c1da3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:26.569397 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cb02a49b-af95-4475-8883-582a2d5c1da3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:26.569889 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cb02a49b-af95-4475-8883-582a2d5c1da3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:26.570585 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cb02a49b-af95-4475-8883-582a2d5c1da3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:26.709206 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-cb02a49b-af95-4475-8883-582a2d5c1da3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:26.717281 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-cb02a49b-af95-4475-8883-582a2d5c1da3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.161121 Aug 24 12:32:26.723320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 173/353] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:26 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:27.300448 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-59680f34-59f9-4ee0-a5af-b937696c1ceb tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] Calling method '.version_select at 0x7f76f55a4670>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:27.347519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-59680f34-59f9-4ee0-a5af-b937696c1ceb tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1" status: 200 len: 353 microversion: 2.1 time: 0.051221 Aug 24 12:32:27.348103 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 181/354] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 12:32:27 2022] GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:27.360178 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-867e599a-5552-45f7-9590-e4e0d843a5f5 tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] Calling method '.version_select at 0x7f76f5ea55e0>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:27.407259 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-867e599a-5552-45f7-9590-e4e0d843a5f5 tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1" status: 200 len: 353 microversion: 2.1 time: 0.050766 Aug 24 12:32:27.407813 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 174/355] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 12:32:27 2022] GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:27.430329 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8dda113e-0536-44c8-9d94-efb8665100c0 tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] Calling method '.version_select at 0x7f76f561aa60>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:27.646015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8dda113e-0536-44c8-9d94-efb8665100c0 tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1" status: 202 len: 0 microversion: 2.1 time: 0.219673 Aug 24 12:32:27.656678 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 182/356] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 24 12:32:27 2022] DELETE /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:32:27.657197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f53a7704-b505-4bcc-b2ec-beb75002f0ea tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] Calling method '.version_select at 0x7f76f5fc6af0>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:27.704482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f53a7704-b505-4bcc-b2ec-beb75002f0ea tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1" status: 200 len: 352 microversion: 2.1 time: 0.053644 Aug 24 12:32:27.704989 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 175/357] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 12:32:27 2022] GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:27.737190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e82496f8-31b2-4ef1-8b84-732c6b21a4f3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:27.737805 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e82496f8-31b2-4ef1-8b84-732c6b21a4f3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:27.744004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e82496f8-31b2-4ef1-8b84-732c6b21a4f3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:27.744493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e82496f8-31b2-4ef1-8b84-732c6b21a4f3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:27.744931 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e82496f8-31b2-4ef1-8b84-732c6b21a4f3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:27.745619 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e82496f8-31b2-4ef1-8b84-732c6b21a4f3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:27.746073 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e82496f8-31b2-4ef1-8b84-732c6b21a4f3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:27.746500 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e82496f8-31b2-4ef1-8b84-732c6b21a4f3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:27.878251 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e82496f8-31b2-4ef1-8b84-732c6b21a4f3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:27.885954 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e82496f8-31b2-4ef1-8b84-732c6b21a4f3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.152668 Aug 24 12:32:27.886549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 183/358] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:27 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:28.719004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1cc3fa82-a5f0-4c32-9f90-afdfa67bf281 tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] Calling method '.version_select at 0x7f76f5efb1f0>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:28.749650 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.wsgi [None req-1cc3fa82-a5f0-4c32-9f90-afdfa67bf281 tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] HTTP exception thrown: Volume 459ec3e6-5a07-4da1-a303-090157061ce1 could not be found. Aug 24 12:32:28.751624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1cc3fa82-a5f0-4c32-9f90-afdfa67bf281 tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] Request method failure captured: Aug 24 12:32:28.751624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: request: GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1 HTTP/1.1 Aug 24 12:32:28.751624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept: application/json Aug 24 12:32:28.751624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept-Encoding: identity Aug 24 12:32:28.751624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Connection: close Aug 24 12:32:28.751624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Length: 0 Aug 24 12:32:28.751624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Type: application/json Aug 24 12:32:28.751624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Host: 10.222.0.45 Aug 24 12:32:28.751624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Openstack-System-Scope: None Aug 24 12:32:28.751624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: User-Agent: python-urllib3/1.26.11 Aug 24 12:32:28.751624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Auth-Token: gAAAAABjBhpPrdzh9JuN-LUej3vnZQ_xTItCy5frbTyimFBNxg5OzZDNDOiSGSKszh-ZWkHBYL08INqvUmOnqaNzCWXRkdzGgim6DWx3O_5jvDk2PxcrqGH4O1RtlMnRlzLreT9cXcAznzzVx7Eb3ppvFu5fqht92DQMuxkVdRLnf3q97SJ4Kik Aug 24 12:32:28.751624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Id: None Aug 24 12:32:28.751624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Name: None Aug 24 12:32:28.751624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Identity-Status: Confirmed Aug 24 12:32:28.751624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Is-Admin-Project: True Aug 24 12:32:28.751624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Id: default Aug 24 12:32:28.751624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Name: Default Aug 24 12:32:28.751624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Id: 160c47318b954399b4b19a977a16759b Aug 24 12:32:28.751624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Name: tempest-VolumesGetTestJSON-1128498892 Aug 24 12:32:28.751624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Role: member,reader Aug 24 12:32:28.751624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Roles: member,reader Aug 24 12:32:28.752908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_160c47318b954399b4b19a977a16759b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/160c47318b954399b4b19a977a16759b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/160c47318b954399b4b19a977a16759b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/160c47318b954399b4b19a977a16759b"}]}] Aug 24 12:32:28.752908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant: tempest-VolumesGetTestJSON-1128498892 Aug 24 12:32:28.752908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Id: 160c47318b954399b4b19a977a16759b Aug 24 12:32:28.752908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Name: tempest-VolumesGetTestJSON-1128498892 Aug 24 12:32:28.752908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User: tempest-VolumesGetTestJSON-1128498892-project Aug 24 12:32:28.752908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Id: default Aug 24 12:32:28.752908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Name: Default Aug 24 12:32:28.752908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Id: dbb6e9196121494e8eb1b56f1b2cce31 Aug 24 12:32:28.752908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Name: tempest-VolumesGetTestJSON-1128498892-project Aug 24 12:32:28.752908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: method: Aug 24 12:32:28.752908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: exception: Volume 459ec3e6-5a07-4da1-a303-090157061ce1 could not be found. Aug 24 12:32:28.752908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: action_args: {'id': '459ec3e6-5a07-4da1-a303-090157061ce1'} Aug 24 12:32:28.752908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:32:28.753751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:28.753751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:32:28.753751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:32:28.753751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 12:32:28.753751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 12:32:28.753751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 12:32:28.753751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 12:32:28.753751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 12:32:28.753751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 12:32:28.753751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 12:32:28.753751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 12:32:28.753751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:32:28.753751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:32:28.753751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:32:28.753751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:32:28.753751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 459ec3e6-5a07-4da1-a303-090157061ce1 could not be found. (HTTP 404) (Request-ID: req-4f47090b-4f38-43a2-83b4-78697ef58701) Aug 24 12:32:28.753751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:32:28.753751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:28.753751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:32:28.754949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:28.754949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 12:32:28.754949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 12:32:28.754949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 12:32:28.754949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 12:32:28.754949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 12:32:28.754949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 12:32:28.754949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 12:32:28.754949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 12:32:28.754949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:32:28.754949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:32:28.754949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 12:32:28.754949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 12:32:28.754949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 12:32:28.754949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 12:32:28.754949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 12:32:28.754949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 12:32:28.754949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 12:32:28.754949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 12:32:28.756019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:32:28.756019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:32:28.756019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:32:28.756019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:32:28.756019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 459ec3e6-5a07-4da1-a303-090157061ce1 could not be found. Aug 24 12:32:28.756019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:32:28.756019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:28.756019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:32:28.756019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:28.756019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:28.756019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:28.756019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:32:28.756019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:32:28.756019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:32:28.756019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:32:28.756019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:32:28.756019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:32:28.756019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 12:32:28.756019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:32:28.757289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 459ec3e6-5a07-4da1-a303-090157061ce1 could not be found. Aug 24 12:32:28.757289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:32:28.757289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:28.757289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:32:28.757289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:28.757289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:28.757289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:28.757289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:32:28.757289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:32:28.757289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 459ec3e6-5a07-4da1-a303-090157061ce1 could not be found. Aug 24 12:32:28.757289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:32:28.757289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1cc3fa82-a5f0-4c32-9f90-afdfa67bf281 tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] Returning 404 to user: Volume 459ec3e6-5a07-4da1-a303-090157061ce1 could not be found. {{(pid=121170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:32:28.757289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1cc3fa82-a5f0-4c32-9f90-afdfa67bf281 tempest-VolumesGetTestJSON-1128498892 tempest-VolumesGetTestJSON-1128498892-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1" status: 404 len: 109 microversion: 2.1 time: 0.038983 Aug 24 12:32:28.757289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 176/359] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 12:32:28 2022] GET /compute/v2.1/os-volumes/459ec3e6-5a07-4da1-a303-090157061ce1 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:32:28.907237 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a1369af3-2f58-457a-930a-bd6b0a3b3856 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:28.908443 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a1369af3-2f58-457a-930a-bd6b0a3b3856 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:28.915942 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1369af3-2f58-457a-930a-bd6b0a3b3856 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:28.916432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1369af3-2f58-457a-930a-bd6b0a3b3856 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:28.916870 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1369af3-2f58-457a-930a-bd6b0a3b3856 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:28.917562 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1369af3-2f58-457a-930a-bd6b0a3b3856 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:28.918109 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1369af3-2f58-457a-930a-bd6b0a3b3856 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:28.918610 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1369af3-2f58-457a-930a-bd6b0a3b3856 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:29.054121 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a1369af3-2f58-457a-930a-bd6b0a3b3856 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:29.063105 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a1369af3-2f58-457a-930a-bd6b0a3b3856 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.160416 Aug 24 12:32:29.063664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 184/360] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:28 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:30.084872 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-45fb8d18-5a1f-491b-947f-2aa7be224fdf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:30.085635 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-45fb8d18-5a1f-491b-947f-2aa7be224fdf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:30.087764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=44 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:32:30.092594 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45fb8d18-5a1f-491b-947f-2aa7be224fdf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:30.093085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45fb8d18-5a1f-491b-947f-2aa7be224fdf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:30.093528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45fb8d18-5a1f-491b-947f-2aa7be224fdf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:30.094223 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45fb8d18-5a1f-491b-947f-2aa7be224fdf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:30.094882 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45fb8d18-5a1f-491b-947f-2aa7be224fdf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:30.095312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45fb8d18-5a1f-491b-947f-2aa7be224fdf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:30.269264 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-45fb8d18-5a1f-491b-947f-2aa7be224fdf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:30.279375 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-45fb8d18-5a1f-491b-947f-2aa7be224fdf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.198164 Aug 24 12:32:30.280116 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 177/361] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:30 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:31.300782 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d0e7d0ea-ab98-4853-856c-95d2007546a9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:31.301777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d0e7d0ea-ab98-4853-856c-95d2007546a9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:31.311846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0e7d0ea-ab98-4853-856c-95d2007546a9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:31.312339 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0e7d0ea-ab98-4853-856c-95d2007546a9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:31.312840 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0e7d0ea-ab98-4853-856c-95d2007546a9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:31.313487 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0e7d0ea-ab98-4853-856c-95d2007546a9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:31.313968 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0e7d0ea-ab98-4853-856c-95d2007546a9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:31.314365 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0e7d0ea-ab98-4853-856c-95d2007546a9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:31.491060 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d0e7d0ea-ab98-4853-856c-95d2007546a9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:31.501523 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d0e7d0ea-ab98-4853-856c-95d2007546a9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.205014 Aug 24 12:32:31.502140 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 185/362] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:31 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:32.523038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f6e5486e-4c2d-4b55-8005-14ba764be070 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:32.523652 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f6e5486e-4c2d-4b55-8005-14ba764be070 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:32.531060 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6e5486e-4c2d-4b55-8005-14ba764be070 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:32.531548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6e5486e-4c2d-4b55-8005-14ba764be070 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:32.531985 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6e5486e-4c2d-4b55-8005-14ba764be070 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:32.532718 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6e5486e-4c2d-4b55-8005-14ba764be070 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:32.533129 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6e5486e-4c2d-4b55-8005-14ba764be070 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:32.533860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6e5486e-4c2d-4b55-8005-14ba764be070 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:32.707608 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f6e5486e-4c2d-4b55-8005-14ba764be070 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:32.718276 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f6e5486e-4c2d-4b55-8005-14ba764be070 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.199049 Aug 24 12:32:32.719286 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 178/363] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:32 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:33.740068 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9dfd612a-606b-4037-9509-2e9080105921 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:33.740756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9dfd612a-606b-4037-9509-2e9080105921 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:33.747031 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9dfd612a-606b-4037-9509-2e9080105921 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:33.747616 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9dfd612a-606b-4037-9509-2e9080105921 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:33.748120 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9dfd612a-606b-4037-9509-2e9080105921 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:33.749092 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9dfd612a-606b-4037-9509-2e9080105921 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:33.749545 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9dfd612a-606b-4037-9509-2e9080105921 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:33.749973 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9dfd612a-606b-4037-9509-2e9080105921 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:33.889734 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9dfd612a-606b-4037-9509-2e9080105921 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:33.897631 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9dfd612a-606b-4037-9509-2e9080105921 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1521 microversion: 2.1 time: 0.161788 Aug 24 12:32:33.898194 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 186/364] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:33 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:34.920233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8978d840-ad4a-4fdd-8ac0-1ef6baf4e26c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:34.921556 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8978d840-ad4a-4fdd-8ac0-1ef6baf4e26c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:34.928044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8978d840-ad4a-4fdd-8ac0-1ef6baf4e26c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:34.928534 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8978d840-ad4a-4fdd-8ac0-1ef6baf4e26c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:34.928969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8978d840-ad4a-4fdd-8ac0-1ef6baf4e26c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:34.929829 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8978d840-ad4a-4fdd-8ac0-1ef6baf4e26c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:34.930293 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8978d840-ad4a-4fdd-8ac0-1ef6baf4e26c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:34.930727 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8978d840-ad4a-4fdd-8ac0-1ef6baf4e26c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:35.089337 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8978d840-ad4a-4fdd-8ac0-1ef6baf4e26c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:35.097467 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8978d840-ad4a-4fdd-8ac0-1ef6baf4e26c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1501 microversion: 2.1 time: 0.182343 Aug 24 12:32:35.097986 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 179/365] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:34 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1501 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:35.118523 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5221cb17-6d62-4f77-bf1b-c59bc35354f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:35.118995 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5221cb17-6d62-4f77-bf1b-c59bc35354f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:35.124861 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5221cb17-6d62-4f77-bf1b-c59bc35354f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:35.125348 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5221cb17-6d62-4f77-bf1b-c59bc35354f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:35.125814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5221cb17-6d62-4f77-bf1b-c59bc35354f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:35.126520 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5221cb17-6d62-4f77-bf1b-c59bc35354f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:35.127005 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5221cb17-6d62-4f77-bf1b-c59bc35354f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:35.127606 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5221cb17-6d62-4f77-bf1b-c59bc35354f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:35.307681 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5221cb17-6d62-4f77-bf1b-c59bc35354f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:35.315629 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5221cb17-6d62-4f77-bf1b-c59bc35354f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1514 microversion: 2.1 time: 0.201354 Aug 24 12:32:35.316307 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 187/366] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:35 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1514 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:38.169309 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c3759e4f-c80b-4209-af94-1c11a0b07204 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:32:38.172322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c3759e4f-c80b-4209-af94-1c11a0b07204 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:38.178556 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3759e4f-c80b-4209-af94-1c11a0b07204 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:38.179080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3759e4f-c80b-4209-af94-1c11a0b07204 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:38.179511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3759e4f-c80b-4209-af94-1c11a0b07204 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:38.180199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3759e4f-c80b-4209-af94-1c11a0b07204 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:38.180649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3759e4f-c80b-4209-af94-1c11a0b07204 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:38.181068 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3759e4f-c80b-4209-af94-1c11a0b07204 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:38.203672 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.objects.instance [None req-c3759e4f-c80b-4209-af94-1c11a0b07204 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lazy-loading 'flavor' on Instance uuid e7228012-d37e-4a5c-bc05-791ad60259e3 {{(pid=121170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:32:38.650106 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c3759e4f-c80b-4209-af94-1c11a0b07204 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "POST /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3/action" status: 200 len: 32 microversion: 2.1 time: 0.484908 Aug 24 12:32:38.650741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 180/367] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 12:32:38 2022] POST /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3/action => generated 32 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 12:32:38.660474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a0653b66-52c5-4fac-a176-55a92f7701ff tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:38.661224 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a0653b66-52c5-4fac-a176-55a92f7701ff tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:38.667246 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a0653b66-52c5-4fac-a176-55a92f7701ff tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:38.667724 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a0653b66-52c5-4fac-a176-55a92f7701ff tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:38.668157 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a0653b66-52c5-4fac-a176-55a92f7701ff tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:38.668843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a0653b66-52c5-4fac-a176-55a92f7701ff tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:38.669784 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a0653b66-52c5-4fac-a176-55a92f7701ff tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:38.670213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a0653b66-52c5-4fac-a176-55a92f7701ff tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:38.851348 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a0653b66-52c5-4fac-a176-55a92f7701ff tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:38.861361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a0653b66-52c5-4fac-a176-55a92f7701ff tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1520 microversion: 2.1 time: 0.204690 Aug 24 12:32:38.861936 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 188/368] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:38 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:39.883671 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0f3ac23c-7f3b-43cf-bb89-3708197aaed9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:39.884365 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0f3ac23c-7f3b-43cf-bb89-3708197aaed9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:39.890463 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f3ac23c-7f3b-43cf-bb89-3708197aaed9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:39.890979 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f3ac23c-7f3b-43cf-bb89-3708197aaed9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:39.891415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f3ac23c-7f3b-43cf-bb89-3708197aaed9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:39.892131 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f3ac23c-7f3b-43cf-bb89-3708197aaed9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:39.892588 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f3ac23c-7f3b-43cf-bb89-3708197aaed9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:39.893013 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f3ac23c-7f3b-43cf-bb89-3708197aaed9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:40.028723 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0f3ac23c-7f3b-43cf-bb89-3708197aaed9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:40.036937 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0f3ac23c-7f3b-43cf-bb89-3708197aaed9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1520 microversion: 2.1 time: 0.157976 Aug 24 12:32:40.037492 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 181/369] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:39 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:41.057494 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-aea41b25-63c3-4448-81a6-18f12c6b2f01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:41.058609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-aea41b25-63c3-4448-81a6-18f12c6b2f01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:41.064872 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aea41b25-63c3-4448-81a6-18f12c6b2f01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:41.065391 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aea41b25-63c3-4448-81a6-18f12c6b2f01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:41.065827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aea41b25-63c3-4448-81a6-18f12c6b2f01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:41.066537 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aea41b25-63c3-4448-81a6-18f12c6b2f01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:41.066998 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aea41b25-63c3-4448-81a6-18f12c6b2f01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:41.067437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aea41b25-63c3-4448-81a6-18f12c6b2f01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:41.196423 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-aea41b25-63c3-4448-81a6-18f12c6b2f01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:41.204206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-aea41b25-63c3-4448-81a6-18f12c6b2f01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1520 microversion: 2.1 time: 0.150709 Aug 24 12:32:41.204760 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 189/370] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:41 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:42.225133 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-55e82e2b-d40c-4540-b51d-11672a174e24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:42.225772 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-55e82e2b-d40c-4540-b51d-11672a174e24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:42.232144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55e82e2b-d40c-4540-b51d-11672a174e24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:42.232628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55e82e2b-d40c-4540-b51d-11672a174e24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:42.233066 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55e82e2b-d40c-4540-b51d-11672a174e24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:42.233751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55e82e2b-d40c-4540-b51d-11672a174e24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:42.234210 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55e82e2b-d40c-4540-b51d-11672a174e24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:42.234639 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55e82e2b-d40c-4540-b51d-11672a174e24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:42.374719 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-55e82e2b-d40c-4540-b51d-11672a174e24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:42.380433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-55e82e2b-d40c-4540-b51d-11672a174e24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1520 microversion: 2.1 time: 0.159075 Aug 24 12:32:42.381003 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 182/371] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:42 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:43.405379 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5f70976a-f541-4768-8ed4-c70e3350ca04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:43.405379 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5f70976a-f541-4768-8ed4-c70e3350ca04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:43.409794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5f70976a-f541-4768-8ed4-c70e3350ca04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:43.410277 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5f70976a-f541-4768-8ed4-c70e3350ca04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:43.410733 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5f70976a-f541-4768-8ed4-c70e3350ca04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:43.411461 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5f70976a-f541-4768-8ed4-c70e3350ca04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:43.411965 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5f70976a-f541-4768-8ed4-c70e3350ca04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:43.412386 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5f70976a-f541-4768-8ed4-c70e3350ca04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:43.549762 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5f70976a-f541-4768-8ed4-c70e3350ca04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:43.557968 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5f70976a-f541-4768-8ed4-c70e3350ca04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1520 microversion: 2.1 time: 0.159030 Aug 24 12:32:43.558542 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 190/372] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:43 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:44.580138 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-322707bc-c80a-448b-a0d6-dddd1d792dbd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:44.581337 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-322707bc-c80a-448b-a0d6-dddd1d792dbd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:44.588562 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-322707bc-c80a-448b-a0d6-dddd1d792dbd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:44.589044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-322707bc-c80a-448b-a0d6-dddd1d792dbd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:44.589669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-322707bc-c80a-448b-a0d6-dddd1d792dbd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:44.590564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-322707bc-c80a-448b-a0d6-dddd1d792dbd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:44.591100 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-322707bc-c80a-448b-a0d6-dddd1d792dbd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:44.591531 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-322707bc-c80a-448b-a0d6-dddd1d792dbd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:44.722041 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-322707bc-c80a-448b-a0d6-dddd1d792dbd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:44.729514 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-322707bc-c80a-448b-a0d6-dddd1d792dbd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1520 microversion: 2.1 time: 0.153427 Aug 24 12:32:44.730066 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 183/373] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:44 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:45.750849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0296c233-6c9f-433a-ae9f-7e36dd586c84 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:45.751464 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0296c233-6c9f-433a-ae9f-7e36dd586c84 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:45.757425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0296c233-6c9f-433a-ae9f-7e36dd586c84 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:45.757914 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0296c233-6c9f-433a-ae9f-7e36dd586c84 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:45.758353 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0296c233-6c9f-433a-ae9f-7e36dd586c84 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:45.759071 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0296c233-6c9f-433a-ae9f-7e36dd586c84 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:45.759530 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0296c233-6c9f-433a-ae9f-7e36dd586c84 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:45.759960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0296c233-6c9f-433a-ae9f-7e36dd586c84 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:45.890815 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0296c233-6c9f-433a-ae9f-7e36dd586c84 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:45.898453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0296c233-6c9f-433a-ae9f-7e36dd586c84 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1520 microversion: 2.1 time: 0.151449 Aug 24 12:32:45.899027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 191/374] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:45 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:46.919753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0520e080-5f2b-46f0-8b2f-6f7e95c308a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:46.920349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0520e080-5f2b-46f0-8b2f-6f7e95c308a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:46.927180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0520e080-5f2b-46f0-8b2f-6f7e95c308a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:46.927571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0520e080-5f2b-46f0-8b2f-6f7e95c308a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:46.928009 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0520e080-5f2b-46f0-8b2f-6f7e95c308a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:46.928686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0520e080-5f2b-46f0-8b2f-6f7e95c308a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:46.929141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0520e080-5f2b-46f0-8b2f-6f7e95c308a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:46.929588 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0520e080-5f2b-46f0-8b2f-6f7e95c308a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:47.064007 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0520e080-5f2b-46f0-8b2f-6f7e95c308a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:47.072000 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0520e080-5f2b-46f0-8b2f-6f7e95c308a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1520 microversion: 2.1 time: 0.156638 Aug 24 12:32:47.076834 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 184/375] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:46 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:48.096746 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-40edad30-3159-4815-a21c-ae0f9408b441 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:48.097432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-40edad30-3159-4815-a21c-ae0f9408b441 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:48.105232 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-40edad30-3159-4815-a21c-ae0f9408b441 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:48.105735 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-40edad30-3159-4815-a21c-ae0f9408b441 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:48.106175 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-40edad30-3159-4815-a21c-ae0f9408b441 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:48.107395 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-40edad30-3159-4815-a21c-ae0f9408b441 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:48.107842 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-40edad30-3159-4815-a21c-ae0f9408b441 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:48.108264 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-40edad30-3159-4815-a21c-ae0f9408b441 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:48.235601 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-40edad30-3159-4815-a21c-ae0f9408b441 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:48.243704 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-40edad30-3159-4815-a21c-ae0f9408b441 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1520 microversion: 2.1 time: 0.152351 Aug 24 12:32:48.244262 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 192/376] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:48 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:49.265104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-60940b4b-5bdf-49de-be02-ce4c902bb607 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:49.265718 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-60940b4b-5bdf-49de-be02-ce4c902bb607 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:49.272085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-60940b4b-5bdf-49de-be02-ce4c902bb607 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:49.272585 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-60940b4b-5bdf-49de-be02-ce4c902bb607 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:49.273021 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-60940b4b-5bdf-49de-be02-ce4c902bb607 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:49.273708 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-60940b4b-5bdf-49de-be02-ce4c902bb607 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:49.274169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-60940b4b-5bdf-49de-be02-ce4c902bb607 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:49.274589 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-60940b4b-5bdf-49de-be02-ce4c902bb607 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:49.402968 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-60940b4b-5bdf-49de-be02-ce4c902bb607 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:49.411231 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-60940b4b-5bdf-49de-be02-ce4c902bb607 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1520 microversion: 2.1 time: 0.150049 Aug 24 12:32:49.412285 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 185/377] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:49 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:50.432348 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-61b2f5f6-ac57-4beb-98d5-81fad01a1ac8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:50.432958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-61b2f5f6-ac57-4beb-98d5-81fad01a1ac8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:50.439080 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61b2f5f6-ac57-4beb-98d5-81fad01a1ac8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:50.439562 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61b2f5f6-ac57-4beb-98d5-81fad01a1ac8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:50.440000 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61b2f5f6-ac57-4beb-98d5-81fad01a1ac8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:50.440691 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61b2f5f6-ac57-4beb-98d5-81fad01a1ac8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:50.441155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61b2f5f6-ac57-4beb-98d5-81fad01a1ac8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:50.441583 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61b2f5f6-ac57-4beb-98d5-81fad01a1ac8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:50.573003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-61b2f5f6-ac57-4beb-98d5-81fad01a1ac8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:50.581968 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-61b2f5f6-ac57-4beb-98d5-81fad01a1ac8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1520 microversion: 2.1 time: 0.153490 Aug 24 12:32:50.594948 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 193/378] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:50 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:51.602958 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1b2c7658-0413-4e35-b564-7d17a57b20ba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:51.603568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1b2c7658-0413-4e35-b564-7d17a57b20ba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:51.609979 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b2c7658-0413-4e35-b564-7d17a57b20ba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:51.610404 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b2c7658-0413-4e35-b564-7d17a57b20ba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:51.610899 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b2c7658-0413-4e35-b564-7d17a57b20ba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:51.611579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b2c7658-0413-4e35-b564-7d17a57b20ba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:51.612035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b2c7658-0413-4e35-b564-7d17a57b20ba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:51.612457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b2c7658-0413-4e35-b564-7d17a57b20ba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:51.748454 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1b2c7658-0413-4e35-b564-7d17a57b20ba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:51.756272 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1b2c7658-0413-4e35-b564-7d17a57b20ba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1520 microversion: 2.1 time: 0.157201 Aug 24 12:32:51.756828 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 186/379] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:51 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:52.777836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7478584d-8151-4f64-bd8d-dbee3569a018 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:52.778454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7478584d-8151-4f64-bd8d-dbee3569a018 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:52.784341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7478584d-8151-4f64-bd8d-dbee3569a018 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:52.784816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7478584d-8151-4f64-bd8d-dbee3569a018 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:52.785246 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7478584d-8151-4f64-bd8d-dbee3569a018 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:52.786037 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7478584d-8151-4f64-bd8d-dbee3569a018 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:52.786541 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7478584d-8151-4f64-bd8d-dbee3569a018 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:52.787015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7478584d-8151-4f64-bd8d-dbee3569a018 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:52.922868 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7478584d-8151-4f64-bd8d-dbee3569a018 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:52.930727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7478584d-8151-4f64-bd8d-dbee3569a018 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1520 microversion: 2.1 time: 0.156987 Aug 24 12:32:52.931419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 194/380] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:52 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:53.951874 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8584e6ad-028a-40a5-a7d1-c484154137d6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:53.952506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8584e6ad-028a-40a5-a7d1-c484154137d6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:53.959321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8584e6ad-028a-40a5-a7d1-c484154137d6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:53.959817 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8584e6ad-028a-40a5-a7d1-c484154137d6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:53.960309 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8584e6ad-028a-40a5-a7d1-c484154137d6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:53.961008 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8584e6ad-028a-40a5-a7d1-c484154137d6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:53.961464 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8584e6ad-028a-40a5-a7d1-c484154137d6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:53.961889 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8584e6ad-028a-40a5-a7d1-c484154137d6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:53.967138 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:32:54.089745 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8584e6ad-028a-40a5-a7d1-c484154137d6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:54.098199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8584e6ad-028a-40a5-a7d1-c484154137d6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1520 microversion: 2.1 time: 0.150226 Aug 24 12:32:54.099005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 187/381] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:53 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:55.118551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9f8681b9-a678-44e8-af35-748f66a5c473 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:55.119995 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9f8681b9-a678-44e8-af35-748f66a5c473 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:55.127284 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f8681b9-a678-44e8-af35-748f66a5c473 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:55.127887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f8681b9-a678-44e8-af35-748f66a5c473 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:55.128324 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f8681b9-a678-44e8-af35-748f66a5c473 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:55.129018 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f8681b9-a678-44e8-af35-748f66a5c473 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:55.129465 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f8681b9-a678-44e8-af35-748f66a5c473 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:55.130133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f8681b9-a678-44e8-af35-748f66a5c473 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:55.267594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9f8681b9-a678-44e8-af35-748f66a5c473 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:55.279545 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9f8681b9-a678-44e8-af35-748f66a5c473 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1520 microversion: 2.1 time: 0.163776 Aug 24 12:32:55.280237 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 195/382] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:55 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:56.301873 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fbb8e85b-66ae-4024-86a9-02231a61211c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:56.302522 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fbb8e85b-66ae-4024-86a9-02231a61211c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:56.310029 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fbb8e85b-66ae-4024-86a9-02231a61211c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:56.310516 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fbb8e85b-66ae-4024-86a9-02231a61211c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:56.310982 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fbb8e85b-66ae-4024-86a9-02231a61211c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:56.311666 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fbb8e85b-66ae-4024-86a9-02231a61211c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:56.312116 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fbb8e85b-66ae-4024-86a9-02231a61211c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:56.312535 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fbb8e85b-66ae-4024-86a9-02231a61211c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:56.455274 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fbb8e85b-66ae-4024-86a9-02231a61211c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:56.462974 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fbb8e85b-66ae-4024-86a9-02231a61211c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1520 microversion: 2.1 time: 0.165485 Aug 24 12:32:56.463532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 188/383] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:56 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:57.485011 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2ad87f1d-78ab-4192-bd22-47857f3d1d1e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:57.486366 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2ad87f1d-78ab-4192-bd22-47857f3d1d1e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:57.493535 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=27 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:32:57.496105 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ad87f1d-78ab-4192-bd22-47857f3d1d1e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:57.496680 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ad87f1d-78ab-4192-bd22-47857f3d1d1e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:57.497114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ad87f1d-78ab-4192-bd22-47857f3d1d1e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:57.498073 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ad87f1d-78ab-4192-bd22-47857f3d1d1e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:57.498797 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ad87f1d-78ab-4192-bd22-47857f3d1d1e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:57.499222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ad87f1d-78ab-4192-bd22-47857f3d1d1e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:57.504672 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=79 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:32:57.657820 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2ad87f1d-78ab-4192-bd22-47857f3d1d1e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:57.665937 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2ad87f1d-78ab-4192-bd22-47857f3d1d1e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1520 microversion: 2.1 time: 0.185933 Aug 24 12:32:57.668648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 196/384] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:57 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:58.692109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-aebe2298-157b-41f6-969c-73b35e08c51f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:58.692633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-aebe2298-157b-41f6-969c-73b35e08c51f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:58.699647 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aebe2298-157b-41f6-969c-73b35e08c51f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:58.700533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aebe2298-157b-41f6-969c-73b35e08c51f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:58.701195 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aebe2298-157b-41f6-969c-73b35e08c51f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:58.702122 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aebe2298-157b-41f6-969c-73b35e08c51f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:58.702871 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aebe2298-157b-41f6-969c-73b35e08c51f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:58.703519 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aebe2298-157b-41f6-969c-73b35e08c51f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:58.888903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-aebe2298-157b-41f6-969c-73b35e08c51f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:58.899578 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-aebe2298-157b-41f6-969c-73b35e08c51f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1520 microversion: 2.1 time: 0.211639 Aug 24 12:32:58.899931 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 189/385] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:58 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:59.921771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-76bd3f54-a8f3-47a3-a9b6-5d49c1981b35 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:59.922979 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-76bd3f54-a8f3-47a3-a9b6-5d49c1981b35 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:59.932229 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76bd3f54-a8f3-47a3-a9b6-5d49c1981b35 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:59.936382 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76bd3f54-a8f3-47a3-a9b6-5d49c1981b35 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:59.937222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76bd3f54-a8f3-47a3-a9b6-5d49c1981b35 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:59.938518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76bd3f54-a8f3-47a3-a9b6-5d49c1981b35 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:59.940634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76bd3f54-a8f3-47a3-a9b6-5d49c1981b35 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:59.943054 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76bd3f54-a8f3-47a3-a9b6-5d49c1981b35 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:00.152055 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-76bd3f54-a8f3-47a3-a9b6-5d49c1981b35 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:00.161091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-76bd3f54-a8f3-47a3-a9b6-5d49c1981b35 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1500 microversion: 2.1 time: 0.244178 Aug 24 12:33:00.161731 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 197/386] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:59 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1500 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:00.182139 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-59dc82b5-c04e-4bea-9021-67fbdfc8e9bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa6fde61-49be-4bd7-9e62-2d86e603138b"}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:00.188312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-59dc82b5-c04e-4bea-9021-67fbdfc8e9bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:00.195007 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=26 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:00.196606 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59dc82b5-c04e-4bea-9021-67fbdfc8e9bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:00.197316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59dc82b5-c04e-4bea-9021-67fbdfc8e9bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:00.200627 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59dc82b5-c04e-4bea-9021-67fbdfc8e9bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:00.203559 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59dc82b5-c04e-4bea-9021-67fbdfc8e9bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:00.205019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59dc82b5-c04e-4bea-9021-67fbdfc8e9bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:00.205563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59dc82b5-c04e-4bea-9021-67fbdfc8e9bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:00.270732 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.wsgi [None req-59dc82b5-c04e-4bea-9021-67fbdfc8e9bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] HTTP exception thrown: Cannot 'attach_volume' instance e7228012-d37e-4a5c-bc05-791ad60259e3 while it is in vm_state rescued Aug 24 12:33:00.272921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-59dc82b5-c04e-4bea-9021-67fbdfc8e9bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Request method failure captured: Aug 24 12:33:00.272921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: request: POST /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3/os-volume_attachments HTTP/1.1 Aug 24 12:33:00.272921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept: application/json Aug 24 12:33:00.272921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept-Encoding: identity Aug 24 12:33:00.272921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Connection: close Aug 24 12:33:00.272921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Length: 74 Aug 24 12:33:00.272921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Type: application/json Aug 24 12:33:00.272921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Host: 10.222.0.45 Aug 24 12:33:00.272921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Openstack-System-Scope: None Aug 24 12:33:00.272921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: User-Agent: python-urllib3/1.26.11 Aug 24 12:33:00.272921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Auth-Token: gAAAAABjBhnPiCoZSEe7wmjTe8U9xlUJz4a5Mp48qYy-cXBN9SdubzuznlpWDZlq64yvw-1br5IS5M11o055Otgjl3rpsAMlh8QWB47vk-vMvC9oSLyFSNPSBKLMaQ10tN_kbVVupvSgWrx6NZcM-VEx1q4Wa9x9_sEvmqQpKFDCK4_ukrJvtn4 Aug 24 12:33:00.272921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Id: None Aug 24 12:33:00.272921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Name: None Aug 24 12:33:00.272921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Identity-Status: Confirmed Aug 24 12:33:00.272921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Is-Admin-Project: True Aug 24 12:33:00.272921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Id: default Aug 24 12:33:00.272921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Name: Default Aug 24 12:33:00.272921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Id: 99f0beb902e4472eae20f0e6c8dc3340 Aug 24 12:33:00.272921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1902039323 Aug 24 12:33:00.272921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Role: member,reader Aug 24 12:33:00.272921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Roles: member,reader Aug 24 12:33:00.274359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_99f0beb902e4472eae20f0e6c8dc3340"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99f0beb902e4472eae20f0e6c8dc3340"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/99f0beb902e4472eae20f0e6c8dc3340"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99f0beb902e4472eae20f0e6c8dc3340"}]}] Aug 24 12:33:00.274359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1902039323 Aug 24 12:33:00.274359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Id: 99f0beb902e4472eae20f0e6c8dc3340 Aug 24 12:33:00.274359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1902039323 Aug 24 12:33:00.274359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User: tempest-ServerRescueNegativeTestJSON-1902039323-project Aug 24 12:33:00.274359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Id: default Aug 24 12:33:00.274359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Name: Default Aug 24 12:33:00.274359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Id: b9252893998a490689497697663ca4d2 Aug 24 12:33:00.274359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1902039323-project Aug 24 12:33:00.274359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Aug 24 12:33:00.274359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {"volumeAttachment": {"volumeId": "aa6fde61-49be-4bd7-9e62-2d86e603138b"}} Aug 24 12:33:00.274359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: method: > Aug 24 12:33:00.275109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: exception: Cannot 'attach_volume' instance e7228012-d37e-4a5c-bc05-791ad60259e3 while it is in vm_state rescued Aug 24 12:33:00.275109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: action_args: {'server_id': 'e7228012-d37e-4a5c-bc05-791ad60259e3', 'body': {'volumeAttachment': {'volumeId': 'aa6fde61-49be-4bd7-9e62-2d86e603138b'}}} Aug 24 12:33:00.275109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:33:00.275109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:33:00.275109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 12:33:00.275109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 12:33:00.275109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 12:33:00.275109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 12:33:00.275109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 12:33:00.275109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 12:33:00.275109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e7228012-d37e-4a5c-bc05-791ad60259e3 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 12:33:00.275109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:33:00.275109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:33:00.275109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:33:00.275109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:33:00.275109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:33:00.275109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:33:00.275109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:33:00.275109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:33:00.276211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:33:00.276211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:33:00.276211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 12:33:00.276211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 12:33:00.276211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 12:33:00.276211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 12:33:00.276211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 12:33:00.276211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 12:33:00.276211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 12:33:00.276211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 12:33:00.276211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 12:33:00.276211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 12:33:00.276211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e7228012-d37e-4a5c-bc05-791ad60259e3 while it is in vm_state rescued Aug 24 12:33:00.276211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:33:00.276211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:33:00.276211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:33:00.276211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:33:00.276211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:33:00.276211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:33:00.277283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:33:00.277283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:33:00.277283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e7228012-d37e-4a5c-bc05-791ad60259e3 while it is in vm_state rescued Aug 24 12:33:00.277283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:33:00.280600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-59dc82b5-c04e-4bea-9021-67fbdfc8e9bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Returning 409 to user: Cannot 'attach_volume' instance e7228012-d37e-4a5c-bc05-791ad60259e3 while it is in vm_state rescued {{(pid=121170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:33:00.283408 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-59dc82b5-c04e-4bea-9021-67fbdfc8e9bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "POST /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.105268 Aug 24 12:33:00.287273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 190/387] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 24 12:33:00 2022] POST /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3/os-volume_attachments => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 12:33:00.294108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1c08336d-2931-494f-b2f3-4e821e38f023 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:00.294713 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1c08336d-2931-494f-b2f3-4e821e38f023 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:00.300899 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c08336d-2931-494f-b2f3-4e821e38f023 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:00.301816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c08336d-2931-494f-b2f3-4e821e38f023 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:00.302435 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c08336d-2931-494f-b2f3-4e821e38f023 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:00.303346 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c08336d-2931-494f-b2f3-4e821e38f023 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:00.303972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c08336d-2931-494f-b2f3-4e821e38f023 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:00.304400 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c08336d-2931-494f-b2f3-4e821e38f023 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:00.589870 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1c08336d-2931-494f-b2f3-4e821e38f023 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "POST /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3/action" status: 202 len: 0 microversion: 2.1 time: 0.299245 Aug 24 12:33:00.594457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 198/388] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 12:33:00 2022] POST /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:33:00.599919 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a751d77b-0929-4538-81b9-5e6d867365fa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:00.600659 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a751d77b-0929-4538-81b9-5e6d867365fa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:00.621458 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a751d77b-0929-4538-81b9-5e6d867365fa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:00.622009 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a751d77b-0929-4538-81b9-5e6d867365fa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:00.622523 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a751d77b-0929-4538-81b9-5e6d867365fa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:00.638280 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a751d77b-0929-4538-81b9-5e6d867365fa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:00.639455 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a751d77b-0929-4538-81b9-5e6d867365fa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:00.639455 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a751d77b-0929-4538-81b9-5e6d867365fa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:01.019447 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a751d77b-0929-4538-81b9-5e6d867365fa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:01.033227 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a751d77b-0929-4538-81b9-5e6d867365fa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1508 microversion: 2.1 time: 0.437303 Aug 24 12:33:01.036572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 191/389] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:00 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1508 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:02.059713 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ab0faf55-d095-40d3-8810-703aab1d034f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:02.060489 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ab0faf55-d095-40d3-8810-703aab1d034f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:02.077585 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab0faf55-d095-40d3-8810-703aab1d034f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:02.080829 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab0faf55-d095-40d3-8810-703aab1d034f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:02.083382 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab0faf55-d095-40d3-8810-703aab1d034f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:02.087623 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab0faf55-d095-40d3-8810-703aab1d034f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:02.088201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab0faf55-d095-40d3-8810-703aab1d034f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:02.088784 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab0faf55-d095-40d3-8810-703aab1d034f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:02.352980 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ab0faf55-d095-40d3-8810-703aab1d034f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:02.377887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ab0faf55-d095-40d3-8810-703aab1d034f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1508 microversion: 2.1 time: 0.324238 Aug 24 12:33:02.379596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 199/390] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:02 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1508 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:03.401278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3fe0ea86-d497-43d7-86e9-abd97ee5da72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:03.402078 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3fe0ea86-d497-43d7-86e9-abd97ee5da72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:03.409297 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3fe0ea86-d497-43d7-86e9-abd97ee5da72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:03.409998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3fe0ea86-d497-43d7-86e9-abd97ee5da72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:03.410437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3fe0ea86-d497-43d7-86e9-abd97ee5da72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:03.411359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3fe0ea86-d497-43d7-86e9-abd97ee5da72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:03.411815 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3fe0ea86-d497-43d7-86e9-abd97ee5da72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:03.418868 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3fe0ea86-d497-43d7-86e9-abd97ee5da72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:03.669449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3fe0ea86-d497-43d7-86e9-abd97ee5da72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:03.679345 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3fe0ea86-d497-43d7-86e9-abd97ee5da72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1508 microversion: 2.1 time: 0.281776 Aug 24 12:33:03.693635 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 192/391] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:03 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1508 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:04.702297 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2b293e2e-651a-4d14-b8e7-69bab493ba48 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:04.702930 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2b293e2e-651a-4d14-b8e7-69bab493ba48 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:04.709499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b293e2e-651a-4d14-b8e7-69bab493ba48 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:04.710038 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b293e2e-651a-4d14-b8e7-69bab493ba48 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:04.710748 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b293e2e-651a-4d14-b8e7-69bab493ba48 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:04.711970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b293e2e-651a-4d14-b8e7-69bab493ba48 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:04.712582 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b293e2e-651a-4d14-b8e7-69bab493ba48 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:04.713169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b293e2e-651a-4d14-b8e7-69bab493ba48 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:04.944190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2b293e2e-651a-4d14-b8e7-69bab493ba48 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:04.964812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2b293e2e-651a-4d14-b8e7-69bab493ba48 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1508 microversion: 2.1 time: 0.267630 Aug 24 12:33:04.971149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 200/392] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:04 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1508 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:05.995831 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bd3a91ba-12a1-468a-83fd-e50b11693523 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:05.997715 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bd3a91ba-12a1-468a-83fd-e50b11693523 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:06.016018 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd3a91ba-12a1-468a-83fd-e50b11693523 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:06.016498 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd3a91ba-12a1-468a-83fd-e50b11693523 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:06.017092 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd3a91ba-12a1-468a-83fd-e50b11693523 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:06.021114 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd3a91ba-12a1-468a-83fd-e50b11693523 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:06.021607 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd3a91ba-12a1-468a-83fd-e50b11693523 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:06.022089 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd3a91ba-12a1-468a-83fd-e50b11693523 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:06.343526 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bd3a91ba-12a1-468a-83fd-e50b11693523 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:06.351252 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bd3a91ba-12a1-468a-83fd-e50b11693523 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1508 microversion: 2.1 time: 0.365748 Aug 24 12:33:06.351810 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 193/393] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:05 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1508 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:07.374452 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9bada5d8-fdf7-4da4-bc20-b57b2c069f62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:07.375215 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9bada5d8-fdf7-4da4-bc20-b57b2c069f62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:07.381932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bada5d8-fdf7-4da4-bc20-b57b2c069f62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:07.382587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bada5d8-fdf7-4da4-bc20-b57b2c069f62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:07.383169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bada5d8-fdf7-4da4-bc20-b57b2c069f62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:07.384285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bada5d8-fdf7-4da4-bc20-b57b2c069f62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:07.385199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bada5d8-fdf7-4da4-bc20-b57b2c069f62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:07.385748 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bada5d8-fdf7-4da4-bc20-b57b2c069f62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:07.781970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9bada5d8-fdf7-4da4-bc20-b57b2c069f62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:07.789925 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9bada5d8-fdf7-4da4-bc20-b57b2c069f62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1508 microversion: 2.1 time: 0.420824 Aug 24 12:33:07.790478 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 201/394] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:07 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1508 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:08.813565 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c918862c-660e-4f9e-aabb-ba1fe60cfef6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:08.815121 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c918862c-660e-4f9e-aabb-ba1fe60cfef6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:08.823859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c918862c-660e-4f9e-aabb-ba1fe60cfef6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:08.823859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c918862c-660e-4f9e-aabb-ba1fe60cfef6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:08.823859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c918862c-660e-4f9e-aabb-ba1fe60cfef6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:08.824477 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c918862c-660e-4f9e-aabb-ba1fe60cfef6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:08.831827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c918862c-660e-4f9e-aabb-ba1fe60cfef6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:08.833020 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c918862c-660e-4f9e-aabb-ba1fe60cfef6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:08.987053 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c918862c-660e-4f9e-aabb-ba1fe60cfef6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:08.995090 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c918862c-660e-4f9e-aabb-ba1fe60cfef6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1508 microversion: 2.1 time: 0.187721 Aug 24 12:33:08.995649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 194/395] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:08 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1508 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:10.016754 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e16c2892-06fa-4e3b-85ce-d3e5a89ca501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:10.018050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e16c2892-06fa-4e3b-85ce-d3e5a89ca501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:10.024495 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e16c2892-06fa-4e3b-85ce-d3e5a89ca501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:10.024983 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e16c2892-06fa-4e3b-85ce-d3e5a89ca501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:10.025420 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e16c2892-06fa-4e3b-85ce-d3e5a89ca501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:10.026128 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e16c2892-06fa-4e3b-85ce-d3e5a89ca501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:10.026611 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e16c2892-06fa-4e3b-85ce-d3e5a89ca501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:10.027071 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e16c2892-06fa-4e3b-85ce-d3e5a89ca501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:10.177447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e16c2892-06fa-4e3b-85ce-d3e5a89ca501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:10.188559 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e16c2892-06fa-4e3b-85ce-d3e5a89ca501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1514 microversion: 2.1 time: 0.175576 Aug 24 12:33:10.189293 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 202/396] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:10 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:19.118198 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f0ba5a66-5ec5-4abf-a1f0-2bc1b17f50c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Action: 'create', calling method: .version_select at 0x7f76f5e201f0>, body: {"keypair": {"name": "tempest-keypair-1797036082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNECgyTwFbieLXD5hQRsBSXEnWnmmtD1lNQtoUK3xgjWgabmgD2AtzOZv57mYgUphUh2bCNX22xZc3RzOeNHdbnVMoQcRYFySASEABBXztzWqVAwRqlj6WjfmiKvJX37JA=="}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:19.125382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=9 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:19.126482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=45 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:19.151511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-f0ba5a66-5ec5-4abf-a1f0-2bc1b17f50c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Getting quotas for project 99f0beb902e4472eae20f0e6c8dc3340. Resources: {'key_pairs'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:33:19.156970 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-f0ba5a66-5ec5-4abf-a1f0-2bc1b17f50c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Getting quotas for user b9252893998a490689497697663ca4d2 and project 99f0beb902e4472eae20f0e6c8dc3340. Resources: {'key_pairs'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:33:19.287023 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f0ba5a66-5ec5-4abf-a1f0-2bc1b17f50c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.173561 Aug 24 12:33:19.293932 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 195/397] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 24 12:33:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:33:21.939464 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4cba0abd-80f3-49e1-96f5-190649a0efa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Action: 'create', calling method: .version_select at 0x7f76f5670820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1936027620", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzFQPbqN+OrDQt6lv9zxh4NnMHpxWYeThgFKedQz3mfD+IIHOpsnbEcT+ocVHHfSMLbdHeIUXJd3QLxbXVTRJuMHx8qHQ37cQb0RbSEmvP8GGHaU2JDnGddz9+D4E6m1Q=="}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:21.945417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=13 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:21.946079 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:21.957212 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-4cba0abd-80f3-49e1-96f5-190649a0efa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Getting quotas for project d3d75e4de32444e2813b11b29553d47a. Resources: {'key_pairs'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:33:21.961018 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-4cba0abd-80f3-49e1-96f5-190649a0efa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Getting quotas for user 1eb6acf487864a41ba1628e9093b8773 and project d3d75e4de32444e2813b11b29553d47a. Resources: {'key_pairs'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:33:21.973445 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4cba0abd-80f3-49e1-96f5-190649a0efa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [60aa5a0c-538c-4b57-bf3f-9d9ef20dcdda] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 12:33:22.476068 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-84f3c549-42dc-4a2a-a310-deaab0ce2e29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1380357239", "imageRef": "62fcb2c8-bff4-46cf-9892-c43d7626629e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "65256e65-b152-4d73-9a03-c89cc38558d4"}], "security_groups": [{"name": "tempest-securitygroup--410327583"}], "key_name": "tempest-keypair-1797036082", "user_data": "}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:22.579451 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.network.neutron [None req-84f3c549-42dc-4a2a-a310-deaab0ce2e29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] validate_networks() for [('65256e65-b152-4d73-9a03-c89cc38558d4', None, None, None, None, None)] {{(pid=121170) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:33:22.954111 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-84f3c549-42dc-4a2a-a310-deaab0ce2e29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Flavor limits 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:33:22.954535 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-84f3c549-42dc-4a2a-a310-deaab0ce2e29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Image limits 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:33:22.955071 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-84f3c549-42dc-4a2a-a310-deaab0ce2e29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Flavor pref 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:33:22.955508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-84f3c549-42dc-4a2a-a310-deaab0ce2e29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Image pref 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:33:22.955922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-84f3c549-42dc-4a2a-a310-deaab0ce2e29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:33:22.964550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-84f3c549-42dc-4a2a-a310-deaab0ce2e29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:22.965033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-84f3c549-42dc-4a2a-a310-deaab0ce2e29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:22.965977 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-84f3c549-42dc-4a2a-a310-deaab0ce2e29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:22.966734 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-84f3c549-42dc-4a2a-a310-deaab0ce2e29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:22.967195 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-84f3c549-42dc-4a2a-a310-deaab0ce2e29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:22.967622 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-84f3c549-42dc-4a2a-a310-deaab0ce2e29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:22.980337 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [None req-4cba0abd-80f3-49e1-96f5-190649a0efa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [60aa5a0c-538c-4b57-bf3f-9d9ef20dcdda] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 60104. Aug 24 12:33:22.984886 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-84f3c549-42dc-4a2a-a310-deaab0ce2e29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Getting quotas for project 99f0beb902e4472eae20f0e6c8dc3340. Resources: {'instances', 'cores', 'ram'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:33:22.988831 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-84f3c549-42dc-4a2a-a310-deaab0ce2e29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Getting quotas for user b9252893998a490689497697663ca4d2 and project 99f0beb902e4472eae20f0e6c8dc3340. Resources: {'instances', 'cores', 'ram'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:33:23.000705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-84f3c549-42dc-4a2a-a310-deaab0ce2e29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Going to run 1 instances... {{(pid=121170) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:33:23.003024 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-84f3c549-42dc-4a2a-a310-deaab0ce2e29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='62fcb2c8-bff4-46cf-9892-c43d7626629e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:33:23.094780 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4cba0abd-80f3-49e1-96f5-190649a0efa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.159133 Aug 24 12:33:23.095368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 203/398] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 24 12:33:21 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:23.144687 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9f7c1270-34b5-4a7d-88a0-973bd7047c4b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-840645781", "imageRef": "540a272d-43a8-4658-8f1d-bc54910ab849", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1936027620", "networks": [{"uuid": "bcbb94c8-ad20-4fb1-b5cc-72e8f9d2727c"}]}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:23.151144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR oslo.messaging._drivers.impl_rabbit [None req-84f3c549-42dc-4a2a-a310-deaab0ce2e29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [d9b54b6e-3edf-432c-84f6-c5eee932d3b4] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 12:33:23.196506 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.network.neutron [None req-9f7c1270-34b5-4a7d-88a0-973bd7047c4b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] validate_networks() for [('bcbb94c8-ad20-4fb1-b5cc-72e8f9d2727c', None, None, None, None, None)] {{(pid=121171) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:33:23.578498 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-9f7c1270-34b5-4a7d-88a0-973bd7047c4b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Flavor limits 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:33:23.578944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-9f7c1270-34b5-4a7d-88a0-973bd7047c4b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Image limits 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:33:23.581793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-9f7c1270-34b5-4a7d-88a0-973bd7047c4b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Flavor pref 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:33:23.581793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-9f7c1270-34b5-4a7d-88a0-973bd7047c4b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Image pref 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:33:23.581793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-9f7c1270-34b5-4a7d-88a0-973bd7047c4b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:33:23.589488 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f7c1270-34b5-4a7d-88a0-973bd7047c4b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:23.590873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f7c1270-34b5-4a7d-88a0-973bd7047c4b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:23.591337 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f7c1270-34b5-4a7d-88a0-973bd7047c4b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:23.592561 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f7c1270-34b5-4a7d-88a0-973bd7047c4b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:23.593140 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f7c1270-34b5-4a7d-88a0-973bd7047c4b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:23.593612 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f7c1270-34b5-4a7d-88a0-973bd7047c4b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:23.610642 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-9f7c1270-34b5-4a7d-88a0-973bd7047c4b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Getting quotas for project d3d75e4de32444e2813b11b29553d47a. Resources: {'instances', 'cores', 'ram'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:33:23.614914 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-9f7c1270-34b5-4a7d-88a0-973bd7047c4b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Getting quotas for user 1eb6acf487864a41ba1628e9093b8773 and project d3d75e4de32444e2813b11b29553d47a. Resources: {'instances', 'cores', 'ram'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:33:23.625767 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9f7c1270-34b5-4a7d-88a0-973bd7047c4b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Going to run 1 instances... {{(pid=121171) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:33:23.628771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9f7c1270-34b5-4a7d-88a0-973bd7047c4b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='540a272d-43a8-4658-8f1d-bc54910ab849',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:33:23.790333 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9f7c1270-34b5-4a7d-88a0-973bd7047c4b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [234238be-16be-4d72-ae14-da565c4fbbf4] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 12:33:24.157739 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [None req-84f3c549-42dc-4a2a-a310-deaab0ce2e29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [d9b54b6e-3edf-432c-84f6-c5eee932d3b4] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 60126. Aug 24 12:33:24.161470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-84f3c549-42dc-4a2a-a310-deaab0ce2e29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.690253 Aug 24 12:33:24.162152 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 196/399] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 12:33:22 2022] POST /compute/v2.1/servers => generated 408 bytes in 1692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 12:33:24.173113 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-cfb40856-88f0-458c-ac1c-b58203a6ec73 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:24.174116 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-cfb40856-88f0-458c-ac1c-b58203a6ec73 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:24.226384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-cfb40856-88f0-458c-ac1c-b58203a6ec73 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:24.237215 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-cfb40856-88f0-458c-ac1c-b58203a6ec73 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1246 microversion: 2.1 time: 0.064320 Aug 24 12:33:24.237215 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 197/400] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:24 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1246 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:24.798005 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [None req-9f7c1270-34b5-4a7d-88a0-973bd7047c4b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [234238be-16be-4d72-ae14-da565c4fbbf4] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 60146. Aug 24 12:33:24.801807 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9f7c1270-34b5-4a7d-88a0-973bd7047c4b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.661045 Aug 24 12:33:24.802453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 204/401] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 12:33:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 12:33:24.820439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bcc965a4-43f4-4418-834d-934b0aa71979 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:24.820439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bcc965a4-43f4-4418-834d-934b0aa71979 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:24.884620 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bcc965a4-43f4-4418-834d-934b0aa71979 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:24.890821 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bcc965a4-43f4-4418-834d-934b0aa71979 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1258 microversion: 2.1 time: 0.081294 Aug 24 12:33:24.891380 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 198/402] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:24 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1258 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:25.254410 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a574a359-c457-494c-b808-b505c9b4780a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:25.258035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a574a359-c457-494c-b808-b505c9b4780a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:25.312815 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a574a359-c457-494c-b808-b505c9b4780a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:25.319521 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a574a359-c457-494c-b808-b505c9b4780a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1246 microversion: 2.1 time: 0.069044 Aug 24 12:33:25.320074 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 205/403] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:25 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1246 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:25.918700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-95db1236-115a-4e9c-8230-d85796d2763e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:25.920834 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-95db1236-115a-4e9c-8230-d85796d2763e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:25.998382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-95db1236-115a-4e9c-8230-d85796d2763e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:26.006721 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-95db1236-115a-4e9c-8230-d85796d2763e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1258 microversion: 2.1 time: 0.098445 Aug 24 12:33:26.007359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 199/404] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:25 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1258 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:26.339623 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7b94e9b8-2708-4370-a0ae-3bfb7cbeb3fe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:26.340223 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7b94e9b8-2708-4370-a0ae-3bfb7cbeb3fe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:26.395263 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7b94e9b8-2708-4370-a0ae-3bfb7cbeb3fe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:26.403246 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7b94e9b8-2708-4370-a0ae-3bfb7cbeb3fe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1246 microversion: 2.1 time: 0.067526 Aug 24 12:33:26.404101 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 206/405] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:26 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1246 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:27.029164 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d1979967-3ca2-4492-9af7-8d7006c03bb1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:27.029671 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d1979967-3ca2-4492-9af7-8d7006c03bb1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:27.100360 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d1979967-3ca2-4492-9af7-8d7006c03bb1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:27.111874 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d1979967-3ca2-4492-9af7-8d7006c03bb1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1258 microversion: 2.1 time: 0.087893 Aug 24 12:33:27.112447 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 200/406] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:27 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1258 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:27.424479 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b2008a40-ad3f-404c-8f94-f7c30a7ec190 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:27.425116 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b2008a40-ad3f-404c-8f94-f7c30a7ec190 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:27.486632 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b2008a40-ad3f-404c-8f94-f7c30a7ec190 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:27.498483 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b2008a40-ad3f-404c-8f94-f7c30a7ec190 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1246 microversion: 2.1 time: 0.078176 Aug 24 12:33:27.499115 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 207/407] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:27 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1246 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:28.135739 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ca9d3c98-4332-4404-bade-fed4146d1f23 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:28.136415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ca9d3c98-4332-4404-bade-fed4146d1f23 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:28.193629 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ca9d3c98-4332-4404-bade-fed4146d1f23 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:28.200448 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ca9d3c98-4332-4404-bade-fed4146d1f23 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1258 microversion: 2.1 time: 0.071199 Aug 24 12:33:28.201001 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 201/408] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:28 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:28.519305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5d5409cf-2488-4775-b3e7-3a0c078d26ac tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:28.519915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5d5409cf-2488-4775-b3e7-3a0c078d26ac tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:28.526354 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d5409cf-2488-4775-b3e7-3a0c078d26ac tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:28.526998 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d5409cf-2488-4775-b3e7-3a0c078d26ac tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:28.527435 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d5409cf-2488-4775-b3e7-3a0c078d26ac tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:28.528129 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d5409cf-2488-4775-b3e7-3a0c078d26ac tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:28.528585 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d5409cf-2488-4775-b3e7-3a0c078d26ac tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:28.529010 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d5409cf-2488-4775-b3e7-3a0c078d26ac tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:28.593809 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5d5409cf-2488-4775-b3e7-3a0c078d26ac tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:28.601418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5d5409cf-2488-4775-b3e7-3a0c078d26ac tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1250 microversion: 2.1 time: 0.085997 Aug 24 12:33:28.601956 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 208/409] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:28 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1250 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:29.221868 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-aceca9d3-8a8d-4afd-a509-13e8d3afceb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:29.224608 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-aceca9d3-8a8d-4afd-a509-13e8d3afceb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:29.229882 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aceca9d3-8a8d-4afd-a509-13e8d3afceb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:29.230553 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aceca9d3-8a8d-4afd-a509-13e8d3afceb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:29.231107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aceca9d3-8a8d-4afd-a509-13e8d3afceb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:29.232369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aceca9d3-8a8d-4afd-a509-13e8d3afceb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:29.232820 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aceca9d3-8a8d-4afd-a509-13e8d3afceb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:29.233238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aceca9d3-8a8d-4afd-a509-13e8d3afceb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:29.310879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-aceca9d3-8a8d-4afd-a509-13e8d3afceb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:29.318670 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-aceca9d3-8a8d-4afd-a509-13e8d3afceb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1262 microversion: 2.1 time: 0.100729 Aug 24 12:33:29.319246 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 202/410] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:29 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1262 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:29.621930 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2f33dec2-5df5-4546-8399-c5c587c8c760 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:29.623191 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2f33dec2-5df5-4546-8399-c5c587c8c760 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:29.629116 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f33dec2-5df5-4546-8399-c5c587c8c760 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:29.629599 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f33dec2-5df5-4546-8399-c5c587c8c760 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:29.630037 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f33dec2-5df5-4546-8399-c5c587c8c760 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:29.630760 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f33dec2-5df5-4546-8399-c5c587c8c760 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:29.631206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f33dec2-5df5-4546-8399-c5c587c8c760 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:29.631637 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f33dec2-5df5-4546-8399-c5c587c8c760 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:29.693962 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2f33dec2-5df5-4546-8399-c5c587c8c760 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:29.701535 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2f33dec2-5df5-4546-8399-c5c587c8c760 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1250 microversion: 2.1 time: 0.083476 Aug 24 12:33:29.702098 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 209/411] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:29 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1250 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:30.339748 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-19d6b72e-64ad-4448-aadf-4994d6f6b659 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:30.340512 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-19d6b72e-64ad-4448-aadf-4994d6f6b659 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:30.347575 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-19d6b72e-64ad-4448-aadf-4994d6f6b659 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:30.348069 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-19d6b72e-64ad-4448-aadf-4994d6f6b659 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:30.348583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-19d6b72e-64ad-4448-aadf-4994d6f6b659 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:30.349283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-19d6b72e-64ad-4448-aadf-4994d6f6b659 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:30.349868 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-19d6b72e-64ad-4448-aadf-4994d6f6b659 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:30.350256 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-19d6b72e-64ad-4448-aadf-4994d6f6b659 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:30.426696 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-19d6b72e-64ad-4448-aadf-4994d6f6b659 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:30.435439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-19d6b72e-64ad-4448-aadf-4994d6f6b659 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1262 microversion: 2.1 time: 0.098913 Aug 24 12:33:30.436005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 203/412] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:30 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1262 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:30.721860 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a2c55e07-afb2-4cbe-b167-004b83869b9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:30.722465 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a2c55e07-afb2-4cbe-b167-004b83869b9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:30.728425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2c55e07-afb2-4cbe-b167-004b83869b9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:30.728905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2c55e07-afb2-4cbe-b167-004b83869b9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:30.729343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2c55e07-afb2-4cbe-b167-004b83869b9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:30.730135 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2c55e07-afb2-4cbe-b167-004b83869b9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:30.730620 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2c55e07-afb2-4cbe-b167-004b83869b9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:30.731073 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2c55e07-afb2-4cbe-b167-004b83869b9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:30.797843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a2c55e07-afb2-4cbe-b167-004b83869b9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:30.805564 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a2c55e07-afb2-4cbe-b167-004b83869b9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1298 microversion: 2.1 time: 0.087484 Aug 24 12:33:30.806126 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 210/413] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:30 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:31.455894 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a8a76047-0109-4585-aa6a-f60bd07f4fbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:31.456522 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a8a76047-0109-4585-aa6a-f60bd07f4fbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:31.463047 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a8a76047-0109-4585-aa6a-f60bd07f4fbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:31.463529 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a8a76047-0109-4585-aa6a-f60bd07f4fbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:31.463963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a8a76047-0109-4585-aa6a-f60bd07f4fbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:31.464645 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a8a76047-0109-4585-aa6a-f60bd07f4fbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:31.465097 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a8a76047-0109-4585-aa6a-f60bd07f4fbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:31.466288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a8a76047-0109-4585-aa6a-f60bd07f4fbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:31.535956 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a8a76047-0109-4585-aa6a-f60bd07f4fbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:31.545085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a8a76047-0109-4585-aa6a-f60bd07f4fbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1262 microversion: 2.1 time: 0.093013 Aug 24 12:33:31.545916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 204/414] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:31 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1262 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:31.825839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d5e8c4f3-72a0-4799-8c9e-8dae1d6d4337 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:31.826463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d5e8c4f3-72a0-4799-8c9e-8dae1d6d4337 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:31.832457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d5e8c4f3-72a0-4799-8c9e-8dae1d6d4337 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:31.832932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d5e8c4f3-72a0-4799-8c9e-8dae1d6d4337 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:31.833362 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d5e8c4f3-72a0-4799-8c9e-8dae1d6d4337 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:31.834036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d5e8c4f3-72a0-4799-8c9e-8dae1d6d4337 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:31.834483 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d5e8c4f3-72a0-4799-8c9e-8dae1d6d4337 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:31.834944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d5e8c4f3-72a0-4799-8c9e-8dae1d6d4337 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:31.899684 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d5e8c4f3-72a0-4799-8c9e-8dae1d6d4337 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:31.908503 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d5e8c4f3-72a0-4799-8c9e-8dae1d6d4337 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1298 microversion: 2.1 time: 0.087010 Aug 24 12:33:31.909074 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 211/415] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:31 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1298 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:32.565913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5d33da4f-cba2-4f8f-98b6-668e9b1854e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:32.566452 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5d33da4f-cba2-4f8f-98b6-668e9b1854e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:32.572795 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5d33da4f-cba2-4f8f-98b6-668e9b1854e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:32.573286 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5d33da4f-cba2-4f8f-98b6-668e9b1854e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:32.579663 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5d33da4f-cba2-4f8f-98b6-668e9b1854e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:32.579663 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5d33da4f-cba2-4f8f-98b6-668e9b1854e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:32.579663 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5d33da4f-cba2-4f8f-98b6-668e9b1854e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:32.579663 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5d33da4f-cba2-4f8f-98b6-668e9b1854e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:32.637143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5d33da4f-cba2-4f8f-98b6-668e9b1854e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:32.645227 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5d33da4f-cba2-4f8f-98b6-668e9b1854e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1262 microversion: 2.1 time: 0.083290 Aug 24 12:33:32.645850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 205/416] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:32 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:32.931798 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9d720665-ef90-4a3a-a40e-c2b095122df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:32.932486 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9d720665-ef90-4a3a-a40e-c2b095122df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:32.940201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9d720665-ef90-4a3a-a40e-c2b095122df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:32.940693 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9d720665-ef90-4a3a-a40e-c2b095122df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:32.946741 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9d720665-ef90-4a3a-a40e-c2b095122df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:32.946741 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9d720665-ef90-4a3a-a40e-c2b095122df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:32.946741 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9d720665-ef90-4a3a-a40e-c2b095122df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:32.946741 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9d720665-ef90-4a3a-a40e-c2b095122df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:33.007056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9d720665-ef90-4a3a-a40e-c2b095122df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:33.014672 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9d720665-ef90-4a3a-a40e-c2b095122df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1298 microversion: 2.1 time: 0.086789 Aug 24 12:33:33.015225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 212/417] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:32 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1298 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:33.665269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9a29e17d-03cc-44e4-ad56-93994e6be199 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:33.665805 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9a29e17d-03cc-44e4-ad56-93994e6be199 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:33.667629 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell0:SELECT=2 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:33.672796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a29e17d-03cc-44e4-ad56-93994e6be199 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:33.673291 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a29e17d-03cc-44e4-ad56-93994e6be199 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:33.673723 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a29e17d-03cc-44e4-ad56-93994e6be199 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:33.674416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a29e17d-03cc-44e4-ad56-93994e6be199 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:33.674911 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a29e17d-03cc-44e4-ad56-93994e6be199 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:33.675338 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a29e17d-03cc-44e4-ad56-93994e6be199 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:33.740393 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9a29e17d-03cc-44e4-ad56-93994e6be199 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:33.748723 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9a29e17d-03cc-44e4-ad56-93994e6be199 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1262 microversion: 2.1 time: 0.086795 Aug 24 12:33:33.749285 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 206/418] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:33 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:34.035969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cf88f860-7549-45cc-b8bf-186e08cffe1f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:34.036609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cf88f860-7549-45cc-b8bf-186e08cffe1f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:34.038642 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=2 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:34.043865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf88f860-7549-45cc-b8bf-186e08cffe1f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:34.044576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf88f860-7549-45cc-b8bf-186e08cffe1f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:34.045713 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf88f860-7549-45cc-b8bf-186e08cffe1f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:34.046593 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf88f860-7549-45cc-b8bf-186e08cffe1f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:34.047277 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf88f860-7549-45cc-b8bf-186e08cffe1f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:34.047909 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf88f860-7549-45cc-b8bf-186e08cffe1f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:34.169208 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cf88f860-7549-45cc-b8bf-186e08cffe1f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:34.178173 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cf88f860-7549-45cc-b8bf-186e08cffe1f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1306 microversion: 2.1 time: 0.146145 Aug 24 12:33:34.190927 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 213/419] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:34 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1306 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:34.771954 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-165f2fe7-b414-4393-87a5-519cd77f7e0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:34.772871 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-165f2fe7-b414-4393-87a5-519cd77f7e0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:34.779586 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-165f2fe7-b414-4393-87a5-519cd77f7e0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:34.780319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-165f2fe7-b414-4393-87a5-519cd77f7e0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:34.780762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-165f2fe7-b414-4393-87a5-519cd77f7e0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:34.781945 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-165f2fe7-b414-4393-87a5-519cd77f7e0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:34.782414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-165f2fe7-b414-4393-87a5-519cd77f7e0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:34.782874 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-165f2fe7-b414-4393-87a5-519cd77f7e0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:34.846459 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-165f2fe7-b414-4393-87a5-519cd77f7e0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:34.854157 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-165f2fe7-b414-4393-87a5-519cd77f7e0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1310 microversion: 2.1 time: 0.088663 Aug 24 12:33:34.854823 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 207/420] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:34 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1310 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:35.198785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9409c1e2-2c07-4086-83a6-c42ea6f3a655 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:35.199388 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9409c1e2-2c07-4086-83a6-c42ea6f3a655 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:35.209434 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9409c1e2-2c07-4086-83a6-c42ea6f3a655 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:35.209434 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9409c1e2-2c07-4086-83a6-c42ea6f3a655 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:35.209881 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9409c1e2-2c07-4086-83a6-c42ea6f3a655 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:35.210714 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9409c1e2-2c07-4086-83a6-c42ea6f3a655 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:35.211169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9409c1e2-2c07-4086-83a6-c42ea6f3a655 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:35.212050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9409c1e2-2c07-4086-83a6-c42ea6f3a655 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:35.510001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9409c1e2-2c07-4086-83a6-c42ea6f3a655 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:35.525836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9409c1e2-2c07-4086-83a6-c42ea6f3a655 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1371 microversion: 2.1 time: 0.325647 Aug 24 12:33:35.525836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 214/421] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:35 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1371 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:35.878021 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f0704716-e77b-417b-903a-79ae5d500f6d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:35.881307 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f0704716-e77b-417b-903a-79ae5d500f6d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:35.886708 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f0704716-e77b-417b-903a-79ae5d500f6d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:35.887527 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f0704716-e77b-417b-903a-79ae5d500f6d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:35.888390 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f0704716-e77b-417b-903a-79ae5d500f6d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:35.893174 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f0704716-e77b-417b-903a-79ae5d500f6d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:35.893874 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f0704716-e77b-417b-903a-79ae5d500f6d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:35.894515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f0704716-e77b-417b-903a-79ae5d500f6d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:36.002395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f0704716-e77b-417b-903a-79ae5d500f6d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:36.012673 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f0704716-e77b-417b-903a-79ae5d500f6d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1316 microversion: 2.1 time: 0.139872 Aug 24 12:33:36.015394 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 208/422] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:35 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1316 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:36.544283 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8ca3b5b8-c1be-4f83-bd61-a46bdffb609b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:36.545082 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8ca3b5b8-c1be-4f83-bd61-a46bdffb609b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:36.557073 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ca3b5b8-c1be-4f83-bd61-a46bdffb609b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:36.557613 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ca3b5b8-c1be-4f83-bd61-a46bdffb609b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:36.558103 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ca3b5b8-c1be-4f83-bd61-a46bdffb609b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:36.564742 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ca3b5b8-c1be-4f83-bd61-a46bdffb609b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:36.565718 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ca3b5b8-c1be-4f83-bd61-a46bdffb609b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:36.566420 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ca3b5b8-c1be-4f83-bd61-a46bdffb609b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:36.727417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-a6d412db-3cfb-456b-a83c-7f36593b6b28 req-c59c98ec-aec5-40b8-b447-30c50dd4e265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50cb23a1-9864-46ef-ae19-411f522e9f10", "tag": "4fe23f91-93ad-4bd1-9b29-2d302a44a9c9"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:36.746224 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-a6d412db-3cfb-456b-a83c-7f36593b6b28 req-c59c98ec-aec5-40b8-b447-30c50dd4e265 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:36.746224 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-a6d412db-3cfb-456b-a83c-7f36593b6b28 req-c59c98ec-aec5-40b8-b447-30c50dd4e265 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:36.751289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-a6d412db-3cfb-456b-a83c-7f36593b6b28 req-c59c98ec-aec5-40b8-b447-30c50dd4e265 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:36.780419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-a6d412db-3cfb-456b-a83c-7f36593b6b28 req-c59c98ec-aec5-40b8-b447-30c50dd4e265 service nova] Creating event network-changed:4fe23f91-93ad-4bd1-9b29-2d302a44a9c9 for instance 50cb23a1-9864-46ef-ae19-411f522e9f10 on hv-cinder-84889 Aug 24 12:33:36.780419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-a6d412db-3cfb-456b-a83c-7f36593b6b28 req-c59c98ec-aec5-40b8-b447-30c50dd4e265 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053142 Aug 24 12:33:36.780419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 209/423] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:33:37.012965 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8ca3b5b8-c1be-4f83-bd61-a46bdffb609b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:37.025996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8ca3b5b8-c1be-4f83-bd61-a46bdffb609b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1371 microversion: 2.1 time: 0.484114 Aug 24 12:33:37.026956 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 215/424] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:36 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1371 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:37.049041 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d50f7aa9-063f-4206-88fb-b66d4dbb8a4d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:37.049576 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d50f7aa9-063f-4206-88fb-b66d4dbb8a4d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:37.061869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d50f7aa9-063f-4206-88fb-b66d4dbb8a4d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:37.064227 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d50f7aa9-063f-4206-88fb-b66d4dbb8a4d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:37.064831 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d50f7aa9-063f-4206-88fb-b66d4dbb8a4d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:37.066432 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d50f7aa9-063f-4206-88fb-b66d4dbb8a4d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:37.067104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d50f7aa9-063f-4206-88fb-b66d4dbb8a4d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:37.067858 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d50f7aa9-063f-4206-88fb-b66d4dbb8a4d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:37.344086 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d50f7aa9-063f-4206-88fb-b66d4dbb8a4d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:37.353929 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d50f7aa9-063f-4206-88fb-b66d4dbb8a4d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.312196 Aug 24 12:33:37.368187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 210/425] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:37 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:38.048876 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5119d94c-e8af-426c-af2f-76f33d859ed8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:38.049865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5119d94c-e8af-426c-af2f-76f33d859ed8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:38.055616 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=16 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:38.057220 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5119d94c-e8af-426c-af2f-76f33d859ed8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:38.058014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5119d94c-e8af-426c-af2f-76f33d859ed8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:38.058450 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5119d94c-e8af-426c-af2f-76f33d859ed8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:38.059789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5119d94c-e8af-426c-af2f-76f33d859ed8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:38.061387 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5119d94c-e8af-426c-af2f-76f33d859ed8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:38.061986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5119d94c-e8af-426c-af2f-76f33d859ed8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:38.215821 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5119d94c-e8af-426c-af2f-76f33d859ed8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:38.232582 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5119d94c-e8af-426c-af2f-76f33d859ed8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1371 microversion: 2.1 time: 0.189026 Aug 24 12:33:38.241858 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 216/426] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:38 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:38.375850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-314e85ca-a96c-4520-a2f6-9547775c446f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:38.376476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-314e85ca-a96c-4520-a2f6-9547775c446f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:38.382862 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell0:SELECT=20 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:38.383914 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-314e85ca-a96c-4520-a2f6-9547775c446f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:38.384606 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-314e85ca-a96c-4520-a2f6-9547775c446f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:38.385222 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-314e85ca-a96c-4520-a2f6-9547775c446f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:38.386077 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-314e85ca-a96c-4520-a2f6-9547775c446f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:38.386717 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-314e85ca-a96c-4520-a2f6-9547775c446f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:38.387136 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-314e85ca-a96c-4520-a2f6-9547775c446f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:38.542778 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-314e85ca-a96c-4520-a2f6-9547775c446f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:38.558165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-314e85ca-a96c-4520-a2f6-9547775c446f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.186365 Aug 24 12:33:38.559926 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 211/427] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:38 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:39.254747 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4982a5a8-1021-4f0f-ba9d-aa6c7533a2b3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:39.255365 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4982a5a8-1021-4f0f-ba9d-aa6c7533a2b3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:39.284602 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4982a5a8-1021-4f0f-ba9d-aa6c7533a2b3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:39.285108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4982a5a8-1021-4f0f-ba9d-aa6c7533a2b3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:39.285579 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4982a5a8-1021-4f0f-ba9d-aa6c7533a2b3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:39.286314 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4982a5a8-1021-4f0f-ba9d-aa6c7533a2b3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:39.286771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4982a5a8-1021-4f0f-ba9d-aa6c7533a2b3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:39.287204 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4982a5a8-1021-4f0f-ba9d-aa6c7533a2b3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:39.499595 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4982a5a8-1021-4f0f-ba9d-aa6c7533a2b3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:39.507538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4982a5a8-1021-4f0f-ba9d-aa6c7533a2b3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1371 microversion: 2.1 time: 0.256977 Aug 24 12:33:39.508114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 217/428] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:39 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1371 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:39.584305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-73d06e7f-4b2f-4a9a-8a3c-550dc7aa976e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:39.585308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-73d06e7f-4b2f-4a9a-8a3c-550dc7aa976e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:39.593302 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-73d06e7f-4b2f-4a9a-8a3c-550dc7aa976e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:39.593790 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-73d06e7f-4b2f-4a9a-8a3c-550dc7aa976e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:39.594230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-73d06e7f-4b2f-4a9a-8a3c-550dc7aa976e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:39.594953 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-73d06e7f-4b2f-4a9a-8a3c-550dc7aa976e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:39.595414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-73d06e7f-4b2f-4a9a-8a3c-550dc7aa976e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:39.595839 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-73d06e7f-4b2f-4a9a-8a3c-550dc7aa976e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:39.735594 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-73d06e7f-4b2f-4a9a-8a3c-550dc7aa976e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:39.746378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-73d06e7f-4b2f-4a9a-8a3c-550dc7aa976e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.169684 Aug 24 12:33:39.746996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 212/429] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:39 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:40.527775 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-162932f2-ad34-4ffd-bf30-3c20e8490d9d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:40.529831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-162932f2-ad34-4ffd-bf30-3c20e8490d9d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:40.535847 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-162932f2-ad34-4ffd-bf30-3c20e8490d9d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:40.536808 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-162932f2-ad34-4ffd-bf30-3c20e8490d9d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:40.537477 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-162932f2-ad34-4ffd-bf30-3c20e8490d9d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:40.538412 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-162932f2-ad34-4ffd-bf30-3c20e8490d9d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:40.539133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-162932f2-ad34-4ffd-bf30-3c20e8490d9d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:40.539619 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-162932f2-ad34-4ffd-bf30-3c20e8490d9d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:40.694087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-162932f2-ad34-4ffd-bf30-3c20e8490d9d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:40.702338 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-162932f2-ad34-4ffd-bf30-3c20e8490d9d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1371 microversion: 2.1 time: 0.178438 Aug 24 12:33:40.714992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 218/430] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:40 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:40.767189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-45064301-068c-4475-b510-fc1311aab73d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:40.768597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-45064301-068c-4475-b510-fc1311aab73d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:40.775260 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45064301-068c-4475-b510-fc1311aab73d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:40.775972 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45064301-068c-4475-b510-fc1311aab73d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:40.776406 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45064301-068c-4475-b510-fc1311aab73d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:40.777097 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45064301-068c-4475-b510-fc1311aab73d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:40.777548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45064301-068c-4475-b510-fc1311aab73d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:40.777967 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45064301-068c-4475-b510-fc1311aab73d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:41.034832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-45064301-068c-4475-b510-fc1311aab73d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:41.042764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-45064301-068c-4475-b510-fc1311aab73d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.279355 Aug 24 12:33:41.043707 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 213/431] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:40 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:41.724160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7110b382-c18b-44da-acee-6e049dbdb83c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:41.724774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7110b382-c18b-44da-acee-6e049dbdb83c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:41.731432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7110b382-c18b-44da-acee-6e049dbdb83c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:41.732852 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7110b382-c18b-44da-acee-6e049dbdb83c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:41.733546 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7110b382-c18b-44da-acee-6e049dbdb83c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:41.734487 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7110b382-c18b-44da-acee-6e049dbdb83c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:41.735194 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7110b382-c18b-44da-acee-6e049dbdb83c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:41.735843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7110b382-c18b-44da-acee-6e049dbdb83c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:41.908177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7110b382-c18b-44da-acee-6e049dbdb83c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:41.917438 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7110b382-c18b-44da-acee-6e049dbdb83c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1371 microversion: 2.1 time: 0.197462 Aug 24 12:33:41.918453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 219/432] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:41 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:42.065398 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-21ee71fb-08ee-4687-8adf-da1bfe25c9c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:42.066474 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-21ee71fb-08ee-4687-8adf-da1bfe25c9c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:42.073908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-21ee71fb-08ee-4687-8adf-da1bfe25c9c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:42.075139 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-21ee71fb-08ee-4687-8adf-da1bfe25c9c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:42.081038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-21ee71fb-08ee-4687-8adf-da1bfe25c9c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:42.081038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-21ee71fb-08ee-4687-8adf-da1bfe25c9c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:42.081038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-21ee71fb-08ee-4687-8adf-da1bfe25c9c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:42.081038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-21ee71fb-08ee-4687-8adf-da1bfe25c9c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:42.218493 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-21ee71fb-08ee-4687-8adf-da1bfe25c9c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:42.229320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-21ee71fb-08ee-4687-8adf-da1bfe25c9c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.168273 Aug 24 12:33:42.234705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 214/433] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:42 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:42.942237 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9c518c5b-e50b-4ec1-8b16-a8c9c6231d40 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:42.943699 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9c518c5b-e50b-4ec1-8b16-a8c9c6231d40 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:42.953554 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9c518c5b-e50b-4ec1-8b16-a8c9c6231d40 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:42.954297 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9c518c5b-e50b-4ec1-8b16-a8c9c6231d40 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:42.954993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9c518c5b-e50b-4ec1-8b16-a8c9c6231d40 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:42.955882 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9c518c5b-e50b-4ec1-8b16-a8c9c6231d40 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:42.956498 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9c518c5b-e50b-4ec1-8b16-a8c9c6231d40 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:42.957085 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9c518c5b-e50b-4ec1-8b16-a8c9c6231d40 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:43.192907 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9c518c5b-e50b-4ec1-8b16-a8c9c6231d40 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:43.201662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9c518c5b-e50b-4ec1-8b16-a8c9c6231d40 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1371 microversion: 2.1 time: 0.265160 Aug 24 12:33:43.205305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 220/434] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:42 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1371 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:43.251547 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-570ca285-49bc-4bba-8f18-d33d53147e7a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:43.252157 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-570ca285-49bc-4bba-8f18-d33d53147e7a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:43.261548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-570ca285-49bc-4bba-8f18-d33d53147e7a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:43.267025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-570ca285-49bc-4bba-8f18-d33d53147e7a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:43.267025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-570ca285-49bc-4bba-8f18-d33d53147e7a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:43.267025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-570ca285-49bc-4bba-8f18-d33d53147e7a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:43.267025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-570ca285-49bc-4bba-8f18-d33d53147e7a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:43.267428 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-570ca285-49bc-4bba-8f18-d33d53147e7a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:43.486922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-570ca285-49bc-4bba-8f18-d33d53147e7a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:43.499391 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-570ca285-49bc-4bba-8f18-d33d53147e7a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.252010 Aug 24 12:33:43.500291 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 215/435] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:43 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:44.227308 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-81660c8c-90a7-4397-bb6f-2904321b278b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:44.228633 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-81660c8c-90a7-4397-bb6f-2904321b278b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:44.236802 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81660c8c-90a7-4397-bb6f-2904321b278b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:44.237470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81660c8c-90a7-4397-bb6f-2904321b278b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:44.237978 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81660c8c-90a7-4397-bb6f-2904321b278b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:44.239000 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81660c8c-90a7-4397-bb6f-2904321b278b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:44.239913 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81660c8c-90a7-4397-bb6f-2904321b278b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:44.240533 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81660c8c-90a7-4397-bb6f-2904321b278b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:44.437685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-81660c8c-90a7-4397-bb6f-2904321b278b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:44.446817 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-81660c8c-90a7-4397-bb6f-2904321b278b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1371 microversion: 2.1 time: 0.223302 Aug 24 12:33:44.447746 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 221/436] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:44 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:44.520770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2a6777f0-935f-43e0-b4cd-1f4df0598edd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:44.521539 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2a6777f0-935f-43e0-b4cd-1f4df0598edd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:44.527581 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a6777f0-935f-43e0-b4cd-1f4df0598edd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:44.528092 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a6777f0-935f-43e0-b4cd-1f4df0598edd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:44.528527 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a6777f0-935f-43e0-b4cd-1f4df0598edd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:44.529378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a6777f0-935f-43e0-b4cd-1f4df0598edd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:44.529705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a6777f0-935f-43e0-b4cd-1f4df0598edd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:44.530129 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a6777f0-935f-43e0-b4cd-1f4df0598edd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:44.703781 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2a6777f0-935f-43e0-b4cd-1f4df0598edd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:44.718140 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2a6777f0-935f-43e0-b4cd-1f4df0598edd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.201288 Aug 24 12:33:44.720167 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 216/437] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:44 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:45.469599 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f9ad875e-c31a-4c6d-a040-ca0f30822989 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:45.470205 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f9ad875e-c31a-4c6d-a040-ca0f30822989 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:45.476830 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f9ad875e-c31a-4c6d-a040-ca0f30822989 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:45.477512 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f9ad875e-c31a-4c6d-a040-ca0f30822989 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:45.478115 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f9ad875e-c31a-4c6d-a040-ca0f30822989 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:45.478842 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f9ad875e-c31a-4c6d-a040-ca0f30822989 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:45.479299 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f9ad875e-c31a-4c6d-a040-ca0f30822989 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:45.479717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f9ad875e-c31a-4c6d-a040-ca0f30822989 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:45.647454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f9ad875e-c31a-4c6d-a040-ca0f30822989 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:45.660272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f9ad875e-c31a-4c6d-a040-ca0f30822989 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1371 microversion: 2.1 time: 0.193873 Aug 24 12:33:45.661048 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 222/438] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:45 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:45.738675 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1ec0bfa0-bca6-4b25-ba1e-d512a9b0016e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:45.739686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1ec0bfa0-bca6-4b25-ba1e-d512a9b0016e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:45.747144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1ec0bfa0-bca6-4b25-ba1e-d512a9b0016e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:45.748486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1ec0bfa0-bca6-4b25-ba1e-d512a9b0016e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:45.749106 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1ec0bfa0-bca6-4b25-ba1e-d512a9b0016e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:45.750371 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1ec0bfa0-bca6-4b25-ba1e-d512a9b0016e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:45.751022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1ec0bfa0-bca6-4b25-ba1e-d512a9b0016e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:45.751619 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1ec0bfa0-bca6-4b25-ba1e-d512a9b0016e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:45.900457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1ec0bfa0-bca6-4b25-ba1e-d512a9b0016e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:45.908976 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1ec0bfa0-bca6-4b25-ba1e-d512a9b0016e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.174685 Aug 24 12:33:45.909624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 217/439] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:45 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:46.682298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f1ed2735-c64b-406a-a098-4a6c92cb3958 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:46.683548 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f1ed2735-c64b-406a-a098-4a6c92cb3958 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:46.690948 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f1ed2735-c64b-406a-a098-4a6c92cb3958 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:46.691623 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f1ed2735-c64b-406a-a098-4a6c92cb3958 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:46.692005 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f1ed2735-c64b-406a-a098-4a6c92cb3958 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:46.692729 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f1ed2735-c64b-406a-a098-4a6c92cb3958 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:46.693177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f1ed2735-c64b-406a-a098-4a6c92cb3958 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:46.693596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f1ed2735-c64b-406a-a098-4a6c92cb3958 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:46.840108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f1ed2735-c64b-406a-a098-4a6c92cb3958 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:46.848265 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f1ed2735-c64b-406a-a098-4a6c92cb3958 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1371 microversion: 2.1 time: 0.170635 Aug 24 12:33:46.849525 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 223/440] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:46 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:46.932044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-67a13933-32e8-46d7-8ad7-7100ce15dbf0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:46.932911 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-67a13933-32e8-46d7-8ad7-7100ce15dbf0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:46.939860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67a13933-32e8-46d7-8ad7-7100ce15dbf0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:46.940350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67a13933-32e8-46d7-8ad7-7100ce15dbf0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:46.940792 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67a13933-32e8-46d7-8ad7-7100ce15dbf0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:46.941491 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67a13933-32e8-46d7-8ad7-7100ce15dbf0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:46.941973 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67a13933-32e8-46d7-8ad7-7100ce15dbf0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:46.942408 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67a13933-32e8-46d7-8ad7-7100ce15dbf0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:47.075510 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-67a13933-32e8-46d7-8ad7-7100ce15dbf0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:47.078859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:47.083269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-67a13933-32e8-46d7-8ad7-7100ce15dbf0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.155221 Aug 24 12:33:47.083825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 218/441] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:46 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:47.869357 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-50bdecc2-84b2-44c2-b716-ffd1cb9d1009 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:47.869967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-50bdecc2-84b2-44c2-b716-ffd1cb9d1009 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:47.875852 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-50bdecc2-84b2-44c2-b716-ffd1cb9d1009 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:47.876332 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-50bdecc2-84b2-44c2-b716-ffd1cb9d1009 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:47.876767 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-50bdecc2-84b2-44c2-b716-ffd1cb9d1009 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:47.877450 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-50bdecc2-84b2-44c2-b716-ffd1cb9d1009 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:47.877905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-50bdecc2-84b2-44c2-b716-ffd1cb9d1009 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:47.878332 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-50bdecc2-84b2-44c2-b716-ffd1cb9d1009 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:47.882250 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:48.003537 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-50bdecc2-84b2-44c2-b716-ffd1cb9d1009 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:48.011004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-50bdecc2-84b2-44c2-b716-ffd1cb9d1009 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1371 microversion: 2.1 time: 0.145395 Aug 24 12:33:48.011555 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 224/442] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:47 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:48.109498 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-cc9b5200-4021-4336-93d3-808fa2728556 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:48.110096 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-cc9b5200-4021-4336-93d3-808fa2728556 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:48.116785 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cc9b5200-4021-4336-93d3-808fa2728556 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:48.117261 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cc9b5200-4021-4336-93d3-808fa2728556 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:48.117693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cc9b5200-4021-4336-93d3-808fa2728556 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:48.118363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cc9b5200-4021-4336-93d3-808fa2728556 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:48.118853 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cc9b5200-4021-4336-93d3-808fa2728556 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:48.119277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cc9b5200-4021-4336-93d3-808fa2728556 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:48.245606 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-cc9b5200-4021-4336-93d3-808fa2728556 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:48.253365 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-cc9b5200-4021-4336-93d3-808fa2728556 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.148001 Aug 24 12:33:48.253922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 219/443] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:48 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:49.031605 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c2a5d644-6e7b-4a3d-80b7-84a34c73a650 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:49.032267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c2a5d644-6e7b-4a3d-80b7-84a34c73a650 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:49.038204 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2a5d644-6e7b-4a3d-80b7-84a34c73a650 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:49.038706 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2a5d644-6e7b-4a3d-80b7-84a34c73a650 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:49.039142 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2a5d644-6e7b-4a3d-80b7-84a34c73a650 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:49.039852 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2a5d644-6e7b-4a3d-80b7-84a34c73a650 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:49.040328 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2a5d644-6e7b-4a3d-80b7-84a34c73a650 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:49.040733 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2a5d644-6e7b-4a3d-80b7-84a34c73a650 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:49.173959 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c2a5d644-6e7b-4a3d-80b7-84a34c73a650 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:49.181646 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c2a5d644-6e7b-4a3d-80b7-84a34c73a650 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1371 microversion: 2.1 time: 0.154036 Aug 24 12:33:49.182208 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 225/444] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:49 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:49.274778 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d47ea00f-1a31-4f83-be40-7b5edef24c98 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:49.276145 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d47ea00f-1a31-4f83-be40-7b5edef24c98 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:49.280156 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:49.283729 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d47ea00f-1a31-4f83-be40-7b5edef24c98 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:49.284342 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d47ea00f-1a31-4f83-be40-7b5edef24c98 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:49.284846 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d47ea00f-1a31-4f83-be40-7b5edef24c98 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:49.285759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d47ea00f-1a31-4f83-be40-7b5edef24c98 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:49.286286 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d47ea00f-1a31-4f83-be40-7b5edef24c98 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:49.286816 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d47ea00f-1a31-4f83-be40-7b5edef24c98 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:49.431342 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d47ea00f-1a31-4f83-be40-7b5edef24c98 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:49.439084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d47ea00f-1a31-4f83-be40-7b5edef24c98 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.168085 Aug 24 12:33:49.439640 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 220/445] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:49 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:50.202904 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7e74809c-fc64-4e36-94ba-c013ee7f4567 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:50.203508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7e74809c-fc64-4e36-94ba-c013ee7f4567 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:50.209391 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7e74809c-fc64-4e36-94ba-c013ee7f4567 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:50.210966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7e74809c-fc64-4e36-94ba-c013ee7f4567 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:50.210966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7e74809c-fc64-4e36-94ba-c013ee7f4567 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:50.210966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7e74809c-fc64-4e36-94ba-c013ee7f4567 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:50.211564 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7e74809c-fc64-4e36-94ba-c013ee7f4567 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:50.211984 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7e74809c-fc64-4e36-94ba-c013ee7f4567 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:50.343026 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7e74809c-fc64-4e36-94ba-c013ee7f4567 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:50.350394 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7e74809c-fc64-4e36-94ba-c013ee7f4567 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1371 microversion: 2.1 time: 0.151947 Aug 24 12:33:50.350968 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 226/446] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:50 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:50.461541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d1bee93d-2288-45b3-bc15-975e6f3e8aa3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:50.462080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d1bee93d-2288-45b3-bc15-975e6f3e8aa3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:50.468527 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1bee93d-2288-45b3-bc15-975e6f3e8aa3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:50.469005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1bee93d-2288-45b3-bc15-975e6f3e8aa3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:50.469437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1bee93d-2288-45b3-bc15-975e6f3e8aa3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:50.470119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1bee93d-2288-45b3-bc15-975e6f3e8aa3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:50.472746 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1bee93d-2288-45b3-bc15-975e6f3e8aa3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:50.472746 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1bee93d-2288-45b3-bc15-975e6f3e8aa3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:50.596903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d1bee93d-2288-45b3-bc15-975e6f3e8aa3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:50.604950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d1bee93d-2288-45b3-bc15-975e6f3e8aa3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.147462 Aug 24 12:33:50.605928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 221/447] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:50 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:51.370469 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4bc4c981-d052-4ce5-a8f3-147215380976 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:51.371098 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4bc4c981-d052-4ce5-a8f3-147215380976 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:51.376949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4bc4c981-d052-4ce5-a8f3-147215380976 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:51.377424 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4bc4c981-d052-4ce5-a8f3-147215380976 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:51.385542 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4bc4c981-d052-4ce5-a8f3-147215380976 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:51.385542 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4bc4c981-d052-4ce5-a8f3-147215380976 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:51.385542 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4bc4c981-d052-4ce5-a8f3-147215380976 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:51.385542 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4bc4c981-d052-4ce5-a8f3-147215380976 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:51.509663 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4bc4c981-d052-4ce5-a8f3-147215380976 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:51.517908 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4bc4c981-d052-4ce5-a8f3-147215380976 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1371 microversion: 2.1 time: 0.151183 Aug 24 12:33:51.518468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 227/448] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:51 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:51.627475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a47e8f1b-cda2-415e-9385-07f1cec04c0f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:51.628082 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a47e8f1b-cda2-415e-9385-07f1cec04c0f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:51.634381 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a47e8f1b-cda2-415e-9385-07f1cec04c0f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:51.634944 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a47e8f1b-cda2-415e-9385-07f1cec04c0f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:51.635374 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a47e8f1b-cda2-415e-9385-07f1cec04c0f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:51.636054 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a47e8f1b-cda2-415e-9385-07f1cec04c0f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:51.636505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a47e8f1b-cda2-415e-9385-07f1cec04c0f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:51.636923 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a47e8f1b-cda2-415e-9385-07f1cec04c0f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:51.770819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a47e8f1b-cda2-415e-9385-07f1cec04c0f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:51.778550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a47e8f1b-cda2-415e-9385-07f1cec04c0f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.155558 Aug 24 12:33:51.784613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 222/449] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:51 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:52.537403 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cc88cc29-2f90-44f6-a796-cd4421f29e81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:52.538066 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cc88cc29-2f90-44f6-a796-cd4421f29e81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:52.539960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:52.544828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc88cc29-2f90-44f6-a796-cd4421f29e81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:52.545315 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc88cc29-2f90-44f6-a796-cd4421f29e81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:52.549668 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc88cc29-2f90-44f6-a796-cd4421f29e81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:52.549668 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc88cc29-2f90-44f6-a796-cd4421f29e81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:52.549668 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc88cc29-2f90-44f6-a796-cd4421f29e81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:52.549668 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc88cc29-2f90-44f6-a796-cd4421f29e81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:52.769570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cc88cc29-2f90-44f6-a796-cd4421f29e81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:52.780376 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cc88cc29-2f90-44f6-a796-cd4421f29e81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1371 microversion: 2.1 time: 0.245596 Aug 24 12:33:52.780965 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 228/450] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:52 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:52.799586 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-88db0972-498b-4f03-a64f-94eee28215cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:52.800197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-88db0972-498b-4f03-a64f-94eee28215cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:52.806477 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-88db0972-498b-4f03-a64f-94eee28215cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:52.807221 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-88db0972-498b-4f03-a64f-94eee28215cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:52.807739 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-88db0972-498b-4f03-a64f-94eee28215cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:52.808376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-88db0972-498b-4f03-a64f-94eee28215cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:52.808836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-88db0972-498b-4f03-a64f-94eee28215cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:52.809272 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-88db0972-498b-4f03-a64f-94eee28215cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:52.940278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-88db0972-498b-4f03-a64f-94eee28215cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:52.948010 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-88db0972-498b-4f03-a64f-94eee28215cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.152462 Aug 24 12:33:52.948573 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 223/451] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:52 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:53.358483 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-0f9e53c6-7421-4b61-bde9-a5e5212ffbe3 req-e71dfbd2-a532-4784-bd2f-c77f4441c856 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ce2c0c-40e5-45d1-b2a6-ad30617badb4", "tag": "4f48e5e7-3a0c-4f05-abe0-02ba501d8cfd"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:53.370305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-0f9e53c6-7421-4b61-bde9-a5e5212ffbe3 req-e71dfbd2-a532-4784-bd2f-c77f4441c856 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:53.370894 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-0f9e53c6-7421-4b61-bde9-a5e5212ffbe3 req-e71dfbd2-a532-4784-bd2f-c77f4441c856 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:53.371586 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-0f9e53c6-7421-4b61-bde9-a5e5212ffbe3 req-e71dfbd2-a532-4784-bd2f-c77f4441c856 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:53.384660 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-0f9e53c6-7421-4b61-bde9-a5e5212ffbe3 req-e71dfbd2-a532-4784-bd2f-c77f4441c856 service nova] Creating event network-changed:4f48e5e7-3a0c-4f05-abe0-02ba501d8cfd for instance 29ce2c0c-40e5-45d1-b2a6-ad30617badb4 on hv-cinder-84889 Aug 24 12:33:53.390306 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-0f9e53c6-7421-4b61-bde9-a5e5212ffbe3 req-e71dfbd2-a532-4784-bd2f-c77f4441c856 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036216 Aug 24 12:33:53.390933 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 229/452] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:53.813175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-678aff44-a69c-4a86-8a47-2cbae243b796 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:53.813803 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-678aff44-a69c-4a86-8a47-2cbae243b796 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:53.820580 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-678aff44-a69c-4a86-8a47-2cbae243b796 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:53.821076 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-678aff44-a69c-4a86-8a47-2cbae243b796 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:53.821554 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-678aff44-a69c-4a86-8a47-2cbae243b796 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:53.822412 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-678aff44-a69c-4a86-8a47-2cbae243b796 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:53.822911 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-678aff44-a69c-4a86-8a47-2cbae243b796 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:53.823635 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-678aff44-a69c-4a86-8a47-2cbae243b796 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:53.969617 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6e3f24cf-c7a0-48bc-af53-c055f573b23e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:53.970347 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6e3f24cf-c7a0-48bc-af53-c055f573b23e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:53.972341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-678aff44-a69c-4a86-8a47-2cbae243b796 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:53.978096 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e3f24cf-c7a0-48bc-af53-c055f573b23e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:53.978588 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e3f24cf-c7a0-48bc-af53-c055f573b23e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:53.979143 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e3f24cf-c7a0-48bc-af53-c055f573b23e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:53.979910 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e3f24cf-c7a0-48bc-af53-c055f573b23e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:53.980359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e3f24cf-c7a0-48bc-af53-c055f573b23e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:53.980776 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e3f24cf-c7a0-48bc-af53-c055f573b23e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:53.982588 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-678aff44-a69c-4a86-8a47-2cbae243b796 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1371 microversion: 2.1 time: 0.184839 Aug 24 12:33:53.983270 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 224/453] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:53 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:54.116586 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6e3f24cf-c7a0-48bc-af53-c055f573b23e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:54.124450 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6e3f24cf-c7a0-48bc-af53-c055f573b23e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.159694 Aug 24 12:33:54.125040 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 230/454] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:53 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:55.004008 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0fac1d77-4b12-4788-aef3-4e025d64a59a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:55.004614 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0fac1d77-4b12-4788-aef3-4e025d64a59a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:55.010978 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fac1d77-4b12-4788-aef3-4e025d64a59a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:55.011457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fac1d77-4b12-4788-aef3-4e025d64a59a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:55.011889 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fac1d77-4b12-4788-aef3-4e025d64a59a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:55.012639 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fac1d77-4b12-4788-aef3-4e025d64a59a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:55.013105 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fac1d77-4b12-4788-aef3-4e025d64a59a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:55.013532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fac1d77-4b12-4788-aef3-4e025d64a59a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:55.145108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5b0cdc08-22ec-4188-8c1b-7c06862518ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:55.145711 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5b0cdc08-22ec-4188-8c1b-7c06862518ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:55.148755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0fac1d77-4b12-4788-aef3-4e025d64a59a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:55.151486 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5b0cdc08-22ec-4188-8c1b-7c06862518ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:55.151962 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5b0cdc08-22ec-4188-8c1b-7c06862518ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:55.152392 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5b0cdc08-22ec-4188-8c1b-7c06862518ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:55.153067 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5b0cdc08-22ec-4188-8c1b-7c06862518ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:55.154191 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5b0cdc08-22ec-4188-8c1b-7c06862518ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:55.154603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5b0cdc08-22ec-4188-8c1b-7c06862518ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:55.156933 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0fac1d77-4b12-4788-aef3-4e025d64a59a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1371 microversion: 2.1 time: 0.156809 Aug 24 12:33:55.157495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 225/455] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:54 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:55.285704 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5b0cdc08-22ec-4188-8c1b-7c06862518ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:55.295443 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5b0cdc08-22ec-4188-8c1b-7c06862518ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.154151 Aug 24 12:33:55.295996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 231/456] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:55 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:56.178162 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-23607fec-66c7-41cf-95e7-c83b31328e60 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:56.178743 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-23607fec-66c7-41cf-95e7-c83b31328e60 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:56.185317 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-23607fec-66c7-41cf-95e7-c83b31328e60 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:56.185829 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-23607fec-66c7-41cf-95e7-c83b31328e60 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:56.186273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-23607fec-66c7-41cf-95e7-c83b31328e60 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:56.187025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-23607fec-66c7-41cf-95e7-c83b31328e60 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:56.187478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-23607fec-66c7-41cf-95e7-c83b31328e60 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:56.187897 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-23607fec-66c7-41cf-95e7-c83b31328e60 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:56.315954 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d4def776-7a5d-406b-becb-9c3391cfe0eb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:56.316613 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d4def776-7a5d-406b-becb-9c3391cfe0eb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:56.316720 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-23607fec-66c7-41cf-95e7-c83b31328e60 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:56.322454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d4def776-7a5d-406b-becb-9c3391cfe0eb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:56.322959 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d4def776-7a5d-406b-becb-9c3391cfe0eb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:56.323393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d4def776-7a5d-406b-becb-9c3391cfe0eb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:56.324070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d4def776-7a5d-406b-becb-9c3391cfe0eb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:56.324394 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-23607fec-66c7-41cf-95e7-c83b31328e60 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1371 microversion: 2.1 time: 0.150167 Aug 24 12:33:56.324514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d4def776-7a5d-406b-becb-9c3391cfe0eb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:56.324919 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d4def776-7a5d-406b-becb-9c3391cfe0eb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:56.325043 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 226/457] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:56 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:56.454045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d4def776-7a5d-406b-becb-9c3391cfe0eb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:56.461759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d4def776-7a5d-406b-becb-9c3391cfe0eb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.149611 Aug 24 12:33:56.462311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 232/458] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:56 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:57.345496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9ac3bc08-dd7e-4cff-b2cf-7f6f32f7ce34 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:57.346113 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9ac3bc08-dd7e-4cff-b2cf-7f6f32f7ce34 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:57.352946 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ac3bc08-dd7e-4cff-b2cf-7f6f32f7ce34 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:57.353431 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ac3bc08-dd7e-4cff-b2cf-7f6f32f7ce34 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:57.353866 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ac3bc08-dd7e-4cff-b2cf-7f6f32f7ce34 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:57.354552 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ac3bc08-dd7e-4cff-b2cf-7f6f32f7ce34 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:57.355037 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ac3bc08-dd7e-4cff-b2cf-7f6f32f7ce34 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:57.355459 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ac3bc08-dd7e-4cff-b2cf-7f6f32f7ce34 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:57.483493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-43d87f6c-76c4-41f8-b8bd-a62f6d1ff3a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:57.484168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-43d87f6c-76c4-41f8-b8bd-a62f6d1ff3a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:57.484800 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9ac3bc08-dd7e-4cff-b2cf-7f6f32f7ce34 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:57.490997 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43d87f6c-76c4-41f8-b8bd-a62f6d1ff3a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:57.491751 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43d87f6c-76c4-41f8-b8bd-a62f6d1ff3a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:57.492185 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43d87f6c-76c4-41f8-b8bd-a62f6d1ff3a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:57.492901 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43d87f6c-76c4-41f8-b8bd-a62f6d1ff3a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:57.493320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9ac3bc08-dd7e-4cff-b2cf-7f6f32f7ce34 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1371 microversion: 2.1 time: 0.151684 Aug 24 12:33:57.493424 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43d87f6c-76c4-41f8-b8bd-a62f6d1ff3a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:57.493749 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43d87f6c-76c4-41f8-b8bd-a62f6d1ff3a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:57.494169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 227/459] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:57 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:57.623704 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-43d87f6c-76c4-41f8-b8bd-a62f6d1ff3a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:57.631237 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-43d87f6c-76c4-41f8-b8bd-a62f6d1ff3a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.152379 Aug 24 12:33:57.631788 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 233/460] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:57 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:58.514089 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-16704254-4ada-4e05-a760-4e99c4cfbef9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:58.514727 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-16704254-4ada-4e05-a760-4e99c4cfbef9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:58.521052 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-16704254-4ada-4e05-a760-4e99c4cfbef9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:58.521533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-16704254-4ada-4e05-a760-4e99c4cfbef9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:58.521968 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-16704254-4ada-4e05-a760-4e99c4cfbef9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:58.522669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-16704254-4ada-4e05-a760-4e99c4cfbef9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:58.523136 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-16704254-4ada-4e05-a760-4e99c4cfbef9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:58.523561 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-16704254-4ada-4e05-a760-4e99c4cfbef9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:58.653345 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-16704254-4ada-4e05-a760-4e99c4cfbef9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:58.661481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-16704254-4ada-4e05-a760-4e99c4cfbef9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1371 microversion: 2.1 time: 0.151782 Aug 24 12:33:58.662039 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 228/461] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:58 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:58.707429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6ad7a742-a9c3-4633-9307-1e6c26c00683 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:58.707947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6ad7a742-a9c3-4633-9307-1e6c26c00683 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:58.717842 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6ad7a742-a9c3-4633-9307-1e6c26c00683 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:58.718321 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6ad7a742-a9c3-4633-9307-1e6c26c00683 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:58.718779 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6ad7a742-a9c3-4633-9307-1e6c26c00683 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:58.719461 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6ad7a742-a9c3-4633-9307-1e6c26c00683 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:58.719904 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6ad7a742-a9c3-4633-9307-1e6c26c00683 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:58.720323 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6ad7a742-a9c3-4633-9307-1e6c26c00683 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:58.850231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6ad7a742-a9c3-4633-9307-1e6c26c00683 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:58.857824 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6ad7a742-a9c3-4633-9307-1e6c26c00683 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.154273 Aug 24 12:33:58.858378 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 234/462] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:58 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:59.681197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d620c0a6-1905-45c0-9953-e54c657d8971 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:59.681963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d620c0a6-1905-45c0-9953-e54c657d8971 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:59.695766 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d620c0a6-1905-45c0-9953-e54c657d8971 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:59.696442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d620c0a6-1905-45c0-9953-e54c657d8971 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:59.697025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d620c0a6-1905-45c0-9953-e54c657d8971 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:59.698065 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d620c0a6-1905-45c0-9953-e54c657d8971 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:59.698726 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d620c0a6-1905-45c0-9953-e54c657d8971 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:59.699154 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d620c0a6-1905-45c0-9953-e54c657d8971 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:59.838015 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d620c0a6-1905-45c0-9953-e54c657d8971 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:59.846014 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d620c0a6-1905-45c0-9953-e54c657d8971 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1371 microversion: 2.1 time: 0.168643 Aug 24 12:33:59.846564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 229/463] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:59 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:59.878311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f698dd46-3b50-46af-9457-825c194aa2c8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:59.878914 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f698dd46-3b50-46af-9457-825c194aa2c8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:59.884697 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f698dd46-3b50-46af-9457-825c194aa2c8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:59.885171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f698dd46-3b50-46af-9457-825c194aa2c8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:59.885604 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f698dd46-3b50-46af-9457-825c194aa2c8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:59.886284 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f698dd46-3b50-46af-9457-825c194aa2c8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:59.886762 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f698dd46-3b50-46af-9457-825c194aa2c8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:59.887189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f698dd46-3b50-46af-9457-825c194aa2c8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:00.022370 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f698dd46-3b50-46af-9457-825c194aa2c8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:00.035056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f698dd46-3b50-46af-9457-825c194aa2c8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.156559 Aug 24 12:34:00.035056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 235/464] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:59 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:00.867446 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4bd783c8-e8e8-4806-b4ec-224dd2aa4527 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:00.868078 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4bd783c8-e8e8-4806-b4ec-224dd2aa4527 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:00.875077 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4bd783c8-e8e8-4806-b4ec-224dd2aa4527 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:00.875562 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4bd783c8-e8e8-4806-b4ec-224dd2aa4527 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:00.876000 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4bd783c8-e8e8-4806-b4ec-224dd2aa4527 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:00.876692 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4bd783c8-e8e8-4806-b4ec-224dd2aa4527 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:00.877139 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4bd783c8-e8e8-4806-b4ec-224dd2aa4527 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:00.877558 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4bd783c8-e8e8-4806-b4ec-224dd2aa4527 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:01.013194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4bd783c8-e8e8-4806-b4ec-224dd2aa4527 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:01.024183 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4bd783c8-e8e8-4806-b4ec-224dd2aa4527 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1371 microversion: 2.1 time: 0.160642 Aug 24 12:34:01.025460 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 230/465] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:00 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:01.053260 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f4e90374-81d0-46e2-b0cc-57daffe42b35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:01.053894 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f4e90374-81d0-46e2-b0cc-57daffe42b35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:01.060497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4e90374-81d0-46e2-b0cc-57daffe42b35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:01.060983 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4e90374-81d0-46e2-b0cc-57daffe42b35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:01.061413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4e90374-81d0-46e2-b0cc-57daffe42b35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:01.062094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4e90374-81d0-46e2-b0cc-57daffe42b35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:01.062567 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4e90374-81d0-46e2-b0cc-57daffe42b35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:01.063010 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4e90374-81d0-46e2-b0cc-57daffe42b35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:01.193090 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f4e90374-81d0-46e2-b0cc-57daffe42b35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:01.201107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f4e90374-81d0-46e2-b0cc-57daffe42b35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.151660 Aug 24 12:34:01.201664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 236/466] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:01 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:02.057692 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fddfa0a6-c6f6-4d2b-ab52-e1c5b70d17b7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:02.058247 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fddfa0a6-c6f6-4d2b-ab52-e1c5b70d17b7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:02.065229 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fddfa0a6-c6f6-4d2b-ab52-e1c5b70d17b7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:02.065721 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fddfa0a6-c6f6-4d2b-ab52-e1c5b70d17b7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:02.066164 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fddfa0a6-c6f6-4d2b-ab52-e1c5b70d17b7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:02.067067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fddfa0a6-c6f6-4d2b-ab52-e1c5b70d17b7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:02.067586 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fddfa0a6-c6f6-4d2b-ab52-e1c5b70d17b7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:02.067953 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fddfa0a6-c6f6-4d2b-ab52-e1c5b70d17b7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:02.199005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fddfa0a6-c6f6-4d2b-ab52-e1c5b70d17b7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:02.207667 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fddfa0a6-c6f6-4d2b-ab52-e1c5b70d17b7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1371 microversion: 2.1 time: 0.154003 Aug 24 12:34:02.208238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 231/467] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:02 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:02.221548 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8ccd2394-a91e-44d8-804a-3d158b035cdb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:02.222251 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8ccd2394-a91e-44d8-804a-3d158b035cdb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:02.228279 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ccd2394-a91e-44d8-804a-3d158b035cdb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:02.228840 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ccd2394-a91e-44d8-804a-3d158b035cdb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:02.229340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ccd2394-a91e-44d8-804a-3d158b035cdb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:02.230153 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ccd2394-a91e-44d8-804a-3d158b035cdb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:02.230696 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ccd2394-a91e-44d8-804a-3d158b035cdb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:02.231288 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ccd2394-a91e-44d8-804a-3d158b035cdb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:02.366375 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8ccd2394-a91e-44d8-804a-3d158b035cdb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:02.374630 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8ccd2394-a91e-44d8-804a-3d158b035cdb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.156945 Aug 24 12:34:02.375206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 237/468] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:02 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:03.229590 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-74e8299a-475c-4729-98ac-b6cc87217037 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:03.231151 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-74e8299a-475c-4729-98ac-b6cc87217037 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:03.239950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-74e8299a-475c-4729-98ac-b6cc87217037 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:03.240447 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-74e8299a-475c-4729-98ac-b6cc87217037 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:03.250769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-74e8299a-475c-4729-98ac-b6cc87217037 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:03.250769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-74e8299a-475c-4729-98ac-b6cc87217037 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:03.250769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-74e8299a-475c-4729-98ac-b6cc87217037 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:03.250769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-74e8299a-475c-4729-98ac-b6cc87217037 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:03.394837 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-74e8299a-475c-4729-98ac-b6cc87217037 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:03.396871 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5a708a54-303a-4ca5-bead-df829a03771e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:03.397761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5a708a54-303a-4ca5-bead-df829a03771e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:03.405603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-74e8299a-475c-4729-98ac-b6cc87217037 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1371 microversion: 2.1 time: 0.180701 Aug 24 12:34:03.406272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5a708a54-303a-4ca5-bead-df829a03771e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:03.406528 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5a708a54-303a-4ca5-bead-df829a03771e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:03.417199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5a708a54-303a-4ca5-bead-df829a03771e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:03.417434 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 232/469] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:03 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:03.421630 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5a708a54-303a-4ca5-bead-df829a03771e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:03.422140 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5a708a54-303a-4ca5-bead-df829a03771e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:03.423864 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5a708a54-303a-4ca5-bead-df829a03771e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:03.584366 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5a708a54-303a-4ca5-bead-df829a03771e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:03.592948 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5a708a54-303a-4ca5-bead-df829a03771e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.201080 Aug 24 12:34:03.594739 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 238/470] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:03 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:03.941051 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-60d90193-b5e3-48b8-a5cc-5473faa734b9 req-b079b56d-e2df-469e-b8a9-699ab27edcf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50cb23a1-9864-46ef-ae19-411f522e9f10", "name": "network-vif-plugged", "status": "completed", "tag": "4fe23f91-93ad-4bd1-9b29-2d302a44a9c9"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:03.951714 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-60d90193-b5e3-48b8-a5cc-5473faa734b9 req-b079b56d-e2df-469e-b8a9-699ab27edcf8 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:03.952199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-60d90193-b5e3-48b8-a5cc-5473faa734b9 req-b079b56d-e2df-469e-b8a9-699ab27edcf8 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:03.952832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-60d90193-b5e3-48b8-a5cc-5473faa734b9 req-b079b56d-e2df-469e-b8a9-699ab27edcf8 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:03.964189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-60d90193-b5e3-48b8-a5cc-5473faa734b9 req-b079b56d-e2df-469e-b8a9-699ab27edcf8 service nova] Creating event network-vif-plugged:4fe23f91-93ad-4bd1-9b29-2d302a44a9c9 for instance 50cb23a1-9864-46ef-ae19-411f522e9f10 on hv-cinder-84889 Aug 24 12:34:03.969650 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-60d90193-b5e3-48b8-a5cc-5473faa734b9 req-b079b56d-e2df-469e-b8a9-699ab27edcf8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032691 Aug 24 12:34:03.970777 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 233/471] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:04.428386 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2da73213-bde5-4504-a7e3-05c15251dddc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:04.429571 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2da73213-bde5-4504-a7e3-05c15251dddc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:04.436361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2da73213-bde5-4504-a7e3-05c15251dddc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:04.436843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2da73213-bde5-4504-a7e3-05c15251dddc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:04.437300 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2da73213-bde5-4504-a7e3-05c15251dddc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:04.437988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2da73213-bde5-4504-a7e3-05c15251dddc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:04.438796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2da73213-bde5-4504-a7e3-05c15251dddc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:04.439392 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2da73213-bde5-4504-a7e3-05c15251dddc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:04.614709 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-715ff281-10cb-4018-902c-c36c53e26fa1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:04.615555 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-715ff281-10cb-4018-902c-c36c53e26fa1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:04.622280 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-715ff281-10cb-4018-902c-c36c53e26fa1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:04.622795 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-715ff281-10cb-4018-902c-c36c53e26fa1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:04.623248 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-715ff281-10cb-4018-902c-c36c53e26fa1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:04.623932 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-715ff281-10cb-4018-902c-c36c53e26fa1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:04.624387 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-715ff281-10cb-4018-902c-c36c53e26fa1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:04.624812 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-715ff281-10cb-4018-902c-c36c53e26fa1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:04.759816 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-715ff281-10cb-4018-902c-c36c53e26fa1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:04.768451 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-715ff281-10cb-4018-902c-c36c53e26fa1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.158401 Aug 24 12:34:04.769017 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 234/472] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:04 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:04.859237 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2da73213-bde5-4504-a7e3-05c15251dddc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:04.866938 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2da73213-bde5-4504-a7e3-05c15251dddc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1371 microversion: 2.1 time: 0.442981 Aug 24 12:34:04.867494 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 239/473] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:04 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1371 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:05.790606 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-048623d2-612f-4fe6-877e-fdec7a4be405 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:05.791263 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-048623d2-612f-4fe6-877e-fdec7a4be405 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:05.798240 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-048623d2-612f-4fe6-877e-fdec7a4be405 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:05.798733 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-048623d2-612f-4fe6-877e-fdec7a4be405 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:05.799169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-048623d2-612f-4fe6-877e-fdec7a4be405 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:05.799851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-048623d2-612f-4fe6-877e-fdec7a4be405 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:05.800308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-048623d2-612f-4fe6-877e-fdec7a4be405 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:05.800721 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-048623d2-612f-4fe6-877e-fdec7a4be405 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:05.887386 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4d86a3bb-9cd2-462a-9df1-642a8b73edfe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:05.888117 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4d86a3bb-9cd2-462a-9df1-642a8b73edfe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:05.894218 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4d86a3bb-9cd2-462a-9df1-642a8b73edfe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:05.894986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4d86a3bb-9cd2-462a-9df1-642a8b73edfe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:05.895478 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4d86a3bb-9cd2-462a-9df1-642a8b73edfe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:05.896197 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4d86a3bb-9cd2-462a-9df1-642a8b73edfe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:05.896650 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4d86a3bb-9cd2-462a-9df1-642a8b73edfe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:05.897076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4d86a3bb-9cd2-462a-9df1-642a8b73edfe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:05.937870 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-048623d2-612f-4fe6-877e-fdec7a4be405 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:05.946620 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-048623d2-612f-4fe6-877e-fdec7a4be405 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.159826 Aug 24 12:34:05.947249 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 235/474] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:05 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:06.028336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4d86a3bb-9cd2-462a-9df1-642a8b73edfe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:06.036867 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4d86a3bb-9cd2-462a-9df1-642a8b73edfe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1371 microversion: 2.1 time: 0.153758 Aug 24 12:34:06.037515 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 240/475] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:05 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:06.968704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-20f4b022-e911-42a3-94d0-f303417294e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:06.969331 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-20f4b022-e911-42a3-94d0-f303417294e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:06.975274 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-20f4b022-e911-42a3-94d0-f303417294e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:06.975795 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-20f4b022-e911-42a3-94d0-f303417294e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:06.976227 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-20f4b022-e911-42a3-94d0-f303417294e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:06.976907 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-20f4b022-e911-42a3-94d0-f303417294e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:06.977367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-20f4b022-e911-42a3-94d0-f303417294e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:06.977787 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-20f4b022-e911-42a3-94d0-f303417294e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:06.981889 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:07.059062 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b6cad58a-98ba-4325-9a6d-222bd1acf216 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:07.059679 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b6cad58a-98ba-4325-9a6d-222bd1acf216 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:07.065950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6cad58a-98ba-4325-9a6d-222bd1acf216 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:07.066757 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6cad58a-98ba-4325-9a6d-222bd1acf216 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:07.067308 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6cad58a-98ba-4325-9a6d-222bd1acf216 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:07.068076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6cad58a-98ba-4325-9a6d-222bd1acf216 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:07.068752 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6cad58a-98ba-4325-9a6d-222bd1acf216 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:07.069405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6cad58a-98ba-4325-9a6d-222bd1acf216 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:07.090713 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:07.109426 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-20f4b022-e911-42a3-94d0-f303417294e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:07.119658 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-20f4b022-e911-42a3-94d0-f303417294e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.155678 Aug 24 12:34:07.120230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 236/476] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:06 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:07.206319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b6cad58a-98ba-4325-9a6d-222bd1acf216 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:07.214006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b6cad58a-98ba-4325-9a6d-222bd1acf216 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1565 microversion: 2.1 time: 0.160158 Aug 24 12:34:07.214619 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 241/477] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:07 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:07.234308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1fad3c54-cbd3-4dc0-a76b-a7773ce0dbad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:07.244752 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1fad3c54-cbd3-4dc0-a76b-a7773ce0dbad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:07.244752 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1fad3c54-cbd3-4dc0-a76b-a7773ce0dbad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:07.244752 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1fad3c54-cbd3-4dc0-a76b-a7773ce0dbad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:07.244752 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1fad3c54-cbd3-4dc0-a76b-a7773ce0dbad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:07.245153 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1fad3c54-cbd3-4dc0-a76b-a7773ce0dbad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:07.245153 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1fad3c54-cbd3-4dc0-a76b-a7773ce0dbad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:07.245153 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1fad3c54-cbd3-4dc0-a76b-a7773ce0dbad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:07.324181 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1fad3c54-cbd3-4dc0-a76b-a7773ce0dbad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093719 Aug 24 12:34:07.324792 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 237/478] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 24 12:34:07 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:07.943794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-0c7752e8-fe12-43bb-9926-afe63ac13f68 req-12c5077e-76f0-4b96-b29f-0a8ac37c5b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ce2c0c-40e5-45d1-b2a6-ad30617badb4", "name": "network-vif-plugged", "status": "completed", "tag": "4f48e5e7-3a0c-4f05-abe0-02ba501d8cfd"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:07.954456 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-0c7752e8-fe12-43bb-9926-afe63ac13f68 req-12c5077e-76f0-4b96-b29f-0a8ac37c5b3c service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:07.955201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-0c7752e8-fe12-43bb-9926-afe63ac13f68 req-12c5077e-76f0-4b96-b29f-0a8ac37c5b3c service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:07.955636 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-0c7752e8-fe12-43bb-9926-afe63ac13f68 req-12c5077e-76f0-4b96-b29f-0a8ac37c5b3c service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:07.966842 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-0c7752e8-fe12-43bb-9926-afe63ac13f68 req-12c5077e-76f0-4b96-b29f-0a8ac37c5b3c service nova] Creating event network-vif-plugged:4f48e5e7-3a0c-4f05-abe0-02ba501d8cfd for instance 29ce2c0c-40e5-45d1-b2a6-ad30617badb4 on hv-cinder-84889 Aug 24 12:34:07.972054 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-0c7752e8-fe12-43bb-9926-afe63ac13f68 req-12c5077e-76f0-4b96-b29f-0a8ac37c5b3c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031882 Aug 24 12:34:07.981281 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 242/479] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:08.141365 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-30080ea6-18a3-4f87-977d-1bb13bc919a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:08.142082 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-30080ea6-18a3-4f87-977d-1bb13bc919a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:08.148234 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30080ea6-18a3-4f87-977d-1bb13bc919a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:08.148714 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30080ea6-18a3-4f87-977d-1bb13bc919a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:08.149147 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30080ea6-18a3-4f87-977d-1bb13bc919a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:08.149827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30080ea6-18a3-4f87-977d-1bb13bc919a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:08.150279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30080ea6-18a3-4f87-977d-1bb13bc919a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:08.150726 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30080ea6-18a3-4f87-977d-1bb13bc919a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:08.388513 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-9cee2341-f079-4679-b381-ea3dda87a60e req-e3e8d6cd-a123-41ad-8602-8c3792939155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50cb23a1-9864-46ef-ae19-411f522e9f10", "tag": "4fe23f91-93ad-4bd1-9b29-2d302a44a9c9"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:08.402713 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-9cee2341-f079-4679-b381-ea3dda87a60e req-e3e8d6cd-a123-41ad-8602-8c3792939155 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:08.403196 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-9cee2341-f079-4679-b381-ea3dda87a60e req-e3e8d6cd-a123-41ad-8602-8c3792939155 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:08.403650 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-9cee2341-f079-4679-b381-ea3dda87a60e req-e3e8d6cd-a123-41ad-8602-8c3792939155 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:08.433157 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-9cee2341-f079-4679-b381-ea3dda87a60e req-e3e8d6cd-a123-41ad-8602-8c3792939155 service nova] Creating event network-changed:4fe23f91-93ad-4bd1-9b29-2d302a44a9c9 for instance 50cb23a1-9864-46ef-ae19-411f522e9f10 on hv-cinder-84889 Aug 24 12:34:08.446329 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-9cee2341-f079-4679-b381-ea3dda87a60e req-e3e8d6cd-a123-41ad-8602-8c3792939155 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062669 Aug 24 12:34:08.447244 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 243/480] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:34:08.547119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-30080ea6-18a3-4f87-977d-1bb13bc919a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:08.554936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-30080ea6-18a3-4f87-977d-1bb13bc919a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.418565 Aug 24 12:34:08.555821 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 238/481] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:08 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:09.577815 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-66de967f-582b-4e3b-bf62-81e7f43a357c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:09.578503 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-66de967f-582b-4e3b-bf62-81e7f43a357c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:09.584633 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-66de967f-582b-4e3b-bf62-81e7f43a357c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:09.585110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-66de967f-582b-4e3b-bf62-81e7f43a357c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:09.585626 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-66de967f-582b-4e3b-bf62-81e7f43a357c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:09.586317 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-66de967f-582b-4e3b-bf62-81e7f43a357c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:09.586800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-66de967f-582b-4e3b-bf62-81e7f43a357c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:09.587227 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-66de967f-582b-4e3b-bf62-81e7f43a357c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:09.770577 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-66de967f-582b-4e3b-bf62-81e7f43a357c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:09.778210 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-66de967f-582b-4e3b-bf62-81e7f43a357c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.205353 Aug 24 12:34:09.779125 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 244/482] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:09 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:10.802526 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-eac9152d-d686-4bb1-b985-54302cc5f3e7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:10.803249 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-eac9152d-d686-4bb1-b985-54302cc5f3e7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:10.810685 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eac9152d-d686-4bb1-b985-54302cc5f3e7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:10.811177 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eac9152d-d686-4bb1-b985-54302cc5f3e7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:10.811613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eac9152d-d686-4bb1-b985-54302cc5f3e7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:10.812312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eac9152d-d686-4bb1-b985-54302cc5f3e7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:10.812774 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eac9152d-d686-4bb1-b985-54302cc5f3e7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:10.813196 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eac9152d-d686-4bb1-b985-54302cc5f3e7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:10.943710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-eac9152d-d686-4bb1-b985-54302cc5f3e7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:10.954168 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-eac9152d-d686-4bb1-b985-54302cc5f3e7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1358 microversion: 2.1 time: 0.160029 Aug 24 12:34:10.954801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 239/483] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:10 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:11.976447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-87f6dd70-284a-4782-b2b5-503afd84008f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:11.977067 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-87f6dd70-284a-4782-b2b5-503afd84008f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:11.982943 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-87f6dd70-284a-4782-b2b5-503afd84008f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:11.983419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-87f6dd70-284a-4782-b2b5-503afd84008f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:11.983848 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-87f6dd70-284a-4782-b2b5-503afd84008f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:11.984526 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-87f6dd70-284a-4782-b2b5-503afd84008f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:11.984976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-87f6dd70-284a-4782-b2b5-503afd84008f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:11.985397 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-87f6dd70-284a-4782-b2b5-503afd84008f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:12.118552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-87f6dd70-284a-4782-b2b5-503afd84008f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:12.125266 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-87f6dd70-284a-4782-b2b5-503afd84008f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1548 microversion: 2.1 time: 0.152783 Aug 24 12:34:12.125816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 245/484] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:11 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:12.146113 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-43cf579a-f14f-45d1-bb39-4442d84ec038 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:12.146767 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-43cf579a-f14f-45d1-bb39-4442d84ec038 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:12.153209 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-43cf579a-f14f-45d1-bb39-4442d84ec038 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:12.153713 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-43cf579a-f14f-45d1-bb39-4442d84ec038 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:12.154150 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-43cf579a-f14f-45d1-bb39-4442d84ec038 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:12.154865 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-43cf579a-f14f-45d1-bb39-4442d84ec038 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:12.155328 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-43cf579a-f14f-45d1-bb39-4442d84ec038 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:12.155752 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-43cf579a-f14f-45d1-bb39-4442d84ec038 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:12.283554 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-43cf579a-f14f-45d1-bb39-4442d84ec038 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:12.291151 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-43cf579a-f14f-45d1-bb39-4442d84ec038 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1548 microversion: 2.1 time: 0.148814 Aug 24 12:34:12.291711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 240/485] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:12 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:12.311463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-785e205c-021b-41bb-bf25-6bf294bd4fd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:12.316079 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-785e205c-021b-41bb-bf25-6bf294bd4fd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:12.316844 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-785e205c-021b-41bb-bf25-6bf294bd4fd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Searching by: {'deleted': False, 'project_id': 'd3d75e4de32444e2813b11b29553d47a'} {{(pid=121171) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 12:34:12.323372 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-785e205c-021b-41bb-bf25-6bf294bd4fd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:12.323854 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-785e205c-021b-41bb-bf25-6bf294bd4fd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:12.324287 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-785e205c-021b-41bb-bf25-6bf294bd4fd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:12.325014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-785e205c-021b-41bb-bf25-6bf294bd4fd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:12.325508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-785e205c-021b-41bb-bf25-6bf294bd4fd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:12.325935 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-785e205c-021b-41bb-bf25-6bf294bd4fd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:12.414908 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.multi_cell_list [None req-785e205c-021b-41bb-bf25-6bf294bd4fd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121171) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 12:34:12.507524 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-785e205c-021b-41bb-bf25-6bf294bd4fd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.200284 Aug 24 12:34:12.508016 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 246/486] 10.222.0.45 () {58 vars in 1125 bytes} [Wed Aug 24 12:34:12 2022] GET /compute/v2.1/servers => generated 342 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:12.519471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b647bf0e-09c8-42e0-a6bf-a43455e61827 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:12.520076 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b647bf0e-09c8-42e0-a6bf-a43455e61827 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:12.526017 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b647bf0e-09c8-42e0-a6bf-a43455e61827 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:12.526491 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b647bf0e-09c8-42e0-a6bf-a43455e61827 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:12.527057 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b647bf0e-09c8-42e0-a6bf-a43455e61827 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:12.527742 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b647bf0e-09c8-42e0-a6bf-a43455e61827 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:12.528190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b647bf0e-09c8-42e0-a6bf-a43455e61827 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:12.529153 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b647bf0e-09c8-42e0-a6bf-a43455e61827 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:12.655436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b647bf0e-09c8-42e0-a6bf-a43455e61827 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:12.663013 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b647bf0e-09c8-42e0-a6bf-a43455e61827 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1548 microversion: 2.1 time: 0.147331 Aug 24 12:34:12.663570 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 241/487] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:12 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:15.515882 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e7862fdf-48f9-4238-804b-7ce129986cb7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4c145b7-fcf4-4bf2-8030-ed47b577a2a6"}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:15.518206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e7862fdf-48f9-4238-804b-7ce129986cb7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:15.524546 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7862fdf-48f9-4238-804b-7ce129986cb7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:15.525031 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7862fdf-48f9-4238-804b-7ce129986cb7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:15.525569 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7862fdf-48f9-4238-804b-7ce129986cb7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:15.526487 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7862fdf-48f9-4238-804b-7ce129986cb7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:15.527010 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7862fdf-48f9-4238-804b-7ce129986cb7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:15.527431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7862fdf-48f9-4238-804b-7ce129986cb7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:16.362501 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e7862fdf-48f9-4238-804b-7ce129986cb7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "POST /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.850453 Aug 24 12:34:16.367192 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 247/488] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 24 12:34:15 2022] POST /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 194 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:17.709072 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3e844c68-3e3e-47a7-9c0c-2e6d196b6701 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:17.709583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3e844c68-3e3e-47a7-9c0c-2e6d196b6701 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:17.716062 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e844c68-3e3e-47a7-9c0c-2e6d196b6701 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:17.717042 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e844c68-3e3e-47a7-9c0c-2e6d196b6701 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:17.717475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e844c68-3e3e-47a7-9c0c-2e6d196b6701 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:17.718160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e844c68-3e3e-47a7-9c0c-2e6d196b6701 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:17.718620 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e844c68-3e3e-47a7-9c0c-2e6d196b6701 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:17.719065 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e844c68-3e3e-47a7-9c0c-2e6d196b6701 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:17.742471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3e844c68-3e3e-47a7-9c0c-2e6d196b6701 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/ips" status: 200 len: 153 microversion: 2.20 time: 0.037316 Aug 24 12:34:17.744491 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 242/489] 10.222.0.45 () {60 vars in 1289 bytes} [Wed Aug 24 12:34:17 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/ips => generated 153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:34:17.783731 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3ba16cb4-e948-47ba-9c74-6ce4f582e83a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:17.784334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3ba16cb4-e948-47ba-9c74-6ce4f582e83a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:17.790556 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ba16cb4-e948-47ba-9c74-6ce4f582e83a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:17.791062 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ba16cb4-e948-47ba-9c74-6ce4f582e83a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:17.791489 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ba16cb4-e948-47ba-9c74-6ce4f582e83a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:17.792260 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ba16cb4-e948-47ba-9c74-6ce4f582e83a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:17.792889 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ba16cb4-e948-47ba-9c74-6ce4f582e83a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:17.793309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ba16cb4-e948-47ba-9c74-6ce4f582e83a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:17.817129 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3ba16cb4-e948-47ba-9c74-6ce4f582e83a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/ips" status: 200 len: 145 microversion: 2.1 time: 0.038705 Aug 24 12:34:17.817692 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 248/490] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 24 12:34:17 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:21.055907 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e8dfef54-d6c8-4438-b9bb-23886c032c0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:21.056556 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e8dfef54-d6c8-4438-b9bb-23886c032c0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:21.058968 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=46 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:21.063635 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8dfef54-d6c8-4438-b9bb-23886c032c0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:21.064116 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8dfef54-d6c8-4438-b9bb-23886c032c0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:21.064548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8dfef54-d6c8-4438-b9bb-23886c032c0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:21.065231 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8dfef54-d6c8-4438-b9bb-23886c032c0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:21.065702 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8dfef54-d6c8-4438-b9bb-23886c032c0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:21.066115 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8dfef54-d6c8-4438-b9bb-23886c032c0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:21.089972 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.objects.instance [None req-e8dfef54-d6c8-4438-b9bb-23886c032c0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lazy-loading 'flavor' on Instance uuid 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 {{(pid=121170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:34:21.364860 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c7fac468-f679-4fd6-9c66-f6fe1f28f943 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d58db43-61ed-46df-b0b4-8a520e6b6d9a"}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:21.367243 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c7fac468-f679-4fd6-9c66-f6fe1f28f943 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:21.373960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7fac468-f679-4fd6-9c66-f6fe1f28f943 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:21.381172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7fac468-f679-4fd6-9c66-f6fe1f28f943 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:21.381172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7fac468-f679-4fd6-9c66-f6fe1f28f943 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:21.381172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7fac468-f679-4fd6-9c66-f6fe1f28f943 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:21.381172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7fac468-f679-4fd6-9c66-f6fe1f28f943 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:21.381595 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7fac468-f679-4fd6-9c66-f6fe1f28f943 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:21.608034 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e8dfef54-d6c8-4438-b9bb-23886c032c0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "POST /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/action" status: 202 len: 0 microversion: 2.20 time: 0.555850 Aug 24 12:34:21.608676 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 243/491] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Aug 24 12:34:21 2022] POST /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/action => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:34:21.617783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9745f845-dea3-4af5-a539-bc4a919354ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:21.618073 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9745f845-dea3-4af5-a539-bc4a919354ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:21.627665 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9745f845-dea3-4af5-a539-bc4a919354ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:21.628369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9745f845-dea3-4af5-a539-bc4a919354ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:21.628671 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9745f845-dea3-4af5-a539-bc4a919354ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:21.629379 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9745f845-dea3-4af5-a539-bc4a919354ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:21.629835 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9745f845-dea3-4af5-a539-bc4a919354ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:21.630261 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9745f845-dea3-4af5-a539-bc4a919354ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:21.766451 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9745f845-dea3-4af5-a539-bc4a919354ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:21.774753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9745f845-dea3-4af5-a539-bc4a919354ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:21.776254 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9745f845-dea3-4af5-a539-bc4a919354ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:21.777414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9745f845-dea3-4af5-a539-bc4a919354ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1724 microversion: 2.20 time: 0.164326 Aug 24 12:34:21.777974 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 244/492] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:21 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:34:22.231594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c7fac468-f679-4fd6-9c66-f6fe1f28f943 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "POST /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.870083 Aug 24 12:34:22.234793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 249/493] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 24 12:34:21 2022] POST /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 194 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:34:22.260013 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9499ffa2-a4df-4eb4-9418-239d05247317 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-529031845", "imageRef": "62fcb2c8-bff4-46cf-9892-c43d7626629e", "flavorRef": "452"}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:22.312304 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.network.neutron [None req-9499ffa2-a4df-4eb4-9418-239d05247317 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] validate_networks() for None {{(pid=121170) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:34:22.591112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-9499ffa2-a4df-4eb4-9418-239d05247317 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Flavor limits 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:34:22.591556 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-9499ffa2-a4df-4eb4-9418-239d05247317 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Image limits 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:34:22.592024 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-9499ffa2-a4df-4eb4-9418-239d05247317 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Flavor pref 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:34:22.592503 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-9499ffa2-a4df-4eb4-9418-239d05247317 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Image pref 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:34:22.592956 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-9499ffa2-a4df-4eb4-9418-239d05247317 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:34:22.601543 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9499ffa2-a4df-4eb4-9418-239d05247317 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:22.602004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9499ffa2-a4df-4eb4-9418-239d05247317 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:22.602433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9499ffa2-a4df-4eb4-9418-239d05247317 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:22.603177 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9499ffa2-a4df-4eb4-9418-239d05247317 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:22.603631 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9499ffa2-a4df-4eb4-9418-239d05247317 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:22.604054 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9499ffa2-a4df-4eb4-9418-239d05247317 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:22.620741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-9499ffa2-a4df-4eb4-9418-239d05247317 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Getting quotas for project 947a3ce621a44edbbf2ea57ce77ac101. Resources: {'instances', 'cores', 'ram'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:34:22.625106 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-9499ffa2-a4df-4eb4-9418-239d05247317 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Getting quotas for user c442e73a4d32487c95fe4e77e58cdc28 and project 947a3ce621a44edbbf2ea57ce77ac101. Resources: {'instances', 'cores', 'ram'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:34:22.635640 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9499ffa2-a4df-4eb4-9418-239d05247317 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Going to run 1 instances... {{(pid=121170) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:34:22.637864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9499ffa2-a4df-4eb4-9418-239d05247317 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] [instance: ac2c7aaa-a21e-4663-ab27-655cfb1ef685] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='62fcb2c8-bff4-46cf-9892-c43d7626629e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:34:22.757127 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9499ffa2-a4df-4eb4-9418-239d05247317 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.500854 Aug 24 12:34:22.758087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 245/494] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 12:34:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:34:22.768923 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-797643dd-0feb-4cda-a917-e5c79df8bb02 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:22.770281 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-797643dd-0feb-4cda-a917-e5c79df8bb02 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] [instance: ac2c7aaa-a21e-4663-ab27-655cfb1ef685] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:22.772561 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=2 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:22.773752 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=44 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:22.800599 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2728ba30-2259-471e-8700-036cac676f8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:22.801152 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2728ba30-2259-471e-8700-036cac676f8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:22.807833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2728ba30-2259-471e-8700-036cac676f8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:22.808319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2728ba30-2259-471e-8700-036cac676f8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:22.808751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2728ba30-2259-471e-8700-036cac676f8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:22.809438 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2728ba30-2259-471e-8700-036cac676f8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:22.809940 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2728ba30-2259-471e-8700-036cac676f8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:22.810361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2728ba30-2259-471e-8700-036cac676f8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:22.828158 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-797643dd-0feb-4cda-a917-e5c79df8bb02 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c442e73a4d32487c95fe4e77e58cdc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947a3ce621a44edbbf2ea57ce77ac101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:22.835511 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-797643dd-0feb-4cda-a917-e5c79df8bb02 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] 10.222.0.45 "GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685" status: 200 len: 1214 microversion: 2.1 time: 0.070642 Aug 24 12:34:22.836180 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 250/495] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:22 2022] GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:22.943385 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2728ba30-2259-471e-8700-036cac676f8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:22.952252 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2728ba30-2259-471e-8700-036cac676f8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:22.953752 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2728ba30-2259-471e-8700-036cac676f8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:22.954947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2728ba30-2259-471e-8700-036cac676f8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1724 microversion: 2.20 time: 0.158369 Aug 24 12:34:22.955508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 246/496] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:22 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:34:23.856933 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cb7ff497-76d1-4054-86b0-77f9389134ed tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:23.857588 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cb7ff497-76d1-4054-86b0-77f9389134ed tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] [instance: ac2c7aaa-a21e-4663-ab27-655cfb1ef685] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:23.865906 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cb7ff497-76d1-4054-86b0-77f9389134ed tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:23.866396 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cb7ff497-76d1-4054-86b0-77f9389134ed tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:23.866865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cb7ff497-76d1-4054-86b0-77f9389134ed tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:23.867565 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cb7ff497-76d1-4054-86b0-77f9389134ed tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:23.868025 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cb7ff497-76d1-4054-86b0-77f9389134ed tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:23.868449 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cb7ff497-76d1-4054-86b0-77f9389134ed tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:23.939120 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cb7ff497-76d1-4054-86b0-77f9389134ed tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c442e73a4d32487c95fe4e77e58cdc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947a3ce621a44edbbf2ea57ce77ac101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:23.948054 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cb7ff497-76d1-4054-86b0-77f9389134ed tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] 10.222.0.45 "GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685" status: 200 len: 1218 microversion: 2.1 time: 0.095476 Aug 24 12:34:23.948828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 251/497] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:23 2022] GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:23.978666 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-95f70a71-248f-4c21-864e-e96b8599a47d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:23.979284 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-95f70a71-248f-4c21-864e-e96b8599a47d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:23.986108 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95f70a71-248f-4c21-864e-e96b8599a47d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:23.986618 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95f70a71-248f-4c21-864e-e96b8599a47d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:23.987120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95f70a71-248f-4c21-864e-e96b8599a47d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:23.987843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95f70a71-248f-4c21-864e-e96b8599a47d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:23.988298 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95f70a71-248f-4c21-864e-e96b8599a47d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:23.988732 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95f70a71-248f-4c21-864e-e96b8599a47d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:24.121420 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-95f70a71-248f-4c21-864e-e96b8599a47d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:24.130153 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-95f70a71-248f-4c21-864e-e96b8599a47d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:24.131755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-95f70a71-248f-4c21-864e-e96b8599a47d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:24.132902 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-95f70a71-248f-4c21-864e-e96b8599a47d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1724 microversion: 2.20 time: 0.158288 Aug 24 12:34:24.133448 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 247/498] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:23 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:24.968653 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-62a155a4-35a1-4e19-bf05-6bef3d35e2b9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:24.969274 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-62a155a4-35a1-4e19-bf05-6bef3d35e2b9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] [instance: ac2c7aaa-a21e-4663-ab27-655cfb1ef685] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:24.975729 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62a155a4-35a1-4e19-bf05-6bef3d35e2b9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:24.976218 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62a155a4-35a1-4e19-bf05-6bef3d35e2b9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:24.977284 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62a155a4-35a1-4e19-bf05-6bef3d35e2b9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:24.977992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62a155a4-35a1-4e19-bf05-6bef3d35e2b9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:24.978444 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62a155a4-35a1-4e19-bf05-6bef3d35e2b9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:24.979140 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62a155a4-35a1-4e19-bf05-6bef3d35e2b9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:25.014129 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-59617d23-9039-4d93-b7e1-04170dbc903e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:25.015296 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-59617d23-9039-4d93-b7e1-04170dbc903e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:25.021587 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59617d23-9039-4d93-b7e1-04170dbc903e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:25.022069 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59617d23-9039-4d93-b7e1-04170dbc903e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:25.022505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59617d23-9039-4d93-b7e1-04170dbc903e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:25.023236 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59617d23-9039-4d93-b7e1-04170dbc903e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:25.023697 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59617d23-9039-4d93-b7e1-04170dbc903e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:25.024137 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59617d23-9039-4d93-b7e1-04170dbc903e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:25.049275 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-62a155a4-35a1-4e19-bf05-6bef3d35e2b9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c442e73a4d32487c95fe4e77e58cdc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947a3ce621a44edbbf2ea57ce77ac101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:25.057074 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-62a155a4-35a1-4e19-bf05-6bef3d35e2b9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] 10.222.0.45 "GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685" status: 200 len: 1266 microversion: 2.1 time: 0.092185 Aug 24 12:34:25.057631 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 252/499] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:24 2022] GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:25.154250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-59617d23-9039-4d93-b7e1-04170dbc903e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:25.156742 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d0a955c3-d733-4d0d-9077-449ae3afb1f5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:25.157572 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d0a955c3-d733-4d0d-9077-449ae3afb1f5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:25.163646 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-59617d23-9039-4d93-b7e1-04170dbc903e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1594 microversion: 2.1 time: 0.153294 Aug 24 12:34:25.164222 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 248/500] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:25 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1594 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:25.175052 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0a955c3-d733-4d0d-9077-449ae3afb1f5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:25.175052 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0a955c3-d733-4d0d-9077-449ae3afb1f5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:25.175052 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0a955c3-d733-4d0d-9077-449ae3afb1f5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:25.175052 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0a955c3-d733-4d0d-9077-449ae3afb1f5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:25.178757 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0a955c3-d733-4d0d-9077-449ae3afb1f5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:25.178757 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0a955c3-d733-4d0d-9077-449ae3afb1f5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:25.469025 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d0a955c3-d733-4d0d-9077-449ae3afb1f5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:25.477556 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d0a955c3-d733-4d0d-9077-449ae3afb1f5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:25.479113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d0a955c3-d733-4d0d-9077-449ae3afb1f5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:25.480282 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d0a955c3-d733-4d0d-9077-449ae3afb1f5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1724 microversion: 2.20 time: 0.328738 Aug 24 12:34:25.482181 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 253/501] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:25 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1724 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:26.078379 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ecf1463a-0903-4dd0-90fe-1f251419d84f tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:26.082082 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ecf1463a-0903-4dd0-90fe-1f251419d84f tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] [instance: ac2c7aaa-a21e-4663-ab27-655cfb1ef685] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:26.085600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ecf1463a-0903-4dd0-90fe-1f251419d84f tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:26.086088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ecf1463a-0903-4dd0-90fe-1f251419d84f tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:26.086579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ecf1463a-0903-4dd0-90fe-1f251419d84f tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:26.087320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ecf1463a-0903-4dd0-90fe-1f251419d84f tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:26.087779 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ecf1463a-0903-4dd0-90fe-1f251419d84f tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:26.088208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ecf1463a-0903-4dd0-90fe-1f251419d84f tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:26.154495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ecf1463a-0903-4dd0-90fe-1f251419d84f tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c442e73a4d32487c95fe4e77e58cdc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947a3ce621a44edbbf2ea57ce77ac101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:26.163417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ecf1463a-0903-4dd0-90fe-1f251419d84f tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] 10.222.0.45 "GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685" status: 200 len: 1272 microversion: 2.1 time: 0.088667 Aug 24 12:34:26.163916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 249/502] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:26 2022] GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685 => generated 1272 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:26.507235 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-020fc35f-15aa-4cb4-b513-b0fe0ab9c278 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:26.508431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-020fc35f-15aa-4cb4-b513-b0fe0ab9c278 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:26.515695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-020fc35f-15aa-4cb4-b513-b0fe0ab9c278 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:26.516182 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-020fc35f-15aa-4cb4-b513-b0fe0ab9c278 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:26.516628 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-020fc35f-15aa-4cb4-b513-b0fe0ab9c278 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:26.517308 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-020fc35f-15aa-4cb4-b513-b0fe0ab9c278 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:26.517756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-020fc35f-15aa-4cb4-b513-b0fe0ab9c278 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:26.518644 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-020fc35f-15aa-4cb4-b513-b0fe0ab9c278 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:26.836817 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-020fc35f-15aa-4cb4-b513-b0fe0ab9c278 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:26.845246 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-020fc35f-15aa-4cb4-b513-b0fe0ab9c278 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:26.846784 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-020fc35f-15aa-4cb4-b513-b0fe0ab9c278 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:26.847944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-020fc35f-15aa-4cb4-b513-b0fe0ab9c278 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1724 microversion: 2.20 time: 0.344749 Aug 24 12:34:26.848493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 254/503] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:26 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1724 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:27.184309 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3f74b6e0-1dd3-48e2-b4d4-0028c0713cb5 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:27.184939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3f74b6e0-1dd3-48e2-b4d4-0028c0713cb5 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] [instance: ac2c7aaa-a21e-4663-ab27-655cfb1ef685] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:27.192697 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3f74b6e0-1dd3-48e2-b4d4-0028c0713cb5 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:27.194763 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3f74b6e0-1dd3-48e2-b4d4-0028c0713cb5 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:27.195520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3f74b6e0-1dd3-48e2-b4d4-0028c0713cb5 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:27.196475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3f74b6e0-1dd3-48e2-b4d4-0028c0713cb5 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:27.197171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3f74b6e0-1dd3-48e2-b4d4-0028c0713cb5 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:27.197795 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3f74b6e0-1dd3-48e2-b4d4-0028c0713cb5 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:27.343668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3f74b6e0-1dd3-48e2-b4d4-0028c0713cb5 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c442e73a4d32487c95fe4e77e58cdc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947a3ce621a44edbbf2ea57ce77ac101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:27.351593 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3f74b6e0-1dd3-48e2-b4d4-0028c0713cb5 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] 10.222.0.45 "GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685" status: 200 len: 1314 microversion: 2.1 time: 0.171133 Aug 24 12:34:27.352260 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 250/504] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:27 2022] GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:27.871495 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e34cf41b-4ff6-43e3-b9fe-51423a8725fc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:27.872050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e34cf41b-4ff6-43e3-b9fe-51423a8725fc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:27.878070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e34cf41b-4ff6-43e3-b9fe-51423a8725fc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:27.878595 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e34cf41b-4ff6-43e3-b9fe-51423a8725fc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:27.879072 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e34cf41b-4ff6-43e3-b9fe-51423a8725fc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:27.879759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e34cf41b-4ff6-43e3-b9fe-51423a8725fc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:27.880200 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e34cf41b-4ff6-43e3-b9fe-51423a8725fc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:27.880618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e34cf41b-4ff6-43e3-b9fe-51423a8725fc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:28.159687 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e34cf41b-4ff6-43e3-b9fe-51423a8725fc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:28.168515 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e34cf41b-4ff6-43e3-b9fe-51423a8725fc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:28.170366 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e34cf41b-4ff6-43e3-b9fe-51423a8725fc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:28.172120 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e34cf41b-4ff6-43e3-b9fe-51423a8725fc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1724 microversion: 2.20 time: 0.304617 Aug 24 12:34:28.172667 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 255/505] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:27 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1724 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:28.270728 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-fe0d3e0b-1e23-4ecf-956a-b920f7e23526 req-4c75b25a-0259-4078-a084-92efa5577d8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ce2c0c-40e5-45d1-b2a6-ad30617badb4", "tag": "4f48e5e7-3a0c-4f05-abe0-02ba501d8cfd"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:28.281042 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-fe0d3e0b-1e23-4ecf-956a-b920f7e23526 req-4c75b25a-0259-4078-a084-92efa5577d8d service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:28.281603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-fe0d3e0b-1e23-4ecf-956a-b920f7e23526 req-4c75b25a-0259-4078-a084-92efa5577d8d service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:28.282165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-fe0d3e0b-1e23-4ecf-956a-b920f7e23526 req-4c75b25a-0259-4078-a084-92efa5577d8d service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:28.293740 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-fe0d3e0b-1e23-4ecf-956a-b920f7e23526 req-4c75b25a-0259-4078-a084-92efa5577d8d service nova] Creating event network-changed:4f48e5e7-3a0c-4f05-abe0-02ba501d8cfd for instance 29ce2c0c-40e5-45d1-b2a6-ad30617badb4 on hv-cinder-84889 Aug 24 12:34:28.299862 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-fe0d3e0b-1e23-4ecf-956a-b920f7e23526 req-4c75b25a-0259-4078-a084-92efa5577d8d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033441 Aug 24 12:34:28.300472 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 251/506] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:28.372349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b1bf7dd2-db99-4ccf-b6c3-acaa4c3b1266 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:28.373323 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b1bf7dd2-db99-4ccf-b6c3-acaa4c3b1266 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] [instance: ac2c7aaa-a21e-4663-ab27-655cfb1ef685] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:28.380333 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b1bf7dd2-db99-4ccf-b6c3-acaa4c3b1266 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:28.381133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b1bf7dd2-db99-4ccf-b6c3-acaa4c3b1266 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:28.381777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b1bf7dd2-db99-4ccf-b6c3-acaa4c3b1266 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:28.382772 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b1bf7dd2-db99-4ccf-b6c3-acaa4c3b1266 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:28.383509 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b1bf7dd2-db99-4ccf-b6c3-acaa4c3b1266 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:28.384142 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b1bf7dd2-db99-4ccf-b6c3-acaa4c3b1266 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:28.673856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b1bf7dd2-db99-4ccf-b6c3-acaa4c3b1266 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c442e73a4d32487c95fe4e77e58cdc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947a3ce621a44edbbf2ea57ce77ac101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:28.682715 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b1bf7dd2-db99-4ccf-b6c3-acaa4c3b1266 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] 10.222.0.45 "GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685" status: 200 len: 1314 microversion: 2.1 time: 0.313837 Aug 24 12:34:28.684036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 256/507] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:28 2022] GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:29.196519 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ef76ffe7-2814-42c2-89e7-cc91731a738c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:29.197287 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ef76ffe7-2814-42c2-89e7-cc91731a738c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:29.204690 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef76ffe7-2814-42c2-89e7-cc91731a738c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:29.210214 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef76ffe7-2814-42c2-89e7-cc91731a738c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:29.210214 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef76ffe7-2814-42c2-89e7-cc91731a738c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:29.210214 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef76ffe7-2814-42c2-89e7-cc91731a738c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:29.210214 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef76ffe7-2814-42c2-89e7-cc91731a738c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:29.210856 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef76ffe7-2814-42c2-89e7-cc91731a738c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:29.392904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ef76ffe7-2814-42c2-89e7-cc91731a738c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:29.396809 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:29.410805 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ef76ffe7-2814-42c2-89e7-cc91731a738c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:29.410805 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ef76ffe7-2814-42c2-89e7-cc91731a738c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:29.410805 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ef76ffe7-2814-42c2-89e7-cc91731a738c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1724 microversion: 2.20 time: 0.212662 Aug 24 12:34:29.411189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 252/508] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:29 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:29.704405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-67a2def8-63a4-42ae-a811-b042b465d16c tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:29.705070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-67a2def8-63a4-42ae-a811-b042b465d16c tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] [instance: ac2c7aaa-a21e-4663-ab27-655cfb1ef685] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:29.711376 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-67a2def8-63a4-42ae-a811-b042b465d16c tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:29.711852 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-67a2def8-63a4-42ae-a811-b042b465d16c tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:29.713632 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-67a2def8-63a4-42ae-a811-b042b465d16c tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:29.713632 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-67a2def8-63a4-42ae-a811-b042b465d16c tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:29.713925 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-67a2def8-63a4-42ae-a811-b042b465d16c tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:29.714354 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-67a2def8-63a4-42ae-a811-b042b465d16c tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:29.849123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-67a2def8-63a4-42ae-a811-b042b465d16c tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c442e73a4d32487c95fe4e77e58cdc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947a3ce621a44edbbf2ea57ce77ac101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:29.852483 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:29.856862 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-67a2def8-63a4-42ae-a811-b042b465d16c tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] 10.222.0.45 "GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685" status: 200 len: 1314 microversion: 2.1 time: 0.156364 Aug 24 12:34:29.857424 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 257/509] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:29 2022] GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:30.318397 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-aaeabff7-9840-4812-8277-374d2df003b6 req-cf805999-de12-4dda-980e-38c3c815f1c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac2c7aaa-a21e-4663-ab27-655cfb1ef685", "tag": "9cf85f9e-b41d-40ad-85d5-96956236f62f"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:30.332898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-aaeabff7-9840-4812-8277-374d2df003b6 req-cf805999-de12-4dda-980e-38c3c815f1c5 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:30.333381 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-aaeabff7-9840-4812-8277-374d2df003b6 req-cf805999-de12-4dda-980e-38c3c815f1c5 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:30.333824 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-aaeabff7-9840-4812-8277-374d2df003b6 req-cf805999-de12-4dda-980e-38c3c815f1c5 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:30.346860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-aaeabff7-9840-4812-8277-374d2df003b6 req-cf805999-de12-4dda-980e-38c3c815f1c5 service nova] Creating event network-changed:9cf85f9e-b41d-40ad-85d5-96956236f62f for instance ac2c7aaa-a21e-4663-ab27-655cfb1ef685 on hv-cinder-84889 Aug 24 12:34:30.351671 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-aaeabff7-9840-4812-8277-374d2df003b6 req-cf805999-de12-4dda-980e-38c3c815f1c5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037265 Aug 24 12:34:30.352234 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 253/510] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:30.428298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1b3d2aa3-e80d-48c8-99a2-ffd9213b407b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:30.428907 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1b3d2aa3-e80d-48c8-99a2-ffd9213b407b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:30.435665 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b3d2aa3-e80d-48c8-99a2-ffd9213b407b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:30.440468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b3d2aa3-e80d-48c8-99a2-ffd9213b407b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:30.440468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b3d2aa3-e80d-48c8-99a2-ffd9213b407b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:30.440468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b3d2aa3-e80d-48c8-99a2-ffd9213b407b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:30.440468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b3d2aa3-e80d-48c8-99a2-ffd9213b407b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:30.440809 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b3d2aa3-e80d-48c8-99a2-ffd9213b407b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:30.570067 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1b3d2aa3-e80d-48c8-99a2-ffd9213b407b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:30.580034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1b3d2aa3-e80d-48c8-99a2-ffd9213b407b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:30.582222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1b3d2aa3-e80d-48c8-99a2-ffd9213b407b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:30.583436 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1b3d2aa3-e80d-48c8-99a2-ffd9213b407b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1724 microversion: 2.20 time: 0.158986 Aug 24 12:34:30.583988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 258/511] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:30 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:30.845188 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-86e88a48-d5bc-4f1a-9af4-05396fa6fc30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1518447889"}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:30.845799 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-86e88a48-d5bc-4f1a-9af4-05396fa6fc30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:30.852828 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86e88a48-d5bc-4f1a-9af4-05396fa6fc30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:30.853305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86e88a48-d5bc-4f1a-9af4-05396fa6fc30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:30.854065 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86e88a48-d5bc-4f1a-9af4-05396fa6fc30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:30.854775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86e88a48-d5bc-4f1a-9af4-05396fa6fc30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:30.855266 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86e88a48-d5bc-4f1a-9af4-05396fa6fc30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:30.855684 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86e88a48-d5bc-4f1a-9af4-05396fa6fc30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:30.878455 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-13aa3a0d-df44-4f1e-add9-0a24a9c273ea tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:30.879114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-13aa3a0d-df44-4f1e-add9-0a24a9c273ea tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] [instance: ac2c7aaa-a21e-4663-ab27-655cfb1ef685] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:30.885578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-13aa3a0d-df44-4f1e-add9-0a24a9c273ea tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:30.886066 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-13aa3a0d-df44-4f1e-add9-0a24a9c273ea tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:30.886499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-13aa3a0d-df44-4f1e-add9-0a24a9c273ea tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:30.887224 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-13aa3a0d-df44-4f1e-add9-0a24a9c273ea tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:30.887675 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-13aa3a0d-df44-4f1e-add9-0a24a9c273ea tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:30.888101 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-13aa3a0d-df44-4f1e-add9-0a24a9c273ea tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:30.986725 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.network.security_group_api [None req-86e88a48-d5bc-4f1a-9af4-05396fa6fc30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Adding security group d777661f-9194-4ef8-9b64-1321ec4d9424 to port 4f48e5e7-3a0c-4f05-abe0-02ba501d8cfd Aug 24 12:34:31.033729 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-13aa3a0d-df44-4f1e-add9-0a24a9c273ea tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c442e73a4d32487c95fe4e77e58cdc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947a3ce621a44edbbf2ea57ce77ac101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:31.041240 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-13aa3a0d-df44-4f1e-add9-0a24a9c273ea tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] 10.222.0.45 "GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685" status: 200 len: 1314 microversion: 2.1 time: 0.167163 Aug 24 12:34:31.041906 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 259/512] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:30 2022] GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:31.400498 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-86e88a48-d5bc-4f1a-9af4-05396fa6fc30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "POST /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/action" status: 202 len: 0 microversion: 2.1 time: 0.559520 Aug 24 12:34:31.401180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 254/513] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 12:34:30 2022] POST /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/action => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:34:31.410229 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4dfdcfc7-2735-4c55-969a-37fe8a401e16 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:31.414305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4dfdcfc7-2735-4c55-969a-37fe8a401e16 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:31.417218 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4dfdcfc7-2735-4c55-969a-37fe8a401e16 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:31.417699 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4dfdcfc7-2735-4c55-969a-37fe8a401e16 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:31.418130 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4dfdcfc7-2735-4c55-969a-37fe8a401e16 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:31.418837 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4dfdcfc7-2735-4c55-969a-37fe8a401e16 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:31.419283 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4dfdcfc7-2735-4c55-969a-37fe8a401e16 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:31.419697 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4dfdcfc7-2735-4c55-969a-37fe8a401e16 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:31.426909 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-49cdcd43-7457-491d-81fc-64661aefe14f req-ac5ea1a0-62ad-4c6b-a3ab-8199e59b98ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ce2c0c-40e5-45d1-b2a6-ad30617badb4", "tag": "4f48e5e7-3a0c-4f05-abe0-02ba501d8cfd"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:31.438953 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-49cdcd43-7457-491d-81fc-64661aefe14f req-ac5ea1a0-62ad-4c6b-a3ab-8199e59b98ca service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:31.440109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-49cdcd43-7457-491d-81fc-64661aefe14f req-ac5ea1a0-62ad-4c6b-a3ab-8199e59b98ca service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:31.440704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-49cdcd43-7457-491d-81fc-64661aefe14f req-ac5ea1a0-62ad-4c6b-a3ab-8199e59b98ca service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:31.469025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-49cdcd43-7457-491d-81fc-64661aefe14f req-ac5ea1a0-62ad-4c6b-a3ab-8199e59b98ca service nova] Creating event network-changed:4f48e5e7-3a0c-4f05-abe0-02ba501d8cfd for instance 29ce2c0c-40e5-45d1-b2a6-ad30617badb4 on hv-cinder-84889 Aug 24 12:34:31.483465 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-49cdcd43-7457-491d-81fc-64661aefe14f req-ac5ea1a0-62ad-4c6b-a3ab-8199e59b98ca service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060605 Aug 24 12:34:31.484558 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 255/514] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:34:31.586160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4dfdcfc7-2735-4c55-969a-37fe8a401e16 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:31.595877 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4dfdcfc7-2735-4c55-969a-37fe8a401e16 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1760 microversion: 2.1 time: 0.190484 Aug 24 12:34:31.596750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 260/515] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:31 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1760 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:31.611119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f6e00178-23b9-407b-a81e-d4dde8fe778c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:31.612277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f6e00178-23b9-407b-a81e-d4dde8fe778c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:31.618829 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6e00178-23b9-407b-a81e-d4dde8fe778c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:31.619323 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6e00178-23b9-407b-a81e-d4dde8fe778c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:31.619764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6e00178-23b9-407b-a81e-d4dde8fe778c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:31.620461 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6e00178-23b9-407b-a81e-d4dde8fe778c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:31.620959 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6e00178-23b9-407b-a81e-d4dde8fe778c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:31.621388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6e00178-23b9-407b-a81e-d4dde8fe778c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:31.758309 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f6e00178-23b9-407b-a81e-d4dde8fe778c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:31.767427 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f6e00178-23b9-407b-a81e-d4dde8fe778c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:31.769037 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f6e00178-23b9-407b-a81e-d4dde8fe778c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:31.770278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f6e00178-23b9-407b-a81e-d4dde8fe778c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1724 microversion: 2.20 time: 0.163708 Aug 24 12:34:31.770947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 256/516] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:31 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:32.062241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3e90ba52-2f9b-41c4-9efd-68670f5c4d5e tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:32.062900 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3e90ba52-2f9b-41c4-9efd-68670f5c4d5e tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] [instance: ac2c7aaa-a21e-4663-ab27-655cfb1ef685] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:32.069206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e90ba52-2f9b-41c4-9efd-68670f5c4d5e tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:32.069686 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e90ba52-2f9b-41c4-9efd-68670f5c4d5e tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:32.070128 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e90ba52-2f9b-41c4-9efd-68670f5c4d5e tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:32.070843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e90ba52-2f9b-41c4-9efd-68670f5c4d5e tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:32.071293 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e90ba52-2f9b-41c4-9efd-68670f5c4d5e tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:32.071716 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e90ba52-2f9b-41c4-9efd-68670f5c4d5e tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:32.200660 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3e90ba52-2f9b-41c4-9efd-68670f5c4d5e tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c442e73a4d32487c95fe4e77e58cdc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947a3ce621a44edbbf2ea57ce77ac101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:32.208738 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3e90ba52-2f9b-41c4-9efd-68670f5c4d5e tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] 10.222.0.45 "GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685" status: 200 len: 1314 microversion: 2.1 time: 0.150424 Aug 24 12:34:32.209301 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 261/517] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:32 2022] GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:32.793420 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-05096e0c-f9a9-4fe3-84af-4e8ac87cc8e8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:32.794029 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-05096e0c-f9a9-4fe3-84af-4e8ac87cc8e8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:32.796423 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell0:SELECT=2 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:32.797087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell0:SELECT=6 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:32.802100 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-05096e0c-f9a9-4fe3-84af-4e8ac87cc8e8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:32.802594 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-05096e0c-f9a9-4fe3-84af-4e8ac87cc8e8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:32.803130 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-05096e0c-f9a9-4fe3-84af-4e8ac87cc8e8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:32.803825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-05096e0c-f9a9-4fe3-84af-4e8ac87cc8e8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:32.804288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-05096e0c-f9a9-4fe3-84af-4e8ac87cc8e8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:32.804721 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-05096e0c-f9a9-4fe3-84af-4e8ac87cc8e8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:32.935402 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-05096e0c-f9a9-4fe3-84af-4e8ac87cc8e8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:32.944023 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-05096e0c-f9a9-4fe3-84af-4e8ac87cc8e8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:32.945536 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-05096e0c-f9a9-4fe3-84af-4e8ac87cc8e8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:32.946718 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-05096e0c-f9a9-4fe3-84af-4e8ac87cc8e8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1724 microversion: 2.20 time: 0.157176 Aug 24 12:34:32.947275 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 257/518] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:32 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:34:33.230233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c4275b00-a18e-428e-ac27-0d182bb654fe tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:33.230917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c4275b00-a18e-428e-ac27-0d182bb654fe tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] [instance: ac2c7aaa-a21e-4663-ab27-655cfb1ef685] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:33.232819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=2 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:33.238282 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4275b00-a18e-428e-ac27-0d182bb654fe tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:33.238810 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4275b00-a18e-428e-ac27-0d182bb654fe tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:33.239510 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4275b00-a18e-428e-ac27-0d182bb654fe tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:33.240226 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4275b00-a18e-428e-ac27-0d182bb654fe tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:33.240676 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4275b00-a18e-428e-ac27-0d182bb654fe tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:33.241101 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4275b00-a18e-428e-ac27-0d182bb654fe tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:33.464100 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c4275b00-a18e-428e-ac27-0d182bb654fe tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c442e73a4d32487c95fe4e77e58cdc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947a3ce621a44edbbf2ea57ce77ac101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:33.468238 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c4275b00-a18e-428e-ac27-0d182bb654fe tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] 10.222.0.45 "GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685" status: 200 len: 1314 microversion: 2.1 time: 0.242214 Aug 24 12:34:33.468785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 262/519] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:33 2022] GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:33.969575 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-06ef78e4-12bb-494a-b15d-aad83433d29a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:33.970510 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-06ef78e4-12bb-494a-b15d-aad83433d29a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:33.977936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06ef78e4-12bb-494a-b15d-aad83433d29a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:33.978816 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06ef78e4-12bb-494a-b15d-aad83433d29a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:33.979319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06ef78e4-12bb-494a-b15d-aad83433d29a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:33.980107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06ef78e4-12bb-494a-b15d-aad83433d29a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:33.980861 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06ef78e4-12bb-494a-b15d-aad83433d29a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:33.981390 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06ef78e4-12bb-494a-b15d-aad83433d29a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:34.137415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-06ef78e4-12bb-494a-b15d-aad83433d29a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:34.146637 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-06ef78e4-12bb-494a-b15d-aad83433d29a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:34.148188 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-06ef78e4-12bb-494a-b15d-aad83433d29a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:34.149356 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-06ef78e4-12bb-494a-b15d-aad83433d29a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1724 microversion: 2.20 time: 0.183835 Aug 24 12:34:34.149915 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 258/520] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:33 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:34.489079 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7252cd8e-1e2e-44d9-9268-a98443a798bc tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:34.489944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7252cd8e-1e2e-44d9-9268-a98443a798bc tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] [instance: ac2c7aaa-a21e-4663-ab27-655cfb1ef685] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:34.496415 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7252cd8e-1e2e-44d9-9268-a98443a798bc tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:34.496895 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7252cd8e-1e2e-44d9-9268-a98443a798bc tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:34.497328 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7252cd8e-1e2e-44d9-9268-a98443a798bc tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:34.498008 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7252cd8e-1e2e-44d9-9268-a98443a798bc tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:34.498462 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7252cd8e-1e2e-44d9-9268-a98443a798bc tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:34.499541 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7252cd8e-1e2e-44d9-9268-a98443a798bc tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:34.695836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7252cd8e-1e2e-44d9-9268-a98443a798bc tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c442e73a4d32487c95fe4e77e58cdc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947a3ce621a44edbbf2ea57ce77ac101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:34.704414 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7252cd8e-1e2e-44d9-9268-a98443a798bc tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] 10.222.0.45 "GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685" status: 200 len: 1314 microversion: 2.1 time: 0.219255 Aug 24 12:34:34.705214 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 263/521] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:34 2022] GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:35.100140 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-41b204a6-27d8-4f3f-b46a-0e46396182d5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:35.106663 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-41b204a6-27d8-4f3f-b46a-0e46396182d5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:35.107169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-41b204a6-27d8-4f3f-b46a-0e46396182d5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:35.107609 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-41b204a6-27d8-4f3f-b46a-0e46396182d5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:35.169578 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-41b204a6-27d8-4f3f-b46a-0e46396182d5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Going to try to stop instance {{(pid=121170) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 12:34:35.172727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-345b274d-4d56-48ce-aed1-17f22a01c723 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:35.173584 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-345b274d-4d56-48ce-aed1-17f22a01c723 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:35.179893 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-345b274d-4d56-48ce-aed1-17f22a01c723 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:35.180461 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-345b274d-4d56-48ce-aed1-17f22a01c723 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:35.180994 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-345b274d-4d56-48ce-aed1-17f22a01c723 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:35.181788 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-345b274d-4d56-48ce-aed1-17f22a01c723 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:35.182509 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-345b274d-4d56-48ce-aed1-17f22a01c723 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:35.183349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-345b274d-4d56-48ce-aed1-17f22a01c723 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:35.311899 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-345b274d-4d56-48ce-aed1-17f22a01c723 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:35.319969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-345b274d-4d56-48ce-aed1-17f22a01c723 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:35.321467 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-345b274d-4d56-48ce-aed1-17f22a01c723 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:35.322626 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-345b274d-4d56-48ce-aed1-17f22a01c723 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1745 microversion: 2.20 time: 0.154530 Aug 24 12:34:35.323202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 264/522] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:35 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:35.352501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-41b204a6-27d8-4f3f-b46a-0e46396182d5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "POST /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/action" status: 202 len: 0 microversion: 2.1 time: 0.256127 Aug 24 12:34:35.353104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 259/523] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 12:34:35 2022] POST /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:34:35.360972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-732a575b-7564-432e-926c-513df8cdb07e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:35.361589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-732a575b-7564-432e-926c-513df8cdb07e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:35.367919 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-732a575b-7564-432e-926c-513df8cdb07e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:35.368412 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-732a575b-7564-432e-926c-513df8cdb07e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:35.368849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-732a575b-7564-432e-926c-513df8cdb07e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:35.369544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-732a575b-7564-432e-926c-513df8cdb07e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:35.370003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-732a575b-7564-432e-926c-513df8cdb07e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:35.370430 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-732a575b-7564-432e-926c-513df8cdb07e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:35.499420 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-732a575b-7564-432e-926c-513df8cdb07e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:35.507478 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-732a575b-7564-432e-926c-513df8cdb07e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1722 microversion: 2.1 time: 0.150255 Aug 24 12:34:35.508043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 265/524] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:35 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:35.729805 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-61cbdc8b-218f-43cd-93f0-2b51eec4abf9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:35.730496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-61cbdc8b-218f-43cd-93f0-2b51eec4abf9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] [instance: ac2c7aaa-a21e-4663-ab27-655cfb1ef685] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:35.736705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-61cbdc8b-218f-43cd-93f0-2b51eec4abf9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:35.737180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-61cbdc8b-218f-43cd-93f0-2b51eec4abf9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:35.737611 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-61cbdc8b-218f-43cd-93f0-2b51eec4abf9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:35.738287 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-61cbdc8b-218f-43cd-93f0-2b51eec4abf9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:35.738769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-61cbdc8b-218f-43cd-93f0-2b51eec4abf9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:35.739473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-61cbdc8b-218f-43cd-93f0-2b51eec4abf9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:35.868028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-61cbdc8b-218f-43cd-93f0-2b51eec4abf9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c442e73a4d32487c95fe4e77e58cdc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947a3ce621a44edbbf2ea57ce77ac101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:35.876214 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-61cbdc8b-218f-43cd-93f0-2b51eec4abf9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] 10.222.0.45 "GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685" status: 200 len: 1314 microversion: 2.1 time: 0.150650 Aug 24 12:34:35.876770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 260/525] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:35 2022] GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:36.347120 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-69685208-30d1-4f1d-8fd3-7b4e78fb2d8a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:36.347724 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-69685208-30d1-4f1d-8fd3-7b4e78fb2d8a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:36.354250 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69685208-30d1-4f1d-8fd3-7b4e78fb2d8a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:36.354770 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69685208-30d1-4f1d-8fd3-7b4e78fb2d8a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:36.355209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69685208-30d1-4f1d-8fd3-7b4e78fb2d8a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:36.356294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69685208-30d1-4f1d-8fd3-7b4e78fb2d8a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:36.356985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69685208-30d1-4f1d-8fd3-7b4e78fb2d8a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:36.357649 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69685208-30d1-4f1d-8fd3-7b4e78fb2d8a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:36.500454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-69685208-30d1-4f1d-8fd3-7b4e78fb2d8a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:36.511835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-69685208-30d1-4f1d-8fd3-7b4e78fb2d8a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:36.513333 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-69685208-30d1-4f1d-8fd3-7b4e78fb2d8a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:36.514585 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-69685208-30d1-4f1d-8fd3-7b4e78fb2d8a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1745 microversion: 2.20 time: 0.171979 Aug 24 12:34:36.515603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 266/526] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:36 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:36.531585 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fee23603-b54a-432a-a9c7-212e44a6a495 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:36.532320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fee23603-b54a-432a-a9c7-212e44a6a495 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:36.538485 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fee23603-b54a-432a-a9c7-212e44a6a495 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:36.539040 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fee23603-b54a-432a-a9c7-212e44a6a495 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:36.539485 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fee23603-b54a-432a-a9c7-212e44a6a495 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:36.540187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fee23603-b54a-432a-a9c7-212e44a6a495 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:36.540650 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fee23603-b54a-432a-a9c7-212e44a6a495 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:36.541080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fee23603-b54a-432a-a9c7-212e44a6a495 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:36.673630 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-a118cf5b-4ca5-4f1f-86bd-ef9dac1e2624 req-2f02c02b-6fc0-404c-b605-72a4e2949bfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2c7aaa-a21e-4663-ab27-655cfb1ef685", "name": "network-vif-plugged", "status": "completed", "tag": "9cf85f9e-b41d-40ad-85d5-96956236f62f"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:36.675753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fee23603-b54a-432a-a9c7-212e44a6a495 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:36.684956 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-a118cf5b-4ca5-4f1f-86bd-ef9dac1e2624 req-2f02c02b-6fc0-404c-b605-72a4e2949bfb service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:36.685439 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-a118cf5b-4ca5-4f1f-86bd-ef9dac1e2624 req-2f02c02b-6fc0-404c-b605-72a4e2949bfb service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:36.685863 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-a118cf5b-4ca5-4f1f-86bd-ef9dac1e2624 req-2f02c02b-6fc0-404c-b605-72a4e2949bfb service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:36.686964 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fee23603-b54a-432a-a9c7-212e44a6a495 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1722 microversion: 2.1 time: 0.161582 Aug 24 12:34:36.687585 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 261/527] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:36 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:36.699825 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-a118cf5b-4ca5-4f1f-86bd-ef9dac1e2624 req-2f02c02b-6fc0-404c-b605-72a4e2949bfb service nova] Creating event network-vif-plugged:9cf85f9e-b41d-40ad-85d5-96956236f62f for instance ac2c7aaa-a21e-4663-ab27-655cfb1ef685 on hv-cinder-84889 Aug 24 12:34:36.705797 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-a118cf5b-4ca5-4f1f-86bd-ef9dac1e2624 req-2f02c02b-6fc0-404c-b605-72a4e2949bfb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037179 Aug 24 12:34:36.706393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 267/528] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:36.897231 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-40c3af0e-b916-4029-be58-065f4670adfd tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:36.897936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-40c3af0e-b916-4029-be58-065f4670adfd tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] [instance: ac2c7aaa-a21e-4663-ab27-655cfb1ef685] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:36.904058 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40c3af0e-b916-4029-be58-065f4670adfd tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:36.904541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40c3af0e-b916-4029-be58-065f4670adfd tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:36.905008 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40c3af0e-b916-4029-be58-065f4670adfd tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:36.905689 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40c3af0e-b916-4029-be58-065f4670adfd tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:36.906141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40c3af0e-b916-4029-be58-065f4670adfd tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:36.906604 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40c3af0e-b916-4029-be58-065f4670adfd tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:37.041040 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-40c3af0e-b916-4029-be58-065f4670adfd tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c442e73a4d32487c95fe4e77e58cdc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947a3ce621a44edbbf2ea57ce77ac101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:37.049796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-40c3af0e-b916-4029-be58-065f4670adfd tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] 10.222.0.45 "GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685" status: 200 len: 1314 microversion: 2.1 time: 0.156383 Aug 24 12:34:37.050424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 262/529] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:36 2022] GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:37.539482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-57c0a1d9-066f-471a-9699-659f77e589a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:37.540167 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-57c0a1d9-066f-471a-9699-659f77e589a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:37.546783 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-57c0a1d9-066f-471a-9699-659f77e589a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:37.547266 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-57c0a1d9-066f-471a-9699-659f77e589a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:37.547699 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-57c0a1d9-066f-471a-9699-659f77e589a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:37.548380 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-57c0a1d9-066f-471a-9699-659f77e589a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:37.548832 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-57c0a1d9-066f-471a-9699-659f77e589a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:37.549254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-57c0a1d9-066f-471a-9699-659f77e589a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:37.677905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-57c0a1d9-066f-471a-9699-659f77e589a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:37.685965 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-57c0a1d9-066f-471a-9699-659f77e589a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:37.688067 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-57c0a1d9-066f-471a-9699-659f77e589a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:37.689209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-57c0a1d9-066f-471a-9699-659f77e589a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1745 microversion: 2.20 time: 0.154382 Aug 24 12:34:37.689763 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 268/530] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:37 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:37.708474 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-093625bc-beca-4213-8f9d-951f20af6262 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:37.709078 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-093625bc-beca-4213-8f9d-951f20af6262 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:37.715402 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-093625bc-beca-4213-8f9d-951f20af6262 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:37.715879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-093625bc-beca-4213-8f9d-951f20af6262 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:37.716309 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-093625bc-beca-4213-8f9d-951f20af6262 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:37.716982 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-093625bc-beca-4213-8f9d-951f20af6262 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:37.717479 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-093625bc-beca-4213-8f9d-951f20af6262 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:37.717900 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-093625bc-beca-4213-8f9d-951f20af6262 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:37.843836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-093625bc-beca-4213-8f9d-951f20af6262 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:37.851886 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-093625bc-beca-4213-8f9d-951f20af6262 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1722 microversion: 2.1 time: 0.147212 Aug 24 12:34:37.852438 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 263/531] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:37 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:38.071006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ae1e234c-1d7d-4db5-a135-85b70c64af79 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:38.071612 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ae1e234c-1d7d-4db5-a135-85b70c64af79 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] [instance: ac2c7aaa-a21e-4663-ab27-655cfb1ef685] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:38.077396 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ae1e234c-1d7d-4db5-a135-85b70c64af79 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:38.077875 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ae1e234c-1d7d-4db5-a135-85b70c64af79 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:38.078310 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ae1e234c-1d7d-4db5-a135-85b70c64af79 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:38.079019 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ae1e234c-1d7d-4db5-a135-85b70c64af79 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:38.079468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ae1e234c-1d7d-4db5-a135-85b70c64af79 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:38.079896 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ae1e234c-1d7d-4db5-a135-85b70c64af79 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:38.204516 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ae1e234c-1d7d-4db5-a135-85b70c64af79 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c442e73a4d32487c95fe4e77e58cdc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947a3ce621a44edbbf2ea57ce77ac101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:38.211877 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ae1e234c-1d7d-4db5-a135-85b70c64af79 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] 10.222.0.45 "GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685" status: 200 len: 1314 microversion: 2.1 time: 0.144662 Aug 24 12:34:38.212430 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 269/532] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:38 2022] GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:38.711650 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3e40f960-5994-4b29-8c11-313cca231fa7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:38.712321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3e40f960-5994-4b29-8c11-313cca231fa7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:38.718785 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e40f960-5994-4b29-8c11-313cca231fa7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:38.719277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e40f960-5994-4b29-8c11-313cca231fa7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:38.719716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e40f960-5994-4b29-8c11-313cca231fa7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:38.719992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-02be4a56-5e9b-482c-b3f6-9d6ecf3a4665 req-9a81433f-c45b-4f16-a61e-e2c51080fe03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e5a10ee-202a-453e-b3ff-6c5c05ec72f3", "name": "network-vif-plugged", "status": "completed", "tag": "65aeb21b-342d-4c27-963d-8c021915548c"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:38.720416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e40f960-5994-4b29-8c11-313cca231fa7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:38.720862 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e40f960-5994-4b29-8c11-313cca231fa7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:38.721292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e40f960-5994-4b29-8c11-313cca231fa7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:38.729819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-02be4a56-5e9b-482c-b3f6-9d6ecf3a4665 req-9a81433f-c45b-4f16-a61e-e2c51080fe03 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:38.730289 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-02be4a56-5e9b-482c-b3f6-9d6ecf3a4665 req-9a81433f-c45b-4f16-a61e-e2c51080fe03 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:38.730740 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-02be4a56-5e9b-482c-b3f6-9d6ecf3a4665 req-9a81433f-c45b-4f16-a61e-e2c51080fe03 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:38.741738 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-02be4a56-5e9b-482c-b3f6-9d6ecf3a4665 req-9a81433f-c45b-4f16-a61e-e2c51080fe03 service nova] Creating event network-vif-plugged:65aeb21b-342d-4c27-963d-8c021915548c for instance 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 on hv-cinder-84889 Aug 24 12:34:38.746471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-02be4a56-5e9b-482c-b3f6-9d6ecf3a4665 req-9a81433f-c45b-4f16-a61e-e2c51080fe03 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030064 Aug 24 12:34:38.747263 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 270/533] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:34:38.850100 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3e40f960-5994-4b29-8c11-313cca231fa7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:38.858014 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3e40f960-5994-4b29-8c11-313cca231fa7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:38.859556 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3e40f960-5994-4b29-8c11-313cca231fa7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:38.860691 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3e40f960-5994-4b29-8c11-313cca231fa7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1745 microversion: 2.20 time: 0.152977 Aug 24 12:34:38.861238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 264/534] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:38 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:38.873587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-94898221-acd6-4d45-a4c6-8de8d064de75 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:38.874840 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-94898221-acd6-4d45-a4c6-8de8d064de75 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:38.880909 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94898221-acd6-4d45-a4c6-8de8d064de75 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:38.881390 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94898221-acd6-4d45-a4c6-8de8d064de75 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:38.881823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94898221-acd6-4d45-a4c6-8de8d064de75 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:38.882504 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94898221-acd6-4d45-a4c6-8de8d064de75 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:38.883053 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94898221-acd6-4d45-a4c6-8de8d064de75 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:38.883476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94898221-acd6-4d45-a4c6-8de8d064de75 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:39.008934 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-94898221-acd6-4d45-a4c6-8de8d064de75 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:39.016931 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-94898221-acd6-4d45-a4c6-8de8d064de75 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1722 microversion: 2.1 time: 0.147438 Aug 24 12:34:39.017488 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 271/535] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:38 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:39.232793 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3427f1db-c206-4869-b45e-2bab71e7c5a7 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:39.233908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3427f1db-c206-4869-b45e-2bab71e7c5a7 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] [instance: ac2c7aaa-a21e-4663-ab27-655cfb1ef685] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:39.240276 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3427f1db-c206-4869-b45e-2bab71e7c5a7 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:39.240757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3427f1db-c206-4869-b45e-2bab71e7c5a7 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:39.241187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3427f1db-c206-4869-b45e-2bab71e7c5a7 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:39.241877 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3427f1db-c206-4869-b45e-2bab71e7c5a7 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:39.242331 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3427f1db-c206-4869-b45e-2bab71e7c5a7 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:39.242778 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3427f1db-c206-4869-b45e-2bab71e7c5a7 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:39.370740 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3427f1db-c206-4869-b45e-2bab71e7c5a7 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c442e73a4d32487c95fe4e77e58cdc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947a3ce621a44edbbf2ea57ce77ac101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:39.378632 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3427f1db-c206-4869-b45e-2bab71e7c5a7 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] 10.222.0.45 "GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685" status: 200 len: 1314 microversion: 2.1 time: 0.149729 Aug 24 12:34:39.379312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 265/536] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:39 2022] GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:39.884345 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3da8f0db-f645-4c10-8d83-947367899db0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:39.884965 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3da8f0db-f645-4c10-8d83-947367899db0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:39.891912 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3da8f0db-f645-4c10-8d83-947367899db0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:39.892385 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3da8f0db-f645-4c10-8d83-947367899db0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:39.892814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3da8f0db-f645-4c10-8d83-947367899db0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:39.893493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3da8f0db-f645-4c10-8d83-947367899db0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:39.893942 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3da8f0db-f645-4c10-8d83-947367899db0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:39.894363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3da8f0db-f645-4c10-8d83-947367899db0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:40.023525 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3da8f0db-f645-4c10-8d83-947367899db0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:40.032160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3da8f0db-f645-4c10-8d83-947367899db0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:40.033656 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3da8f0db-f645-4c10-8d83-947367899db0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:40.034909 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3da8f0db-f645-4c10-8d83-947367899db0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1745 microversion: 2.20 time: 0.154450 Aug 24 12:34:40.035454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 272/537] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:39 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:40.037830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b218148c-3cdc-4b24-9543-64ed7a579138 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:40.038451 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b218148c-3cdc-4b24-9543-64ed7a579138 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:40.045121 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b218148c-3cdc-4b24-9543-64ed7a579138 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:40.045614 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b218148c-3cdc-4b24-9543-64ed7a579138 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:40.046052 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b218148c-3cdc-4b24-9543-64ed7a579138 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:40.046767 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b218148c-3cdc-4b24-9543-64ed7a579138 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:40.047234 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b218148c-3cdc-4b24-9543-64ed7a579138 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:40.047666 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b218148c-3cdc-4b24-9543-64ed7a579138 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:40.174789 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b218148c-3cdc-4b24-9543-64ed7a579138 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:40.182970 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b218148c-3cdc-4b24-9543-64ed7a579138 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1722 microversion: 2.1 time: 0.149538 Aug 24 12:34:40.183524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 266/538] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:40 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:40.399332 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e08051d6-6be1-4d11-afd6-b0c79355dff9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:40.399856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e08051d6-6be1-4d11-afd6-b0c79355dff9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] [instance: ac2c7aaa-a21e-4663-ab27-655cfb1ef685] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:40.405916 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e08051d6-6be1-4d11-afd6-b0c79355dff9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:40.406395 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e08051d6-6be1-4d11-afd6-b0c79355dff9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:40.406860 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e08051d6-6be1-4d11-afd6-b0c79355dff9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:40.407540 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e08051d6-6be1-4d11-afd6-b0c79355dff9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:40.407987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e08051d6-6be1-4d11-afd6-b0c79355dff9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:40.408406 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e08051d6-6be1-4d11-afd6-b0c79355dff9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:40.535351 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e08051d6-6be1-4d11-afd6-b0c79355dff9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c442e73a4d32487c95fe4e77e58cdc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947a3ce621a44edbbf2ea57ce77ac101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:40.542854 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e08051d6-6be1-4d11-afd6-b0c79355dff9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] 10.222.0.45 "GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685" status: 200 len: 1464 microversion: 2.1 time: 0.147435 Aug 24 12:34:40.543413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 273/539] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:40 2022] GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685 => generated 1464 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:40.586313 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9f9fda1a-400d-461e-a954-932873f8b379 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:40.586834 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9f9fda1a-400d-461e-a954-932873f8b379 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] [instance: ac2c7aaa-a21e-4663-ab27-655cfb1ef685] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:40.592571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9f9fda1a-400d-461e-a954-932873f8b379 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:40.593048 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9f9fda1a-400d-461e-a954-932873f8b379 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:40.593476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9f9fda1a-400d-461e-a954-932873f8b379 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:40.594149 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9f9fda1a-400d-461e-a954-932873f8b379 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:40.594594 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9f9fda1a-400d-461e-a954-932873f8b379 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:40.595039 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9f9fda1a-400d-461e-a954-932873f8b379 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:40.619325 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9f9fda1a-400d-461e-a954-932873f8b379 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] [instance: ac2c7aaa-a21e-4663-ab27-655cfb1ef685] Going to try to terminate instance {{(pid=121170) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:34:40.885915 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9f9fda1a-400d-461e-a954-932873f8b379 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685" status: 204 len: 0 microversion: 2.1 time: 0.303003 Aug 24 12:34:40.886497 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 267/540] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 12:34:40 2022] DELETE /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:34:40.894685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-afa14cbb-8964-440f-80fa-58173318d676 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:40.895314 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-afa14cbb-8964-440f-80fa-58173318d676 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] [instance: ac2c7aaa-a21e-4663-ab27-655cfb1ef685] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:40.901578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-afa14cbb-8964-440f-80fa-58173318d676 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:40.902050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-afa14cbb-8964-440f-80fa-58173318d676 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:40.902473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-afa14cbb-8964-440f-80fa-58173318d676 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:40.903168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-afa14cbb-8964-440f-80fa-58173318d676 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:40.903611 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-afa14cbb-8964-440f-80fa-58173318d676 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:40.904024 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-afa14cbb-8964-440f-80fa-58173318d676 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:41.033613 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-afa14cbb-8964-440f-80fa-58173318d676 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c442e73a4d32487c95fe4e77e58cdc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947a3ce621a44edbbf2ea57ce77ac101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:41.041233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-afa14cbb-8964-440f-80fa-58173318d676 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] 10.222.0.45 "GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685" status: 200 len: 1470 microversion: 2.1 time: 0.150382 Aug 24 12:34:41.041791 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 274/541] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:40 2022] GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685 => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:41.057770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-82d94cad-da79-4604-b45f-399fee801ce5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:41.058499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-82d94cad-da79-4604-b45f-399fee801ce5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:41.065342 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-82d94cad-da79-4604-b45f-399fee801ce5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:41.065827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-82d94cad-da79-4604-b45f-399fee801ce5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:41.066262 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-82d94cad-da79-4604-b45f-399fee801ce5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:41.066976 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-82d94cad-da79-4604-b45f-399fee801ce5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:41.067437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-82d94cad-da79-4604-b45f-399fee801ce5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:41.067862 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-82d94cad-da79-4604-b45f-399fee801ce5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:41.085734 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:41.200779 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-82d94cad-da79-4604-b45f-399fee801ce5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:41.205285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f584f8e9-3d81-430f-8105-51b89140aed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:41.205891 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f584f8e9-3d81-430f-8105-51b89140aed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:41.209382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-82d94cad-da79-4604-b45f-399fee801ce5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:41.210916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-82d94cad-da79-4604-b45f-399fee801ce5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:41.211639 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f584f8e9-3d81-430f-8105-51b89140aed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:41.212080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-82d94cad-da79-4604-b45f-399fee801ce5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1745 microversion: 2.20 time: 0.158581 Aug 24 12:34:41.212190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f584f8e9-3d81-430f-8105-51b89140aed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:41.212530 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f584f8e9-3d81-430f-8105-51b89140aed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:41.212626 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 268/542] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:41 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:41.213209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f584f8e9-3d81-430f-8105-51b89140aed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:41.213888 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f584f8e9-3d81-430f-8105-51b89140aed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:41.214078 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f584f8e9-3d81-430f-8105-51b89140aed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:41.340533 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f584f8e9-3d81-430f-8105-51b89140aed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:41.343997 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:41.348980 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f584f8e9-3d81-430f-8105-51b89140aed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1722 microversion: 2.1 time: 0.148223 Aug 24 12:34:41.349529 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 275/543] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:41 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:42.061395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-53c43648-234a-4372-8318-b48fca2766b9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:42.062058 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-53c43648-234a-4372-8318-b48fca2766b9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] [instance: ac2c7aaa-a21e-4663-ab27-655cfb1ef685] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:42.069099 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-53c43648-234a-4372-8318-b48fca2766b9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:42.069582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-53c43648-234a-4372-8318-b48fca2766b9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:42.070022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-53c43648-234a-4372-8318-b48fca2766b9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:42.070738 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-53c43648-234a-4372-8318-b48fca2766b9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:42.071204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-53c43648-234a-4372-8318-b48fca2766b9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:42.071628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-53c43648-234a-4372-8318-b48fca2766b9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:42.198266 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-53c43648-234a-4372-8318-b48fca2766b9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c442e73a4d32487c95fe4e77e58cdc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947a3ce621a44edbbf2ea57ce77ac101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:42.205927 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-53c43648-234a-4372-8318-b48fca2766b9 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] 10.222.0.45 "GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685" status: 200 len: 1470 microversion: 2.1 time: 0.148521 Aug 24 12:34:42.206487 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 269/544] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:42 2022] GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685 => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:42.235685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3e6b6401-4c1c-4f0b-9de5-914238b4627a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:42.236286 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3e6b6401-4c1c-4f0b-9de5-914238b4627a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:42.243405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e6b6401-4c1c-4f0b-9de5-914238b4627a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:42.243885 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e6b6401-4c1c-4f0b-9de5-914238b4627a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:42.244319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e6b6401-4c1c-4f0b-9de5-914238b4627a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:42.245002 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e6b6401-4c1c-4f0b-9de5-914238b4627a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:42.245454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e6b6401-4c1c-4f0b-9de5-914238b4627a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:42.245875 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e6b6401-4c1c-4f0b-9de5-914238b4627a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:42.371080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2a73b7af-ce81-4844-ab8b-f66b051f4f96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:42.371695 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2a73b7af-ce81-4844-ab8b-f66b051f4f96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:42.377033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3e6b6401-4c1c-4f0b-9de5-914238b4627a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:42.377691 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a73b7af-ce81-4844-ab8b-f66b051f4f96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:42.378186 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a73b7af-ce81-4844-ab8b-f66b051f4f96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:42.378618 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a73b7af-ce81-4844-ab8b-f66b051f4f96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:42.379342 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a73b7af-ce81-4844-ab8b-f66b051f4f96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:42.379802 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a73b7af-ce81-4844-ab8b-f66b051f4f96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:42.380230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a73b7af-ce81-4844-ab8b-f66b051f4f96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:42.385326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3e6b6401-4c1c-4f0b-9de5-914238b4627a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:42.386841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3e6b6401-4c1c-4f0b-9de5-914238b4627a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:42.387992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3e6b6401-4c1c-4f0b-9de5-914238b4627a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1745 microversion: 2.20 time: 0.156767 Aug 24 12:34:42.388539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 276/545] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:42 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:42.514240 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2a73b7af-ce81-4844-ab8b-f66b051f4f96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:42.522555 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2a73b7af-ce81-4844-ab8b-f66b051f4f96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1722 microversion: 2.1 time: 0.155501 Aug 24 12:34:42.523143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 270/546] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:42 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:43.228143 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-12c1f2b6-3c75-4f28-a6a7-33cd0564ce7d tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:43.228858 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-12c1f2b6-3c75-4f28-a6a7-33cd0564ce7d tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] [instance: ac2c7aaa-a21e-4663-ab27-655cfb1ef685] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:43.235955 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12c1f2b6-3c75-4f28-a6a7-33cd0564ce7d tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:43.236550 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12c1f2b6-3c75-4f28-a6a7-33cd0564ce7d tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:43.236861 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12c1f2b6-3c75-4f28-a6a7-33cd0564ce7d tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:43.237665 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12c1f2b6-3c75-4f28-a6a7-33cd0564ce7d tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:43.238119 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12c1f2b6-3c75-4f28-a6a7-33cd0564ce7d tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:43.238774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12c1f2b6-3c75-4f28-a6a7-33cd0564ce7d tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:43.403784 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-12c1f2b6-3c75-4f28-a6a7-33cd0564ce7d tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c442e73a4d32487c95fe4e77e58cdc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947a3ce621a44edbbf2ea57ce77ac101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:43.429352 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-12c1f2b6-3c75-4f28-a6a7-33cd0564ce7d tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] 10.222.0.45 "GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685" status: 200 len: 1470 microversion: 2.1 time: 0.189780 Aug 24 12:34:43.429352 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 277/547] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:43 2022] GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685 => generated 1470 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:43.441188 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-787ac0a7-2329-4ecf-8f2f-293dfb2d8add tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:43.442013 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-787ac0a7-2329-4ecf-8f2f-293dfb2d8add tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:43.463021 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-787ac0a7-2329-4ecf-8f2f-293dfb2d8add tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:43.463807 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-787ac0a7-2329-4ecf-8f2f-293dfb2d8add tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:43.464427 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-787ac0a7-2329-4ecf-8f2f-293dfb2d8add tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:43.465403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-787ac0a7-2329-4ecf-8f2f-293dfb2d8add tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:43.466185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-787ac0a7-2329-4ecf-8f2f-293dfb2d8add tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:43.467682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-787ac0a7-2329-4ecf-8f2f-293dfb2d8add tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:43.545371 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0903ea1a-f1d9-462a-a059-efdf5d15b09e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:43.548011 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0903ea1a-f1d9-462a-a059-efdf5d15b09e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:43.559155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0903ea1a-f1d9-462a-a059-efdf5d15b09e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:43.560498 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0903ea1a-f1d9-462a-a059-efdf5d15b09e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:43.561124 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0903ea1a-f1d9-462a-a059-efdf5d15b09e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:43.563716 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0903ea1a-f1d9-462a-a059-efdf5d15b09e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:43.566302 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0903ea1a-f1d9-462a-a059-efdf5d15b09e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:43.566932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0903ea1a-f1d9-462a-a059-efdf5d15b09e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:43.683223 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-787ac0a7-2329-4ecf-8f2f-293dfb2d8add tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:43.696396 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-787ac0a7-2329-4ecf-8f2f-293dfb2d8add tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:43.700863 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-787ac0a7-2329-4ecf-8f2f-293dfb2d8add tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:43.715302 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-787ac0a7-2329-4ecf-8f2f-293dfb2d8add tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1740 microversion: 2.20 time: 0.293640 Aug 24 12:34:43.715302 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 271/548] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:43 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1740 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:43.715302 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-cc11ecab-1e14-4ee7-a46d-28c2490ce091 req-0eb667ce-2cf2-40e9-9840-c03a574793fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2c7aaa-a21e-4663-ab27-655cfb1ef685", "name": "network-vif-deleted", "tag": "9cf85f9e-b41d-40ad-85d5-96956236f62f"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:43.749072 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-cc11ecab-1e14-4ee7-a46d-28c2490ce091 req-0eb667ce-2cf2-40e9-9840-c03a574793fc service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:43.749597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-cc11ecab-1e14-4ee7-a46d-28c2490ce091 req-0eb667ce-2cf2-40e9-9840-c03a574793fc service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:43.750598 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-cc11ecab-1e14-4ee7-a46d-28c2490ce091 req-0eb667ce-2cf2-40e9-9840-c03a574793fc service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:43.772478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-cc11ecab-1e14-4ee7-a46d-28c2490ce091 req-0eb667ce-2cf2-40e9-9840-c03a574793fc service nova] Creating event network-vif-deleted:9cf85f9e-b41d-40ad-85d5-96956236f62f for instance ac2c7aaa-a21e-4663-ab27-655cfb1ef685 on hv-cinder-84889 Aug 24 12:34:43.780782 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-cc11ecab-1e14-4ee7-a46d-28c2490ce091 req-0eb667ce-2cf2-40e9-9840-c03a574793fc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074224 Aug 24 12:34:43.781936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 272/549] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:43.822021 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0903ea1a-f1d9-462a-a059-efdf5d15b09e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:43.830916 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0903ea1a-f1d9-462a-a059-efdf5d15b09e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1722 microversion: 2.1 time: 0.290462 Aug 24 12:34:43.835250 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 278/550] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:43 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1722 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:44.446404 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0a1db2c8-e59b-4836-8bf9-a2c8479ff112 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:44.447221 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0a1db2c8-e59b-4836-8bf9-a2c8479ff112 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] [instance: ac2c7aaa-a21e-4663-ab27-655cfb1ef685] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:44.455526 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a1db2c8-e59b-4836-8bf9-a2c8479ff112 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:44.456040 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a1db2c8-e59b-4836-8bf9-a2c8479ff112 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:44.456751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a1db2c8-e59b-4836-8bf9-a2c8479ff112 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:44.457621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a1db2c8-e59b-4836-8bf9-a2c8479ff112 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:44.458267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a1db2c8-e59b-4836-8bf9-a2c8479ff112 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:44.458888 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a1db2c8-e59b-4836-8bf9-a2c8479ff112 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:44.498419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a1db2c8-e59b-4836-8bf9-a2c8479ff112 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:44.499175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a1db2c8-e59b-4836-8bf9-a2c8479ff112 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:44.499802 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a1db2c8-e59b-4836-8bf9-a2c8479ff112 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:44.500470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.objects.instance [None req-0a1db2c8-e59b-4836-8bf9-a2c8479ff112 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lazy-loading 'fault' on Instance uuid ac2c7aaa-a21e-4663-ab27-655cfb1ef685 {{(pid=121170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:34:44.550108 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0a1db2c8-e59b-4836-8bf9-a2c8479ff112 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c442e73a4d32487c95fe4e77e58cdc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947a3ce621a44edbbf2ea57ce77ac101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:44.558225 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0a1db2c8-e59b-4836-8bf9-a2c8479ff112 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] 10.222.0.45 "GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685" status: 200 len: 1304 microversion: 2.1 time: 0.116506 Aug 24 12:34:44.559170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 273/551] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:44 2022] GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685 => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:44.728248 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fc3a8af3-5dee-42d1-bfd6-4ad43fee656d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:44.729733 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fc3a8af3-5dee-42d1-bfd6-4ad43fee656d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:44.741666 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc3a8af3-5dee-42d1-bfd6-4ad43fee656d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:44.742419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc3a8af3-5dee-42d1-bfd6-4ad43fee656d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:44.743095 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc3a8af3-5dee-42d1-bfd6-4ad43fee656d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:44.744021 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc3a8af3-5dee-42d1-bfd6-4ad43fee656d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:44.744647 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc3a8af3-5dee-42d1-bfd6-4ad43fee656d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:44.745264 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc3a8af3-5dee-42d1-bfd6-4ad43fee656d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:44.852809 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9a17526b-256c-444d-a870-56282e909cc6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:44.855857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9a17526b-256c-444d-a870-56282e909cc6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:44.861839 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a17526b-256c-444d-a870-56282e909cc6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:44.862587 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a17526b-256c-444d-a870-56282e909cc6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:44.863296 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a17526b-256c-444d-a870-56282e909cc6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:44.864436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a17526b-256c-444d-a870-56282e909cc6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:44.865056 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a17526b-256c-444d-a870-56282e909cc6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:44.865639 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a17526b-256c-444d-a870-56282e909cc6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:44.908369 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fc3a8af3-5dee-42d1-bfd6-4ad43fee656d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:44.928711 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fc3a8af3-5dee-42d1-bfd6-4ad43fee656d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:44.936818 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fc3a8af3-5dee-42d1-bfd6-4ad43fee656d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:44.936818 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fc3a8af3-5dee-42d1-bfd6-4ad43fee656d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1740 microversion: 2.20 time: 0.207800 Aug 24 12:34:44.936818 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 279/552] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:44 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:34:45.114774 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9a17526b-256c-444d-a870-56282e909cc6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:45.127683 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9a17526b-256c-444d-a870-56282e909cc6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1722 microversion: 2.1 time: 0.278640 Aug 24 12:34:45.145374 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 274/553] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:44 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:45.583558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a59869ff-a7b3-49b2-ae0d-b59fd3e019d4 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:45.584142 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a59869ff-a7b3-49b2-ae0d-b59fd3e019d4 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] [instance: ac2c7aaa-a21e-4663-ab27-655cfb1ef685] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:45.590190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a59869ff-a7b3-49b2-ae0d-b59fd3e019d4 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:45.590695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a59869ff-a7b3-49b2-ae0d-b59fd3e019d4 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:45.591134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a59869ff-a7b3-49b2-ae0d-b59fd3e019d4 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:45.591811 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a59869ff-a7b3-49b2-ae0d-b59fd3e019d4 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:45.592258 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a59869ff-a7b3-49b2-ae0d-b59fd3e019d4 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:45.592682 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a59869ff-a7b3-49b2-ae0d-b59fd3e019d4 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:45.605990 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.wsgi [None req-a59869ff-a7b3-49b2-ae0d-b59fd3e019d4 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] HTTP exception thrown: Instance ac2c7aaa-a21e-4663-ab27-655cfb1ef685 could not be found. Aug 24 12:34:45.607813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a59869ff-a7b3-49b2-ae0d-b59fd3e019d4 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Request method failure captured: Aug 24 12:34:45.607813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: request: GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685 HTTP/1.1 Aug 24 12:34:45.607813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept: application/json Aug 24 12:34:45.607813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept-Encoding: identity Aug 24 12:34:45.607813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Connection: close Aug 24 12:34:45.607813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Length: 0 Aug 24 12:34:45.607813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Type: application/json Aug 24 12:34:45.607813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Host: 10.222.0.45 Aug 24 12:34:45.607813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Openstack-System-Scope: None Aug 24 12:34:45.607813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: User-Agent: python-urllib3/1.26.11 Aug 24 12:34:45.607813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Auth-Token: gAAAAABjBhrL-LZmxmNfKCFq5i5nRn9VLrs0cMftw-BJzeU3RifQoxstRMuN9_zu_L-VGhmgDZ1gjwa9vzgZFVZ18hdnyTN0HfMf5MAHGBTYbj81pucmF-Og-7Kj1IeWy7Mmjz9NfBs-4bZkOzAO3y1TXwh6AeRs-4dwcreroi6lYSldQxcttHg Aug 24 12:34:45.607813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Id: None Aug 24 12:34:45.607813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Name: None Aug 24 12:34:45.607813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Identity-Status: Confirmed Aug 24 12:34:45.607813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Is-Admin-Project: True Aug 24 12:34:45.607813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Id: default Aug 24 12:34:45.607813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Name: Default Aug 24 12:34:45.607813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Id: 947a3ce621a44edbbf2ea57ce77ac101 Aug 24 12:34:45.607813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Name: tempest-VolumesNegativeTest-2145953888 Aug 24 12:34:45.607813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Role: member,reader Aug 24 12:34:45.607813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Roles: member,reader Aug 24 12:34:45.609169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_947a3ce621a44edbbf2ea57ce77ac101"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/947a3ce621a44edbbf2ea57ce77ac101"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/947a3ce621a44edbbf2ea57ce77ac101"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/947a3ce621a44edbbf2ea57ce77ac101"}]}] Aug 24 12:34:45.609169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant: tempest-VolumesNegativeTest-2145953888 Aug 24 12:34:45.609169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Id: 947a3ce621a44edbbf2ea57ce77ac101 Aug 24 12:34:45.609169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Name: tempest-VolumesNegativeTest-2145953888 Aug 24 12:34:45.609169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User: tempest-VolumesNegativeTest-2145953888-project Aug 24 12:34:45.609169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Id: default Aug 24 12:34:45.609169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Name: Default Aug 24 12:34:45.609169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Id: c442e73a4d32487c95fe4e77e58cdc28 Aug 24 12:34:45.609169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Name: tempest-VolumesNegativeTest-2145953888-project Aug 24 12:34:45.609169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: method: > Aug 24 12:34:45.609169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: exception: Instance ac2c7aaa-a21e-4663-ab27-655cfb1ef685 could not be found. Aug 24 12:34:45.609169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: action_args: {'id': 'ac2c7aaa-a21e-4663-ab27-655cfb1ef685'} Aug 24 12:34:45.609985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:34:45.609985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:34:45.609985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:34:45.609985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:34:45.609985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:34:45.609985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:34:45.609985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:34:45.609985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:34:45.609985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:34:45.609985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:34:45.609985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac2c7aaa-a21e-4663-ab27-655cfb1ef685 could not be found. Aug 24 12:34:45.609985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:34:45.609985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:34:45.609985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:34:45.609985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:34:45.609985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:34:45.609985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:34:45.609985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:34:45.609985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:34:45.609985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:34:45.612202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:34:45.612202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:34:45.612202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:34:45.612202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:34:45.612202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:34:45.612202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:34:45.612202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:34:45.612202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac2c7aaa-a21e-4663-ab27-655cfb1ef685 could not be found. Aug 24 12:34:45.612202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:34:45.612202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:34:45.612202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:34:45.612202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:34:45.612202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:34:45.612202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:34:45.612202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:34:45.612202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:34:45.612202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac2c7aaa-a21e-4663-ab27-655cfb1ef685 could not be found. Aug 24 12:34:45.612202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:34:45.613329 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a59869ff-a7b3-49b2-ae0d-b59fd3e019d4 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] Returning 404 to user: Instance ac2c7aaa-a21e-4663-ab27-655cfb1ef685 could not be found. {{(pid=121171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:34:45.613329 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a59869ff-a7b3-49b2-ae0d-b59fd3e019d4 tempest-VolumesNegativeTest-2145953888 tempest-VolumesNegativeTest-2145953888-project] 10.222.0.45 "GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685" status: 404 len: 111 microversion: 2.1 time: 0.029546 Aug 24 12:34:45.613329 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 280/554] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:45 2022] GET /compute/v2.1/servers/ac2c7aaa-a21e-4663-ab27-655cfb1ef685 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:34:45.955345 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-35adb561-8009-44ef-a7eb-a263d0387496 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:45.956877 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-35adb561-8009-44ef-a7eb-a263d0387496 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:45.966196 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35adb561-8009-44ef-a7eb-a263d0387496 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:45.967671 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35adb561-8009-44ef-a7eb-a263d0387496 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:45.968436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35adb561-8009-44ef-a7eb-a263d0387496 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:45.969446 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35adb561-8009-44ef-a7eb-a263d0387496 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:45.970164 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35adb561-8009-44ef-a7eb-a263d0387496 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:45.970855 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35adb561-8009-44ef-a7eb-a263d0387496 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:46.144685 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-35adb561-8009-44ef-a7eb-a263d0387496 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:46.154372 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b5c925e7-b1ea-4d1b-bae4-fdeb5b945487 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:46.155005 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b5c925e7-b1ea-4d1b-bae4-fdeb5b945487 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:46.157399 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-35adb561-8009-44ef-a7eb-a263d0387496 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:46.159026 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-35adb561-8009-44ef-a7eb-a263d0387496 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:46.160547 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-35adb561-8009-44ef-a7eb-a263d0387496 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1740 microversion: 2.20 time: 0.209430 Aug 24 12:34:46.161244 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 275/555] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:45 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:46.162183 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b5c925e7-b1ea-4d1b-bae4-fdeb5b945487 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:46.162721 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b5c925e7-b1ea-4d1b-bae4-fdeb5b945487 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:46.163505 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b5c925e7-b1ea-4d1b-bae4-fdeb5b945487 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:46.164142 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b5c925e7-b1ea-4d1b-bae4-fdeb5b945487 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:46.164620 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b5c925e7-b1ea-4d1b-bae4-fdeb5b945487 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:46.165051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b5c925e7-b1ea-4d1b-bae4-fdeb5b945487 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:46.306579 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b5c925e7-b1ea-4d1b-bae4-fdeb5b945487 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:46.314722 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b5c925e7-b1ea-4d1b-bae4-fdeb5b945487 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1722 microversion: 2.1 time: 0.165599 Aug 24 12:34:46.315299 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 281/556] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:46 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:47.186439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-afa52a94-c8c6-4b08-ac1c-4389cd63a357 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:47.187034 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-afa52a94-c8c6-4b08-ac1c-4389cd63a357 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:47.195433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-afa52a94-c8c6-4b08-ac1c-4389cd63a357 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:47.203792 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-afa52a94-c8c6-4b08-ac1c-4389cd63a357 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:47.204793 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-afa52a94-c8c6-4b08-ac1c-4389cd63a357 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:47.205772 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-afa52a94-c8c6-4b08-ac1c-4389cd63a357 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:47.206457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-afa52a94-c8c6-4b08-ac1c-4389cd63a357 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:47.207116 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-afa52a94-c8c6-4b08-ac1c-4389cd63a357 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:47.338923 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-82a9bee7-e8b4-4a83-91c0-5e1b55c40423 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:47.341044 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-82a9bee7-e8b4-4a83-91c0-5e1b55c40423 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:47.351040 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82a9bee7-e8b4-4a83-91c0-5e1b55c40423 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:47.351722 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82a9bee7-e8b4-4a83-91c0-5e1b55c40423 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:47.352406 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82a9bee7-e8b4-4a83-91c0-5e1b55c40423 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:47.353338 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82a9bee7-e8b4-4a83-91c0-5e1b55c40423 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:47.354256 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82a9bee7-e8b4-4a83-91c0-5e1b55c40423 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:47.355098 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82a9bee7-e8b4-4a83-91c0-5e1b55c40423 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:47.376949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-afa52a94-c8c6-4b08-ac1c-4389cd63a357 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:47.386796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-afa52a94-c8c6-4b08-ac1c-4389cd63a357 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:47.388442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-afa52a94-c8c6-4b08-ac1c-4389cd63a357 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:47.389870 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-afa52a94-c8c6-4b08-ac1c-4389cd63a357 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1740 microversion: 2.20 time: 0.208893 Aug 24 12:34:47.391181 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 276/557] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:47 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:47.552275 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-82a9bee7-e8b4-4a83-91c0-5e1b55c40423 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:47.563487 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-82a9bee7-e8b4-4a83-91c0-5e1b55c40423 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1722 microversion: 2.1 time: 0.228944 Aug 24 12:34:47.565013 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 282/558] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:47 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:48.415306 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2eb18eb3-0c97-4494-b4ec-b7172e5bc8a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:48.416849 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2eb18eb3-0c97-4494-b4ec-b7172e5bc8a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:48.428513 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2eb18eb3-0c97-4494-b4ec-b7172e5bc8a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:48.429345 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2eb18eb3-0c97-4494-b4ec-b7172e5bc8a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:48.430785 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2eb18eb3-0c97-4494-b4ec-b7172e5bc8a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:48.431672 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2eb18eb3-0c97-4494-b4ec-b7172e5bc8a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:48.432401 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2eb18eb3-0c97-4494-b4ec-b7172e5bc8a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:48.433191 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2eb18eb3-0c97-4494-b4ec-b7172e5bc8a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:48.585363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b203bba6-9d16-4e8f-bd06-6a9ddffd6cd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:48.585950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b203bba6-9d16-4e8f-bd06-6a9ddffd6cd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:48.595797 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b203bba6-9d16-4e8f-bd06-6a9ddffd6cd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:48.598473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b203bba6-9d16-4e8f-bd06-6a9ddffd6cd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:48.598962 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b203bba6-9d16-4e8f-bd06-6a9ddffd6cd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:48.599891 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b203bba6-9d16-4e8f-bd06-6a9ddffd6cd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:48.600645 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b203bba6-9d16-4e8f-bd06-6a9ddffd6cd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:48.601292 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b203bba6-9d16-4e8f-bd06-6a9ddffd6cd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:48.612399 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2eb18eb3-0c97-4494-b4ec-b7172e5bc8a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:48.622023 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2eb18eb3-0c97-4494-b4ec-b7172e5bc8a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:48.624131 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2eb18eb3-0c97-4494-b4ec-b7172e5bc8a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:48.629128 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2eb18eb3-0c97-4494-b4ec-b7172e5bc8a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1740 microversion: 2.20 time: 0.214669 Aug 24 12:34:48.629128 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 277/559] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:48 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1740 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:48.774705 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b203bba6-9d16-4e8f-bd06-6a9ddffd6cd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:48.785371 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b203bba6-9d16-4e8f-bd06-6a9ddffd6cd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1722 microversion: 2.1 time: 0.203721 Aug 24 12:34:48.791500 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 283/560] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:48 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:49.654847 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ae385bc7-d839-407e-99ad-2059e48ebc5e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:49.655514 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ae385bc7-d839-407e-99ad-2059e48ebc5e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:49.662690 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae385bc7-d839-407e-99ad-2059e48ebc5e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:49.663182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae385bc7-d839-407e-99ad-2059e48ebc5e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:49.663620 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae385bc7-d839-407e-99ad-2059e48ebc5e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:49.664351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae385bc7-d839-407e-99ad-2059e48ebc5e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:49.664806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae385bc7-d839-407e-99ad-2059e48ebc5e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:49.665233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae385bc7-d839-407e-99ad-2059e48ebc5e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:49.799427 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ae385bc7-d839-407e-99ad-2059e48ebc5e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:49.805903 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6816fd50-44c1-4dc8-9c0b-f529509db23f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:49.806771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6816fd50-44c1-4dc8-9c0b-f529509db23f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:49.807485 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ae385bc7-d839-407e-99ad-2059e48ebc5e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:49.808969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ae385bc7-d839-407e-99ad-2059e48ebc5e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:49.810109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ae385bc7-d839-407e-99ad-2059e48ebc5e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1740 microversion: 2.20 time: 0.164870 Aug 24 12:34:49.810667 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 278/561] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:49 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:49.813980 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6816fd50-44c1-4dc8-9c0b-f529509db23f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:49.814540 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6816fd50-44c1-4dc8-9c0b-f529509db23f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:49.815012 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6816fd50-44c1-4dc8-9c0b-f529509db23f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:49.815702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6816fd50-44c1-4dc8-9c0b-f529509db23f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:49.816161 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6816fd50-44c1-4dc8-9c0b-f529509db23f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:49.816614 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6816fd50-44c1-4dc8-9c0b-f529509db23f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:49.972594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6816fd50-44c1-4dc8-9c0b-f529509db23f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:49.980938 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6816fd50-44c1-4dc8-9c0b-f529509db23f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1722 microversion: 2.1 time: 0.178800 Aug 24 12:34:49.981496 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 284/562] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:49 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:50.834689 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2a40f5f7-34fb-44b3-9c4c-3e54ff5b2ecd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:50.836240 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2a40f5f7-34fb-44b3-9c4c-3e54ff5b2ecd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:50.845058 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a40f5f7-34fb-44b3-9c4c-3e54ff5b2ecd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:50.845975 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a40f5f7-34fb-44b3-9c4c-3e54ff5b2ecd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:50.846799 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a40f5f7-34fb-44b3-9c4c-3e54ff5b2ecd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:50.847917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a40f5f7-34fb-44b3-9c4c-3e54ff5b2ecd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:50.848639 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a40f5f7-34fb-44b3-9c4c-3e54ff5b2ecd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:50.849433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a40f5f7-34fb-44b3-9c4c-3e54ff5b2ecd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:51.003603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6748fb39-1cf1-467b-8c0b-07d7564c3e95 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:51.004229 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6748fb39-1cf1-467b-8c0b-07d7564c3e95 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:51.016176 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6748fb39-1cf1-467b-8c0b-07d7564c3e95 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:51.016689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6748fb39-1cf1-467b-8c0b-07d7564c3e95 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:51.017132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6748fb39-1cf1-467b-8c0b-07d7564c3e95 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:51.017859 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6748fb39-1cf1-467b-8c0b-07d7564c3e95 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:51.018321 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6748fb39-1cf1-467b-8c0b-07d7564c3e95 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:51.023943 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6748fb39-1cf1-467b-8c0b-07d7564c3e95 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:51.246466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2a40f5f7-34fb-44b3-9c4c-3e54ff5b2ecd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:51.270305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2a40f5f7-34fb-44b3-9c4c-3e54ff5b2ecd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:51.271829 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2a40f5f7-34fb-44b3-9c4c-3e54ff5b2ecd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:51.274534 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2a40f5f7-34fb-44b3-9c4c-3e54ff5b2ecd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1740 microversion: 2.20 time: 0.442960 Aug 24 12:34:51.289856 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 279/563] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:50 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1740 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:51.344554 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6748fb39-1cf1-467b-8c0b-07d7564c3e95 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:51.354222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6748fb39-1cf1-467b-8c0b-07d7564c3e95 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1722 microversion: 2.1 time: 0.354852 Aug 24 12:34:51.358182 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 285/564] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:50 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1722 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:52.304080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-44f4c85a-ca9a-4ed6-992a-3082328b4834 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:52.306264 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-44f4c85a-ca9a-4ed6-992a-3082328b4834 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:52.311521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:52.317195 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-44f4c85a-ca9a-4ed6-992a-3082328b4834 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:52.317684 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-44f4c85a-ca9a-4ed6-992a-3082328b4834 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:52.318369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-44f4c85a-ca9a-4ed6-992a-3082328b4834 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:52.319534 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-44f4c85a-ca9a-4ed6-992a-3082328b4834 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:52.320369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-44f4c85a-ca9a-4ed6-992a-3082328b4834 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:52.321210 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-44f4c85a-ca9a-4ed6-992a-3082328b4834 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:52.384277 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e098a12c-573c-406c-b7c5-7f84bca2eda4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:52.384880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e098a12c-573c-406c-b7c5-7f84bca2eda4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:52.392717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e098a12c-573c-406c-b7c5-7f84bca2eda4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:52.393430 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e098a12c-573c-406c-b7c5-7f84bca2eda4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:52.396737 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e098a12c-573c-406c-b7c5-7f84bca2eda4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:52.396737 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e098a12c-573c-406c-b7c5-7f84bca2eda4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:52.396737 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e098a12c-573c-406c-b7c5-7f84bca2eda4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:52.396737 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e098a12c-573c-406c-b7c5-7f84bca2eda4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:52.482253 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-44f4c85a-ca9a-4ed6-992a-3082328b4834 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:52.492377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-44f4c85a-ca9a-4ed6-992a-3082328b4834 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:52.494033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-44f4c85a-ca9a-4ed6-992a-3082328b4834 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:52.495416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-44f4c85a-ca9a-4ed6-992a-3082328b4834 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1740 microversion: 2.20 time: 0.197530 Aug 24 12:34:52.496334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 280/565] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:52 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:52.571905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e098a12c-573c-406c-b7c5-7f84bca2eda4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:52.580656 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e098a12c-573c-406c-b7c5-7f84bca2eda4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1699 microversion: 2.1 time: 0.201278 Aug 24 12:34:52.581211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 286/566] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:52 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1699 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:52.601628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ef300d95-8154-4686-bcf2-c14caec2709c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:52.607778 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef300d95-8154-4686-bcf2-c14caec2709c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:52.610764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef300d95-8154-4686-bcf2-c14caec2709c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:52.610764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef300d95-8154-4686-bcf2-c14caec2709c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:52.630278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ef300d95-8154-4686-bcf2-c14caec2709c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Going to try to start instance {{(pid=121170) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 12:34:52.806321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ef300d95-8154-4686-bcf2-c14caec2709c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "POST /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/action" status: 202 len: 0 microversion: 2.1 time: 0.208425 Aug 24 12:34:52.812967 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 281/567] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 12:34:52 2022] POST /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:34:52.825097 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a454332c-5508-4a84-b342-98fc974480cd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:52.826420 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a454332c-5508-4a84-b342-98fc974480cd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:52.839843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a454332c-5508-4a84-b342-98fc974480cd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:52.841384 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a454332c-5508-4a84-b342-98fc974480cd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:52.842208 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a454332c-5508-4a84-b342-98fc974480cd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:52.843803 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a454332c-5508-4a84-b342-98fc974480cd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:52.844903 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a454332c-5508-4a84-b342-98fc974480cd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:52.846045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a454332c-5508-4a84-b342-98fc974480cd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:53.155814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a454332c-5508-4a84-b342-98fc974480cd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:53.173981 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a454332c-5508-4a84-b342-98fc974480cd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1708 microversion: 2.1 time: 0.358165 Aug 24 12:34:53.199650 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 287/568] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:52 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1708 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:53.519582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-19c54503-0aea-4446-a24f-4a37683f9ac3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:53.520281 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-19c54503-0aea-4446-a24f-4a37683f9ac3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:53.526384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-19c54503-0aea-4446-a24f-4a37683f9ac3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:53.526912 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-19c54503-0aea-4446-a24f-4a37683f9ac3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:53.527384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-19c54503-0aea-4446-a24f-4a37683f9ac3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:53.528085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-19c54503-0aea-4446-a24f-4a37683f9ac3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:53.528542 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-19c54503-0aea-4446-a24f-4a37683f9ac3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:53.528969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-19c54503-0aea-4446-a24f-4a37683f9ac3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:53.677612 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-19c54503-0aea-4446-a24f-4a37683f9ac3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:53.686169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-19c54503-0aea-4446-a24f-4a37683f9ac3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:53.687690 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-19c54503-0aea-4446-a24f-4a37683f9ac3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:53.688850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-19c54503-0aea-4446-a24f-4a37683f9ac3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1740 microversion: 2.20 time: 0.174306 Aug 24 12:34:53.689405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 282/569] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:53 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:34:54.205979 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e47ea88d-1a80-4a9f-ad7c-e26c9660af93 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:54.206863 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e47ea88d-1a80-4a9f-ad7c-e26c9660af93 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:54.210466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=78 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:54.216265 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e47ea88d-1a80-4a9f-ad7c-e26c9660af93 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:54.217208 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e47ea88d-1a80-4a9f-ad7c-e26c9660af93 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:54.217843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e47ea88d-1a80-4a9f-ad7c-e26c9660af93 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:54.218673 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e47ea88d-1a80-4a9f-ad7c-e26c9660af93 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:54.219295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e47ea88d-1a80-4a9f-ad7c-e26c9660af93 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:54.219988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e47ea88d-1a80-4a9f-ad7c-e26c9660af93 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:54.406753 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e47ea88d-1a80-4a9f-ad7c-e26c9660af93 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:54.419654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e47ea88d-1a80-4a9f-ad7c-e26c9660af93 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1708 microversion: 2.1 time: 0.218428 Aug 24 12:34:54.420230 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 288/570] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:54 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1708 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:54.712006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-69056e72-d934-442c-8e64-a69ee65cc143 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:54.712615 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-69056e72-d934-442c-8e64-a69ee65cc143 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:54.719834 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-69056e72-d934-442c-8e64-a69ee65cc143 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:54.720315 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-69056e72-d934-442c-8e64-a69ee65cc143 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:54.720747 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-69056e72-d934-442c-8e64-a69ee65cc143 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:54.721441 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-69056e72-d934-442c-8e64-a69ee65cc143 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:54.721940 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-69056e72-d934-442c-8e64-a69ee65cc143 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:54.722439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-69056e72-d934-442c-8e64-a69ee65cc143 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:54.864009 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-69056e72-d934-442c-8e64-a69ee65cc143 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:54.872505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-69056e72-d934-442c-8e64-a69ee65cc143 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:54.873995 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-69056e72-d934-442c-8e64-a69ee65cc143 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:54.875213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-69056e72-d934-442c-8e64-a69ee65cc143 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1740 microversion: 2.20 time: 0.167306 Aug 24 12:34:54.875775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 283/571] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:54 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:55.440925 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-add07a45-bcef-4b6a-b473-d5ee0fcddf74 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:55.442338 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-add07a45-bcef-4b6a-b473-d5ee0fcddf74 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:55.447801 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-add07a45-bcef-4b6a-b473-d5ee0fcddf74 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:55.448273 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-add07a45-bcef-4b6a-b473-d5ee0fcddf74 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:55.448701 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-add07a45-bcef-4b6a-b473-d5ee0fcddf74 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:55.449374 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-add07a45-bcef-4b6a-b473-d5ee0fcddf74 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:55.449821 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-add07a45-bcef-4b6a-b473-d5ee0fcddf74 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:55.450236 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-add07a45-bcef-4b6a-b473-d5ee0fcddf74 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:55.586251 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-add07a45-bcef-4b6a-b473-d5ee0fcddf74 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:55.595146 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-add07a45-bcef-4b6a-b473-d5ee0fcddf74 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1712 microversion: 2.1 time: 0.157995 Aug 24 12:34:55.595803 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 289/572] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:55 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1712 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:55.901611 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4953fff4-dce7-4be5-a509-8594ca9d20a6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:55.902219 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4953fff4-dce7-4be5-a509-8594ca9d20a6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:55.908880 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4953fff4-dce7-4be5-a509-8594ca9d20a6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:55.909369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4953fff4-dce7-4be5-a509-8594ca9d20a6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:55.909806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4953fff4-dce7-4be5-a509-8594ca9d20a6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:55.910496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4953fff4-dce7-4be5-a509-8594ca9d20a6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:55.910992 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4953fff4-dce7-4be5-a509-8594ca9d20a6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:55.911415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4953fff4-dce7-4be5-a509-8594ca9d20a6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:55.929117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:56.048203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4953fff4-dce7-4be5-a509-8594ca9d20a6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:56.056676 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4953fff4-dce7-4be5-a509-8594ca9d20a6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:56.058247 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4953fff4-dce7-4be5-a509-8594ca9d20a6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:56.059659 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4953fff4-dce7-4be5-a509-8594ca9d20a6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1740 microversion: 2.20 time: 0.162118 Aug 24 12:34:56.060284 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 284/573] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:55 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:57.083568 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6a2c3502-3ad1-4d93-a79e-d5a60ee7eeb7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:57.084349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6a2c3502-3ad1-4d93-a79e-d5a60ee7eeb7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:57.091807 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6a2c3502-3ad1-4d93-a79e-d5a60ee7eeb7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:57.092679 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6a2c3502-3ad1-4d93-a79e-d5a60ee7eeb7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:57.093831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6a2c3502-3ad1-4d93-a79e-d5a60ee7eeb7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:57.094691 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6a2c3502-3ad1-4d93-a79e-d5a60ee7eeb7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:57.095215 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6a2c3502-3ad1-4d93-a79e-d5a60ee7eeb7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:57.095717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6a2c3502-3ad1-4d93-a79e-d5a60ee7eeb7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:57.236854 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6a2c3502-3ad1-4d93-a79e-d5a60ee7eeb7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:57.245560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6a2c3502-3ad1-4d93-a79e-d5a60ee7eeb7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:57.247084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6a2c3502-3ad1-4d93-a79e-d5a60ee7eeb7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:57.248246 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6a2c3502-3ad1-4d93-a79e-d5a60ee7eeb7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1722 microversion: 2.20 time: 0.168829 Aug 24 12:34:57.248796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 290/574] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:57 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:58.271283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c41d3ff1-7c6e-47a5-9723-b741a35c9b04 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:58.271896 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c41d3ff1-7c6e-47a5-9723-b741a35c9b04 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:58.279114 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c41d3ff1-7c6e-47a5-9723-b741a35c9b04 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:58.279597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c41d3ff1-7c6e-47a5-9723-b741a35c9b04 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:58.280075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c41d3ff1-7c6e-47a5-9723-b741a35c9b04 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:58.281267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c41d3ff1-7c6e-47a5-9723-b741a35c9b04 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:58.281766 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c41d3ff1-7c6e-47a5-9723-b741a35c9b04 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:58.282192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c41d3ff1-7c6e-47a5-9723-b741a35c9b04 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:58.413552 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c41d3ff1-7c6e-47a5-9723-b741a35c9b04 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:58.422499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c41d3ff1-7c6e-47a5-9723-b741a35c9b04 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:58.424034 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c41d3ff1-7c6e-47a5-9723-b741a35c9b04 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:58.425200 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c41d3ff1-7c6e-47a5-9723-b741a35c9b04 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1722 microversion: 2.20 time: 0.157968 Aug 24 12:34:58.425759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 285/575] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:58 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:59.105519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3717f8b3-74e1-4dfa-84a4-985e24474f74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-162374328", "imageRef": "62fcb2c8-bff4-46cf-9892-c43d7626629e", "flavorRef": "452", "networks": [{"uuid": "275993b4-0841-427c-adad-124460fa43d0"}]}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:59.158835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.network.neutron [None req-3717f8b3-74e1-4dfa-84a4-985e24474f74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] validate_networks() for [('275993b4-0841-427c-adad-124460fa43d0', None, None, None, None, None)] {{(pid=121171) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:34:59.448332 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f3edfcc6-3b94-4c34-8996-86cb1d0cdd90 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:59.449178 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f3edfcc6-3b94-4c34-8996-86cb1d0cdd90 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:59.455874 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3edfcc6-3b94-4c34-8996-86cb1d0cdd90 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:59.456442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3edfcc6-3b94-4c34-8996-86cb1d0cdd90 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:59.456989 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3edfcc6-3b94-4c34-8996-86cb1d0cdd90 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:59.457754 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3edfcc6-3b94-4c34-8996-86cb1d0cdd90 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:59.458285 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3edfcc6-3b94-4c34-8996-86cb1d0cdd90 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:59.458821 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3edfcc6-3b94-4c34-8996-86cb1d0cdd90 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:59.515515 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-3717f8b3-74e1-4dfa-84a4-985e24474f74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Flavor limits 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:34:59.515933 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-3717f8b3-74e1-4dfa-84a4-985e24474f74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Image limits 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:34:59.516435 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-3717f8b3-74e1-4dfa-84a4-985e24474f74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Flavor pref 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:34:59.516869 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-3717f8b3-74e1-4dfa-84a4-985e24474f74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Image pref 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:34:59.517273 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-3717f8b3-74e1-4dfa-84a4-985e24474f74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:34:59.526579 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3717f8b3-74e1-4dfa-84a4-985e24474f74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:59.532056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3717f8b3-74e1-4dfa-84a4-985e24474f74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:59.532056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3717f8b3-74e1-4dfa-84a4-985e24474f74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:59.532056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3717f8b3-74e1-4dfa-84a4-985e24474f74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:59.532056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3717f8b3-74e1-4dfa-84a4-985e24474f74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:59.532527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3717f8b3-74e1-4dfa-84a4-985e24474f74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:59.547142 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-3717f8b3-74e1-4dfa-84a4-985e24474f74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Getting quotas for project bba3be3dcc1f48afbf2c60f233b8032d. Resources: {'instances', 'cores', 'ram'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:34:59.551091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-3717f8b3-74e1-4dfa-84a4-985e24474f74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Getting quotas for user b19f208c6c274e7d89a7bf08f908871d and project bba3be3dcc1f48afbf2c60f233b8032d. Resources: {'instances', 'cores', 'ram'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:34:59.562115 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3717f8b3-74e1-4dfa-84a4-985e24474f74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Going to run 1 instances... {{(pid=121171) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:34:59.566804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3717f8b3-74e1-4dfa-84a4-985e24474f74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='62fcb2c8-bff4-46cf-9892-c43d7626629e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:34:59.600734 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f3edfcc6-3b94-4c34-8996-86cb1d0cdd90 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:59.609608 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f3edfcc6-3b94-4c34-8996-86cb1d0cdd90 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:59.611144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f3edfcc6-3b94-4c34-8996-86cb1d0cdd90 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:59.612478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f3edfcc6-3b94-4c34-8996-86cb1d0cdd90 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1725 microversion: 2.20 time: 0.168202 Aug 24 12:34:59.613049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 286/576] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:59 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:34:59.634544 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fdb4ff90-d891-4972-8436-a144d0736665 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ef1db7b-1b7c-4868-b6c3-cd06510c0d00"}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:59.636991 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fdb4ff90-d891-4972-8436-a144d0736665 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:59.642931 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fdb4ff90-d891-4972-8436-a144d0736665 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:59.643413 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fdb4ff90-d891-4972-8436-a144d0736665 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:59.646876 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fdb4ff90-d891-4972-8436-a144d0736665 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:59.646876 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fdb4ff90-d891-4972-8436-a144d0736665 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:59.646876 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fdb4ff90-d891-4972-8436-a144d0736665 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:59.646876 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fdb4ff90-d891-4972-8436-a144d0736665 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:59.679605 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3717f8b3-74e1-4dfa-84a4-985e24474f74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577766 Aug 24 12:34:59.680240 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 291/577] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 12:34:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:34:59.691202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3330269d-cfbb-45fd-8edc-7fe14f74661c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:59.691867 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3330269d-cfbb-45fd-8edc-7fe14f74661c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:59.753298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3330269d-cfbb-45fd-8edc-7fe14f74661c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:59.761183 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3330269d-cfbb-45fd-8edc-7fe14f74661c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1218 microversion: 2.1 time: 0.073963 Aug 24 12:34:59.761725 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 292/578] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:59 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:00.581825 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-120afd76-2a1b-46b6-a8da-6be9c545ff83 req-661d527d-0870-4454-9d87-6156e972bc30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e5a10ee-202a-453e-b3ff-6c5c05ec72f3", "name": "network-vif-unplugged", "status": "completed", "tag": "65aeb21b-342d-4c27-963d-8c021915548c"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:00.591909 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-120afd76-2a1b-46b6-a8da-6be9c545ff83 req-661d527d-0870-4454-9d87-6156e972bc30 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:00.592390 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-120afd76-2a1b-46b6-a8da-6be9c545ff83 req-661d527d-0870-4454-9d87-6156e972bc30 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:00.592825 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-120afd76-2a1b-46b6-a8da-6be9c545ff83 req-661d527d-0870-4454-9d87-6156e972bc30 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:00.604154 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.compute.server_external_events [req-120afd76-2a1b-46b6-a8da-6be9c545ff83 req-661d527d-0870-4454-9d87-6156e972bc30 service nova] Unable to find a host for instance 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3. Dropping event network-vif-unplugged {{(pid=121171) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 12:35:00.605017 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-120afd76-2a1b-46b6-a8da-6be9c545ff83 req-661d527d-0870-4454-9d87-6156e972bc30 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027207 Aug 24 12:35:00.605580 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 293/579] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 24 12:35:00.739814 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fdb4ff90-d891-4972-8436-a144d0736665 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "POST /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.108718 Aug 24 12:35:00.740466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 287/580] 10.222.0.45 () {62 vars in 1364 bytes} [Wed Aug 24 12:34:59 2022] POST /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 188 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:35:00.782043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-937c022c-c8ba-4245-ac74-f140d12b9ec1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:00.782974 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-937c022c-c8ba-4245-ac74-f140d12b9ec1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:00.834411 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-937c022c-c8ba-4245-ac74-f140d12b9ec1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:00.841469 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-937c022c-c8ba-4245-ac74-f140d12b9ec1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1218 microversion: 2.1 time: 0.064002 Aug 24 12:35:00.842028 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 294/581] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:00 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:00.865745 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-df22a79b-b999-456b-9945-ce02d0b57338 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:00.866335 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-df22a79b-b999-456b-9945-ce02d0b57338 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:00.872258 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df22a79b-b999-456b-9945-ce02d0b57338 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:00.872742 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df22a79b-b999-456b-9945-ce02d0b57338 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:00.873182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df22a79b-b999-456b-9945-ce02d0b57338 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:00.873878 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df22a79b-b999-456b-9945-ce02d0b57338 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:00.874335 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df22a79b-b999-456b-9945-ce02d0b57338 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:00.874798 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df22a79b-b999-456b-9945-ce02d0b57338 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:00.916492 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-df22a79b-b999-456b-9945-ce02d0b57338 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121170) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 12:35:01.262983 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-df22a79b-b999-456b-9945-ce02d0b57338 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "POST /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/action" status: 202 len: 0 microversion: 2.20 time: 0.401300 Aug 24 12:35:01.263785 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 288/582] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Aug 24 12:35:00 2022] POST /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:35:01.473343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3dd5a759-a2ef-46e5-a212-c3f66a021f9e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:01.474034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3dd5a759-a2ef-46e5-a212-c3f66a021f9e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:01.480445 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3dd5a759-a2ef-46e5-a212-c3f66a021f9e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:01.480967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3dd5a759-a2ef-46e5-a212-c3f66a021f9e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:01.485796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3dd5a759-a2ef-46e5-a212-c3f66a021f9e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:01.485796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3dd5a759-a2ef-46e5-a212-c3f66a021f9e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:01.485796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3dd5a759-a2ef-46e5-a212-c3f66a021f9e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:01.485796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3dd5a759-a2ef-46e5-a212-c3f66a021f9e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:01.695436 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3dd5a759-a2ef-46e5-a212-c3f66a021f9e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:01.703889 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3dd5a759-a2ef-46e5-a212-c3f66a021f9e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:01.705367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3dd5a759-a2ef-46e5-a212-c3f66a021f9e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:01.706554 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3dd5a759-a2ef-46e5-a212-c3f66a021f9e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1751 microversion: 2.20 time: 0.437928 Aug 24 12:35:01.707140 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 295/583] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:01 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1751 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:01.863736 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1eb86eaf-72f7-434b-bdc6-e713a9c3e3e9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:01.864611 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1eb86eaf-72f7-434b-bdc6-e713a9c3e3e9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:01.871684 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1eb86eaf-72f7-434b-bdc6-e713a9c3e3e9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:01.872176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1eb86eaf-72f7-434b-bdc6-e713a9c3e3e9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:01.872617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1eb86eaf-72f7-434b-bdc6-e713a9c3e3e9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:01.873308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1eb86eaf-72f7-434b-bdc6-e713a9c3e3e9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:01.873764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1eb86eaf-72f7-434b-bdc6-e713a9c3e3e9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:01.874192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1eb86eaf-72f7-434b-bdc6-e713a9c3e3e9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:01.964626 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1eb86eaf-72f7-434b-bdc6-e713a9c3e3e9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:01.972967 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1eb86eaf-72f7-434b-bdc6-e713a9c3e3e9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1270 microversion: 2.1 time: 0.114128 Aug 24 12:35:01.974265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 289/584] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:01 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1270 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:02.729717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9a9e19a2-8e3a-4669-830d-a557cabfc981 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:02.730447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9a9e19a2-8e3a-4669-830d-a557cabfc981 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:02.736940 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9a9e19a2-8e3a-4669-830d-a557cabfc981 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:02.737576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9a9e19a2-8e3a-4669-830d-a557cabfc981 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:02.738084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9a9e19a2-8e3a-4669-830d-a557cabfc981 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:02.738917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9a9e19a2-8e3a-4669-830d-a557cabfc981 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:02.739728 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9a9e19a2-8e3a-4669-830d-a557cabfc981 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:02.740222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9a9e19a2-8e3a-4669-830d-a557cabfc981 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:02.758599 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:02.914925 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9a9e19a2-8e3a-4669-830d-a557cabfc981 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:02.924392 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9a9e19a2-8e3a-4669-830d-a557cabfc981 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:02.925879 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9a9e19a2-8e3a-4669-830d-a557cabfc981 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:02.927091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9a9e19a2-8e3a-4669-830d-a557cabfc981 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1751 microversion: 2.20 time: 0.201558 Aug 24 12:35:02.927649 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 296/585] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:02 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1751 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:02.998874 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1df3512f-50a6-4316-b60d-49e71cea9d93 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:02.999456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1df3512f-50a6-4316-b60d-49e71cea9d93 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:03.007349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1df3512f-50a6-4316-b60d-49e71cea9d93 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:03.007905 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1df3512f-50a6-4316-b60d-49e71cea9d93 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:03.008424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1df3512f-50a6-4316-b60d-49e71cea9d93 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:03.009180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1df3512f-50a6-4316-b60d-49e71cea9d93 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:03.009858 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1df3512f-50a6-4316-b60d-49e71cea9d93 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:03.010616 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1df3512f-50a6-4316-b60d-49e71cea9d93 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:03.146626 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1df3512f-50a6-4316-b60d-49e71cea9d93 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:03.154604 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1df3512f-50a6-4316-b60d-49e71cea9d93 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1318 microversion: 2.1 time: 0.161528 Aug 24 12:35:03.155202 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 290/586] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:02 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:03.837316 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-6b23cc47-1488-4393-91c1-0550ba6ba6f0 req-caa2b56d-0240-4917-bb9c-de5094b12c84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9fbb4c1-a035-462e-b287-be4131984b09", "tag": "b27a0942-207a-439e-b81b-5254e8176d43"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:03.848018 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-6b23cc47-1488-4393-91c1-0550ba6ba6f0 req-caa2b56d-0240-4917-bb9c-de5094b12c84 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:03.848482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-6b23cc47-1488-4393-91c1-0550ba6ba6f0 req-caa2b56d-0240-4917-bb9c-de5094b12c84 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:03.848985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-6b23cc47-1488-4393-91c1-0550ba6ba6f0 req-caa2b56d-0240-4917-bb9c-de5094b12c84 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:03.861243 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-6b23cc47-1488-4393-91c1-0550ba6ba6f0 req-caa2b56d-0240-4917-bb9c-de5094b12c84 service nova] Creating event network-changed:b27a0942-207a-439e-b81b-5254e8176d43 for instance b9fbb4c1-a035-462e-b287-be4131984b09 on hv-cinder-84889 Aug 24 12:35:03.867313 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-6b23cc47-1488-4393-91c1-0550ba6ba6f0 req-caa2b56d-0240-4917-bb9c-de5094b12c84 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033072 Aug 24 12:35:03.867940 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 297/587] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:03.951372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1a8bc432-fec9-4fd1-839f-1d6f4b396be1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:03.952197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1a8bc432-fec9-4fd1-839f-1d6f4b396be1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:03.959147 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1a8bc432-fec9-4fd1-839f-1d6f4b396be1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:03.964095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1a8bc432-fec9-4fd1-839f-1d6f4b396be1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:03.964095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1a8bc432-fec9-4fd1-839f-1d6f4b396be1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:03.964095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1a8bc432-fec9-4fd1-839f-1d6f4b396be1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:03.964095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1a8bc432-fec9-4fd1-839f-1d6f4b396be1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:03.964459 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1a8bc432-fec9-4fd1-839f-1d6f4b396be1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:04.098299 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1a8bc432-fec9-4fd1-839f-1d6f4b396be1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:04.107216 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1a8bc432-fec9-4fd1-839f-1d6f4b396be1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:04.108768 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1a8bc432-fec9-4fd1-839f-1d6f4b396be1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:04.109916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1a8bc432-fec9-4fd1-839f-1d6f4b396be1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1753 microversion: 2.20 time: 0.162635 Aug 24 12:35:04.110465 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 291/588] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:03 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:04.180386 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-95c8a791-9b31-43f5-993e-2d488746353a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:04.181110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-95c8a791-9b31-43f5-993e-2d488746353a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:04.187796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-95c8a791-9b31-43f5-993e-2d488746353a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:04.188309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-95c8a791-9b31-43f5-993e-2d488746353a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:04.188742 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-95c8a791-9b31-43f5-993e-2d488746353a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:04.189415 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-95c8a791-9b31-43f5-993e-2d488746353a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:04.189869 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-95c8a791-9b31-43f5-993e-2d488746353a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:04.190287 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-95c8a791-9b31-43f5-993e-2d488746353a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:04.323425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-95c8a791-9b31-43f5-993e-2d488746353a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:04.331921 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-95c8a791-9b31-43f5-993e-2d488746353a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1318 microversion: 2.1 time: 0.155768 Aug 24 12:35:04.332513 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 298/589] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:04 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:05.133748 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dc2ef385-4f81-48fc-9d25-6566f2c338ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:05.135010 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dc2ef385-4f81-48fc-9d25-6566f2c338ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:05.141482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc2ef385-4f81-48fc-9d25-6566f2c338ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:05.142496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc2ef385-4f81-48fc-9d25-6566f2c338ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:05.142967 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc2ef385-4f81-48fc-9d25-6566f2c338ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:05.143662 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc2ef385-4f81-48fc-9d25-6566f2c338ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:05.144101 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc2ef385-4f81-48fc-9d25-6566f2c338ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:05.144518 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc2ef385-4f81-48fc-9d25-6566f2c338ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:05.273628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-dc2ef385-4f81-48fc-9d25-6566f2c338ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:05.282327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-dc2ef385-4f81-48fc-9d25-6566f2c338ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:05.283858 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-dc2ef385-4f81-48fc-9d25-6566f2c338ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:05.286645 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dc2ef385-4f81-48fc-9d25-6566f2c338ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1753 microversion: 2.20 time: 0.155235 Aug 24 12:35:05.286645 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 292/590] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:05 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:05.352768 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3af43b34-1460-4e8b-8b96-5bec8cf3e184 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:05.353372 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3af43b34-1460-4e8b-8b96-5bec8cf3e184 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:05.359819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3af43b34-1460-4e8b-8b96-5bec8cf3e184 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:05.360344 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3af43b34-1460-4e8b-8b96-5bec8cf3e184 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:05.360776 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3af43b34-1460-4e8b-8b96-5bec8cf3e184 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:05.361457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3af43b34-1460-4e8b-8b96-5bec8cf3e184 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:05.361908 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3af43b34-1460-4e8b-8b96-5bec8cf3e184 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:05.362328 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3af43b34-1460-4e8b-8b96-5bec8cf3e184 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:05.494859 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3af43b34-1460-4e8b-8b96-5bec8cf3e184 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:05.502526 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3af43b34-1460-4e8b-8b96-5bec8cf3e184 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1318 microversion: 2.1 time: 0.153620 Aug 24 12:35:05.503109 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 299/591] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:05 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:06.307408 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-65f57185-525f-4f31-9369-35fc3e9b54a4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:06.308006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-65f57185-525f-4f31-9369-35fc3e9b54a4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:06.314962 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-65f57185-525f-4f31-9369-35fc3e9b54a4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:06.315436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-65f57185-525f-4f31-9369-35fc3e9b54a4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:06.315866 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-65f57185-525f-4f31-9369-35fc3e9b54a4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:06.316546 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-65f57185-525f-4f31-9369-35fc3e9b54a4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:06.316995 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-65f57185-525f-4f31-9369-35fc3e9b54a4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:06.317414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-65f57185-525f-4f31-9369-35fc3e9b54a4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:06.443555 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-65f57185-525f-4f31-9369-35fc3e9b54a4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:06.452083 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-65f57185-525f-4f31-9369-35fc3e9b54a4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:06.453719 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-65f57185-525f-4f31-9369-35fc3e9b54a4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:06.454894 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-65f57185-525f-4f31-9369-35fc3e9b54a4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.151379 Aug 24 12:35:06.455449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 293/592] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:06 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:06.522627 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-223626a9-d91c-45a7-b171-b2b4b23603e6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:06.523254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-223626a9-d91c-45a7-b171-b2b4b23603e6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:06.529676 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-223626a9-d91c-45a7-b171-b2b4b23603e6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:06.530158 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-223626a9-d91c-45a7-b171-b2b4b23603e6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:06.530589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-223626a9-d91c-45a7-b171-b2b4b23603e6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:06.531324 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-223626a9-d91c-45a7-b171-b2b4b23603e6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:06.531804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-223626a9-d91c-45a7-b171-b2b4b23603e6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:06.532230 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-223626a9-d91c-45a7-b171-b2b4b23603e6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:06.658601 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-223626a9-d91c-45a7-b171-b2b4b23603e6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:06.666079 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-223626a9-d91c-45a7-b171-b2b4b23603e6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1318 microversion: 2.1 time: 0.147267 Aug 24 12:35:06.666632 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 300/593] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:06 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:07.477283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ff26504f-bc96-4fc6-b584-9dcca284ed32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:07.477885 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ff26504f-bc96-4fc6-b584-9dcca284ed32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:07.484321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ff26504f-bc96-4fc6-b584-9dcca284ed32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:07.484799 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ff26504f-bc96-4fc6-b584-9dcca284ed32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:07.485748 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ff26504f-bc96-4fc6-b584-9dcca284ed32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:07.486441 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ff26504f-bc96-4fc6-b584-9dcca284ed32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:07.486924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ff26504f-bc96-4fc6-b584-9dcca284ed32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:07.487349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ff26504f-bc96-4fc6-b584-9dcca284ed32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:07.615942 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ff26504f-bc96-4fc6-b584-9dcca284ed32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:07.624451 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ff26504f-bc96-4fc6-b584-9dcca284ed32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:07.626540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ff26504f-bc96-4fc6-b584-9dcca284ed32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:07.627713 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ff26504f-bc96-4fc6-b584-9dcca284ed32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.154364 Aug 24 12:35:07.628258 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 294/594] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:07 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:07.687246 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8b042ec0-2a7f-4dcd-acdd-16725281a818 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:07.687789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8b042ec0-2a7f-4dcd-acdd-16725281a818 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:07.695173 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b042ec0-2a7f-4dcd-acdd-16725281a818 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:07.695648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b042ec0-2a7f-4dcd-acdd-16725281a818 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:07.696077 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b042ec0-2a7f-4dcd-acdd-16725281a818 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:07.696748 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b042ec0-2a7f-4dcd-acdd-16725281a818 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:07.697194 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b042ec0-2a7f-4dcd-acdd-16725281a818 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:07.697610 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b042ec0-2a7f-4dcd-acdd-16725281a818 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:07.825741 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8b042ec0-2a7f-4dcd-acdd-16725281a818 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:07.833535 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8b042ec0-2a7f-4dcd-acdd-16725281a818 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1318 microversion: 2.1 time: 0.150185 Aug 24 12:35:07.834080 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 301/595] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:07 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:08.650198 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-45405d26-c5e9-4533-b7e8-54b65e3e1f99 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:08.650943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-45405d26-c5e9-4533-b7e8-54b65e3e1f99 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:08.658196 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45405d26-c5e9-4533-b7e8-54b65e3e1f99 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:08.658752 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45405d26-c5e9-4533-b7e8-54b65e3e1f99 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:08.659196 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45405d26-c5e9-4533-b7e8-54b65e3e1f99 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:08.660008 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45405d26-c5e9-4533-b7e8-54b65e3e1f99 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:08.660470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45405d26-c5e9-4533-b7e8-54b65e3e1f99 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:08.660898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45405d26-c5e9-4533-b7e8-54b65e3e1f99 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:08.788240 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-45405d26-c5e9-4533-b7e8-54b65e3e1f99 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:08.796787 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-45405d26-c5e9-4533-b7e8-54b65e3e1f99 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:08.798282 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-45405d26-c5e9-4533-b7e8-54b65e3e1f99 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:08.799457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-45405d26-c5e9-4533-b7e8-54b65e3e1f99 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.153153 Aug 24 12:35:08.800008 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 295/596] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:08 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:08.854396 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2bbac9fb-5849-4ab3-9ed9-47fd484041de tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:08.854957 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2bbac9fb-5849-4ab3-9ed9-47fd484041de tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:08.861541 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2bbac9fb-5849-4ab3-9ed9-47fd484041de tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:08.862053 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2bbac9fb-5849-4ab3-9ed9-47fd484041de tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:08.862481 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2bbac9fb-5849-4ab3-9ed9-47fd484041de tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:08.863221 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2bbac9fb-5849-4ab3-9ed9-47fd484041de tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:08.863661 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2bbac9fb-5849-4ab3-9ed9-47fd484041de tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:08.864075 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2bbac9fb-5849-4ab3-9ed9-47fd484041de tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:08.996788 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2bbac9fb-5849-4ab3-9ed9-47fd484041de tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:09.004735 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2bbac9fb-5849-4ab3-9ed9-47fd484041de tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1318 microversion: 2.1 time: 0.154642 Aug 24 12:35:09.005290 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 302/597] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:08 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:09.822228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7e4a7407-a9e6-46c7-b351-f80a31171a5d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:09.822884 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7e4a7407-a9e6-46c7-b351-f80a31171a5d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:09.829412 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e4a7407-a9e6-46c7-b351-f80a31171a5d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:09.829992 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e4a7407-a9e6-46c7-b351-f80a31171a5d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:09.830435 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e4a7407-a9e6-46c7-b351-f80a31171a5d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:09.831144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e4a7407-a9e6-46c7-b351-f80a31171a5d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:09.831597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e4a7407-a9e6-46c7-b351-f80a31171a5d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:09.832017 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e4a7407-a9e6-46c7-b351-f80a31171a5d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:09.983659 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7e4a7407-a9e6-46c7-b351-f80a31171a5d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:09.993156 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7e4a7407-a9e6-46c7-b351-f80a31171a5d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:09.994673 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7e4a7407-a9e6-46c7-b351-f80a31171a5d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:09.995816 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7e4a7407-a9e6-46c7-b351-f80a31171a5d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.177609 Aug 24 12:35:09.996365 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 296/598] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:09 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:10.025303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-02133dd2-6728-4da2-ba24-5d05d9fa1336 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:10.025942 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-02133dd2-6728-4da2-ba24-5d05d9fa1336 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:10.031103 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=2 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:10.034030 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02133dd2-6728-4da2-ba24-5d05d9fa1336 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:10.034518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02133dd2-6728-4da2-ba24-5d05d9fa1336 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:10.034982 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02133dd2-6728-4da2-ba24-5d05d9fa1336 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:10.035686 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02133dd2-6728-4da2-ba24-5d05d9fa1336 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:10.036143 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02133dd2-6728-4da2-ba24-5d05d9fa1336 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:10.036569 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02133dd2-6728-4da2-ba24-5d05d9fa1336 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:10.170802 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-02133dd2-6728-4da2-ba24-5d05d9fa1336 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:10.178783 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-02133dd2-6728-4da2-ba24-5d05d9fa1336 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1318 microversion: 2.1 time: 0.157234 Aug 24 12:35:10.179344 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 303/599] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:10 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:11.017949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a6ce3519-6a23-45d4-9f78-b6262e468664 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:11.018552 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a6ce3519-6a23-45d4-9f78-b6262e468664 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:11.025580 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6ce3519-6a23-45d4-9f78-b6262e468664 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:11.026134 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6ce3519-6a23-45d4-9f78-b6262e468664 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:11.026809 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6ce3519-6a23-45d4-9f78-b6262e468664 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:11.027510 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6ce3519-6a23-45d4-9f78-b6262e468664 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:11.028009 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6ce3519-6a23-45d4-9f78-b6262e468664 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:11.028434 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6ce3519-6a23-45d4-9f78-b6262e468664 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:11.056753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:11.170330 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a6ce3519-6a23-45d4-9f78-b6262e468664 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:11.179421 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a6ce3519-6a23-45d4-9f78-b6262e468664 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:11.180895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a6ce3519-6a23-45d4-9f78-b6262e468664 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:11.182033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a6ce3519-6a23-45d4-9f78-b6262e468664 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.167922 Aug 24 12:35:11.182587 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 297/600] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:11 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:11.196342 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=10 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:11.201890 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f5a24268-f03b-450d-a825-4f4b23f02337 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:11.202499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f5a24268-f03b-450d-a825-4f4b23f02337 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:11.208351 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5a24268-f03b-450d-a825-4f4b23f02337 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:11.209221 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5a24268-f03b-450d-a825-4f4b23f02337 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:11.209815 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5a24268-f03b-450d-a825-4f4b23f02337 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:11.210697 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5a24268-f03b-450d-a825-4f4b23f02337 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:11.211317 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5a24268-f03b-450d-a825-4f4b23f02337 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:11.211916 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5a24268-f03b-450d-a825-4f4b23f02337 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:11.351550 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f5a24268-f03b-450d-a825-4f4b23f02337 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:11.359439 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f5a24268-f03b-450d-a825-4f4b23f02337 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1318 microversion: 2.1 time: 0.163780 Aug 24 12:35:11.360040 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 304/601] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:11 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:12.208598 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-15737b31-cdce-44e5-b817-4de7bee9f171 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:12.209274 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-15737b31-cdce-44e5-b817-4de7bee9f171 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:12.215912 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15737b31-cdce-44e5-b817-4de7bee9f171 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:12.216397 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15737b31-cdce-44e5-b817-4de7bee9f171 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:12.216835 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15737b31-cdce-44e5-b817-4de7bee9f171 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:12.217830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15737b31-cdce-44e5-b817-4de7bee9f171 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:12.218396 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15737b31-cdce-44e5-b817-4de7bee9f171 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:12.218847 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15737b31-cdce-44e5-b817-4de7bee9f171 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:12.363640 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-15737b31-cdce-44e5-b817-4de7bee9f171 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:12.377888 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-15737b31-cdce-44e5-b817-4de7bee9f171 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:12.377888 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-15737b31-cdce-44e5-b817-4de7bee9f171 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:12.377888 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-15737b31-cdce-44e5-b817-4de7bee9f171 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.172796 Aug 24 12:35:12.378332 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 298/602] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:12 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:12.387059 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-292752e7-d037-43bc-8122-9adaa9ee9239 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:12.387884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-292752e7-d037-43bc-8122-9adaa9ee9239 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:12.394839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-292752e7-d037-43bc-8122-9adaa9ee9239 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:12.395343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-292752e7-d037-43bc-8122-9adaa9ee9239 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:12.395773 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-292752e7-d037-43bc-8122-9adaa9ee9239 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:12.396461 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-292752e7-d037-43bc-8122-9adaa9ee9239 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:12.396910 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-292752e7-d037-43bc-8122-9adaa9ee9239 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:12.397328 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-292752e7-d037-43bc-8122-9adaa9ee9239 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:12.540842 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-292752e7-d037-43bc-8122-9adaa9ee9239 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:12.549974 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-292752e7-d037-43bc-8122-9adaa9ee9239 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1318 microversion: 2.1 time: 0.168557 Aug 24 12:35:12.551284 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 305/603] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:12 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:13.110038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-e7a3390b-4054-4706-818c-2bc65849eb32 req-8389bc8d-ff44-4bff-8626-9965700c2996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9fbb4c1-a035-462e-b287-be4131984b09", "name": "network-vif-plugged", "status": "completed", "tag": "b27a0942-207a-439e-b81b-5254e8176d43"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:13.120454 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-e7a3390b-4054-4706-818c-2bc65849eb32 req-8389bc8d-ff44-4bff-8626-9965700c2996 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:13.120937 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-e7a3390b-4054-4706-818c-2bc65849eb32 req-8389bc8d-ff44-4bff-8626-9965700c2996 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:13.121370 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-e7a3390b-4054-4706-818c-2bc65849eb32 req-8389bc8d-ff44-4bff-8626-9965700c2996 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:13.132508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-e7a3390b-4054-4706-818c-2bc65849eb32 req-8389bc8d-ff44-4bff-8626-9965700c2996 service nova] Creating event network-vif-plugged:b27a0942-207a-439e-b81b-5254e8176d43 for instance b9fbb4c1-a035-462e-b287-be4131984b09 on hv-cinder-84889 Aug 24 12:35:13.138803 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-e7a3390b-4054-4706-818c-2bc65849eb32 req-8389bc8d-ff44-4bff-8626-9965700c2996 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032414 Aug 24 12:35:13.139478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 299/604] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:13.400694 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c0c5ccb4-e364-4fe2-aae6-2699c1fa4f45 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:13.401350 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c0c5ccb4-e364-4fe2-aae6-2699c1fa4f45 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:13.408650 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0c5ccb4-e364-4fe2-aae6-2699c1fa4f45 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:13.409803 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0c5ccb4-e364-4fe2-aae6-2699c1fa4f45 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:13.409803 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0c5ccb4-e364-4fe2-aae6-2699c1fa4f45 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:13.410202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0c5ccb4-e364-4fe2-aae6-2699c1fa4f45 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:13.410673 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0c5ccb4-e364-4fe2-aae6-2699c1fa4f45 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:13.411133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0c5ccb4-e364-4fe2-aae6-2699c1fa4f45 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:13.559533 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c0c5ccb4-e364-4fe2-aae6-2699c1fa4f45 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:13.568674 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c0c5ccb4-e364-4fe2-aae6-2699c1fa4f45 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:13.570715 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c0c5ccb4-e364-4fe2-aae6-2699c1fa4f45 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:13.571876 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c0c5ccb4-e364-4fe2-aae6-2699c1fa4f45 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.175134 Aug 24 12:35:13.572666 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 306/605] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:13 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:13.575687 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9a35a1b2-7078-481f-a9e1-e3c6003bf2b3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:13.577148 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9a35a1b2-7078-481f-a9e1-e3c6003bf2b3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:13.584492 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a35a1b2-7078-481f-a9e1-e3c6003bf2b3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:13.585501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a35a1b2-7078-481f-a9e1-e3c6003bf2b3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:13.586176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a35a1b2-7078-481f-a9e1-e3c6003bf2b3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:13.587135 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a35a1b2-7078-481f-a9e1-e3c6003bf2b3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:13.587827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a35a1b2-7078-481f-a9e1-e3c6003bf2b3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:13.588484 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a35a1b2-7078-481f-a9e1-e3c6003bf2b3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:13.727350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9a35a1b2-7078-481f-a9e1-e3c6003bf2b3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:13.735024 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9a35a1b2-7078-481f-a9e1-e3c6003bf2b3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1318 microversion: 2.1 time: 0.165286 Aug 24 12:35:13.735581 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 300/606] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:13 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:14.598846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3dc3e986-7041-4097-82e2-111d4c3b6cf1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:14.600182 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3dc3e986-7041-4097-82e2-111d4c3b6cf1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:14.607346 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3dc3e986-7041-4097-82e2-111d4c3b6cf1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:14.607840 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3dc3e986-7041-4097-82e2-111d4c3b6cf1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:14.608277 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3dc3e986-7041-4097-82e2-111d4c3b6cf1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:14.608976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3dc3e986-7041-4097-82e2-111d4c3b6cf1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:14.609432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3dc3e986-7041-4097-82e2-111d4c3b6cf1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:14.609858 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3dc3e986-7041-4097-82e2-111d4c3b6cf1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:14.756091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6a0ef108-c348-4bf2-8d16-97a813af4215 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:14.756692 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6a0ef108-c348-4bf2-8d16-97a813af4215 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:14.757953 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3dc3e986-7041-4097-82e2-111d4c3b6cf1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:14.769721 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3dc3e986-7041-4097-82e2-111d4c3b6cf1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:14.771422 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3dc3e986-7041-4097-82e2-111d4c3b6cf1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:14.772201 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a0ef108-c348-4bf2-8d16-97a813af4215 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:14.772763 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a0ef108-c348-4bf2-8d16-97a813af4215 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:14.773007 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3dc3e986-7041-4097-82e2-111d4c3b6cf1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.180019 Aug 24 12:35:14.773203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a0ef108-c348-4bf2-8d16-97a813af4215 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:14.782682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a0ef108-c348-4bf2-8d16-97a813af4215 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:14.782682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a0ef108-c348-4bf2-8d16-97a813af4215 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:14.782985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 307/607] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:14 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:14.783152 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a0ef108-c348-4bf2-8d16-97a813af4215 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:14.929983 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6a0ef108-c348-4bf2-8d16-97a813af4215 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:14.937706 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6a0ef108-c348-4bf2-8d16-97a813af4215 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1318 microversion: 2.1 time: 0.186065 Aug 24 12:35:14.938272 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 301/608] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:14 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:15.796487 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-64b570d7-5af0-4c54-9435-ddc8e9fec587 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:15.797110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-64b570d7-5af0-4c54-9435-ddc8e9fec587 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:15.803271 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64b570d7-5af0-4c54-9435-ddc8e9fec587 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:15.803746 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64b570d7-5af0-4c54-9435-ddc8e9fec587 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:15.804174 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64b570d7-5af0-4c54-9435-ddc8e9fec587 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:15.804853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64b570d7-5af0-4c54-9435-ddc8e9fec587 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:15.805297 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64b570d7-5af0-4c54-9435-ddc8e9fec587 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:15.805710 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64b570d7-5af0-4c54-9435-ddc8e9fec587 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:15.943094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-64b570d7-5af0-4c54-9435-ddc8e9fec587 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:15.953700 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-64b570d7-5af0-4c54-9435-ddc8e9fec587 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:15.959111 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bd7d9aae-5fb0-480d-ab3e-f3c07e6d29bd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:15.960000 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bd7d9aae-5fb0-480d-ab3e-f3c07e6d29bd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:15.965709 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-64b570d7-5af0-4c54-9435-ddc8e9fec587 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:15.966543 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd7d9aae-5fb0-480d-ab3e-f3c07e6d29bd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:15.967007 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-64b570d7-5af0-4c54-9435-ddc8e9fec587 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.174382 Aug 24 12:35:15.967141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd7d9aae-5fb0-480d-ab3e-f3c07e6d29bd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:15.967489 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd7d9aae-5fb0-480d-ab3e-f3c07e6d29bd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:15.977950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd7d9aae-5fb0-480d-ab3e-f3c07e6d29bd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:15.977950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd7d9aae-5fb0-480d-ab3e-f3c07e6d29bd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:15.977950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd7d9aae-5fb0-480d-ab3e-f3c07e6d29bd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:15.979072 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 308/609] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:15 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:16.328436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bd7d9aae-5fb0-480d-ab3e-f3c07e6d29bd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:16.335985 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bd7d9aae-5fb0-480d-ab3e-f3c07e6d29bd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1318 microversion: 2.1 time: 0.381230 Aug 24 12:35:16.336541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 302/610] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:15 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:16.995738 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-498528c0-2992-4b48-bb6b-69be3627d883 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:16.996606 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-498528c0-2992-4b48-bb6b-69be3627d883 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:17.003845 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-498528c0-2992-4b48-bb6b-69be3627d883 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:17.004403 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-498528c0-2992-4b48-bb6b-69be3627d883 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:17.004846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-498528c0-2992-4b48-bb6b-69be3627d883 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:17.005546 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-498528c0-2992-4b48-bb6b-69be3627d883 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:17.005995 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-498528c0-2992-4b48-bb6b-69be3627d883 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:17.006416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-498528c0-2992-4b48-bb6b-69be3627d883 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:17.140366 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-498528c0-2992-4b48-bb6b-69be3627d883 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:17.149706 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-498528c0-2992-4b48-bb6b-69be3627d883 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:17.151233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-498528c0-2992-4b48-bb6b-69be3627d883 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:17.152436 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-498528c0-2992-4b48-bb6b-69be3627d883 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.160703 Aug 24 12:35:17.152989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 309/611] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:16 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:17.357185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-da500b93-488a-48eb-8cb2-8fa57b669c3f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:17.357779 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-da500b93-488a-48eb-8cb2-8fa57b669c3f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:17.374167 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da500b93-488a-48eb-8cb2-8fa57b669c3f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:17.374677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da500b93-488a-48eb-8cb2-8fa57b669c3f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:17.375115 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da500b93-488a-48eb-8cb2-8fa57b669c3f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:17.375830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da500b93-488a-48eb-8cb2-8fa57b669c3f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:17.376255 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da500b93-488a-48eb-8cb2-8fa57b669c3f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:17.376692 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da500b93-488a-48eb-8cb2-8fa57b669c3f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:17.519235 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-da500b93-488a-48eb-8cb2-8fa57b669c3f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:17.530157 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-da500b93-488a-48eb-8cb2-8fa57b669c3f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1318 microversion: 2.1 time: 0.177206 Aug 24 12:35:17.531262 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 303/612] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:17 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:18.175829 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b21383af-3fd4-47bd-bc51-e68170840d20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:18.176532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b21383af-3fd4-47bd-bc51-e68170840d20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:18.182836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b21383af-3fd4-47bd-bc51-e68170840d20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:18.183316 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b21383af-3fd4-47bd-bc51-e68170840d20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:18.183742 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b21383af-3fd4-47bd-bc51-e68170840d20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:18.184415 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b21383af-3fd4-47bd-bc51-e68170840d20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:18.184858 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b21383af-3fd4-47bd-bc51-e68170840d20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:18.185273 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b21383af-3fd4-47bd-bc51-e68170840d20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:18.349003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b21383af-3fd4-47bd-bc51-e68170840d20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:18.357533 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b21383af-3fd4-47bd-bc51-e68170840d20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:18.359063 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b21383af-3fd4-47bd-bc51-e68170840d20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:18.360201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b21383af-3fd4-47bd-bc51-e68170840d20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.188985 Aug 24 12:35:18.360752 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 310/613] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:18 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:18.550953 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bdcff35b-c059-499c-b0f6-4a2d81e9023d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:18.551505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bdcff35b-c059-499c-b0f6-4a2d81e9023d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:18.557895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bdcff35b-c059-499c-b0f6-4a2d81e9023d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:18.558410 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bdcff35b-c059-499c-b0f6-4a2d81e9023d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:18.558915 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bdcff35b-c059-499c-b0f6-4a2d81e9023d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:18.559605 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bdcff35b-c059-499c-b0f6-4a2d81e9023d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:18.560065 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bdcff35b-c059-499c-b0f6-4a2d81e9023d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:18.560491 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bdcff35b-c059-499c-b0f6-4a2d81e9023d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:18.707713 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bdcff35b-c059-499c-b0f6-4a2d81e9023d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:18.715406 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bdcff35b-c059-499c-b0f6-4a2d81e9023d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1318 microversion: 2.1 time: 0.168441 Aug 24 12:35:18.715956 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 304/614] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:18 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:19.383290 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0a5e9f00-750d-4067-b062-9c582253fa38 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:19.383929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0a5e9f00-750d-4067-b062-9c582253fa38 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:19.390378 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a5e9f00-750d-4067-b062-9c582253fa38 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:19.390899 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a5e9f00-750d-4067-b062-9c582253fa38 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:19.391331 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a5e9f00-750d-4067-b062-9c582253fa38 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:19.392034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a5e9f00-750d-4067-b062-9c582253fa38 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:19.392490 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a5e9f00-750d-4067-b062-9c582253fa38 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:19.392908 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a5e9f00-750d-4067-b062-9c582253fa38 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:19.548816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0a5e9f00-750d-4067-b062-9c582253fa38 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:19.558185 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0a5e9f00-750d-4067-b062-9c582253fa38 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:19.559736 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0a5e9f00-750d-4067-b062-9c582253fa38 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:19.560879 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0a5e9f00-750d-4067-b062-9c582253fa38 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.181514 Aug 24 12:35:19.561428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 311/615] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:19 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:35:19.736157 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-28d03291-736b-4583-8d92-54356d3a4981 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:19.737340 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-28d03291-736b-4583-8d92-54356d3a4981 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:19.744369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-28d03291-736b-4583-8d92-54356d3a4981 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:19.744859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-28d03291-736b-4583-8d92-54356d3a4981 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:19.745299 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-28d03291-736b-4583-8d92-54356d3a4981 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:19.746329 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-28d03291-736b-4583-8d92-54356d3a4981 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:19.747022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-28d03291-736b-4583-8d92-54356d3a4981 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:19.747611 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-28d03291-736b-4583-8d92-54356d3a4981 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:19.881309 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-28d03291-736b-4583-8d92-54356d3a4981 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:19.888920 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-28d03291-736b-4583-8d92-54356d3a4981 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1318 microversion: 2.1 time: 0.156634 Aug 24 12:35:19.889473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 305/616] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:19 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:20.586489 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c39b13f0-033b-418b-8a46-b1ea4ae82172 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:20.587110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c39b13f0-033b-418b-8a46-b1ea4ae82172 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:20.593462 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c39b13f0-033b-418b-8a46-b1ea4ae82172 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:20.593935 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c39b13f0-033b-418b-8a46-b1ea4ae82172 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:20.594367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c39b13f0-033b-418b-8a46-b1ea4ae82172 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:20.595070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c39b13f0-033b-418b-8a46-b1ea4ae82172 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:20.595514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c39b13f0-033b-418b-8a46-b1ea4ae82172 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:20.595928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c39b13f0-033b-418b-8a46-b1ea4ae82172 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:20.725132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c39b13f0-033b-418b-8a46-b1ea4ae82172 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:20.733568 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c39b13f0-033b-418b-8a46-b1ea4ae82172 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:20.735071 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c39b13f0-033b-418b-8a46-b1ea4ae82172 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:20.736207 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c39b13f0-033b-418b-8a46-b1ea4ae82172 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.153554 Aug 24 12:35:20.736753 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 312/617] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:20 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:20.911140 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7ffb2916-5b33-4716-9f63-8910b2ff67a8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:20.911761 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7ffb2916-5b33-4716-9f63-8910b2ff67a8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:20.918014 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7ffb2916-5b33-4716-9f63-8910b2ff67a8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:20.918497 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7ffb2916-5b33-4716-9f63-8910b2ff67a8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:20.918965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7ffb2916-5b33-4716-9f63-8910b2ff67a8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:20.919652 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7ffb2916-5b33-4716-9f63-8910b2ff67a8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:20.920110 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7ffb2916-5b33-4716-9f63-8910b2ff67a8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:20.920536 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7ffb2916-5b33-4716-9f63-8910b2ff67a8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:21.049311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7ffb2916-5b33-4716-9f63-8910b2ff67a8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:21.056791 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7ffb2916-5b33-4716-9f63-8910b2ff67a8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1318 microversion: 2.1 time: 0.150039 Aug 24 12:35:21.057347 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 306/618] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:20 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:21.759759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-69584c0e-bdb5-401e-a31d-ba77276d8a9e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:21.760364 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-69584c0e-bdb5-401e-a31d-ba77276d8a9e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:21.766850 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69584c0e-bdb5-401e-a31d-ba77276d8a9e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:21.767332 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69584c0e-bdb5-401e-a31d-ba77276d8a9e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:21.767762 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69584c0e-bdb5-401e-a31d-ba77276d8a9e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:21.768493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69584c0e-bdb5-401e-a31d-ba77276d8a9e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:21.768942 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69584c0e-bdb5-401e-a31d-ba77276d8a9e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:21.769362 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69584c0e-bdb5-401e-a31d-ba77276d8a9e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:21.894934 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-69584c0e-bdb5-401e-a31d-ba77276d8a9e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:21.898256 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:21.903636 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-69584c0e-bdb5-401e-a31d-ba77276d8a9e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:21.905120 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-69584c0e-bdb5-401e-a31d-ba77276d8a9e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:21.906262 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-69584c0e-bdb5-401e-a31d-ba77276d8a9e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.150407 Aug 24 12:35:21.906834 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 313/619] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:21 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:22.077812 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f604052f-eac1-4c92-97b0-6aaa73fa2be5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:22.078378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f604052f-eac1-4c92-97b0-6aaa73fa2be5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:22.085338 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f604052f-eac1-4c92-97b0-6aaa73fa2be5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:22.085824 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f604052f-eac1-4c92-97b0-6aaa73fa2be5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:22.086261 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f604052f-eac1-4c92-97b0-6aaa73fa2be5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:22.086978 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f604052f-eac1-4c92-97b0-6aaa73fa2be5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:22.087452 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f604052f-eac1-4c92-97b0-6aaa73fa2be5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:22.087863 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f604052f-eac1-4c92-97b0-6aaa73fa2be5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:22.213398 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f604052f-eac1-4c92-97b0-6aaa73fa2be5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:22.220915 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f604052f-eac1-4c92-97b0-6aaa73fa2be5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1318 microversion: 2.1 time: 0.147004 Aug 24 12:35:22.222077 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 307/620] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:22 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:22.930465 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ce3552e2-d595-4a98-ac0e-8c3d352056df tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:22.931120 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ce3552e2-d595-4a98-ac0e-8c3d352056df tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:22.937591 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce3552e2-d595-4a98-ac0e-8c3d352056df tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:22.938071 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce3552e2-d595-4a98-ac0e-8c3d352056df tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:22.938503 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce3552e2-d595-4a98-ac0e-8c3d352056df tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:22.939211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce3552e2-d595-4a98-ac0e-8c3d352056df tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:22.939659 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce3552e2-d595-4a98-ac0e-8c3d352056df tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:22.940084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce3552e2-d595-4a98-ac0e-8c3d352056df tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:23.068792 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ce3552e2-d595-4a98-ac0e-8c3d352056df tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:23.077289 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ce3552e2-d595-4a98-ac0e-8c3d352056df tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:23.078801 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ce3552e2-d595-4a98-ac0e-8c3d352056df tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:23.079950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ce3552e2-d595-4a98-ac0e-8c3d352056df tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.153774 Aug 24 12:35:23.080499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 314/621] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:22 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:35:23.242368 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1938af4e-dfff-474c-8795-fdcc2f500953 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:23.243000 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1938af4e-dfff-474c-8795-fdcc2f500953 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:23.245419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:23.250044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1938af4e-dfff-474c-8795-fdcc2f500953 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:23.250528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1938af4e-dfff-474c-8795-fdcc2f500953 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:23.251006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1938af4e-dfff-474c-8795-fdcc2f500953 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:23.251694 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1938af4e-dfff-474c-8795-fdcc2f500953 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:23.252148 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1938af4e-dfff-474c-8795-fdcc2f500953 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:23.252641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1938af4e-dfff-474c-8795-fdcc2f500953 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:23.377942 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1938af4e-dfff-474c-8795-fdcc2f500953 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:23.385418 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1938af4e-dfff-474c-8795-fdcc2f500953 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1318 microversion: 2.1 time: 0.147194 Aug 24 12:35:23.385980 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 308/622] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:23 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:24.102551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1d3da714-8932-4fe5-9b9b-2191585a7646 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:24.103192 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1d3da714-8932-4fe5-9b9b-2191585a7646 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:24.109540 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1d3da714-8932-4fe5-9b9b-2191585a7646 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:24.110022 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1d3da714-8932-4fe5-9b9b-2191585a7646 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:24.110455 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1d3da714-8932-4fe5-9b9b-2191585a7646 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:24.111169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1d3da714-8932-4fe5-9b9b-2191585a7646 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:24.111624 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1d3da714-8932-4fe5-9b9b-2191585a7646 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:24.112046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1d3da714-8932-4fe5-9b9b-2191585a7646 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:24.238080 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1d3da714-8932-4fe5-9b9b-2191585a7646 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:24.246954 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1d3da714-8932-4fe5-9b9b-2191585a7646 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:24.248469 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1d3da714-8932-4fe5-9b9b-2191585a7646 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:24.249617 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1d3da714-8932-4fe5-9b9b-2191585a7646 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.150984 Aug 24 12:35:24.250174 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 315/623] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:24 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:24.405631 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-91d9a68a-bcdb-40ff-8f5b-b3d46c8d3fdc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:24.406277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-91d9a68a-bcdb-40ff-8f5b-b3d46c8d3fdc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:24.412661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-91d9a68a-bcdb-40ff-8f5b-b3d46c8d3fdc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:24.413147 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-91d9a68a-bcdb-40ff-8f5b-b3d46c8d3fdc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:24.413590 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-91d9a68a-bcdb-40ff-8f5b-b3d46c8d3fdc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:24.414283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-91d9a68a-bcdb-40ff-8f5b-b3d46c8d3fdc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:24.414874 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-91d9a68a-bcdb-40ff-8f5b-b3d46c8d3fdc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:24.421910 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-91d9a68a-bcdb-40ff-8f5b-b3d46c8d3fdc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:24.544635 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-91d9a68a-bcdb-40ff-8f5b-b3d46c8d3fdc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:24.552602 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-91d9a68a-bcdb-40ff-8f5b-b3d46c8d3fdc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1318 microversion: 2.1 time: 0.150823 Aug 24 12:35:24.553152 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 309/624] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:24 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:25.273012 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cfd06c7e-ef1a-418e-aa83-f8feea598b49 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:25.273618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cfd06c7e-ef1a-418e-aa83-f8feea598b49 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:25.275956 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:25.280848 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfd06c7e-ef1a-418e-aa83-f8feea598b49 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:25.281330 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfd06c7e-ef1a-418e-aa83-f8feea598b49 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:25.281786 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfd06c7e-ef1a-418e-aa83-f8feea598b49 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:25.282474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfd06c7e-ef1a-418e-aa83-f8feea598b49 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:25.282957 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfd06c7e-ef1a-418e-aa83-f8feea598b49 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:25.283744 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfd06c7e-ef1a-418e-aa83-f8feea598b49 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:25.472832 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cfd06c7e-ef1a-418e-aa83-f8feea598b49 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:25.481569 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cfd06c7e-ef1a-418e-aa83-f8feea598b49 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:25.483089 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cfd06c7e-ef1a-418e-aa83-f8feea598b49 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:25.484257 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cfd06c7e-ef1a-418e-aa83-f8feea598b49 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.215144 Aug 24 12:35:25.484839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 316/625] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:25 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:25.573337 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5859042b-3fbe-4bbe-ba5d-ac9a25223ae0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:25.573943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5859042b-3fbe-4bbe-ba5d-ac9a25223ae0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:25.580486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5859042b-3fbe-4bbe-ba5d-ac9a25223ae0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:25.581611 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5859042b-3fbe-4bbe-ba5d-ac9a25223ae0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:25.582051 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5859042b-3fbe-4bbe-ba5d-ac9a25223ae0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:25.582766 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5859042b-3fbe-4bbe-ba5d-ac9a25223ae0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:25.583228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5859042b-3fbe-4bbe-ba5d-ac9a25223ae0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:25.583655 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5859042b-3fbe-4bbe-ba5d-ac9a25223ae0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:25.712787 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5859042b-3fbe-4bbe-ba5d-ac9a25223ae0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:25.720224 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5859042b-3fbe-4bbe-ba5d-ac9a25223ae0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1318 microversion: 2.1 time: 0.150837 Aug 24 12:35:25.720839 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 310/626] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:25 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:26.507463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7030256d-591f-4b77-93bb-15d984364583 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:26.508096 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7030256d-591f-4b77-93bb-15d984364583 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:26.514440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7030256d-591f-4b77-93bb-15d984364583 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:26.514948 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7030256d-591f-4b77-93bb-15d984364583 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:26.515381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7030256d-591f-4b77-93bb-15d984364583 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:26.516057 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7030256d-591f-4b77-93bb-15d984364583 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:26.516505 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7030256d-591f-4b77-93bb-15d984364583 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:26.516925 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7030256d-591f-4b77-93bb-15d984364583 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:26.642965 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7030256d-591f-4b77-93bb-15d984364583 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:26.651992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7030256d-591f-4b77-93bb-15d984364583 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:26.653460 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7030256d-591f-4b77-93bb-15d984364583 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:26.654588 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7030256d-591f-4b77-93bb-15d984364583 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.151058 Aug 24 12:35:26.655156 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 317/627] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:26 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:26.740948 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e478ec8b-e36f-4628-8788-78b96bfe9b0a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:26.741560 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e478ec8b-e36f-4628-8788-78b96bfe9b0a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:26.747936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e478ec8b-e36f-4628-8788-78b96bfe9b0a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:26.748413 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e478ec8b-e36f-4628-8788-78b96bfe9b0a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:26.748847 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e478ec8b-e36f-4628-8788-78b96bfe9b0a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:26.749524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e478ec8b-e36f-4628-8788-78b96bfe9b0a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:26.749975 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e478ec8b-e36f-4628-8788-78b96bfe9b0a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:26.750396 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e478ec8b-e36f-4628-8788-78b96bfe9b0a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:26.878072 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e478ec8b-e36f-4628-8788-78b96bfe9b0a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:26.885473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e478ec8b-e36f-4628-8788-78b96bfe9b0a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1318 microversion: 2.1 time: 0.148809 Aug 24 12:35:26.886021 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 311/628] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:26 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:27.677307 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-117f9c34-bb92-4b7f-ab52-7b960ed6a6ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:27.677907 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-117f9c34-bb92-4b7f-ab52-7b960ed6a6ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:27.684411 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-117f9c34-bb92-4b7f-ab52-7b960ed6a6ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:27.684826 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-117f9c34-bb92-4b7f-ab52-7b960ed6a6ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:27.685254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-117f9c34-bb92-4b7f-ab52-7b960ed6a6ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:27.685928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-117f9c34-bb92-4b7f-ab52-7b960ed6a6ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:27.686373 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-117f9c34-bb92-4b7f-ab52-7b960ed6a6ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:27.686828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-117f9c34-bb92-4b7f-ab52-7b960ed6a6ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:27.820564 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-117f9c34-bb92-4b7f-ab52-7b960ed6a6ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:27.829091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-117f9c34-bb92-4b7f-ab52-7b960ed6a6ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:27.830558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-117f9c34-bb92-4b7f-ab52-7b960ed6a6ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:27.832401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-117f9c34-bb92-4b7f-ab52-7b960ed6a6ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.159000 Aug 24 12:35:27.833254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 318/629] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:27 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:27.906354 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6d45ee54-f37d-4619-bbc5-533f85b64034 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:27.906982 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6d45ee54-f37d-4619-bbc5-533f85b64034 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:27.913254 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d45ee54-f37d-4619-bbc5-533f85b64034 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:27.913734 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d45ee54-f37d-4619-bbc5-533f85b64034 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:27.914172 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d45ee54-f37d-4619-bbc5-533f85b64034 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:27.914888 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d45ee54-f37d-4619-bbc5-533f85b64034 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:27.915347 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d45ee54-f37d-4619-bbc5-533f85b64034 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:27.915773 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d45ee54-f37d-4619-bbc5-533f85b64034 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:28.041158 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6d45ee54-f37d-4619-bbc5-533f85b64034 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:28.048642 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6d45ee54-f37d-4619-bbc5-533f85b64034 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1507 microversion: 2.1 time: 0.146114 Aug 24 12:35:28.049193 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 312/630] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:27 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1507 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:28.855018 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b8f87069-098d-4037-850f-2d34643f36b5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:28.855652 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b8f87069-098d-4037-850f-2d34643f36b5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:28.861945 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8f87069-098d-4037-850f-2d34643f36b5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:28.862425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8f87069-098d-4037-850f-2d34643f36b5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:28.862899 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8f87069-098d-4037-850f-2d34643f36b5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:28.863584 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8f87069-098d-4037-850f-2d34643f36b5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:28.864036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8f87069-098d-4037-850f-2d34643f36b5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:28.864723 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8f87069-098d-4037-850f-2d34643f36b5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:28.991273 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b8f87069-098d-4037-850f-2d34643f36b5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:28.999848 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b8f87069-098d-4037-850f-2d34643f36b5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:29.001341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b8f87069-098d-4037-850f-2d34643f36b5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:29.002486 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b8f87069-098d-4037-850f-2d34643f36b5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.151564 Aug 24 12:35:29.003245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 319/631] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:28 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:30.025972 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3fd3f15b-3f63-4525-a892-cb96d6945e40 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:30.026844 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3fd3f15b-3f63-4525-a892-cb96d6945e40 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:30.034282 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3fd3f15b-3f63-4525-a892-cb96d6945e40 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:30.034912 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3fd3f15b-3f63-4525-a892-cb96d6945e40 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:30.035351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3fd3f15b-3f63-4525-a892-cb96d6945e40 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:30.036050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3fd3f15b-3f63-4525-a892-cb96d6945e40 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:30.036505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3fd3f15b-3f63-4525-a892-cb96d6945e40 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:30.036930 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3fd3f15b-3f63-4525-a892-cb96d6945e40 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:30.186035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3fd3f15b-3f63-4525-a892-cb96d6945e40 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:30.196163 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3fd3f15b-3f63-4525-a892-cb96d6945e40 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:30.197650 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3fd3f15b-3f63-4525-a892-cb96d6945e40 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:30.198856 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3fd3f15b-3f63-4525-a892-cb96d6945e40 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.177647 Aug 24 12:35:30.199415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 313/632] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:30 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:31.229034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8dacc08a-949d-4f61-8596-11211d82db5b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:31.229628 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8dacc08a-949d-4f61-8596-11211d82db5b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:31.236020 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8dacc08a-949d-4f61-8596-11211d82db5b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:31.236502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8dacc08a-949d-4f61-8596-11211d82db5b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:31.236936 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8dacc08a-949d-4f61-8596-11211d82db5b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:31.238131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8dacc08a-949d-4f61-8596-11211d82db5b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:31.238583 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8dacc08a-949d-4f61-8596-11211d82db5b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:31.239030 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8dacc08a-949d-4f61-8596-11211d82db5b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:31.373614 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8dacc08a-949d-4f61-8596-11211d82db5b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:31.382134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8dacc08a-949d-4f61-8596-11211d82db5b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:31.383687 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8dacc08a-949d-4f61-8596-11211d82db5b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:31.384830 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8dacc08a-949d-4f61-8596-11211d82db5b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.159834 Aug 24 12:35:31.385387 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 320/633] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:31 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:32.407836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-73791ebb-f3d1-4db1-8c14-7a881b373b63 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:32.408502 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-73791ebb-f3d1-4db1-8c14-7a881b373b63 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:32.415073 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-73791ebb-f3d1-4db1-8c14-7a881b373b63 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:32.418890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-73791ebb-f3d1-4db1-8c14-7a881b373b63 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:32.418890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-73791ebb-f3d1-4db1-8c14-7a881b373b63 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:32.418890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-73791ebb-f3d1-4db1-8c14-7a881b373b63 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:32.418890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-73791ebb-f3d1-4db1-8c14-7a881b373b63 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:32.419201 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-73791ebb-f3d1-4db1-8c14-7a881b373b63 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:32.556928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-73791ebb-f3d1-4db1-8c14-7a881b373b63 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:32.560521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:32.567094 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-73791ebb-f3d1-4db1-8c14-7a881b373b63 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:32.568590 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-73791ebb-f3d1-4db1-8c14-7a881b373b63 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:32.569761 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-73791ebb-f3d1-4db1-8c14-7a881b373b63 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.165921 Aug 24 12:35:32.570344 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 314/634] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:32 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:33.592548 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-98f7e5a6-22ed-4807-b1b2-5fb5c88636ed tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:33.593177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-98f7e5a6-22ed-4807-b1b2-5fb5c88636ed tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:33.600077 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98f7e5a6-22ed-4807-b1b2-5fb5c88636ed tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:33.600566 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98f7e5a6-22ed-4807-b1b2-5fb5c88636ed tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:33.600984 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98f7e5a6-22ed-4807-b1b2-5fb5c88636ed tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:33.601666 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98f7e5a6-22ed-4807-b1b2-5fb5c88636ed tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:33.602111 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98f7e5a6-22ed-4807-b1b2-5fb5c88636ed tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:33.602527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98f7e5a6-22ed-4807-b1b2-5fb5c88636ed tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:33.734232 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-98f7e5a6-22ed-4807-b1b2-5fb5c88636ed tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:33.743639 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-98f7e5a6-22ed-4807-b1b2-5fb5c88636ed tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:33.745111 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-98f7e5a6-22ed-4807-b1b2-5fb5c88636ed tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:33.746246 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-98f7e5a6-22ed-4807-b1b2-5fb5c88636ed tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.157681 Aug 24 12:35:33.746818 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 321/635] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:33 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:34.770023 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f8a72766-32cd-42bc-927b-ff013d014ad4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:34.770866 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f8a72766-32cd-42bc-927b-ff013d014ad4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:34.777429 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f8a72766-32cd-42bc-927b-ff013d014ad4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:34.777988 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f8a72766-32cd-42bc-927b-ff013d014ad4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:34.778429 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f8a72766-32cd-42bc-927b-ff013d014ad4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:34.779146 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f8a72766-32cd-42bc-927b-ff013d014ad4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:34.779602 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f8a72766-32cd-42bc-927b-ff013d014ad4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:34.780030 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f8a72766-32cd-42bc-927b-ff013d014ad4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:34.835760 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-15895756-717d-4c5b-9dca-93167ab73b7d req-9af943f2-b24f-4171-9b09-f8df7dcc0b7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e5a10ee-202a-453e-b3ff-6c5c05ec72f3", "name": "network-vif-plugged", "status": "completed", "tag": "65aeb21b-342d-4c27-963d-8c021915548c"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:34.846214 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-15895756-717d-4c5b-9dca-93167ab73b7d req-9af943f2-b24f-4171-9b09-f8df7dcc0b7c service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:34.846736 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-15895756-717d-4c5b-9dca-93167ab73b7d req-9af943f2-b24f-4171-9b09-f8df7dcc0b7c service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:34.847143 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-15895756-717d-4c5b-9dca-93167ab73b7d req-9af943f2-b24f-4171-9b09-f8df7dcc0b7c service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:34.859760 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-15895756-717d-4c5b-9dca-93167ab73b7d req-9af943f2-b24f-4171-9b09-f8df7dcc0b7c service nova] Creating event network-vif-plugged:65aeb21b-342d-4c27-963d-8c021915548c for instance 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 on hv-cinder-84889 Aug 24 12:35:34.865010 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-15895756-717d-4c5b-9dca-93167ab73b7d req-9af943f2-b24f-4171-9b09-f8df7dcc0b7c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033338 Aug 24 12:35:34.870369 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 322/636] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:35:34.919212 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f8a72766-32cd-42bc-927b-ff013d014ad4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:34.928434 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f8a72766-32cd-42bc-927b-ff013d014ad4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:34.929975 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f8a72766-32cd-42bc-927b-ff013d014ad4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:34.931197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f8a72766-32cd-42bc-927b-ff013d014ad4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.165935 Aug 24 12:35:34.931763 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 315/637] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:34 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:35.954785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4b604b75-2afd-4092-bfd3-8879186aed48 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:35.955386 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4b604b75-2afd-4092-bfd3-8879186aed48 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:35.961499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b604b75-2afd-4092-bfd3-8879186aed48 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:35.962009 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b604b75-2afd-4092-bfd3-8879186aed48 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:35.962439 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b604b75-2afd-4092-bfd3-8879186aed48 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:35.963188 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b604b75-2afd-4092-bfd3-8879186aed48 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:35.963632 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b604b75-2afd-4092-bfd3-8879186aed48 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:35.967805 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b604b75-2afd-4092-bfd3-8879186aed48 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:36.101214 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4b604b75-2afd-4092-bfd3-8879186aed48 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:36.109674 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4b604b75-2afd-4092-bfd3-8879186aed48 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:36.111198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4b604b75-2afd-4092-bfd3-8879186aed48 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:36.112335 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4b604b75-2afd-4092-bfd3-8879186aed48 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.162437 Aug 24 12:35:36.112874 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 323/638] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:35 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:37.136713 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-97be9cc2-4ab6-4d60-a103-a8734a93f5b8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:37.137392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-97be9cc2-4ab6-4d60-a103-a8734a93f5b8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:37.143599 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97be9cc2-4ab6-4d60-a103-a8734a93f5b8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:37.144090 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97be9cc2-4ab6-4d60-a103-a8734a93f5b8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:37.144544 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97be9cc2-4ab6-4d60-a103-a8734a93f5b8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:37.145273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97be9cc2-4ab6-4d60-a103-a8734a93f5b8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:37.145729 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97be9cc2-4ab6-4d60-a103-a8734a93f5b8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:37.146156 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97be9cc2-4ab6-4d60-a103-a8734a93f5b8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:37.284186 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-97be9cc2-4ab6-4d60-a103-a8734a93f5b8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:37.293343 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-97be9cc2-4ab6-4d60-a103-a8734a93f5b8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:37.294950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-97be9cc2-4ab6-4d60-a103-a8734a93f5b8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:37.299807 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-97be9cc2-4ab6-4d60-a103-a8734a93f5b8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.163509 Aug 24 12:35:37.299807 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 316/639] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:37 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:35:38.321520 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-beb29153-e803-4a09-91a8-853f8a4fde34 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:38.327393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-beb29153-e803-4a09-91a8-853f8a4fde34 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:38.330361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-beb29153-e803-4a09-91a8-853f8a4fde34 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:38.331168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-beb29153-e803-4a09-91a8-853f8a4fde34 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:38.332012 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-beb29153-e803-4a09-91a8-853f8a4fde34 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:38.332731 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-beb29153-e803-4a09-91a8-853f8a4fde34 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:38.333182 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-beb29153-e803-4a09-91a8-853f8a4fde34 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:38.333605 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-beb29153-e803-4a09-91a8-853f8a4fde34 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:38.468474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-beb29153-e803-4a09-91a8-853f8a4fde34 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:38.477710 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-beb29153-e803-4a09-91a8-853f8a4fde34 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:38.479235 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-beb29153-e803-4a09-91a8-853f8a4fde34 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:38.480419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-beb29153-e803-4a09-91a8-853f8a4fde34 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1809 microversion: 2.20 time: 0.162861 Aug 24 12:35:38.480977 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 324/640] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:38 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:39.502965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9f6b3d43-3de7-4fe3-b2ed-cf3cf02be216 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:39.503669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9f6b3d43-3de7-4fe3-b2ed-cf3cf02be216 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:39.510071 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9f6b3d43-3de7-4fe3-b2ed-cf3cf02be216 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:39.510558 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9f6b3d43-3de7-4fe3-b2ed-cf3cf02be216 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:39.511030 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9f6b3d43-3de7-4fe3-b2ed-cf3cf02be216 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:39.511720 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9f6b3d43-3de7-4fe3-b2ed-cf3cf02be216 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:39.512186 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9f6b3d43-3de7-4fe3-b2ed-cf3cf02be216 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:39.512627 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9f6b3d43-3de7-4fe3-b2ed-cf3cf02be216 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:39.651212 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9f6b3d43-3de7-4fe3-b2ed-cf3cf02be216 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:39.659798 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9f6b3d43-3de7-4fe3-b2ed-cf3cf02be216 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:39.661368 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9f6b3d43-3de7-4fe3-b2ed-cf3cf02be216 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:39.662468 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9f6b3d43-3de7-4fe3-b2ed-cf3cf02be216 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1796 microversion: 2.20 time: 0.163489 Aug 24 12:35:39.663141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 317/641] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:39 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1796 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:51.502813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=17 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:51.503561 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=62 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:51.610478 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6c97553a-babd-42df-9c05-9416fe0c1c8a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec20bae7-7644-4b28-bc2e-f28915eeb2cb"}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:51.612989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6c97553a-babd-42df-9c05-9416fe0c1c8a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:51.619694 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c97553a-babd-42df-9c05-9416fe0c1c8a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:51.620174 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c97553a-babd-42df-9c05-9416fe0c1c8a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:51.620608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c97553a-babd-42df-9c05-9416fe0c1c8a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:51.623256 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c97553a-babd-42df-9c05-9416fe0c1c8a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:51.623256 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c97553a-babd-42df-9c05-9416fe0c1c8a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:51.623256 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c97553a-babd-42df-9c05-9416fe0c1c8a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:52.483453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6c97553a-babd-42df-9c05-9416fe0c1c8a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "POST /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.985399 Aug 24 12:35:52.484064 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 325/642] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 24 12:35:51 2022] POST /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 194 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:52.907022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ff081a1b-38b5-4aad-a058-bf38f43edfe8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "993d2a0c-8e3d-4e96-946f-a191346775b9", "device": "/dev/sdb"}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:52.910024 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ff081a1b-38b5-4aad-a058-bf38f43edfe8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:52.913105 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=19 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:52.913743 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=18 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:52.918361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ff081a1b-38b5-4aad-a058-bf38f43edfe8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:52.918875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ff081a1b-38b5-4aad-a058-bf38f43edfe8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:52.919313 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ff081a1b-38b5-4aad-a058-bf38f43edfe8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:52.919992 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ff081a1b-38b5-4aad-a058-bf38f43edfe8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:52.920445 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ff081a1b-38b5-4aad-a058-bf38f43edfe8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:52.920869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ff081a1b-38b5-4aad-a058-bf38f43edfe8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:53.757722 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ff081a1b-38b5-4aad-a058-bf38f43edfe8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "POST /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.854471 Aug 24 12:35:53.758327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 318/643] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 24 12:35:52 2022] POST /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09/os-volume_attachments => generated 194 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:55.545926 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ee4d33aa-6712-4fb6-9191-1431f421e1d7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:55.548199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ee4d33aa-6712-4fb6-9191-1431f421e1d7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:55.554917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee4d33aa-6712-4fb6-9191-1431f421e1d7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:55.555392 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee4d33aa-6712-4fb6-9191-1431f421e1d7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:55.555821 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee4d33aa-6712-4fb6-9191-1431f421e1d7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:55.556497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee4d33aa-6712-4fb6-9191-1431f421e1d7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:55.556940 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee4d33aa-6712-4fb6-9191-1431f421e1d7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:55.557354 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee4d33aa-6712-4fb6-9191-1431f421e1d7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:55.759941 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ee4d33aa-6712-4fb6-9191-1431f421e1d7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "POST /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/action" status: 202 len: 0 microversion: 2.1 time: 0.218523 Aug 24 12:35:55.760587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 326/644] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 12:35:55 2022] POST /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:35:55.769638 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-58e02d3d-b6da-484c-8b3c-e6672d1683dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:55.770414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-58e02d3d-b6da-484c-8b3c-e6672d1683dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:55.777142 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58e02d3d-b6da-484c-8b3c-e6672d1683dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:55.777624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58e02d3d-b6da-484c-8b3c-e6672d1683dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:55.778057 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58e02d3d-b6da-484c-8b3c-e6672d1683dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:55.778775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58e02d3d-b6da-484c-8b3c-e6672d1683dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:55.779255 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58e02d3d-b6da-484c-8b3c-e6672d1683dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:55.779676 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58e02d3d-b6da-484c-8b3c-e6672d1683dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:55.929119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-58e02d3d-b6da-484c-8b3c-e6672d1683dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:55.937515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-58e02d3d-b6da-484c-8b3c-e6672d1683dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1752 microversion: 2.1 time: 0.172514 Aug 24 12:35:55.938070 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 319/645] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:55 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:56.960198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1edcc078-3845-44c7-874a-4d139b501033 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:56.960897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1edcc078-3845-44c7-874a-4d139b501033 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:56.967190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1edcc078-3845-44c7-874a-4d139b501033 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:56.967695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1edcc078-3845-44c7-874a-4d139b501033 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:56.968114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1edcc078-3845-44c7-874a-4d139b501033 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:56.968809 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1edcc078-3845-44c7-874a-4d139b501033 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:56.969261 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1edcc078-3845-44c7-874a-4d139b501033 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:56.969687 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1edcc078-3845-44c7-874a-4d139b501033 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:57.116063 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1edcc078-3845-44c7-874a-4d139b501033 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:57.124166 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1edcc078-3845-44c7-874a-4d139b501033 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1757 microversion: 2.1 time: 0.168686 Aug 24 12:35:57.124718 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 327/646] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:56 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:58.145246 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4857e27f-c7d3-4ac3-b76b-1e79ff7e3ac8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:58.145845 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4857e27f-c7d3-4ac3-b76b-1e79ff7e3ac8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:58.152293 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4857e27f-c7d3-4ac3-b76b-1e79ff7e3ac8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:58.152776 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4857e27f-c7d3-4ac3-b76b-1e79ff7e3ac8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:58.153211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4857e27f-c7d3-4ac3-b76b-1e79ff7e3ac8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:58.153898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4857e27f-c7d3-4ac3-b76b-1e79ff7e3ac8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:58.154354 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4857e27f-c7d3-4ac3-b76b-1e79ff7e3ac8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:58.154811 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4857e27f-c7d3-4ac3-b76b-1e79ff7e3ac8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:58.292947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4857e27f-c7d3-4ac3-b76b-1e79ff7e3ac8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:58.301105 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4857e27f-c7d3-4ac3-b76b-1e79ff7e3ac8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1757 microversion: 2.1 time: 0.159711 Aug 24 12:35:58.301668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 320/647] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:58 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:59.324987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-70ed75a1-e068-4820-88aa-d4fe3fd3fa02 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:59.325593 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-70ed75a1-e068-4820-88aa-d4fe3fd3fa02 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:59.331941 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70ed75a1-e068-4820-88aa-d4fe3fd3fa02 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:59.332417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70ed75a1-e068-4820-88aa-d4fe3fd3fa02 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:59.332849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70ed75a1-e068-4820-88aa-d4fe3fd3fa02 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:59.334133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70ed75a1-e068-4820-88aa-d4fe3fd3fa02 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:59.334601 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70ed75a1-e068-4820-88aa-d4fe3fd3fa02 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:59.335045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70ed75a1-e068-4820-88aa-d4fe3fd3fa02 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:59.475765 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-70ed75a1-e068-4820-88aa-d4fe3fd3fa02 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:59.484187 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-70ed75a1-e068-4820-88aa-d4fe3fd3fa02 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1757 microversion: 2.1 time: 0.163069 Aug 24 12:35:59.484745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 328/648] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:59 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:00.507385 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f80f5cb9-ba73-4fb2-b823-96260bb73ed2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:00.507993 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f80f5cb9-ba73-4fb2-b823-96260bb73ed2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:00.514401 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f80f5cb9-ba73-4fb2-b823-96260bb73ed2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:00.514976 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f80f5cb9-ba73-4fb2-b823-96260bb73ed2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:00.515473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f80f5cb9-ba73-4fb2-b823-96260bb73ed2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:00.516190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f80f5cb9-ba73-4fb2-b823-96260bb73ed2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:00.516647 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f80f5cb9-ba73-4fb2-b823-96260bb73ed2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:00.517069 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f80f5cb9-ba73-4fb2-b823-96260bb73ed2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:00.655686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f80f5cb9-ba73-4fb2-b823-96260bb73ed2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:00.664075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f80f5cb9-ba73-4fb2-b823-96260bb73ed2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1757 microversion: 2.1 time: 0.161185 Aug 24 12:36:00.664624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 321/649] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:00 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:01.060182 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c5ee5d9a-a4fc-4a19-8e07-59da9b842454 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:01.062429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c5ee5d9a-a4fc-4a19-8e07-59da9b842454 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:01.069318 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5ee5d9a-a4fc-4a19-8e07-59da9b842454 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:01.069800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5ee5d9a-a4fc-4a19-8e07-59da9b842454 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:01.070230 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5ee5d9a-a4fc-4a19-8e07-59da9b842454 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:01.071037 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5ee5d9a-a4fc-4a19-8e07-59da9b842454 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:01.071432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5ee5d9a-a4fc-4a19-8e07-59da9b842454 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:01.071853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5ee5d9a-a4fc-4a19-8e07-59da9b842454 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:01.094253 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.objects.instance [None req-c5ee5d9a-a4fc-4a19-8e07-59da9b842454 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lazy-loading 'flavor' on Instance uuid 50cb23a1-9864-46ef-ae19-411f522e9f10 {{(pid=121171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:36:01.472190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c5ee5d9a-a4fc-4a19-8e07-59da9b842454 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "POST /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/action" status: 200 len: 32 microversion: 2.1 time: 0.415927 Aug 24 12:36:01.472749 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 329/650] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 12:36:01 2022] POST /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/action => generated 32 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 12:36:01.483135 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5b606cbe-4bd9-49df-b3e5-57fac92743ce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:01.484026 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5b606cbe-4bd9-49df-b3e5-57fac92743ce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:01.491590 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b606cbe-4bd9-49df-b3e5-57fac92743ce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:01.492074 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b606cbe-4bd9-49df-b3e5-57fac92743ce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:01.492535 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b606cbe-4bd9-49df-b3e5-57fac92743ce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:01.493227 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b606cbe-4bd9-49df-b3e5-57fac92743ce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:01.493700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b606cbe-4bd9-49df-b3e5-57fac92743ce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:01.494207 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b606cbe-4bd9-49df-b3e5-57fac92743ce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:01.627925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5b606cbe-4bd9-49df-b3e5-57fac92743ce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:01.636265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5b606cbe-4bd9-49df-b3e5-57fac92743ce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.157038 Aug 24 12:36:01.636824 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 322/651] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:01 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:01.685850 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1a4dd58a-19df-4553-9e57-3895bff1b742 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:01.686540 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1a4dd58a-19df-4553-9e57-3895bff1b742 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:01.693042 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1a4dd58a-19df-4553-9e57-3895bff1b742 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:01.693513 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1a4dd58a-19df-4553-9e57-3895bff1b742 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:01.693948 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1a4dd58a-19df-4553-9e57-3895bff1b742 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:01.694641 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1a4dd58a-19df-4553-9e57-3895bff1b742 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:01.695117 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1a4dd58a-19df-4553-9e57-3895bff1b742 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:01.695545 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1a4dd58a-19df-4553-9e57-3895bff1b742 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:01.931958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1a4dd58a-19df-4553-9e57-3895bff1b742 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:01.940402 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1a4dd58a-19df-4553-9e57-3895bff1b742 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1757 microversion: 2.1 time: 0.258988 Aug 24 12:36:01.940976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 330/652] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:01 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1757 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:02.657975 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fa920252-91b2-48bc-9c03-1d339acfed80 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:02.658987 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fa920252-91b2-48bc-9c03-1d339acfed80 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:02.665335 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa920252-91b2-48bc-9c03-1d339acfed80 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:02.665821 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa920252-91b2-48bc-9c03-1d339acfed80 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:02.666255 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa920252-91b2-48bc-9c03-1d339acfed80 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:02.666969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa920252-91b2-48bc-9c03-1d339acfed80 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:02.667422 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa920252-91b2-48bc-9c03-1d339acfed80 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:02.667840 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa920252-91b2-48bc-9c03-1d339acfed80 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:02.811510 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fa920252-91b2-48bc-9c03-1d339acfed80 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:02.819766 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fa920252-91b2-48bc-9c03-1d339acfed80 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.166356 Aug 24 12:36:02.820324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 323/653] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:02 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:02.960751 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6e4d5dd1-acee-4999-8b42-d5779d78fd2a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:02.961360 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6e4d5dd1-acee-4999-8b42-d5779d78fd2a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:02.967782 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e4d5dd1-acee-4999-8b42-d5779d78fd2a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:02.968272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e4d5dd1-acee-4999-8b42-d5779d78fd2a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:02.968709 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e4d5dd1-acee-4999-8b42-d5779d78fd2a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:02.969399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e4d5dd1-acee-4999-8b42-d5779d78fd2a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:02.969857 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e4d5dd1-acee-4999-8b42-d5779d78fd2a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:02.970284 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e4d5dd1-acee-4999-8b42-d5779d78fd2a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:03.186897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6e4d5dd1-acee-4999-8b42-d5779d78fd2a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:03.195637 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6e4d5dd1-acee-4999-8b42-d5779d78fd2a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1757 microversion: 2.1 time: 0.238728 Aug 24 12:36:03.196215 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 331/654] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:02 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1757 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:03.840553 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4b4045d4-0a87-4d4b-9684-c5e0dc42dbcf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:03.841158 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4b4045d4-0a87-4d4b-9684-c5e0dc42dbcf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:03.847620 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4b4045d4-0a87-4d4b-9684-c5e0dc42dbcf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:03.848103 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4b4045d4-0a87-4d4b-9684-c5e0dc42dbcf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:03.848540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4b4045d4-0a87-4d4b-9684-c5e0dc42dbcf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:03.849223 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4b4045d4-0a87-4d4b-9684-c5e0dc42dbcf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:03.850197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4b4045d4-0a87-4d4b-9684-c5e0dc42dbcf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:03.850623 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4b4045d4-0a87-4d4b-9684-c5e0dc42dbcf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:03.979611 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4b4045d4-0a87-4d4b-9684-c5e0dc42dbcf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:03.988461 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4b4045d4-0a87-4d4b-9684-c5e0dc42dbcf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151747 Aug 24 12:36:03.989023 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 324/655] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:03 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:04.217117 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-43c86d89-7e5f-4593-8754-26e51ada9205 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:04.217656 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-43c86d89-7e5f-4593-8754-26e51ada9205 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:04.223966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43c86d89-7e5f-4593-8754-26e51ada9205 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:04.224446 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43c86d89-7e5f-4593-8754-26e51ada9205 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:04.225468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43c86d89-7e5f-4593-8754-26e51ada9205 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:04.226154 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43c86d89-7e5f-4593-8754-26e51ada9205 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:04.226602 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43c86d89-7e5f-4593-8754-26e51ada9205 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:04.227050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43c86d89-7e5f-4593-8754-26e51ada9205 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:04.367527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-43c86d89-7e5f-4593-8754-26e51ada9205 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:04.375669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-43c86d89-7e5f-4593-8754-26e51ada9205 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1757 microversion: 2.1 time: 0.162435 Aug 24 12:36:04.376515 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 332/656] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:04 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:05.009310 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a5171ca8-a016-46d9-9d74-1cfb074acdfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:05.009919 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a5171ca8-a016-46d9-9d74-1cfb074acdfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:05.016279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a5171ca8-a016-46d9-9d74-1cfb074acdfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:05.016770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a5171ca8-a016-46d9-9d74-1cfb074acdfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:05.017217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a5171ca8-a016-46d9-9d74-1cfb074acdfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:05.017910 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a5171ca8-a016-46d9-9d74-1cfb074acdfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:05.018371 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a5171ca8-a016-46d9-9d74-1cfb074acdfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:05.018827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a5171ca8-a016-46d9-9d74-1cfb074acdfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:05.147079 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a5171ca8-a016-46d9-9d74-1cfb074acdfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:05.155308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a5171ca8-a016-46d9-9d74-1cfb074acdfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150414 Aug 24 12:36:05.155897 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 325/657] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:05 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:05.398234 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b96409ea-36e2-476c-ab63-992dfa49e38b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:05.398794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b96409ea-36e2-476c-ab63-992dfa49e38b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:05.405170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b96409ea-36e2-476c-ab63-992dfa49e38b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:05.405556 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b96409ea-36e2-476c-ab63-992dfa49e38b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:05.405988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b96409ea-36e2-476c-ab63-992dfa49e38b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:05.406688 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b96409ea-36e2-476c-ab63-992dfa49e38b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:05.407146 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b96409ea-36e2-476c-ab63-992dfa49e38b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:05.407569 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b96409ea-36e2-476c-ab63-992dfa49e38b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:05.553815 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b96409ea-36e2-476c-ab63-992dfa49e38b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:05.561872 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b96409ea-36e2-476c-ab63-992dfa49e38b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1757 microversion: 2.1 time: 0.167585 Aug 24 12:36:05.562423 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 333/658] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:05 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:06.176611 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e540c766-e25c-4f3a-b954-7b3e6d1b01e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:06.177237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e540c766-e25c-4f3a-b954-7b3e6d1b01e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:06.183726 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e540c766-e25c-4f3a-b954-7b3e6d1b01e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:06.184242 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e540c766-e25c-4f3a-b954-7b3e6d1b01e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:06.184721 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e540c766-e25c-4f3a-b954-7b3e6d1b01e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:06.185408 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e540c766-e25c-4f3a-b954-7b3e6d1b01e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:06.185869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e540c766-e25c-4f3a-b954-7b3e6d1b01e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:06.186296 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e540c766-e25c-4f3a-b954-7b3e6d1b01e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:06.315569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e540c766-e25c-4f3a-b954-7b3e6d1b01e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:06.324783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e540c766-e25c-4f3a-b954-7b3e6d1b01e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151764 Aug 24 12:36:06.325504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 326/659] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:06 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:06.583532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-17b42c63-f16d-44eb-8fa9-0b5492e2e761 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:06.585020 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-17b42c63-f16d-44eb-8fa9-0b5492e2e761 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:06.591597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-17b42c63-f16d-44eb-8fa9-0b5492e2e761 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:06.592079 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-17b42c63-f16d-44eb-8fa9-0b5492e2e761 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:06.592514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-17b42c63-f16d-44eb-8fa9-0b5492e2e761 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:06.593196 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-17b42c63-f16d-44eb-8fa9-0b5492e2e761 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:06.593674 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-17b42c63-f16d-44eb-8fa9-0b5492e2e761 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:06.594100 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-17b42c63-f16d-44eb-8fa9-0b5492e2e761 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:06.731035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-17b42c63-f16d-44eb-8fa9-0b5492e2e761 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:06.739081 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-17b42c63-f16d-44eb-8fa9-0b5492e2e761 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1757 microversion: 2.1 time: 0.159481 Aug 24 12:36:06.739892 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 334/660] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:06 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:07.345546 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bc14ee3f-7b31-428b-8d8c-b99dda3ba579 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:07.346150 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bc14ee3f-7b31-428b-8d8c-b99dda3ba579 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:07.352954 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc14ee3f-7b31-428b-8d8c-b99dda3ba579 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:07.353473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc14ee3f-7b31-428b-8d8c-b99dda3ba579 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:07.353867 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc14ee3f-7b31-428b-8d8c-b99dda3ba579 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:07.354544 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc14ee3f-7b31-428b-8d8c-b99dda3ba579 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:07.355017 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc14ee3f-7b31-428b-8d8c-b99dda3ba579 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:07.355436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc14ee3f-7b31-428b-8d8c-b99dda3ba579 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:07.482563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bc14ee3f-7b31-428b-8d8c-b99dda3ba579 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:07.491561 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bc14ee3f-7b31-428b-8d8c-b99dda3ba579 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150187 Aug 24 12:36:07.492112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 327/661] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:07 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:07.759628 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3d117df5-1a3a-4fb5-9014-ea0fcd2ef292 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:07.760284 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3d117df5-1a3a-4fb5-9014-ea0fcd2ef292 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:07.766727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3d117df5-1a3a-4fb5-9014-ea0fcd2ef292 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:07.767211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3d117df5-1a3a-4fb5-9014-ea0fcd2ef292 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:07.767637 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3d117df5-1a3a-4fb5-9014-ea0fcd2ef292 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:07.768324 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3d117df5-1a3a-4fb5-9014-ea0fcd2ef292 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:07.768755 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3d117df5-1a3a-4fb5-9014-ea0fcd2ef292 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:07.769170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3d117df5-1a3a-4fb5-9014-ea0fcd2ef292 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:07.910376 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3d117df5-1a3a-4fb5-9014-ea0fcd2ef292 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:07.919301 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3d117df5-1a3a-4fb5-9014-ea0fcd2ef292 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1757 microversion: 2.1 time: 0.163503 Aug 24 12:36:07.919868 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 335/662] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:07 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:08.512783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-da771fe9-84f8-431a-8468-1725d8a2f138 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:08.513405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-da771fe9-84f8-431a-8468-1725d8a2f138 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:08.519898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da771fe9-84f8-431a-8468-1725d8a2f138 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:08.520388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da771fe9-84f8-431a-8468-1725d8a2f138 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:08.520830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da771fe9-84f8-431a-8468-1725d8a2f138 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:08.521607 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da771fe9-84f8-431a-8468-1725d8a2f138 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:08.522072 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da771fe9-84f8-431a-8468-1725d8a2f138 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:08.522503 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da771fe9-84f8-431a-8468-1725d8a2f138 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:08.649601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-da771fe9-84f8-431a-8468-1725d8a2f138 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:08.658081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-da771fe9-84f8-431a-8468-1725d8a2f138 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149120 Aug 24 12:36:08.658897 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 328/663] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:08 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:08.940342 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4fea9190-cf2b-44df-a654-f338c9f6bdbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:08.940876 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4fea9190-cf2b-44df-a654-f338c9f6bdbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:08.947109 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4fea9190-cf2b-44df-a654-f338c9f6bdbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:08.950384 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4fea9190-cf2b-44df-a654-f338c9f6bdbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:08.950384 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4fea9190-cf2b-44df-a654-f338c9f6bdbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:08.950384 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4fea9190-cf2b-44df-a654-f338c9f6bdbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:08.950384 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4fea9190-cf2b-44df-a654-f338c9f6bdbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:08.950905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4fea9190-cf2b-44df-a654-f338c9f6bdbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:09.093526 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4fea9190-cf2b-44df-a654-f338c9f6bdbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:09.103520 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4fea9190-cf2b-44df-a654-f338c9f6bdbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1757 microversion: 2.1 time: 0.167059 Aug 24 12:36:09.104073 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 336/664] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:08 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:09.678723 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1a2a6d19-7071-47dd-b7bb-357d91f2b743 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:09.679313 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1a2a6d19-7071-47dd-b7bb-357d91f2b743 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:09.685698 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1a2a6d19-7071-47dd-b7bb-357d91f2b743 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:09.686180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1a2a6d19-7071-47dd-b7bb-357d91f2b743 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:09.686615 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1a2a6d19-7071-47dd-b7bb-357d91f2b743 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:09.687334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1a2a6d19-7071-47dd-b7bb-357d91f2b743 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:09.687790 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1a2a6d19-7071-47dd-b7bb-357d91f2b743 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:09.688217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1a2a6d19-7071-47dd-b7bb-357d91f2b743 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:09.817265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1a2a6d19-7071-47dd-b7bb-357d91f2b743 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:09.825870 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1a2a6d19-7071-47dd-b7bb-357d91f2b743 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151108 Aug 24 12:36:09.826426 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 329/665] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:09 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:10.125083 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4b8435df-4141-42f9-bbed-f359de60e547 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:10.125689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4b8435df-4141-42f9-bbed-f359de60e547 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:10.132575 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b8435df-4141-42f9-bbed-f359de60e547 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:10.133057 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b8435df-4141-42f9-bbed-f359de60e547 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:10.133486 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b8435df-4141-42f9-bbed-f359de60e547 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:10.135771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b8435df-4141-42f9-bbed-f359de60e547 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:10.135771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b8435df-4141-42f9-bbed-f359de60e547 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:10.135771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b8435df-4141-42f9-bbed-f359de60e547 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:10.139666 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:10.277099 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4b8435df-4141-42f9-bbed-f359de60e547 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:10.285278 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4b8435df-4141-42f9-bbed-f359de60e547 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1757 microversion: 2.1 time: 0.164051 Aug 24 12:36:10.285837 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 337/666] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:10 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:10.846307 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-76da73bf-846a-4324-9ba8-a63fe33b5a72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:10.846960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-76da73bf-846a-4324-9ba8-a63fe33b5a72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:10.853870 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-76da73bf-846a-4324-9ba8-a63fe33b5a72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:10.854352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-76da73bf-846a-4324-9ba8-a63fe33b5a72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:10.854818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-76da73bf-846a-4324-9ba8-a63fe33b5a72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:10.855506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-76da73bf-846a-4324-9ba8-a63fe33b5a72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:10.855964 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-76da73bf-846a-4324-9ba8-a63fe33b5a72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:10.856388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-76da73bf-846a-4324-9ba8-a63fe33b5a72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:10.983731 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-76da73bf-846a-4324-9ba8-a63fe33b5a72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:10.992092 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-76da73bf-846a-4324-9ba8-a63fe33b5a72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149642 Aug 24 12:36:10.992644 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 330/667] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:10 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:11.307007 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e047f346-a49d-4695-a0ad-4a2440a59ad6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:11.307614 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e047f346-a49d-4695-a0ad-4a2440a59ad6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:11.314779 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e047f346-a49d-4695-a0ad-4a2440a59ad6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:11.315260 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e047f346-a49d-4695-a0ad-4a2440a59ad6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:11.315703 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e047f346-a49d-4695-a0ad-4a2440a59ad6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:11.316381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e047f346-a49d-4695-a0ad-4a2440a59ad6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:11.316829 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e047f346-a49d-4695-a0ad-4a2440a59ad6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:11.317250 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e047f346-a49d-4695-a0ad-4a2440a59ad6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:11.462293 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e047f346-a49d-4695-a0ad-4a2440a59ad6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:11.470386 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e047f346-a49d-4695-a0ad-4a2440a59ad6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1757 microversion: 2.1 time: 0.167303 Aug 24 12:36:11.471063 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 338/668] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:11 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:12.012788 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4b148be9-318a-4b27-9a24-8a4e512546b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:12.013466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4b148be9-318a-4b27-9a24-8a4e512546b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:12.019763 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4b148be9-318a-4b27-9a24-8a4e512546b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:12.020225 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4b148be9-318a-4b27-9a24-8a4e512546b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:12.020656 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4b148be9-318a-4b27-9a24-8a4e512546b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:12.021330 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4b148be9-318a-4b27-9a24-8a4e512546b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:12.021782 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4b148be9-318a-4b27-9a24-8a4e512546b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:12.022202 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4b148be9-318a-4b27-9a24-8a4e512546b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:12.154000 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4b148be9-318a-4b27-9a24-8a4e512546b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:12.162213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4b148be9-318a-4b27-9a24-8a4e512546b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153247 Aug 24 12:36:12.163502 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 331/669] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:12 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:12.491771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-17a0bf03-c2fd-4075-a528-45879b57c942 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:12.492438 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-17a0bf03-c2fd-4075-a528-45879b57c942 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:12.498921 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-17a0bf03-c2fd-4075-a528-45879b57c942 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:12.499399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-17a0bf03-c2fd-4075-a528-45879b57c942 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:12.499831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-17a0bf03-c2fd-4075-a528-45879b57c942 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:12.500509 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-17a0bf03-c2fd-4075-a528-45879b57c942 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:12.500975 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-17a0bf03-c2fd-4075-a528-45879b57c942 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:12.501412 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-17a0bf03-c2fd-4075-a528-45879b57c942 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:12.641805 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-17a0bf03-c2fd-4075-a528-45879b57c942 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:12.650455 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-17a0bf03-c2fd-4075-a528-45879b57c942 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1757 microversion: 2.1 time: 0.162817 Aug 24 12:36:12.651026 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 339/670] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:12 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:13.184436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0bef3e2f-0c7a-43b6-8264-eddccd51b69e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:13.185048 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0bef3e2f-0c7a-43b6-8264-eddccd51b69e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:13.191423 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bef3e2f-0c7a-43b6-8264-eddccd51b69e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:13.191907 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bef3e2f-0c7a-43b6-8264-eddccd51b69e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:13.192345 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bef3e2f-0c7a-43b6-8264-eddccd51b69e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:13.193031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bef3e2f-0c7a-43b6-8264-eddccd51b69e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:13.193490 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bef3e2f-0c7a-43b6-8264-eddccd51b69e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:13.194542 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bef3e2f-0c7a-43b6-8264-eddccd51b69e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:13.320402 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0bef3e2f-0c7a-43b6-8264-eddccd51b69e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:13.328499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0bef3e2f-0c7a-43b6-8264-eddccd51b69e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.147987 Aug 24 12:36:13.329063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 332/671] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:13 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:13.671455 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0bd35e36-0c76-4ae6-91e0-fc0025531990 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:13.672044 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0bd35e36-0c76-4ae6-91e0-fc0025531990 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:13.678582 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0bd35e36-0c76-4ae6-91e0-fc0025531990 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:13.679117 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0bd35e36-0c76-4ae6-91e0-fc0025531990 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:13.679548 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0bd35e36-0c76-4ae6-91e0-fc0025531990 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:13.680236 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0bd35e36-0c76-4ae6-91e0-fc0025531990 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:13.680686 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0bd35e36-0c76-4ae6-91e0-fc0025531990 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:13.681109 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0bd35e36-0c76-4ae6-91e0-fc0025531990 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:13.820574 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0bd35e36-0c76-4ae6-91e0-fc0025531990 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:13.828585 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0bd35e36-0c76-4ae6-91e0-fc0025531990 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1757 microversion: 2.1 time: 0.160976 Aug 24 12:36:13.829147 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 340/672] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:13 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:14.349775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f85eef3f-9277-49af-9582-cc92d475c042 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:14.350405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f85eef3f-9277-49af-9582-cc92d475c042 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:14.356767 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f85eef3f-9277-49af-9582-cc92d475c042 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:14.357246 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f85eef3f-9277-49af-9582-cc92d475c042 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:14.357677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f85eef3f-9277-49af-9582-cc92d475c042 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:14.358358 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f85eef3f-9277-49af-9582-cc92d475c042 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:14.358847 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f85eef3f-9277-49af-9582-cc92d475c042 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:14.359266 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f85eef3f-9277-49af-9582-cc92d475c042 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:14.363233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:14.487203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f85eef3f-9277-49af-9582-cc92d475c042 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:14.496519 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f85eef3f-9277-49af-9582-cc92d475c042 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150583 Aug 24 12:36:14.497072 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 333/673] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:14 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:14.628135 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-eaa4a6ca-6c90-425d-b323-fc2950dda50d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:14.628629 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-eaa4a6ca-6c90-425d-b323-fc2950dda50d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:14.635212 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eaa4a6ca-6c90-425d-b323-fc2950dda50d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:14.635691 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eaa4a6ca-6c90-425d-b323-fc2950dda50d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:14.636123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eaa4a6ca-6c90-425d-b323-fc2950dda50d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:14.636800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eaa4a6ca-6c90-425d-b323-fc2950dda50d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:14.637251 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eaa4a6ca-6c90-425d-b323-fc2950dda50d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:14.637670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eaa4a6ca-6c90-425d-b323-fc2950dda50d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:14.760015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.objects.instance [None req-eaa4a6ca-6c90-425d-b323-fc2950dda50d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lazy-loading 'services' on Instance uuid 720992f6-0031-4c2a-801d-07a71dd87158 {{(pid=121171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:36:14.851158 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ad3f0bbd-6188-4ffe-ab1c-aeef4afdad91 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:14.851768 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ad3f0bbd-6188-4ffe-ab1c-aeef4afdad91 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:14.857707 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad3f0bbd-6188-4ffe-ab1c-aeef4afdad91 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:14.858186 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad3f0bbd-6188-4ffe-ab1c-aeef4afdad91 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:14.858621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad3f0bbd-6188-4ffe-ab1c-aeef4afdad91 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:14.859336 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad3f0bbd-6188-4ffe-ab1c-aeef4afdad91 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:14.859789 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad3f0bbd-6188-4ffe-ab1c-aeef4afdad91 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:14.860213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad3f0bbd-6188-4ffe-ab1c-aeef4afdad91 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:15.003511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ad3f0bbd-6188-4ffe-ab1c-aeef4afdad91 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:15.011893 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ad3f0bbd-6188-4ffe-ab1c-aeef4afdad91 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1757 microversion: 2.1 time: 0.165443 Aug 24 12:36:15.012213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-eaa4a6ca-6c90-425d-b323-fc2950dda50d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "DELETE /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments/2d58db43-61ed-46df-b0b4-8a520e6b6d9a" status: 202 len: 0 microversion: 2.1 time: 0.483893 Aug 24 12:36:15.012665 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 334/674] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:14 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:15.012966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 341/675] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 24 12:36:14 2022] DELETE /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments/2d58db43-61ed-46df-b0b4-8a520e6b6d9a => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:36:15.519006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c1bfa27a-0fb3-49f6-976d-2b3a6f02cd17 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:15.519006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c1bfa27a-0fb3-49f6-976d-2b3a6f02cd17 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:15.525773 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1bfa27a-0fb3-49f6-976d-2b3a6f02cd17 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:15.526262 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1bfa27a-0fb3-49f6-976d-2b3a6f02cd17 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:15.526747 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1bfa27a-0fb3-49f6-976d-2b3a6f02cd17 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:15.527425 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1bfa27a-0fb3-49f6-976d-2b3a6f02cd17 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:15.527886 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1bfa27a-0fb3-49f6-976d-2b3a6f02cd17 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:15.528307 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1bfa27a-0fb3-49f6-976d-2b3a6f02cd17 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:15.662633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c1bfa27a-0fb3-49f6-976d-2b3a6f02cd17 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:15.670642 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c1bfa27a-0fb3-49f6-976d-2b3a6f02cd17 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.156806 Aug 24 12:36:15.671216 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 335/676] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:15 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:16.034294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5dd6106c-6652-49a0-992e-e4c7cdc314cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:16.034998 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5dd6106c-6652-49a0-992e-e4c7cdc314cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:16.041017 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5dd6106c-6652-49a0-992e-e4c7cdc314cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:16.041492 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5dd6106c-6652-49a0-992e-e4c7cdc314cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:16.041919 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5dd6106c-6652-49a0-992e-e4c7cdc314cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:16.042591 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5dd6106c-6652-49a0-992e-e4c7cdc314cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:16.043063 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5dd6106c-6652-49a0-992e-e4c7cdc314cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:16.043480 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5dd6106c-6652-49a0-992e-e4c7cdc314cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:16.189012 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5dd6106c-6652-49a0-992e-e4c7cdc314cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:16.197783 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5dd6106c-6652-49a0-992e-e4c7cdc314cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1760 microversion: 2.1 time: 0.168262 Aug 24 12:36:16.198338 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 342/677] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:16 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1760 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:16.691092 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-45b3339d-9db5-4d0b-a567-63794b907bfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:16.691705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-45b3339d-9db5-4d0b-a567-63794b907bfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:16.697963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45b3339d-9db5-4d0b-a567-63794b907bfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:16.698447 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45b3339d-9db5-4d0b-a567-63794b907bfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:16.698925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45b3339d-9db5-4d0b-a567-63794b907bfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:16.699614 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45b3339d-9db5-4d0b-a567-63794b907bfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:16.700073 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45b3339d-9db5-4d0b-a567-63794b907bfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:16.700498 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45b3339d-9db5-4d0b-a567-63794b907bfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:16.832260 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-45b3339d-9db5-4d0b-a567-63794b907bfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:16.840809 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-45b3339d-9db5-4d0b-a567-63794b907bfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153472 Aug 24 12:36:16.841366 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 336/678] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:16 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:17.861756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-76ae1dcc-412c-4064-97bd-412e6ed1452f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:17.862354 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-76ae1dcc-412c-4064-97bd-412e6ed1452f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:17.869481 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76ae1dcc-412c-4064-97bd-412e6ed1452f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:17.869951 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76ae1dcc-412c-4064-97bd-412e6ed1452f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:17.870378 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76ae1dcc-412c-4064-97bd-412e6ed1452f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:17.871074 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76ae1dcc-412c-4064-97bd-412e6ed1452f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:17.871520 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76ae1dcc-412c-4064-97bd-412e6ed1452f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:17.871936 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76ae1dcc-412c-4064-97bd-412e6ed1452f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:18.002005 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-76ae1dcc-412c-4064-97bd-412e6ed1452f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:18.010110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-76ae1dcc-412c-4064-97bd-412e6ed1452f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152153 Aug 24 12:36:18.010677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 343/679] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:17 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:19.030288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c9d104e5-5f3d-483e-8ecf-850b3cef0498 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:19.030924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c9d104e5-5f3d-483e-8ecf-850b3cef0498 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:19.037453 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9d104e5-5f3d-483e-8ecf-850b3cef0498 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:19.037937 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9d104e5-5f3d-483e-8ecf-850b3cef0498 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:19.038368 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9d104e5-5f3d-483e-8ecf-850b3cef0498 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:19.039085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9d104e5-5f3d-483e-8ecf-850b3cef0498 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:19.039539 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9d104e5-5f3d-483e-8ecf-850b3cef0498 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:19.039961 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9d104e5-5f3d-483e-8ecf-850b3cef0498 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:19.166776 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c9d104e5-5f3d-483e-8ecf-850b3cef0498 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:19.174864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c9d104e5-5f3d-483e-8ecf-850b3cef0498 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148466 Aug 24 12:36:19.175424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 337/680] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:19 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:20.196900 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2d92baa5-97bb-4afd-9b1c-865a01fc60fb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:20.197529 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2d92baa5-97bb-4afd-9b1c-865a01fc60fb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:20.203836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d92baa5-97bb-4afd-9b1c-865a01fc60fb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:20.204338 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d92baa5-97bb-4afd-9b1c-865a01fc60fb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:20.204764 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d92baa5-97bb-4afd-9b1c-865a01fc60fb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:20.205441 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d92baa5-97bb-4afd-9b1c-865a01fc60fb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:20.205886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d92baa5-97bb-4afd-9b1c-865a01fc60fb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:20.206305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d92baa5-97bb-4afd-9b1c-865a01fc60fb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:20.339662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2d92baa5-97bb-4afd-9b1c-865a01fc60fb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:20.348491 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2d92baa5-97bb-4afd-9b1c-865a01fc60fb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.156339 Aug 24 12:36:20.349053 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 344/681] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:20 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:21.369314 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5e33bfd2-7c51-4337-b3e7-78bfef65e861 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:21.369923 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5e33bfd2-7c51-4337-b3e7-78bfef65e861 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:21.376658 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e33bfd2-7c51-4337-b3e7-78bfef65e861 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:21.377139 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e33bfd2-7c51-4337-b3e7-78bfef65e861 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:21.377597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e33bfd2-7c51-4337-b3e7-78bfef65e861 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:21.378357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e33bfd2-7c51-4337-b3e7-78bfef65e861 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:21.378852 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e33bfd2-7c51-4337-b3e7-78bfef65e861 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:21.379277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e33bfd2-7c51-4337-b3e7-78bfef65e861 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:21.510057 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5e33bfd2-7c51-4337-b3e7-78bfef65e861 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:21.518181 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5e33bfd2-7c51-4337-b3e7-78bfef65e861 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152774 Aug 24 12:36:21.518763 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 338/682] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:21 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:22.540132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-635de554-7236-41d2-8906-7a5bd916bf9e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:22.540766 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-635de554-7236-41d2-8906-7a5bd916bf9e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:22.543319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=41 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:22.547879 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-635de554-7236-41d2-8906-7a5bd916bf9e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:22.548347 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-635de554-7236-41d2-8906-7a5bd916bf9e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:22.548773 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-635de554-7236-41d2-8906-7a5bd916bf9e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:22.549449 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-635de554-7236-41d2-8906-7a5bd916bf9e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:22.549894 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-635de554-7236-41d2-8906-7a5bd916bf9e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:22.550308 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-635de554-7236-41d2-8906-7a5bd916bf9e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:22.677870 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-635de554-7236-41d2-8906-7a5bd916bf9e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:22.685981 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-635de554-7236-41d2-8906-7a5bd916bf9e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150533 Aug 24 12:36:22.686540 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 345/683] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:22 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:23.707294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c5bc420c-c86d-4ed2-b366-92084245092c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:23.707903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c5bc420c-c86d-4ed2-b366-92084245092c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:23.710229 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=43 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:23.715187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c5bc420c-c86d-4ed2-b366-92084245092c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:23.715677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c5bc420c-c86d-4ed2-b366-92084245092c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:23.716110 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c5bc420c-c86d-4ed2-b366-92084245092c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:23.716808 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c5bc420c-c86d-4ed2-b366-92084245092c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:23.717254 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c5bc420c-c86d-4ed2-b366-92084245092c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:23.717678 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c5bc420c-c86d-4ed2-b366-92084245092c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:23.846198 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c5bc420c-c86d-4ed2-b366-92084245092c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:23.855052 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c5bc420c-c86d-4ed2-b366-92084245092c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151664 Aug 24 12:36:23.855783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 339/684] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:23 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:24.876967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0ccc5d6b-ee2e-4dca-8e79-784975679667 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:24.877407 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0ccc5d6b-ee2e-4dca-8e79-784975679667 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:24.884487 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ccc5d6b-ee2e-4dca-8e79-784975679667 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:24.884972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ccc5d6b-ee2e-4dca-8e79-784975679667 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:24.885405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ccc5d6b-ee2e-4dca-8e79-784975679667 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:24.886086 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ccc5d6b-ee2e-4dca-8e79-784975679667 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:24.886532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ccc5d6b-ee2e-4dca-8e79-784975679667 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:24.886975 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ccc5d6b-ee2e-4dca-8e79-784975679667 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:25.014789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0ccc5d6b-ee2e-4dca-8e79-784975679667 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:25.023058 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0ccc5d6b-ee2e-4dca-8e79-784975679667 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150020 Aug 24 12:36:25.023686 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 346/685] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:24 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:26.043846 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-26f8f410-db8b-422b-b9e1-3fc4c75650f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:26.044447 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-26f8f410-db8b-422b-b9e1-3fc4c75650f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:26.050916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-26f8f410-db8b-422b-b9e1-3fc4c75650f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:26.051397 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-26f8f410-db8b-422b-b9e1-3fc4c75650f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:26.051830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-26f8f410-db8b-422b-b9e1-3fc4c75650f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:26.052508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-26f8f410-db8b-422b-b9e1-3fc4c75650f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:26.052962 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-26f8f410-db8b-422b-b9e1-3fc4c75650f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:26.053382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-26f8f410-db8b-422b-b9e1-3fc4c75650f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:26.178856 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-26f8f410-db8b-422b-b9e1-3fc4c75650f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:26.187119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-26f8f410-db8b-422b-b9e1-3fc4c75650f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.147059 Aug 24 12:36:26.187758 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 340/686] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:26 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:27.208483 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-49125812-0aab-4c95-85bb-2d9220b0b51d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:27.209502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-49125812-0aab-4c95-85bb-2d9220b0b51d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:27.215893 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-49125812-0aab-4c95-85bb-2d9220b0b51d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:27.216374 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-49125812-0aab-4c95-85bb-2d9220b0b51d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:27.216808 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-49125812-0aab-4c95-85bb-2d9220b0b51d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:27.217490 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-49125812-0aab-4c95-85bb-2d9220b0b51d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:27.217943 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-49125812-0aab-4c95-85bb-2d9220b0b51d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:27.218366 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-49125812-0aab-4c95-85bb-2d9220b0b51d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:27.343427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-49125812-0aab-4c95-85bb-2d9220b0b51d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:27.352131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-49125812-0aab-4c95-85bb-2d9220b0b51d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.147587 Aug 24 12:36:27.352698 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 347/687] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:27 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:28.373001 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-de3d4eaf-9093-40db-98fc-0f1586b71f85 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:28.373646 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-de3d4eaf-9093-40db-98fc-0f1586b71f85 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:28.380054 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de3d4eaf-9093-40db-98fc-0f1586b71f85 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:28.380541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de3d4eaf-9093-40db-98fc-0f1586b71f85 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:28.381661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de3d4eaf-9093-40db-98fc-0f1586b71f85 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:28.382559 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de3d4eaf-9093-40db-98fc-0f1586b71f85 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:28.383049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de3d4eaf-9093-40db-98fc-0f1586b71f85 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:28.383483 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de3d4eaf-9093-40db-98fc-0f1586b71f85 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:28.515609 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-de3d4eaf-9093-40db-98fc-0f1586b71f85 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:28.524764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-de3d4eaf-9093-40db-98fc-0f1586b71f85 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.155514 Aug 24 12:36:28.525343 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 341/688] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:28 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:29.546262 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b373470f-663e-4c92-a3f8-7df4fc83b3c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:29.546896 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b373470f-663e-4c92-a3f8-7df4fc83b3c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:29.553723 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b373470f-663e-4c92-a3f8-7df4fc83b3c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:29.554197 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b373470f-663e-4c92-a3f8-7df4fc83b3c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:29.554623 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b373470f-663e-4c92-a3f8-7df4fc83b3c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:29.555330 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b373470f-663e-4c92-a3f8-7df4fc83b3c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:29.555776 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b373470f-663e-4c92-a3f8-7df4fc83b3c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:29.556194 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b373470f-663e-4c92-a3f8-7df4fc83b3c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:29.684388 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b373470f-663e-4c92-a3f8-7df4fc83b3c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:29.692503 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b373470f-663e-4c92-a3f8-7df4fc83b3c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150381 Aug 24 12:36:29.693059 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 348/689] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:29 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:30.714313 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-10625dda-74f3-4b8b-8019-82e7ed162076 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:30.714882 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-10625dda-74f3-4b8b-8019-82e7ed162076 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:30.721150 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-10625dda-74f3-4b8b-8019-82e7ed162076 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:30.721639 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-10625dda-74f3-4b8b-8019-82e7ed162076 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:30.722067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-10625dda-74f3-4b8b-8019-82e7ed162076 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:30.722783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-10625dda-74f3-4b8b-8019-82e7ed162076 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:30.723233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-10625dda-74f3-4b8b-8019-82e7ed162076 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:30.723651 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-10625dda-74f3-4b8b-8019-82e7ed162076 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:30.851459 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-10625dda-74f3-4b8b-8019-82e7ed162076 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:30.859590 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-10625dda-74f3-4b8b-8019-82e7ed162076 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149135 Aug 24 12:36:30.860148 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 342/690] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:30 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:31.881703 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5fd383c3-b543-4417-b9c9-e508743657ee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:31.882308 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5fd383c3-b543-4417-b9c9-e508743657ee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:31.888620 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5fd383c3-b543-4417-b9c9-e508743657ee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:31.889099 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5fd383c3-b543-4417-b9c9-e508743657ee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:31.889532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5fd383c3-b543-4417-b9c9-e508743657ee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:31.890214 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5fd383c3-b543-4417-b9c9-e508743657ee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:31.890680 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5fd383c3-b543-4417-b9c9-e508743657ee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:31.891115 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5fd383c3-b543-4417-b9c9-e508743657ee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:32.024507 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5fd383c3-b543-4417-b9c9-e508743657ee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:32.032751 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5fd383c3-b543-4417-b9c9-e508743657ee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.155429 Aug 24 12:36:32.033309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 349/691] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:31 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:33.054239 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e8b90eb4-ec06-4215-bcc4-f285e0d3596c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:33.054865 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e8b90eb4-ec06-4215-bcc4-f285e0d3596c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:33.061312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8b90eb4-ec06-4215-bcc4-f285e0d3596c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:33.061801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8b90eb4-ec06-4215-bcc4-f285e0d3596c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:33.062243 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8b90eb4-ec06-4215-bcc4-f285e0d3596c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:33.062958 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8b90eb4-ec06-4215-bcc4-f285e0d3596c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:33.063420 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8b90eb4-ec06-4215-bcc4-f285e0d3596c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:33.063848 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8b90eb4-ec06-4215-bcc4-f285e0d3596c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:33.196518 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e8b90eb4-ec06-4215-bcc4-f285e0d3596c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:33.204619 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e8b90eb4-ec06-4215-bcc4-f285e0d3596c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.154182 Aug 24 12:36:33.205185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 343/692] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:33 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:34.226181 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-588e4f77-0383-467a-b7a2-b484f495fe8e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:34.226855 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-588e4f77-0383-467a-b7a2-b484f495fe8e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:34.233550 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-588e4f77-0383-467a-b7a2-b484f495fe8e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:34.234032 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-588e4f77-0383-467a-b7a2-b484f495fe8e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:34.234468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-588e4f77-0383-467a-b7a2-b484f495fe8e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:34.235177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-588e4f77-0383-467a-b7a2-b484f495fe8e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:34.235628 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-588e4f77-0383-467a-b7a2-b484f495fe8e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:34.236050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-588e4f77-0383-467a-b7a2-b484f495fe8e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:34.361061 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-588e4f77-0383-467a-b7a2-b484f495fe8e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:34.369328 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-588e4f77-0383-467a-b7a2-b484f495fe8e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.147924 Aug 24 12:36:34.369882 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 350/693] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:34 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:35.390432 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-223cfd6f-f468-4d3f-bca8-9f7c38373420 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:35.390990 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-223cfd6f-f468-4d3f-bca8-9f7c38373420 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:35.397814 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-223cfd6f-f468-4d3f-bca8-9f7c38373420 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:35.398294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-223cfd6f-f468-4d3f-bca8-9f7c38373420 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:35.398757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-223cfd6f-f468-4d3f-bca8-9f7c38373420 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:35.399441 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-223cfd6f-f468-4d3f-bca8-9f7c38373420 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:35.399893 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-223cfd6f-f468-4d3f-bca8-9f7c38373420 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:35.400316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-223cfd6f-f468-4d3f-bca8-9f7c38373420 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:35.527012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-223cfd6f-f468-4d3f-bca8-9f7c38373420 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:35.535083 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-223cfd6f-f468-4d3f-bca8-9f7c38373420 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148500 Aug 24 12:36:35.535647 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 344/694] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:35 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:36.557121 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8b5106a3-717b-439b-acc6-dd8263b4fcd3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:36.557726 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8b5106a3-717b-439b-acc6-dd8263b4fcd3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:36.564122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b5106a3-717b-439b-acc6-dd8263b4fcd3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:36.564600 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b5106a3-717b-439b-acc6-dd8263b4fcd3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:36.565043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b5106a3-717b-439b-acc6-dd8263b4fcd3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:36.565835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b5106a3-717b-439b-acc6-dd8263b4fcd3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:36.566172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b5106a3-717b-439b-acc6-dd8263b4fcd3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:36.566597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b5106a3-717b-439b-acc6-dd8263b4fcd3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:36.699557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8b5106a3-717b-439b-acc6-dd8263b4fcd3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:36.707573 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8b5106a3-717b-439b-acc6-dd8263b4fcd3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.154939 Aug 24 12:36:36.708123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 351/695] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:36 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:37.727411 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dc888f2c-9528-4b40-a006-0e9b17884a76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:37.728018 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dc888f2c-9528-4b40-a006-0e9b17884a76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:37.734149 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc888f2c-9528-4b40-a006-0e9b17884a76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:37.734624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc888f2c-9528-4b40-a006-0e9b17884a76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:37.735086 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc888f2c-9528-4b40-a006-0e9b17884a76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:37.735766 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc888f2c-9528-4b40-a006-0e9b17884a76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:37.736217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc888f2c-9528-4b40-a006-0e9b17884a76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:37.736637 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc888f2c-9528-4b40-a006-0e9b17884a76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:37.861686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-dc888f2c-9528-4b40-a006-0e9b17884a76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:37.870505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dc888f2c-9528-4b40-a006-0e9b17884a76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.146981 Aug 24 12:36:37.871083 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 345/696] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:37 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:38.891658 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-49452d99-2f32-46db-911f-8032ef4ad3bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:38.892262 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-49452d99-2f32-46db-911f-8032ef4ad3bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:38.899208 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-49452d99-2f32-46db-911f-8032ef4ad3bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:38.899683 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-49452d99-2f32-46db-911f-8032ef4ad3bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:38.900112 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-49452d99-2f32-46db-911f-8032ef4ad3bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:38.901370 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-49452d99-2f32-46db-911f-8032ef4ad3bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:38.901370 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-49452d99-2f32-46db-911f-8032ef4ad3bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:38.901625 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-49452d99-2f32-46db-911f-8032ef4ad3bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:39.031148 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-49452d99-2f32-46db-911f-8032ef4ad3bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:39.039170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-49452d99-2f32-46db-911f-8032ef4ad3bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151295 Aug 24 12:36:39.039706 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 352/697] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:38 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:39.198476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:36:39.198931 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 12:36:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:36:40.059731 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a3bbe025-c46c-4d33-8d8c-cfa1be1e3c6e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:40.060369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a3bbe025-c46c-4d33-8d8c-cfa1be1e3c6e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:40.066734 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a3bbe025-c46c-4d33-8d8c-cfa1be1e3c6e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:40.067237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a3bbe025-c46c-4d33-8d8c-cfa1be1e3c6e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:40.067669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a3bbe025-c46c-4d33-8d8c-cfa1be1e3c6e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:40.068351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a3bbe025-c46c-4d33-8d8c-cfa1be1e3c6e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:40.068805 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a3bbe025-c46c-4d33-8d8c-cfa1be1e3c6e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:40.069229 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a3bbe025-c46c-4d33-8d8c-cfa1be1e3c6e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:40.200748 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a3bbe025-c46c-4d33-8d8c-cfa1be1e3c6e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:40.209650 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a3bbe025-c46c-4d33-8d8c-cfa1be1e3c6e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153775 Aug 24 12:36:40.210193 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 346/698] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:40 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:41.230119 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-58ec2ab7-aa50-4090-8338-52f0be3e154c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:41.230748 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-58ec2ab7-aa50-4090-8338-52f0be3e154c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:41.236996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-58ec2ab7-aa50-4090-8338-52f0be3e154c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:41.237470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-58ec2ab7-aa50-4090-8338-52f0be3e154c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:41.237898 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-58ec2ab7-aa50-4090-8338-52f0be3e154c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:41.238580 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-58ec2ab7-aa50-4090-8338-52f0be3e154c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:41.239051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-58ec2ab7-aa50-4090-8338-52f0be3e154c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:41.240342 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-58ec2ab7-aa50-4090-8338-52f0be3e154c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:41.244207 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:41.372123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-58ec2ab7-aa50-4090-8338-52f0be3e154c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:41.376900 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-58ec2ab7-aa50-4090-8338-52f0be3e154c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150731 Aug 24 12:36:41.377450 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 353/699] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:41 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:42.397210 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5b1106ee-72f3-4c2b-a759-672d01c7cd42 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:42.397825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5b1106ee-72f3-4c2b-a759-672d01c7cd42 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:42.404223 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b1106ee-72f3-4c2b-a759-672d01c7cd42 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:42.404739 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b1106ee-72f3-4c2b-a759-672d01c7cd42 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:42.407120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b1106ee-72f3-4c2b-a759-672d01c7cd42 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:42.407120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b1106ee-72f3-4c2b-a759-672d01c7cd42 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:42.407120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b1106ee-72f3-4c2b-a759-672d01c7cd42 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:42.407120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b1106ee-72f3-4c2b-a759-672d01c7cd42 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:42.535933 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5b1106ee-72f3-4c2b-a759-672d01c7cd42 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:42.544647 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5b1106ee-72f3-4c2b-a759-672d01c7cd42 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151285 Aug 24 12:36:42.545207 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 347/700] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:42 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:42.990543 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:36:42.991089 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 12:36:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:36:43.565957 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a526abda-2bcc-4f2c-86b7-85523e7b4867 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:43.566560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a526abda-2bcc-4f2c-86b7-85523e7b4867 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:43.573529 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a526abda-2bcc-4f2c-86b7-85523e7b4867 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:43.574012 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a526abda-2bcc-4f2c-86b7-85523e7b4867 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:43.574440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a526abda-2bcc-4f2c-86b7-85523e7b4867 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:43.575162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a526abda-2bcc-4f2c-86b7-85523e7b4867 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:43.575610 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a526abda-2bcc-4f2c-86b7-85523e7b4867 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:43.576028 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a526abda-2bcc-4f2c-86b7-85523e7b4867 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:43.711779 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a526abda-2bcc-4f2c-86b7-85523e7b4867 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:43.721754 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a526abda-2bcc-4f2c-86b7-85523e7b4867 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.159351 Aug 24 12:36:43.722577 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 354/701] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:43 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:44.744072 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fe2578a4-7acb-4758-a61a-d2977332b702 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:44.744682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fe2578a4-7acb-4758-a61a-d2977332b702 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:44.751053 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe2578a4-7acb-4758-a61a-d2977332b702 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:44.751532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe2578a4-7acb-4758-a61a-d2977332b702 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:44.751968 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe2578a4-7acb-4758-a61a-d2977332b702 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:44.752646 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe2578a4-7acb-4758-a61a-d2977332b702 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:44.753102 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe2578a4-7acb-4758-a61a-d2977332b702 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:44.753520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe2578a4-7acb-4758-a61a-d2977332b702 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:44.883632 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fe2578a4-7acb-4758-a61a-d2977332b702 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:44.885758 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=93 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:44.892169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fe2578a4-7acb-4758-a61a-d2977332b702 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152751 Aug 24 12:36:44.892719 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 348/702] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:44 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:45.912915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cec3de42-bb97-453a-b823-ef05cc0d06cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:45.913520 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cec3de42-bb97-453a-b823-ef05cc0d06cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:45.919681 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cec3de42-bb97-453a-b823-ef05cc0d06cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:45.920165 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cec3de42-bb97-453a-b823-ef05cc0d06cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:45.920591 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cec3de42-bb97-453a-b823-ef05cc0d06cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:45.921267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cec3de42-bb97-453a-b823-ef05cc0d06cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:45.921710 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cec3de42-bb97-453a-b823-ef05cc0d06cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:45.922126 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cec3de42-bb97-453a-b823-ef05cc0d06cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:46.048032 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cec3de42-bb97-453a-b823-ef05cc0d06cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:46.056021 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cec3de42-bb97-453a-b823-ef05cc0d06cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.147668 Aug 24 12:36:46.056571 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 355/703] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:45 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:47.076961 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-77c8e2e4-79bb-4404-a139-87a39613a523 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:47.077577 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-77c8e2e4-79bb-4404-a139-87a39613a523 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:47.084567 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-77c8e2e4-79bb-4404-a139-87a39613a523 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:47.085045 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-77c8e2e4-79bb-4404-a139-87a39613a523 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:47.085483 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-77c8e2e4-79bb-4404-a139-87a39613a523 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:47.086166 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-77c8e2e4-79bb-4404-a139-87a39613a523 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:47.086623 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-77c8e2e4-79bb-4404-a139-87a39613a523 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:47.087129 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-77c8e2e4-79bb-4404-a139-87a39613a523 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:47.211570 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-77c8e2e4-79bb-4404-a139-87a39613a523 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:47.219550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-77c8e2e4-79bb-4404-a139-87a39613a523 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.146760 Aug 24 12:36:47.220104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 349/704] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:47 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:48.241154 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c2ca4482-af80-4456-bf0c-5b3b0a8ff1a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:48.241803 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c2ca4482-af80-4456-bf0c-5b3b0a8ff1a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:48.248265 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2ca4482-af80-4456-bf0c-5b3b0a8ff1a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:48.248746 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2ca4482-af80-4456-bf0c-5b3b0a8ff1a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:48.249188 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2ca4482-af80-4456-bf0c-5b3b0a8ff1a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:48.249862 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2ca4482-af80-4456-bf0c-5b3b0a8ff1a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:48.250310 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2ca4482-af80-4456-bf0c-5b3b0a8ff1a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:48.250754 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2ca4482-af80-4456-bf0c-5b3b0a8ff1a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:48.384248 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c2ca4482-af80-4456-bf0c-5b3b0a8ff1a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:48.392321 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c2ca4482-af80-4456-bf0c-5b3b0a8ff1a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.155785 Aug 24 12:36:48.392866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 356/705] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:48 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:49.413256 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fcc711bf-597b-4527-8c6c-fff9117d92eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:49.413867 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fcc711bf-597b-4527-8c6c-fff9117d92eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:49.420428 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fcc711bf-597b-4527-8c6c-fff9117d92eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:49.427326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fcc711bf-597b-4527-8c6c-fff9117d92eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:49.427326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fcc711bf-597b-4527-8c6c-fff9117d92eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:49.427326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fcc711bf-597b-4527-8c6c-fff9117d92eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:49.427326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fcc711bf-597b-4527-8c6c-fff9117d92eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:49.427718 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fcc711bf-597b-4527-8c6c-fff9117d92eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:49.555117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fcc711bf-597b-4527-8c6c-fff9117d92eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:49.563162 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fcc711bf-597b-4527-8c6c-fff9117d92eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153787 Aug 24 12:36:49.564029 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 350/706] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:49 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:50.584819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-23fb609f-4224-45ac-be7d-7a33fe1ea6dd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:50.585317 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-23fb609f-4224-45ac-be7d-7a33fe1ea6dd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:50.591754 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-23fb609f-4224-45ac-be7d-7a33fe1ea6dd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:50.592107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-23fb609f-4224-45ac-be7d-7a33fe1ea6dd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:50.592621 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-23fb609f-4224-45ac-be7d-7a33fe1ea6dd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:50.593222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-23fb609f-4224-45ac-be7d-7a33fe1ea6dd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:50.593675 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-23fb609f-4224-45ac-be7d-7a33fe1ea6dd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:50.594102 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-23fb609f-4224-45ac-be7d-7a33fe1ea6dd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:50.720031 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-23fb609f-4224-45ac-be7d-7a33fe1ea6dd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:50.729687 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-23fb609f-4224-45ac-be7d-7a33fe1ea6dd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149259 Aug 24 12:36:50.730240 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 357/707] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:50 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:51.750206 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-addb0151-705b-4ace-bb57-bf63610e9b6e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:51.750836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-addb0151-705b-4ace-bb57-bf63610e9b6e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:51.757715 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-addb0151-705b-4ace-bb57-bf63610e9b6e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:51.758132 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-addb0151-705b-4ace-bb57-bf63610e9b6e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:51.758562 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-addb0151-705b-4ace-bb57-bf63610e9b6e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:51.759273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-addb0151-705b-4ace-bb57-bf63610e9b6e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:51.759723 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-addb0151-705b-4ace-bb57-bf63610e9b6e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:51.760140 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-addb0151-705b-4ace-bb57-bf63610e9b6e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:51.884495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-addb0151-705b-4ace-bb57-bf63610e9b6e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:51.892476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-addb0151-705b-4ace-bb57-bf63610e9b6e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.146109 Aug 24 12:36:51.893029 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 351/708] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:51 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:52.913601 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8a5fcd3d-7205-47ad-88ac-b796d4b6645c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:52.914193 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8a5fcd3d-7205-47ad-88ac-b796d4b6645c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:52.916544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=26 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:52.921142 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8a5fcd3d-7205-47ad-88ac-b796d4b6645c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:52.921614 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8a5fcd3d-7205-47ad-88ac-b796d4b6645c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:52.922043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8a5fcd3d-7205-47ad-88ac-b796d4b6645c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:52.922741 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8a5fcd3d-7205-47ad-88ac-b796d4b6645c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:52.923186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8a5fcd3d-7205-47ad-88ac-b796d4b6645c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:52.923603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8a5fcd3d-7205-47ad-88ac-b796d4b6645c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:53.053444 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8a5fcd3d-7205-47ad-88ac-b796d4b6645c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:53.061844 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8a5fcd3d-7205-47ad-88ac-b796d4b6645c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152694 Aug 24 12:36:53.062400 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 358/709] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:52 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:54.083739 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3c2c1b4d-9d2a-4d9b-9afc-417789b905b7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:54.084365 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3c2c1b4d-9d2a-4d9b-9afc-417789b905b7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:54.086996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=26 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:54.091456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c2c1b4d-9d2a-4d9b-9afc-417789b905b7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:54.091942 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c2c1b4d-9d2a-4d9b-9afc-417789b905b7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:54.092373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c2c1b4d-9d2a-4d9b-9afc-417789b905b7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:54.093063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c2c1b4d-9d2a-4d9b-9afc-417789b905b7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:54.093520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c2c1b4d-9d2a-4d9b-9afc-417789b905b7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:54.093942 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c2c1b4d-9d2a-4d9b-9afc-417789b905b7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:54.222952 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3c2c1b4d-9d2a-4d9b-9afc-417789b905b7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:54.231767 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3c2c1b4d-9d2a-4d9b-9afc-417789b905b7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152522 Aug 24 12:36:54.232310 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 352/710] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:54 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:55.252681 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6eafd8fe-374b-4660-b81a-d773288464dc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:55.253279 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6eafd8fe-374b-4660-b81a-d773288464dc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:55.259649 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6eafd8fe-374b-4660-b81a-d773288464dc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:55.260124 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6eafd8fe-374b-4660-b81a-d773288464dc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:55.260551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6eafd8fe-374b-4660-b81a-d773288464dc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:55.261225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6eafd8fe-374b-4660-b81a-d773288464dc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:55.261669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6eafd8fe-374b-4660-b81a-d773288464dc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:55.262088 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6eafd8fe-374b-4660-b81a-d773288464dc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:55.386517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6eafd8fe-374b-4660-b81a-d773288464dc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:55.394543 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6eafd8fe-374b-4660-b81a-d773288464dc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.145658 Aug 24 12:36:55.395069 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 359/711] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:55 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:56.415376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-583f72e9-2f42-440c-8bfa-b81e7dbbb191 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:56.415977 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-583f72e9-2f42-440c-8bfa-b81e7dbbb191 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:56.422475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-583f72e9-2f42-440c-8bfa-b81e7dbbb191 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:56.432610 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-583f72e9-2f42-440c-8bfa-b81e7dbbb191 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:56.432610 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-583f72e9-2f42-440c-8bfa-b81e7dbbb191 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:56.432610 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-583f72e9-2f42-440c-8bfa-b81e7dbbb191 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:56.432610 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-583f72e9-2f42-440c-8bfa-b81e7dbbb191 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:56.433528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-583f72e9-2f42-440c-8bfa-b81e7dbbb191 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:56.554315 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-583f72e9-2f42-440c-8bfa-b81e7dbbb191 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:56.562302 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-583f72e9-2f42-440c-8bfa-b81e7dbbb191 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150820 Aug 24 12:36:56.562880 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 353/712] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:56 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:57.583801 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a28b1b1e-9c5f-4963-b47c-af5171a029e7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:57.584408 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a28b1b1e-9c5f-4963-b47c-af5171a029e7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:57.590857 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a28b1b1e-9c5f-4963-b47c-af5171a029e7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:57.591336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a28b1b1e-9c5f-4963-b47c-af5171a029e7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:57.591771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a28b1b1e-9c5f-4963-b47c-af5171a029e7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:57.592452 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a28b1b1e-9c5f-4963-b47c-af5171a029e7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:57.592928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a28b1b1e-9c5f-4963-b47c-af5171a029e7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:57.593348 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a28b1b1e-9c5f-4963-b47c-af5171a029e7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:57.718011 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a28b1b1e-9c5f-4963-b47c-af5171a029e7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:57.726513 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a28b1b1e-9c5f-4963-b47c-af5171a029e7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.146892 Aug 24 12:36:57.727104 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 360/713] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:57 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:58.747687 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8d760233-9eba-4eed-845b-e39f4802de0c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:58.748295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8d760233-9eba-4eed-845b-e39f4802de0c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:58.754607 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d760233-9eba-4eed-845b-e39f4802de0c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:58.755750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d760233-9eba-4eed-845b-e39f4802de0c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:58.756181 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d760233-9eba-4eed-845b-e39f4802de0c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:58.756859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d760233-9eba-4eed-845b-e39f4802de0c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:58.757312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d760233-9eba-4eed-845b-e39f4802de0c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:58.757733 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d760233-9eba-4eed-845b-e39f4802de0c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:58.883706 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8d760233-9eba-4eed-845b-e39f4802de0c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:58.891741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8d760233-9eba-4eed-845b-e39f4802de0c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.147882 Aug 24 12:36:58.892298 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 354/714] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:58 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:59.911421 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-eddf7b71-7c42-46d8-bffe-6ca6f1f8eb95 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:59.912025 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-eddf7b71-7c42-46d8-bffe-6ca6f1f8eb95 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:59.918334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eddf7b71-7c42-46d8-bffe-6ca6f1f8eb95 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:59.918855 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eddf7b71-7c42-46d8-bffe-6ca6f1f8eb95 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:59.919282 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eddf7b71-7c42-46d8-bffe-6ca6f1f8eb95 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:59.919961 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eddf7b71-7c42-46d8-bffe-6ca6f1f8eb95 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:59.920417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eddf7b71-7c42-46d8-bffe-6ca6f1f8eb95 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:59.920834 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eddf7b71-7c42-46d8-bffe-6ca6f1f8eb95 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:00.018209 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-68115ae5-45bd-4c7a-861d-67c919a3f247 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:00.018824 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-68115ae5-45bd-4c7a-861d-67c919a3f247 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:00.025909 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-68115ae5-45bd-4c7a-861d-67c919a3f247 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:00.026475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-68115ae5-45bd-4c7a-861d-67c919a3f247 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:00.027017 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-68115ae5-45bd-4c7a-861d-67c919a3f247 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:00.027723 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-68115ae5-45bd-4c7a-861d-67c919a3f247 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:00.028181 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-68115ae5-45bd-4c7a-861d-67c919a3f247 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:00.028611 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-68115ae5-45bd-4c7a-861d-67c919a3f247 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:00.050813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-eddf7b71-7c42-46d8-bffe-6ca6f1f8eb95 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:00.059086 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-eddf7b71-7c42-46d8-bffe-6ca6f1f8eb95 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151402 Aug 24 12:37:00.059268 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-68115ae5-45bd-4c7a-861d-67c919a3f247 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments/4ef1db7b-1b7c-4868-b6c3-cd06510c0d00" status: 200 len: 194 microversion: 2.20 time: 0.044835 Aug 24 12:37:00.059884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 361/715] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:59 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:00.060005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 355/716] 10.222.0.45 () {60 vars in 1454 bytes} [Wed Aug 24 12:37:00 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments/4ef1db7b-1b7c-4868-b6c3-cd06510c0d00 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:37:00.127452 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b9c742cc-0a75-4ad7-a5b0-83fb98d98e3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:00.127943 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b9c742cc-0a75-4ad7-a5b0-83fb98d98e3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:00.134326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b9c742cc-0a75-4ad7-a5b0-83fb98d98e3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:00.134851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b9c742cc-0a75-4ad7-a5b0-83fb98d98e3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:00.135286 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b9c742cc-0a75-4ad7-a5b0-83fb98d98e3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:00.135965 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b9c742cc-0a75-4ad7-a5b0-83fb98d98e3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:00.136450 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b9c742cc-0a75-4ad7-a5b0-83fb98d98e3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:00.136872 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b9c742cc-0a75-4ad7-a5b0-83fb98d98e3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:00.216684 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.objects.instance [None req-b9c742cc-0a75-4ad7-a5b0-83fb98d98e3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lazy-loading 'services' on Instance uuid 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 {{(pid=121171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:37:00.405003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b9c742cc-0a75-4ad7-a5b0-83fb98d98e3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments/4ef1db7b-1b7c-4868-b6c3-cd06510c0d00" status: 202 len: 0 microversion: 2.20 time: 0.281369 Aug 24 12:37:00.405596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 362/717] 10.222.0.45 () {60 vars in 1457 bytes} [Wed Aug 24 12:37:00 2022] DELETE /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments/4ef1db7b-1b7c-4868-b6c3-cd06510c0d00 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:37:00.414099 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c97b9103-db52-40b0-a448-3d403ed68c73 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:00.416466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c97b9103-db52-40b0-a448-3d403ed68c73 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:00.422465 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c97b9103-db52-40b0-a448-3d403ed68c73 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:00.422989 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c97b9103-db52-40b0-a448-3d403ed68c73 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:00.423423 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c97b9103-db52-40b0-a448-3d403ed68c73 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:00.424105 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c97b9103-db52-40b0-a448-3d403ed68c73 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:00.424537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c97b9103-db52-40b0-a448-3d403ed68c73 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:00.425004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c97b9103-db52-40b0-a448-3d403ed68c73 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:00.459658 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c97b9103-db52-40b0-a448-3d403ed68c73 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049507 Aug 24 12:37:00.460213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 356/718] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:00 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:01.082224 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-aa464c46-57c4-44dd-bee4-dc8839730579 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:01.083454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-aa464c46-57c4-44dd-bee4-dc8839730579 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:01.089502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aa464c46-57c4-44dd-bee4-dc8839730579 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:01.089981 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aa464c46-57c4-44dd-bee4-dc8839730579 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:01.090419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aa464c46-57c4-44dd-bee4-dc8839730579 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:01.091149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aa464c46-57c4-44dd-bee4-dc8839730579 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:01.091606 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aa464c46-57c4-44dd-bee4-dc8839730579 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:01.092029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aa464c46-57c4-44dd-bee4-dc8839730579 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:01.220323 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-aa464c46-57c4-44dd-bee4-dc8839730579 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:01.229163 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-aa464c46-57c4-44dd-bee4-dc8839730579 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151611 Aug 24 12:37:01.229695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 363/719] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:01 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:01.472369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1d88fc42-aa52-4fb0-9bef-d3a4fa69ba35 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:01.474612 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1d88fc42-aa52-4fb0-9bef-d3a4fa69ba35 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:01.481100 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1d88fc42-aa52-4fb0-9bef-d3a4fa69ba35 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:01.481594 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1d88fc42-aa52-4fb0-9bef-d3a4fa69ba35 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:01.482037 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1d88fc42-aa52-4fb0-9bef-d3a4fa69ba35 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:01.482765 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1d88fc42-aa52-4fb0-9bef-d3a4fa69ba35 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:01.483230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1d88fc42-aa52-4fb0-9bef-d3a4fa69ba35 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:01.483665 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1d88fc42-aa52-4fb0-9bef-d3a4fa69ba35 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:01.513707 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1d88fc42-aa52-4fb0-9bef-d3a4fa69ba35 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045411 Aug 24 12:37:01.519952 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 357/720] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:01 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:02.249792 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-509adb8f-c6ce-45b5-88cb-22b52d5710f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:02.250397 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-509adb8f-c6ce-45b5-88cb-22b52d5710f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:02.256792 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-509adb8f-c6ce-45b5-88cb-22b52d5710f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:02.257282 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-509adb8f-c6ce-45b5-88cb-22b52d5710f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:02.257716 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-509adb8f-c6ce-45b5-88cb-22b52d5710f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:02.258466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-509adb8f-c6ce-45b5-88cb-22b52d5710f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:02.258949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-509adb8f-c6ce-45b5-88cb-22b52d5710f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:02.259371 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-509adb8f-c6ce-45b5-88cb-22b52d5710f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:02.389292 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-509adb8f-c6ce-45b5-88cb-22b52d5710f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:02.397847 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-509adb8f-c6ce-45b5-88cb-22b52d5710f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152013 Aug 24 12:37:02.398403 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 364/721] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:02 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:02.526948 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4ccacf03-d56c-47d3-8442-5dae500ab354 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:02.528974 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4ccacf03-d56c-47d3-8442-5dae500ab354 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:02.535331 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4ccacf03-d56c-47d3-8442-5dae500ab354 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:02.535810 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4ccacf03-d56c-47d3-8442-5dae500ab354 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:02.536819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4ccacf03-d56c-47d3-8442-5dae500ab354 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:02.537504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4ccacf03-d56c-47d3-8442-5dae500ab354 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:02.538056 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4ccacf03-d56c-47d3-8442-5dae500ab354 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:02.538360 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4ccacf03-d56c-47d3-8442-5dae500ab354 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:02.567287 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4ccacf03-d56c-47d3-8442-5dae500ab354 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044327 Aug 24 12:37:02.567850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 358/722] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:02 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:03.418436 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-46092e9d-aceb-405e-9de4-450c2cf97cea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:03.419067 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-46092e9d-aceb-405e-9de4-450c2cf97cea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:03.425501 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46092e9d-aceb-405e-9de4-450c2cf97cea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:03.426324 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46092e9d-aceb-405e-9de4-450c2cf97cea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:03.426581 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46092e9d-aceb-405e-9de4-450c2cf97cea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:03.427462 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46092e9d-aceb-405e-9de4-450c2cf97cea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:03.428414 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46092e9d-aceb-405e-9de4-450c2cf97cea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:03.428829 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46092e9d-aceb-405e-9de4-450c2cf97cea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:03.557565 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-46092e9d-aceb-405e-9de4-450c2cf97cea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:03.565977 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-46092e9d-aceb-405e-9de4-450c2cf97cea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151403 Aug 24 12:37:03.566890 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 365/723] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:03 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:03.581066 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d1de5660-df5f-4461-b723-e4ca6fa0fe42 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:03.583785 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d1de5660-df5f-4461-b723-e4ca6fa0fe42 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:03.592274 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1de5660-df5f-4461-b723-e4ca6fa0fe42 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:03.593271 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1de5660-df5f-4461-b723-e4ca6fa0fe42 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:03.593728 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1de5660-df5f-4461-b723-e4ca6fa0fe42 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:03.594618 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1de5660-df5f-4461-b723-e4ca6fa0fe42 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:03.595101 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1de5660-df5f-4461-b723-e4ca6fa0fe42 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:03.595642 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1de5660-df5f-4461-b723-e4ca6fa0fe42 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:03.629783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d1de5660-df5f-4461-b723-e4ca6fa0fe42 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053611 Aug 24 12:37:03.630383 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 359/724] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:03 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:04.588380 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b1e9479f-e772-4b20-9a27-135503746a87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:04.588985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b1e9479f-e772-4b20-9a27-135503746a87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:04.595312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b1e9479f-e772-4b20-9a27-135503746a87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:04.595771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b1e9479f-e772-4b20-9a27-135503746a87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:04.596199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b1e9479f-e772-4b20-9a27-135503746a87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:04.596879 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b1e9479f-e772-4b20-9a27-135503746a87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:04.597327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b1e9479f-e772-4b20-9a27-135503746a87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:04.597742 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b1e9479f-e772-4b20-9a27-135503746a87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:04.642418 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8a347cf3-7d34-49ca-a18d-af4adb212131 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:04.644798 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8a347cf3-7d34-49ca-a18d-af4adb212131 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:04.653136 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8a347cf3-7d34-49ca-a18d-af4adb212131 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:04.653669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8a347cf3-7d34-49ca-a18d-af4adb212131 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:04.654043 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8a347cf3-7d34-49ca-a18d-af4adb212131 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:04.654952 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8a347cf3-7d34-49ca-a18d-af4adb212131 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:04.655559 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8a347cf3-7d34-49ca-a18d-af4adb212131 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:04.656125 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8a347cf3-7d34-49ca-a18d-af4adb212131 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:04.703554 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8a347cf3-7d34-49ca-a18d-af4adb212131 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063824 Aug 24 12:37:04.703554 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 360/725] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:04 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:37:04.738705 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b1e9479f-e772-4b20-9a27-135503746a87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:04.747010 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b1e9479f-e772-4b20-9a27-135503746a87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.163045 Aug 24 12:37:04.747560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 366/726] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:04 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:05.715284 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f7a0a60e-8a67-45b4-9058-4331ea77f58b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:05.717416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f7a0a60e-8a67-45b4-9058-4331ea77f58b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:05.723664 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7a0a60e-8a67-45b4-9058-4331ea77f58b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:05.724153 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7a0a60e-8a67-45b4-9058-4331ea77f58b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:05.724589 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7a0a60e-8a67-45b4-9058-4331ea77f58b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:05.725285 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7a0a60e-8a67-45b4-9058-4331ea77f58b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:05.725737 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7a0a60e-8a67-45b4-9058-4331ea77f58b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:05.726159 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7a0a60e-8a67-45b4-9058-4331ea77f58b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:05.755189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f7a0a60e-8a67-45b4-9058-4331ea77f58b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043855 Aug 24 12:37:05.755718 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 361/727] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:05 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:05.766603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-43377cea-0b1b-4980-80ab-4b93edc74d93 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:05.767229 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-43377cea-0b1b-4980-80ab-4b93edc74d93 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:05.774123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43377cea-0b1b-4980-80ab-4b93edc74d93 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:05.774599 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43377cea-0b1b-4980-80ab-4b93edc74d93 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:05.775065 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43377cea-0b1b-4980-80ab-4b93edc74d93 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:05.775747 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43377cea-0b1b-4980-80ab-4b93edc74d93 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:05.776197 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43377cea-0b1b-4980-80ab-4b93edc74d93 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:05.776621 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43377cea-0b1b-4980-80ab-4b93edc74d93 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:05.903230 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-43377cea-0b1b-4980-80ab-4b93edc74d93 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:05.911427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-43377cea-0b1b-4980-80ab-4b93edc74d93 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148652 Aug 24 12:37:05.920804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 367/728] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:05 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:06.768123 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-eaf220aa-f516-431f-8c26-62edb2447386 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:06.770224 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-eaf220aa-f516-431f-8c26-62edb2447386 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:06.776257 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eaf220aa-f516-431f-8c26-62edb2447386 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:06.776737 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eaf220aa-f516-431f-8c26-62edb2447386 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:06.777167 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eaf220aa-f516-431f-8c26-62edb2447386 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:06.777852 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eaf220aa-f516-431f-8c26-62edb2447386 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:06.778303 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eaf220aa-f516-431f-8c26-62edb2447386 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:06.778749 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eaf220aa-f516-431f-8c26-62edb2447386 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:06.808344 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-eaf220aa-f516-431f-8c26-62edb2447386 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044276 Aug 24 12:37:06.808863 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 362/729] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:06 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:06.932211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b5dc568e-3984-4e67-a9b5-869e13c41056 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:06.932805 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b5dc568e-3984-4e67-a9b5-869e13c41056 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:06.939027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b5dc568e-3984-4e67-a9b5-869e13c41056 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:06.939498 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b5dc568e-3984-4e67-a9b5-869e13c41056 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:06.939926 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b5dc568e-3984-4e67-a9b5-869e13c41056 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:06.940599 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b5dc568e-3984-4e67-a9b5-869e13c41056 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:06.941072 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b5dc568e-3984-4e67-a9b5-869e13c41056 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:06.941490 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b5dc568e-3984-4e67-a9b5-869e13c41056 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:07.074521 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b5dc568e-3984-4e67-a9b5-869e13c41056 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:07.082569 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b5dc568e-3984-4e67-a9b5-869e13c41056 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.154176 Aug 24 12:37:07.083137 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 368/730] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:06 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:07.820769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-416bba04-1605-431e-ae6d-02f1c37db9ca tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:07.822911 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-416bba04-1605-431e-ae6d-02f1c37db9ca tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:07.829284 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-416bba04-1605-431e-ae6d-02f1c37db9ca tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:07.829762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-416bba04-1605-431e-ae6d-02f1c37db9ca tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:07.830193 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-416bba04-1605-431e-ae6d-02f1c37db9ca tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:07.830910 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-416bba04-1605-431e-ae6d-02f1c37db9ca tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:07.831357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-416bba04-1605-431e-ae6d-02f1c37db9ca tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:07.831779 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-416bba04-1605-431e-ae6d-02f1c37db9ca tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:07.860403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-416bba04-1605-431e-ae6d-02f1c37db9ca tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044227 Aug 24 12:37:07.861141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 363/731] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:07 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:37:08.104113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cd37a047-5a9b-46bc-97c6-3f291825fa1d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:08.104720 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cd37a047-5a9b-46bc-97c6-3f291825fa1d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:08.111387 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd37a047-5a9b-46bc-97c6-3f291825fa1d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:08.111870 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd37a047-5a9b-46bc-97c6-3f291825fa1d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:08.112298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd37a047-5a9b-46bc-97c6-3f291825fa1d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:08.112970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd37a047-5a9b-46bc-97c6-3f291825fa1d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:08.113415 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd37a047-5a9b-46bc-97c6-3f291825fa1d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:08.113832 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd37a047-5a9b-46bc-97c6-3f291825fa1d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:08.118887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:08.241375 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cd37a047-5a9b-46bc-97c6-3f291825fa1d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:08.250122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cd37a047-5a9b-46bc-97c6-3f291825fa1d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150333 Aug 24 12:37:08.250697 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 369/732] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:08 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:08.873078 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-485c3b4c-be74-475a-b49a-09d8ad0529a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:08.875254 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-485c3b4c-be74-475a-b49a-09d8ad0529a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:08.881833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-485c3b4c-be74-475a-b49a-09d8ad0529a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:08.882321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-485c3b4c-be74-475a-b49a-09d8ad0529a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:08.883301 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-485c3b4c-be74-475a-b49a-09d8ad0529a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:08.884137 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-485c3b4c-be74-475a-b49a-09d8ad0529a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:08.884583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-485c3b4c-be74-475a-b49a-09d8ad0529a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:08.884899 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-485c3b4c-be74-475a-b49a-09d8ad0529a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:08.914202 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-485c3b4c-be74-475a-b49a-09d8ad0529a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045093 Aug 24 12:37:08.914780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 364/733] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:08 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:09.270923 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ed55f884-f94a-4c63-8ae0-87664fdca7a3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:09.271530 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ed55f884-f94a-4c63-8ae0-87664fdca7a3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:09.278320 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ed55f884-f94a-4c63-8ae0-87664fdca7a3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:09.278850 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ed55f884-f94a-4c63-8ae0-87664fdca7a3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:09.279287 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ed55f884-f94a-4c63-8ae0-87664fdca7a3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:09.280563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ed55f884-f94a-4c63-8ae0-87664fdca7a3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:09.280563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ed55f884-f94a-4c63-8ae0-87664fdca7a3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:09.280828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ed55f884-f94a-4c63-8ae0-87664fdca7a3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:09.414038 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ed55f884-f94a-4c63-8ae0-87664fdca7a3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:09.422262 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ed55f884-f94a-4c63-8ae0-87664fdca7a3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.155214 Aug 24 12:37:09.422847 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 370/734] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:09 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:09.926527 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4866b125-f1f2-4973-a4c9-ec39aa530995 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:09.928705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4866b125-f1f2-4973-a4c9-ec39aa530995 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:09.935581 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4866b125-f1f2-4973-a4c9-ec39aa530995 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:09.936064 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4866b125-f1f2-4973-a4c9-ec39aa530995 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:09.936500 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4866b125-f1f2-4973-a4c9-ec39aa530995 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:09.937189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4866b125-f1f2-4973-a4c9-ec39aa530995 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:09.937648 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4866b125-f1f2-4973-a4c9-ec39aa530995 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:09.938079 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4866b125-f1f2-4973-a4c9-ec39aa530995 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:09.952407 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:09.968491 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4866b125-f1f2-4973-a4c9-ec39aa530995 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045955 Aug 24 12:37:09.969049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 365/735] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:09 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:10.443471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f23d3fd8-181a-42f7-8434-b0139b60a90a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:10.444082 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f23d3fd8-181a-42f7-8434-b0139b60a90a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:10.450475 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f23d3fd8-181a-42f7-8434-b0139b60a90a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:10.450995 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f23d3fd8-181a-42f7-8434-b0139b60a90a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:10.451431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f23d3fd8-181a-42f7-8434-b0139b60a90a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:10.452115 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f23d3fd8-181a-42f7-8434-b0139b60a90a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:10.452568 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f23d3fd8-181a-42f7-8434-b0139b60a90a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:10.453021 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f23d3fd8-181a-42f7-8434-b0139b60a90a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:10.578023 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f23d3fd8-181a-42f7-8434-b0139b60a90a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:10.586767 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f23d3fd8-181a-42f7-8434-b0139b60a90a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1716 microversion: 2.1 time: 0.147162 Aug 24 12:37:10.587325 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 371/736] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:10 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1716 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:10.645795 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c63542d8-6cd2-4141-a222-2a2ea78c82ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:10.646294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c63542d8-6cd2-4141-a222-2a2ea78c82ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:10.653164 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c63542d8-6cd2-4141-a222-2a2ea78c82ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:10.653649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c63542d8-6cd2-4141-a222-2a2ea78c82ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:10.654086 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c63542d8-6cd2-4141-a222-2a2ea78c82ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:10.654804 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c63542d8-6cd2-4141-a222-2a2ea78c82ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:10.655263 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c63542d8-6cd2-4141-a222-2a2ea78c82ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:10.655688 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c63542d8-6cd2-4141-a222-2a2ea78c82ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:10.774690 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.wsgi [None req-c63542d8-6cd2-4141-a222-2a2ea78c82ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] HTTP exception thrown: Cannot 'detach_volume' instance 50cb23a1-9864-46ef-ae19-411f522e9f10 while it is in vm_state rescued Aug 24 12:37:10.776294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c63542d8-6cd2-4141-a222-2a2ea78c82ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Request method failure captured: Aug 24 12:37:10.776294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: request: DELETE /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments/ec20bae7-7644-4b28-bc2e-f28915eeb2cb HTTP/1.1 Aug 24 12:37:10.776294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept: application/json Aug 24 12:37:10.776294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept-Encoding: identity Aug 24 12:37:10.776294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Connection: close Aug 24 12:37:10.776294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Length: 0 Aug 24 12:37:10.776294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Type: application/json Aug 24 12:37:10.776294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Host: 10.222.0.45 Aug 24 12:37:10.776294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Openstack-System-Scope: None Aug 24 12:37:10.776294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: User-Agent: python-urllib3/1.26.11 Aug 24 12:37:10.776294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Auth-Token: gAAAAABjBhnPiCoZSEe7wmjTe8U9xlUJz4a5Mp48qYy-cXBN9SdubzuznlpWDZlq64yvw-1br5IS5M11o055Otgjl3rpsAMlh8QWB47vk-vMvC9oSLyFSNPSBKLMaQ10tN_kbVVupvSgWrx6NZcM-VEx1q4Wa9x9_sEvmqQpKFDCK4_ukrJvtn4 Aug 24 12:37:10.776294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Id: None Aug 24 12:37:10.776294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Name: None Aug 24 12:37:10.776294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Identity-Status: Confirmed Aug 24 12:37:10.776294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Is-Admin-Project: True Aug 24 12:37:10.776294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Id: default Aug 24 12:37:10.776294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Name: Default Aug 24 12:37:10.776294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Id: 99f0beb902e4472eae20f0e6c8dc3340 Aug 24 12:37:10.776294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1902039323 Aug 24 12:37:10.776294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Role: member,reader Aug 24 12:37:10.776294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Roles: member,reader Aug 24 12:37:10.777843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_99f0beb902e4472eae20f0e6c8dc3340"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99f0beb902e4472eae20f0e6c8dc3340"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/99f0beb902e4472eae20f0e6c8dc3340"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99f0beb902e4472eae20f0e6c8dc3340"}]}] Aug 24 12:37:10.777843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1902039323 Aug 24 12:37:10.777843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Id: 99f0beb902e4472eae20f0e6c8dc3340 Aug 24 12:37:10.777843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1902039323 Aug 24 12:37:10.777843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User: tempest-ServerRescueNegativeTestJSON-1902039323-project Aug 24 12:37:10.777843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Id: default Aug 24 12:37:10.777843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Name: Default Aug 24 12:37:10.777843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Id: b9252893998a490689497697663ca4d2 Aug 24 12:37:10.777843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1902039323-project Aug 24 12:37:10.777843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: method: > Aug 24 12:37:10.777843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: exception: Cannot 'detach_volume' instance 50cb23a1-9864-46ef-ae19-411f522e9f10 while it is in vm_state rescued Aug 24 12:37:10.778701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: action_args: {'server_id': '50cb23a1-9864-46ef-ae19-411f522e9f10', 'id': 'ec20bae7-7644-4b28-bc2e-f28915eeb2cb'} Aug 24 12:37:10.778701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:37:10.778701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:10.778701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 12:37:10.778701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 12:37:10.778701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 12:37:10.778701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 12:37:10.778701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 12:37:10.778701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 12:37:10.778701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 50cb23a1-9864-46ef-ae19-411f522e9f10 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 12:37:10.778701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:37:10.778701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:10.778701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:37:10.778701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:10.778701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:10.778701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:10.778701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:37:10.778701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:37:10.778701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:37:10.778701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:37:10.779994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 12:37:10.779994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 12:37:10.779994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 12:37:10.779994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 12:37:10.779994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 50cb23a1-9864-46ef-ae19-411f522e9f10 while it is in vm_state rescued Aug 24 12:37:10.779994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:37:10.779994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:10.779994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:37:10.779994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:10.779994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:10.779994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:10.779994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:37:10.779994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:37:10.779994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 50cb23a1-9864-46ef-ae19-411f522e9f10 while it is in vm_state rescued Aug 24 12:37:10.779994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 12:37:10.779994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c63542d8-6cd2-4141-a222-2a2ea78c82ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Returning 409 to user: Cannot 'detach_volume' instance 50cb23a1-9864-46ef-ae19-411f522e9f10 while it is in vm_state rescued {{(pid=121170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:37:10.780952 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c63542d8-6cd2-4141-a222-2a2ea78c82ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "DELETE /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments/ec20bae7-7644-4b28-bc2e-f28915eeb2cb" status: 409 len: 152 microversion: 2.1 time: 0.135873 Aug 24 12:37:10.780952 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 366/737] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 24 12:37:10 2022] DELETE /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments/ec20bae7-7644-4b28-bc2e-f28915eeb2cb => generated 152 bytes in 137 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 12:37:10.786778 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-de748f8a-52e6-4fe7-a746-383c7f23f9d7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:10.787315 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-de748f8a-52e6-4fe7-a746-383c7f23f9d7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:10.793829 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de748f8a-52e6-4fe7-a746-383c7f23f9d7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:10.794314 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de748f8a-52e6-4fe7-a746-383c7f23f9d7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:10.794787 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de748f8a-52e6-4fe7-a746-383c7f23f9d7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:10.795472 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de748f8a-52e6-4fe7-a746-383c7f23f9d7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:10.795927 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de748f8a-52e6-4fe7-a746-383c7f23f9d7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:10.796354 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de748f8a-52e6-4fe7-a746-383c7f23f9d7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:10.981501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d400945e-b751-4977-a320-175a68ac0189 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:10.983658 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d400945e-b751-4977-a320-175a68ac0189 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:10.993670 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d400945e-b751-4977-a320-175a68ac0189 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:10.994160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d400945e-b751-4977-a320-175a68ac0189 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:10.994594 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d400945e-b751-4977-a320-175a68ac0189 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:10.995308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d400945e-b751-4977-a320-175a68ac0189 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:10.995757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d400945e-b751-4977-a320-175a68ac0189 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:10.996196 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d400945e-b751-4977-a320-175a68ac0189 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:11.025802 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d400945e-b751-4977-a320-175a68ac0189 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048069 Aug 24 12:37:11.031387 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 367/738] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:10 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:37:11.033008 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-de748f8a-52e6-4fe7-a746-383c7f23f9d7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "POST /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/action" status: 202 len: 0 microversion: 2.1 time: 0.249854 Aug 24 12:37:11.036685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 372/739] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 12:37:10 2022] POST /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:37:11.048678 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-29e99bb5-7f48-4d66-956c-d16488a1215b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:11.048678 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-29e99bb5-7f48-4d66-956c-d16488a1215b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:11.048919 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29e99bb5-7f48-4d66-956c-d16488a1215b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:11.049466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29e99bb5-7f48-4d66-956c-d16488a1215b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:11.049783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29e99bb5-7f48-4d66-956c-d16488a1215b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:11.050468 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29e99bb5-7f48-4d66-956c-d16488a1215b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:11.050946 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29e99bb5-7f48-4d66-956c-d16488a1215b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:11.051369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29e99bb5-7f48-4d66-956c-d16488a1215b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:11.183725 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-29e99bb5-7f48-4d66-956c-d16488a1215b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:11.191883 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-29e99bb5-7f48-4d66-956c-d16488a1215b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1724 microversion: 2.1 time: 0.153990 Aug 24 12:37:11.192456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 368/740] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:11 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:12.039514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a42c8a3f-beb9-4c87-a42c-2d94fb2e4305 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:12.041861 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a42c8a3f-beb9-4c87-a42c-2d94fb2e4305 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:12.047927 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a42c8a3f-beb9-4c87-a42c-2d94fb2e4305 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:12.048405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a42c8a3f-beb9-4c87-a42c-2d94fb2e4305 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:12.048835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a42c8a3f-beb9-4c87-a42c-2d94fb2e4305 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:12.049519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a42c8a3f-beb9-4c87-a42c-2d94fb2e4305 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:12.049965 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a42c8a3f-beb9-4c87-a42c-2d94fb2e4305 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:12.050384 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a42c8a3f-beb9-4c87-a42c-2d94fb2e4305 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:12.079803 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a42c8a3f-beb9-4c87-a42c-2d94fb2e4305 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045198 Aug 24 12:37:12.080356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 373/741] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:12 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:12.212906 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1b27e67d-8d5a-433b-be5c-cab1011ccf72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:12.213511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1b27e67d-8d5a-433b-be5c-cab1011ccf72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:12.220389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b27e67d-8d5a-433b-be5c-cab1011ccf72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:12.220865 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b27e67d-8d5a-433b-be5c-cab1011ccf72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:12.221453 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b27e67d-8d5a-433b-be5c-cab1011ccf72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:12.222297 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b27e67d-8d5a-433b-be5c-cab1011ccf72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:12.222790 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b27e67d-8d5a-433b-be5c-cab1011ccf72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:12.223217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b27e67d-8d5a-433b-be5c-cab1011ccf72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:12.350319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1b27e67d-8d5a-433b-be5c-cab1011ccf72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:12.359562 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1b27e67d-8d5a-433b-be5c-cab1011ccf72 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1724 microversion: 2.1 time: 0.150399 Aug 24 12:37:12.360145 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 369/742] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:12 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:13.092627 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-65f74c5c-5767-4d3d-ac16-b6b5d1167c14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:13.094856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-65f74c5c-5767-4d3d-ac16-b6b5d1167c14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:13.101218 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-65f74c5c-5767-4d3d-ac16-b6b5d1167c14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:13.102235 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-65f74c5c-5767-4d3d-ac16-b6b5d1167c14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:13.102682 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-65f74c5c-5767-4d3d-ac16-b6b5d1167c14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:13.103369 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-65f74c5c-5767-4d3d-ac16-b6b5d1167c14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:13.103821 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-65f74c5c-5767-4d3d-ac16-b6b5d1167c14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:13.104243 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-65f74c5c-5767-4d3d-ac16-b6b5d1167c14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:13.133301 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-65f74c5c-5767-4d3d-ac16-b6b5d1167c14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044129 Aug 24 12:37:13.133846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 374/743] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:13 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:13.381221 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-65c90108-0afc-43df-b007-870335d67c66 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:13.381744 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-65c90108-0afc-43df-b007-870335d67c66 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:13.388638 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-65c90108-0afc-43df-b007-870335d67c66 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:13.389129 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-65c90108-0afc-43df-b007-870335d67c66 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:13.389569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-65c90108-0afc-43df-b007-870335d67c66 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:13.390258 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-65c90108-0afc-43df-b007-870335d67c66 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:13.390751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-65c90108-0afc-43df-b007-870335d67c66 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:13.391225 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-65c90108-0afc-43df-b007-870335d67c66 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:13.525594 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-65c90108-0afc-43df-b007-870335d67c66 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:13.533616 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-65c90108-0afc-43df-b007-870335d67c66 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1724 microversion: 2.1 time: 0.156359 Aug 24 12:37:13.534174 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 370/744] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:13 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:14.145649 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-36dc9aa3-e9d4-45ca-97d7-d52a53806efa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:14.147813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-36dc9aa3-e9d4-45ca-97d7-d52a53806efa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:14.154121 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36dc9aa3-e9d4-45ca-97d7-d52a53806efa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:14.154601 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36dc9aa3-e9d4-45ca-97d7-d52a53806efa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:14.155065 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36dc9aa3-e9d4-45ca-97d7-d52a53806efa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:14.155744 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36dc9aa3-e9d4-45ca-97d7-d52a53806efa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:14.156194 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36dc9aa3-e9d4-45ca-97d7-d52a53806efa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:14.156616 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36dc9aa3-e9d4-45ca-97d7-d52a53806efa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:14.186123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-36dc9aa3-e9d4-45ca-97d7-d52a53806efa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044440 Aug 24 12:37:14.186879 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 375/745] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:14 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:14.554066 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4a8d8292-653e-421a-a026-87bef0a95980 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:14.554694 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4a8d8292-653e-421a-a026-87bef0a95980 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:14.561081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a8d8292-653e-421a-a026-87bef0a95980 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:14.561564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a8d8292-653e-421a-a026-87bef0a95980 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:14.562033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a8d8292-653e-421a-a026-87bef0a95980 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:14.562744 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a8d8292-653e-421a-a026-87bef0a95980 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:14.563202 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a8d8292-653e-421a-a026-87bef0a95980 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:14.563627 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a8d8292-653e-421a-a026-87bef0a95980 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:14.690003 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4a8d8292-653e-421a-a026-87bef0a95980 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:14.698704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4a8d8292-653e-421a-a026-87bef0a95980 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1724 microversion: 2.1 time: 0.148472 Aug 24 12:37:14.699264 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 371/746] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:14 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:15.198177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ab603671-9e39-4d15-ae79-bfd1ea5cec9c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:15.200306 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ab603671-9e39-4d15-ae79-bfd1ea5cec9c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:15.206675 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab603671-9e39-4d15-ae79-bfd1ea5cec9c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:15.207167 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab603671-9e39-4d15-ae79-bfd1ea5cec9c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:15.207598 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab603671-9e39-4d15-ae79-bfd1ea5cec9c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:15.208277 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab603671-9e39-4d15-ae79-bfd1ea5cec9c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:15.208723 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab603671-9e39-4d15-ae79-bfd1ea5cec9c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:15.209145 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab603671-9e39-4d15-ae79-bfd1ea5cec9c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:15.239831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ab603671-9e39-4d15-ae79-bfd1ea5cec9c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045927 Aug 24 12:37:15.240387 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 376/747] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:15 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:15.719427 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e0ccc2cb-37fb-435b-a4b5-80d709b6cde7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:15.720039 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e0ccc2cb-37fb-435b-a4b5-80d709b6cde7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:15.726955 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0ccc2cb-37fb-435b-a4b5-80d709b6cde7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:15.727438 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0ccc2cb-37fb-435b-a4b5-80d709b6cde7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:15.727874 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0ccc2cb-37fb-435b-a4b5-80d709b6cde7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:15.728559 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0ccc2cb-37fb-435b-a4b5-80d709b6cde7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:15.729013 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0ccc2cb-37fb-435b-a4b5-80d709b6cde7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:15.729436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0ccc2cb-37fb-435b-a4b5-80d709b6cde7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:15.855363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e0ccc2cb-37fb-435b-a4b5-80d709b6cde7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:15.863311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e0ccc2cb-37fb-435b-a4b5-80d709b6cde7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1730 microversion: 2.1 time: 0.147740 Aug 24 12:37:15.863882 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 372/748] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:15 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:15.883441 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-15668e66-0a26-4601-8d7e-a635140c2425 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:15.890570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-15668e66-0a26-4601-8d7e-a635140c2425 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:15.890570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15668e66-0a26-4601-8d7e-a635140c2425 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:15.890570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15668e66-0a26-4601-8d7e-a635140c2425 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:15.890926 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15668e66-0a26-4601-8d7e-a635140c2425 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:15.891439 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15668e66-0a26-4601-8d7e-a635140c2425 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:15.891897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15668e66-0a26-4601-8d7e-a635140c2425 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:15.892317 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15668e66-0a26-4601-8d7e-a635140c2425 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:15.968897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-15668e66-0a26-4601-8d7e-a635140c2425 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089336 Aug 24 12:37:15.969477 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 377/749] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 24 12:37:15 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:16.252547 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c0de66c5-41d6-4549-9d12-8a9cae9ad9c9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:16.254843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c0de66c5-41d6-4549-9d12-8a9cae9ad9c9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:16.261459 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c0de66c5-41d6-4549-9d12-8a9cae9ad9c9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:16.261948 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c0de66c5-41d6-4549-9d12-8a9cae9ad9c9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:16.262386 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c0de66c5-41d6-4549-9d12-8a9cae9ad9c9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:16.263113 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c0de66c5-41d6-4549-9d12-8a9cae9ad9c9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:16.263571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c0de66c5-41d6-4549-9d12-8a9cae9ad9c9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:16.264051 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c0de66c5-41d6-4549-9d12-8a9cae9ad9c9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:16.299756 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c0de66c5-41d6-4549-9d12-8a9cae9ad9c9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051162 Aug 24 12:37:16.300536 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 373/750] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:16 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:17.170096 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-85e5c7c6-7dbe-4896-ba44-f234ea885a5e req-eeb800cd-6e62-4bcc-8c43-e4b80c061ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50cb23a1-9864-46ef-ae19-411f522e9f10", "tag": "4fe23f91-93ad-4bd1-9b29-2d302a44a9c9"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:17.179364 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-85e5c7c6-7dbe-4896-ba44-f234ea885a5e req-eeb800cd-6e62-4bcc-8c43-e4b80c061ec3 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:17.179840 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-85e5c7c6-7dbe-4896-ba44-f234ea885a5e req-eeb800cd-6e62-4bcc-8c43-e4b80c061ec3 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:17.180272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-85e5c7c6-7dbe-4896-ba44-f234ea885a5e req-eeb800cd-6e62-4bcc-8c43-e4b80c061ec3 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:17.191311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-85e5c7c6-7dbe-4896-ba44-f234ea885a5e req-eeb800cd-6e62-4bcc-8c43-e4b80c061ec3 service nova] Creating event network-changed:4fe23f91-93ad-4bd1-9b29-2d302a44a9c9 for instance 50cb23a1-9864-46ef-ae19-411f522e9f10 on hv-cinder-84889 Aug 24 12:37:17.197131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-85e5c7c6-7dbe-4896-ba44-f234ea885a5e req-eeb800cd-6e62-4bcc-8c43-e4b80c061ec3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084277 Aug 24 12:37:17.197885 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 378/751] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:17.312282 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9e172b7c-4dc2-42e3-a459-504750285d54 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:17.314682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9e172b7c-4dc2-42e3-a459-504750285d54 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:17.321817 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e172b7c-4dc2-42e3-a459-504750285d54 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:17.322134 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e172b7c-4dc2-42e3-a459-504750285d54 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:17.322563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e172b7c-4dc2-42e3-a459-504750285d54 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:17.323449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e172b7c-4dc2-42e3-a459-504750285d54 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:17.323898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e172b7c-4dc2-42e3-a459-504750285d54 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:17.324316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e172b7c-4dc2-42e3-a459-504750285d54 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:17.354630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9e172b7c-4dc2-42e3-a459-504750285d54 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046255 Aug 24 12:37:17.360044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 374/752] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:17 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:18.368586 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-aefbf2c5-92a3-4064-b0b4-6f6aeb1b1680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:18.370787 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-aefbf2c5-92a3-4064-b0b4-6f6aeb1b1680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:18.376853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aefbf2c5-92a3-4064-b0b4-6f6aeb1b1680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:18.377331 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aefbf2c5-92a3-4064-b0b4-6f6aeb1b1680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:18.377765 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aefbf2c5-92a3-4064-b0b4-6f6aeb1b1680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:18.378468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aefbf2c5-92a3-4064-b0b4-6f6aeb1b1680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:18.378938 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aefbf2c5-92a3-4064-b0b4-6f6aeb1b1680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:18.379360 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aefbf2c5-92a3-4064-b0b4-6f6aeb1b1680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:18.408469 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-aefbf2c5-92a3-4064-b0b4-6f6aeb1b1680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045070 Aug 24 12:37:18.409212 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 379/753] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:18 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:19.212606 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-1a636b20-8f35-4acd-ba8e-b9740a02b6f9 req-a4148060-0cbf-4dac-a519-94cd1ef65501 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50cb23a1-9864-46ef-ae19-411f522e9f10", "tag": "4fe23f91-93ad-4bd1-9b29-2d302a44a9c9"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:19.222072 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-1a636b20-8f35-4acd-ba8e-b9740a02b6f9 req-a4148060-0cbf-4dac-a519-94cd1ef65501 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:19.222550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-1a636b20-8f35-4acd-ba8e-b9740a02b6f9 req-a4148060-0cbf-4dac-a519-94cd1ef65501 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:19.223005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-1a636b20-8f35-4acd-ba8e-b9740a02b6f9 req-a4148060-0cbf-4dac-a519-94cd1ef65501 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:19.234299 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-1a636b20-8f35-4acd-ba8e-b9740a02b6f9 req-a4148060-0cbf-4dac-a519-94cd1ef65501 service nova] Creating event network-changed:4fe23f91-93ad-4bd1-9b29-2d302a44a9c9 for instance 50cb23a1-9864-46ef-ae19-411f522e9f10 on hv-cinder-84889 Aug 24 12:37:19.239101 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-1a636b20-8f35-4acd-ba8e-b9740a02b6f9 req-a4148060-0cbf-4dac-a519-94cd1ef65501 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030240 Aug 24 12:37:19.239921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 375/754] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:19.420675 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3631c411-85ae-47ac-b75d-2cd25007090f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:19.422879 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3631c411-85ae-47ac-b75d-2cd25007090f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:19.429448 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3631c411-85ae-47ac-b75d-2cd25007090f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:19.430141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3631c411-85ae-47ac-b75d-2cd25007090f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:19.430595 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3631c411-85ae-47ac-b75d-2cd25007090f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:19.431480 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3631c411-85ae-47ac-b75d-2cd25007090f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:19.431940 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3631c411-85ae-47ac-b75d-2cd25007090f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:19.432366 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3631c411-85ae-47ac-b75d-2cd25007090f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:19.462474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3631c411-85ae-47ac-b75d-2cd25007090f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045725 Aug 24 12:37:19.465976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 380/755] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:19 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:20.479801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a5be38b1-f022-4b61-9ba0-8793734e6295 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:20.482014 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a5be38b1-f022-4b61-9ba0-8793734e6295 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:20.488100 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a5be38b1-f022-4b61-9ba0-8793734e6295 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:20.488584 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a5be38b1-f022-4b61-9ba0-8793734e6295 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:20.489019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a5be38b1-f022-4b61-9ba0-8793734e6295 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:20.489978 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a5be38b1-f022-4b61-9ba0-8793734e6295 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:20.490433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a5be38b1-f022-4b61-9ba0-8793734e6295 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:20.490888 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a5be38b1-f022-4b61-9ba0-8793734e6295 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:20.519901 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a5be38b1-f022-4b61-9ba0-8793734e6295 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045406 Aug 24 12:37:20.520445 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 376/756] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:20 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:21.532477 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3a7105f1-a75c-4cd2-b3cf-ee24388d7d79 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:21.534633 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3a7105f1-a75c-4cd2-b3cf-ee24388d7d79 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:21.541565 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a7105f1-a75c-4cd2-b3cf-ee24388d7d79 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:21.542071 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a7105f1-a75c-4cd2-b3cf-ee24388d7d79 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:21.542519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a7105f1-a75c-4cd2-b3cf-ee24388d7d79 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:21.543274 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a7105f1-a75c-4cd2-b3cf-ee24388d7d79 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:21.543723 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a7105f1-a75c-4cd2-b3cf-ee24388d7d79 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:21.544148 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a7105f1-a75c-4cd2-b3cf-ee24388d7d79 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:21.573465 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3a7105f1-a75c-4cd2-b3cf-ee24388d7d79 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044967 Aug 24 12:37:21.574241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 381/757] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:21 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:22.585952 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-258ad833-98bb-4af5-8f0e-87e89c982a44 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:22.588083 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-258ad833-98bb-4af5-8f0e-87e89c982a44 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:22.594529 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-258ad833-98bb-4af5-8f0e-87e89c982a44 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:22.595036 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-258ad833-98bb-4af5-8f0e-87e89c982a44 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:22.595470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-258ad833-98bb-4af5-8f0e-87e89c982a44 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:22.596143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-258ad833-98bb-4af5-8f0e-87e89c982a44 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:22.596594 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-258ad833-98bb-4af5-8f0e-87e89c982a44 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:22.597010 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-258ad833-98bb-4af5-8f0e-87e89c982a44 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:22.625730 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-258ad833-98bb-4af5-8f0e-87e89c982a44 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044262 Aug 24 12:37:22.626264 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 377/758] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:22 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:23.638037 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-070d31b4-acee-4016-8e5f-30ac2a9dba7c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:23.640204 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-070d31b4-acee-4016-8e5f-30ac2a9dba7c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:23.643553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=48 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:23.647076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-070d31b4-acee-4016-8e5f-30ac2a9dba7c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:23.647553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-070d31b4-acee-4016-8e5f-30ac2a9dba7c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:23.647985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-070d31b4-acee-4016-8e5f-30ac2a9dba7c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:23.648665 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-070d31b4-acee-4016-8e5f-30ac2a9dba7c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:23.649707 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-070d31b4-acee-4016-8e5f-30ac2a9dba7c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:23.650130 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-070d31b4-acee-4016-8e5f-30ac2a9dba7c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:23.678801 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-070d31b4-acee-4016-8e5f-30ac2a9dba7c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045113 Aug 24 12:37:23.679281 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 382/759] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:23 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:24.691150 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8b55cdad-7dd4-4061-9f09-94962c4de5ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:24.693175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8b55cdad-7dd4-4061-9f09-94962c4de5ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:24.696073 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=52 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:24.700673 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b55cdad-7dd4-4061-9f09-94962c4de5ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:24.701148 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b55cdad-7dd4-4061-9f09-94962c4de5ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:24.701580 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b55cdad-7dd4-4061-9f09-94962c4de5ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:24.702254 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b55cdad-7dd4-4061-9f09-94962c4de5ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:24.702778 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b55cdad-7dd4-4061-9f09-94962c4de5ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:24.703198 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b55cdad-7dd4-4061-9f09-94962c4de5ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:24.733188 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8b55cdad-7dd4-4061-9f09-94962c4de5ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046032 Aug 24 12:37:24.733733 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 378/760] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:24 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:25.746247 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1964033c-f148-400b-b8c0-c2f109a4b5af tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:25.748361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1964033c-f148-400b-b8c0-c2f109a4b5af tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:25.754667 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1964033c-f148-400b-b8c0-c2f109a4b5af tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:25.755150 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1964033c-f148-400b-b8c0-c2f109a4b5af tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:25.755575 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1964033c-f148-400b-b8c0-c2f109a4b5af tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:25.756255 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1964033c-f148-400b-b8c0-c2f109a4b5af tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:25.756695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1964033c-f148-400b-b8c0-c2f109a4b5af tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:25.757109 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1964033c-f148-400b-b8c0-c2f109a4b5af tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:25.785690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1964033c-f148-400b-b8c0-c2f109a4b5af tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044304 Aug 24 12:37:25.786222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 383/761] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:25 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:26.797972 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5786adad-f0e8-4e7b-b5a3-60ea0daf40eb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:26.800107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5786adad-f0e8-4e7b-b5a3-60ea0daf40eb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:26.807085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5786adad-f0e8-4e7b-b5a3-60ea0daf40eb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:26.807565 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5786adad-f0e8-4e7b-b5a3-60ea0daf40eb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:26.808002 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5786adad-f0e8-4e7b-b5a3-60ea0daf40eb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:26.808691 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5786adad-f0e8-4e7b-b5a3-60ea0daf40eb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:26.809148 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5786adad-f0e8-4e7b-b5a3-60ea0daf40eb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:26.809577 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5786adad-f0e8-4e7b-b5a3-60ea0daf40eb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:26.837346 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5786adad-f0e8-4e7b-b5a3-60ea0daf40eb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043413 Aug 24 12:37:26.837881 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 379/762] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:26 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:27.849496 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b55e02b8-9c4c-4028-8610-8806e96d121f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:27.851626 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b55e02b8-9c4c-4028-8610-8806e96d121f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:27.857865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b55e02b8-9c4c-4028-8610-8806e96d121f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:27.858345 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b55e02b8-9c4c-4028-8610-8806e96d121f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:27.858823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b55e02b8-9c4c-4028-8610-8806e96d121f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:27.859501 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b55e02b8-9c4c-4028-8610-8806e96d121f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:27.859949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b55e02b8-9c4c-4028-8610-8806e96d121f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:27.860368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b55e02b8-9c4c-4028-8610-8806e96d121f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:27.889497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b55e02b8-9c4c-4028-8610-8806e96d121f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044001 Aug 24 12:37:27.890036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 384/763] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:27 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:28.902522 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-16174a07-f0da-4a6b-bbe7-6e7b7660f591 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:28.904633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-16174a07-f0da-4a6b-bbe7-6e7b7660f591 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:28.910907 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-16174a07-f0da-4a6b-bbe7-6e7b7660f591 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:28.911382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-16174a07-f0da-4a6b-bbe7-6e7b7660f591 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:28.911807 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-16174a07-f0da-4a6b-bbe7-6e7b7660f591 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:28.912480 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-16174a07-f0da-4a6b-bbe7-6e7b7660f591 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:28.912923 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-16174a07-f0da-4a6b-bbe7-6e7b7660f591 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:28.913340 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-16174a07-f0da-4a6b-bbe7-6e7b7660f591 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:28.940976 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-16174a07-f0da-4a6b-bbe7-6e7b7660f591 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043009 Aug 24 12:37:28.941507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 380/764] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:28 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:29.953320 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d956a05d-02b1-4914-ad7c-c0e48562e233 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:29.955482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d956a05d-02b1-4914-ad7c-c0e48562e233 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:29.961966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d956a05d-02b1-4914-ad7c-c0e48562e233 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:29.962379 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d956a05d-02b1-4914-ad7c-c0e48562e233 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:29.962858 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d956a05d-02b1-4914-ad7c-c0e48562e233 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:29.963536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d956a05d-02b1-4914-ad7c-c0e48562e233 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:29.963985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d956a05d-02b1-4914-ad7c-c0e48562e233 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:29.964405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d956a05d-02b1-4914-ad7c-c0e48562e233 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:29.988844 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:29.994348 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d956a05d-02b1-4914-ad7c-c0e48562e233 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045044 Aug 24 12:37:29.999109 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 385/765] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:29 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:31.006781 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0b961901-fc02-4d5a-a8e7-c2e096f5c76d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:31.010058 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0b961901-fc02-4d5a-a8e7-c2e096f5c76d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:31.016564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b961901-fc02-4d5a-a8e7-c2e096f5c76d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:31.017045 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b961901-fc02-4d5a-a8e7-c2e096f5c76d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:31.017477 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b961901-fc02-4d5a-a8e7-c2e096f5c76d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:31.018337 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b961901-fc02-4d5a-a8e7-c2e096f5c76d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:31.018832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b961901-fc02-4d5a-a8e7-c2e096f5c76d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:31.019258 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b961901-fc02-4d5a-a8e7-c2e096f5c76d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:31.048796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0b961901-fc02-4d5a-a8e7-c2e096f5c76d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045953 Aug 24 12:37:31.049349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 381/766] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:31 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:32.061148 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-67189559-b9ae-450d-9188-3be29d5ce084 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:32.063311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-67189559-b9ae-450d-9188-3be29d5ce084 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:32.070808 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-67189559-b9ae-450d-9188-3be29d5ce084 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:32.071301 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-67189559-b9ae-450d-9188-3be29d5ce084 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:32.071735 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-67189559-b9ae-450d-9188-3be29d5ce084 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:32.072414 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-67189559-b9ae-450d-9188-3be29d5ce084 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:32.072861 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-67189559-b9ae-450d-9188-3be29d5ce084 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:32.073278 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-67189559-b9ae-450d-9188-3be29d5ce084 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:32.101474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-67189559-b9ae-450d-9188-3be29d5ce084 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044270 Aug 24 12:37:32.102015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 386/767] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:32 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:32.741928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0aa9dbe9-fb52-43a0-b04d-4f6731d2bdfd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1518447889"}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:32.742461 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0aa9dbe9-fb52-43a0-b04d-4f6731d2bdfd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:32.748947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0aa9dbe9-fb52-43a0-b04d-4f6731d2bdfd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:32.749426 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0aa9dbe9-fb52-43a0-b04d-4f6731d2bdfd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:32.749857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0aa9dbe9-fb52-43a0-b04d-4f6731d2bdfd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:32.750533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0aa9dbe9-fb52-43a0-b04d-4f6731d2bdfd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:32.751016 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0aa9dbe9-fb52-43a0-b04d-4f6731d2bdfd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:32.751434 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0aa9dbe9-fb52-43a0-b04d-4f6731d2bdfd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:32.878430 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.network.security_group_api [None req-0aa9dbe9-fb52-43a0-b04d-4f6731d2bdfd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Removing security group d777661f-9194-4ef8-9b64-1321ec4d9424 from port 4f48e5e7-3a0c-4f05-abe0-02ba501d8cfd Aug 24 12:37:33.113592 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7241aa99-610f-4dbd-a652-f42be4d95ace tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:33.116115 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7241aa99-610f-4dbd-a652-f42be4d95ace tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:33.122970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7241aa99-610f-4dbd-a652-f42be4d95ace tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:33.123454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7241aa99-610f-4dbd-a652-f42be4d95ace tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:33.123884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7241aa99-610f-4dbd-a652-f42be4d95ace tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:33.124577 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7241aa99-610f-4dbd-a652-f42be4d95ace tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:33.125027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7241aa99-610f-4dbd-a652-f42be4d95ace tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:33.125447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7241aa99-610f-4dbd-a652-f42be4d95ace tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:33.155198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7241aa99-610f-4dbd-a652-f42be4d95ace tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046043 Aug 24 12:37:33.155761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 387/768] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:33 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:33.229217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0aa9dbe9-fb52-43a0-b04d-4f6731d2bdfd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "POST /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/action" status: 202 len: 0 microversion: 2.1 time: 0.491199 Aug 24 12:37:33.230061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 382/769] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 12:37:32 2022] POST /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:37:33.324965 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-b0de8a9b-3a10-4547-8743-4bd5e056f55c req-0a9a269a-d211-488f-a1a4-59aa316c9a6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ce2c0c-40e5-45d1-b2a6-ad30617badb4", "tag": "4f48e5e7-3a0c-4f05-abe0-02ba501d8cfd"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:33.334412 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-b0de8a9b-3a10-4547-8743-4bd5e056f55c req-0a9a269a-d211-488f-a1a4-59aa316c9a6d service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:33.334907 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-b0de8a9b-3a10-4547-8743-4bd5e056f55c req-0a9a269a-d211-488f-a1a4-59aa316c9a6d service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:33.335628 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-b0de8a9b-3a10-4547-8743-4bd5e056f55c req-0a9a269a-d211-488f-a1a4-59aa316c9a6d service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:33.348624 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-b0de8a9b-3a10-4547-8743-4bd5e056f55c req-0a9a269a-d211-488f-a1a4-59aa316c9a6d service nova] Creating event network-changed:4f48e5e7-3a0c-4f05-abe0-02ba501d8cfd for instance 29ce2c0c-40e5-45d1-b2a6-ad30617badb4 on hv-cinder-84889 Aug 24 12:37:33.354283 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-b0de8a9b-3a10-4547-8743-4bd5e056f55c req-0a9a269a-d211-488f-a1a4-59aa316c9a6d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120373 Aug 24 12:37:33.355147 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 388/770] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:34.168404 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0b6ee15d-575d-4fc6-9985-f7a0bab3aec9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:34.170753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0b6ee15d-575d-4fc6-9985-f7a0bab3aec9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:34.176845 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b6ee15d-575d-4fc6-9985-f7a0bab3aec9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:34.177337 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b6ee15d-575d-4fc6-9985-f7a0bab3aec9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:34.180334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b6ee15d-575d-4fc6-9985-f7a0bab3aec9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:34.180334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b6ee15d-575d-4fc6-9985-f7a0bab3aec9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:34.180334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b6ee15d-575d-4fc6-9985-f7a0bab3aec9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:34.180334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b6ee15d-575d-4fc6-9985-f7a0bab3aec9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:34.182416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:34.210377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0b6ee15d-575d-4fc6-9985-f7a0bab3aec9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046953 Aug 24 12:37:34.210975 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 383/771] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:34 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:34.688395 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8a847a84-4986-47d2-a4bd-fb1a3517261f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:34.688973 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8a847a84-4986-47d2-a4bd-fb1a3517261f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:34.695740 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8a847a84-4986-47d2-a4bd-fb1a3517261f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:34.696222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8a847a84-4986-47d2-a4bd-fb1a3517261f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:34.696655 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8a847a84-4986-47d2-a4bd-fb1a3517261f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:34.697341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8a847a84-4986-47d2-a4bd-fb1a3517261f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:34.697795 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8a847a84-4986-47d2-a4bd-fb1a3517261f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:34.698219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8a847a84-4986-47d2-a4bd-fb1a3517261f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:34.777178 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.objects.instance [None req-8a847a84-4986-47d2-a4bd-fb1a3517261f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lazy-loading 'services' on Instance uuid 29ce2c0c-40e5-45d1-b2a6-ad30617badb4 {{(pid=121171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:37:34.965216 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8a847a84-4986-47d2-a4bd-fb1a3517261f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "DELETE /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments/b4c145b7-fcf4-4bf2-8030-ed47b577a2a6" status: 202 len: 0 microversion: 2.1 time: 0.280871 Aug 24 12:37:34.966049 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 389/772] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 24 12:37:34 2022] DELETE /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments/b4c145b7-fcf4-4bf2-8030-ed47b577a2a6 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:37:34.974797 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e609433f-f4db-4d76-a21a-c88f369333b2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:34.977144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e609433f-f4db-4d76-a21a-c88f369333b2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:34.983611 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e609433f-f4db-4d76-a21a-c88f369333b2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:34.984137 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e609433f-f4db-4d76-a21a-c88f369333b2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:34.984533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e609433f-f4db-4d76-a21a-c88f369333b2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:34.985228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e609433f-f4db-4d76-a21a-c88f369333b2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:34.985680 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e609433f-f4db-4d76-a21a-c88f369333b2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:34.986098 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e609433f-f4db-4d76-a21a-c88f369333b2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:35.016054 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e609433f-f4db-4d76-a21a-c88f369333b2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045640 Aug 24 12:37:35.016606 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 384/773] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:34 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:35.224437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-01cb8eb6-7389-4adc-963a-180088164b7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:35.226762 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-01cb8eb6-7389-4adc-963a-180088164b7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:35.232866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01cb8eb6-7389-4adc-963a-180088164b7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:35.233342 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01cb8eb6-7389-4adc-963a-180088164b7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:35.233768 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01cb8eb6-7389-4adc-963a-180088164b7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:35.234473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01cb8eb6-7389-4adc-963a-180088164b7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:35.234936 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01cb8eb6-7389-4adc-963a-180088164b7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:35.235352 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01cb8eb6-7389-4adc-963a-180088164b7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:35.265001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-01cb8eb6-7389-4adc-963a-180088164b7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044915 Aug 24 12:37:35.265542 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 390/774] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:35 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:35.369619 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-2b7059c2-9e91-4367-9f61-027203a93e35 req-c37773c7-37c7-48d0-af53-743adcd640c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ce2c0c-40e5-45d1-b2a6-ad30617badb4", "tag": "4f48e5e7-3a0c-4f05-abe0-02ba501d8cfd"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:35.391688 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-2b7059c2-9e91-4367-9f61-027203a93e35 req-c37773c7-37c7-48d0-af53-743adcd640c1 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:35.392198 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-2b7059c2-9e91-4367-9f61-027203a93e35 req-c37773c7-37c7-48d0-af53-743adcd640c1 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:35.392650 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-2b7059c2-9e91-4367-9f61-027203a93e35 req-c37773c7-37c7-48d0-af53-743adcd640c1 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:35.404531 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-2b7059c2-9e91-4367-9f61-027203a93e35 req-c37773c7-37c7-48d0-af53-743adcd640c1 service nova] Creating event network-changed:4f48e5e7-3a0c-4f05-abe0-02ba501d8cfd for instance 29ce2c0c-40e5-45d1-b2a6-ad30617badb4 on hv-cinder-84889 Aug 24 12:37:35.409515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-2b7059c2-9e91-4367-9f61-027203a93e35 req-c37773c7-37c7-48d0-af53-743adcd640c1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043987 Aug 24 12:37:35.410116 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 385/775] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:36.029242 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-22581e9d-32d3-4453-99fc-86ecfcaba532 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:36.031349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-22581e9d-32d3-4453-99fc-86ecfcaba532 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:36.037830 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22581e9d-32d3-4453-99fc-86ecfcaba532 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:36.038313 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22581e9d-32d3-4453-99fc-86ecfcaba532 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:36.038779 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22581e9d-32d3-4453-99fc-86ecfcaba532 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:36.040068 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22581e9d-32d3-4453-99fc-86ecfcaba532 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:36.040521 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22581e9d-32d3-4453-99fc-86ecfcaba532 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:36.040940 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22581e9d-32d3-4453-99fc-86ecfcaba532 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:36.069117 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-22581e9d-32d3-4453-99fc-86ecfcaba532 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043819 Aug 24 12:37:36.069668 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 391/776] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:36 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:37:36.277803 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3b8456b1-52b6-4301-a40a-669e84071279 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:36.280104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3b8456b1-52b6-4301-a40a-669e84071279 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:36.286085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b8456b1-52b6-4301-a40a-669e84071279 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:36.286563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b8456b1-52b6-4301-a40a-669e84071279 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:36.287024 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b8456b1-52b6-4301-a40a-669e84071279 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:36.287708 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b8456b1-52b6-4301-a40a-669e84071279 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:36.288160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b8456b1-52b6-4301-a40a-669e84071279 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:36.288584 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b8456b1-52b6-4301-a40a-669e84071279 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:36.317091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3b8456b1-52b6-4301-a40a-669e84071279 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044062 Aug 24 12:37:36.317623 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 386/777] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:36 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:37.081381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6f50a2f0-621b-440a-a31a-8d017e1f6691 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:37.083531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6f50a2f0-621b-440a-a31a-8d017e1f6691 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:37.089813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6f50a2f0-621b-440a-a31a-8d017e1f6691 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:37.090285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6f50a2f0-621b-440a-a31a-8d017e1f6691 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:37.090748 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6f50a2f0-621b-440a-a31a-8d017e1f6691 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:37.091419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6f50a2f0-621b-440a-a31a-8d017e1f6691 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:37.091862 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6f50a2f0-621b-440a-a31a-8d017e1f6691 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:37.092280 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6f50a2f0-621b-440a-a31a-8d017e1f6691 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:37.123159 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6f50a2f0-621b-440a-a31a-8d017e1f6691 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045563 Aug 24 12:37:37.123955 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 392/778] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:37 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:37.329424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3916883f-d2ad-4d15-81c1-6ee57429243b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:37.331703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3916883f-d2ad-4d15-81c1-6ee57429243b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:37.337952 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3916883f-d2ad-4d15-81c1-6ee57429243b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:37.338433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3916883f-d2ad-4d15-81c1-6ee57429243b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:37.338907 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3916883f-d2ad-4d15-81c1-6ee57429243b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:37.339600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3916883f-d2ad-4d15-81c1-6ee57429243b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:37.340057 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3916883f-d2ad-4d15-81c1-6ee57429243b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:37.340482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3916883f-d2ad-4d15-81c1-6ee57429243b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:37.369656 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3916883f-d2ad-4d15-81c1-6ee57429243b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044320 Aug 24 12:37:37.370198 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 387/779] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:37 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:38.136753 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9af31f42-5572-4e64-a7ae-4f8df19df0b6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:38.138893 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9af31f42-5572-4e64-a7ae-4f8df19df0b6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:38.145162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9af31f42-5572-4e64-a7ae-4f8df19df0b6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:38.145638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9af31f42-5572-4e64-a7ae-4f8df19df0b6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:38.146064 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9af31f42-5572-4e64-a7ae-4f8df19df0b6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:38.146763 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9af31f42-5572-4e64-a7ae-4f8df19df0b6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:38.147210 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9af31f42-5572-4e64-a7ae-4f8df19df0b6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:38.147625 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9af31f42-5572-4e64-a7ae-4f8df19df0b6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:38.175503 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9af31f42-5572-4e64-a7ae-4f8df19df0b6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043303 Aug 24 12:37:38.176031 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 393/780] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:38 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:38.382021 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-954bfb9b-e23c-4bea-b24a-ae879307f5bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:38.384735 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-954bfb9b-e23c-4bea-b24a-ae879307f5bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:38.391170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-954bfb9b-e23c-4bea-b24a-ae879307f5bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:38.391616 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-954bfb9b-e23c-4bea-b24a-ae879307f5bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:38.392054 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-954bfb9b-e23c-4bea-b24a-ae879307f5bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:38.392739 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-954bfb9b-e23c-4bea-b24a-ae879307f5bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:38.393195 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-954bfb9b-e23c-4bea-b24a-ae879307f5bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:38.393619 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-954bfb9b-e23c-4bea-b24a-ae879307f5bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:38.421807 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-954bfb9b-e23c-4bea-b24a-ae879307f5bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043753 Aug 24 12:37:38.422757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 388/781] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:38 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:39.188057 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8285ab4f-869a-4c14-85e4-ae19171067d9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:39.190152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8285ab4f-869a-4c14-85e4-ae19171067d9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:39.197226 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8285ab4f-869a-4c14-85e4-ae19171067d9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:39.197702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8285ab4f-869a-4c14-85e4-ae19171067d9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:39.198157 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8285ab4f-869a-4c14-85e4-ae19171067d9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:39.198859 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8285ab4f-869a-4c14-85e4-ae19171067d9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:39.199302 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8285ab4f-869a-4c14-85e4-ae19171067d9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:39.199719 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8285ab4f-869a-4c14-85e4-ae19171067d9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:39.228112 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8285ab4f-869a-4c14-85e4-ae19171067d9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044004 Aug 24 12:37:39.228649 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 394/782] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:39 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:39.434579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5b5670ea-1df1-4938-bee9-f00945c0aea3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:39.436724 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5b5670ea-1df1-4938-bee9-f00945c0aea3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:39.443167 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b5670ea-1df1-4938-bee9-f00945c0aea3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:39.443589 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b5670ea-1df1-4938-bee9-f00945c0aea3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:39.444026 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b5670ea-1df1-4938-bee9-f00945c0aea3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:39.444711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b5670ea-1df1-4938-bee9-f00945c0aea3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:39.445165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b5670ea-1df1-4938-bee9-f00945c0aea3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:39.445585 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b5670ea-1df1-4938-bee9-f00945c0aea3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:39.473265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5b5670ea-1df1-4938-bee9-f00945c0aea3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043390 Aug 24 12:37:39.473805 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 389/783] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:39 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:40.239729 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-686f970f-d219-4fbf-96e3-654375ffc0dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:40.241887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-686f970f-d219-4fbf-96e3-654375ffc0dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:40.248456 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-686f970f-d219-4fbf-96e3-654375ffc0dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:40.248934 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-686f970f-d219-4fbf-96e3-654375ffc0dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:40.249366 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-686f970f-d219-4fbf-96e3-654375ffc0dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:40.250045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-686f970f-d219-4fbf-96e3-654375ffc0dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:40.250495 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-686f970f-d219-4fbf-96e3-654375ffc0dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:40.250937 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-686f970f-d219-4fbf-96e3-654375ffc0dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:40.279671 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-686f970f-d219-4fbf-96e3-654375ffc0dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044156 Aug 24 12:37:40.280207 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 395/784] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:40 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:40.486348 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-db28fb67-486e-4770-be52-10f22092b247 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:40.488495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-db28fb67-486e-4770-be52-10f22092b247 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:40.495530 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db28fb67-486e-4770-be52-10f22092b247 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:40.496006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db28fb67-486e-4770-be52-10f22092b247 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:40.496437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db28fb67-486e-4770-be52-10f22092b247 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:40.497112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db28fb67-486e-4770-be52-10f22092b247 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:40.497563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db28fb67-486e-4770-be52-10f22092b247 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:40.497976 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db28fb67-486e-4770-be52-10f22092b247 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:40.526213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-db28fb67-486e-4770-be52-10f22092b247 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043943 Aug 24 12:37:40.526767 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 390/785] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:40 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:41.292530 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ded8af3a-c413-4867-a0c6-fc3a11fc1f0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:41.294644 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ded8af3a-c413-4867-a0c6-fc3a11fc1f0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:41.301194 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ded8af3a-c413-4867-a0c6-fc3a11fc1f0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:41.301700 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ded8af3a-c413-4867-a0c6-fc3a11fc1f0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:41.302128 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ded8af3a-c413-4867-a0c6-fc3a11fc1f0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:41.302837 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ded8af3a-c413-4867-a0c6-fc3a11fc1f0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:41.303286 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ded8af3a-c413-4867-a0c6-fc3a11fc1f0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:41.303700 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ded8af3a-c413-4867-a0c6-fc3a11fc1f0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:41.331909 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ded8af3a-c413-4867-a0c6-fc3a11fc1f0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043949 Aug 24 12:37:41.332453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 396/786] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:41 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:41.538633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7cb5e909-df97-4e7a-9c4b-b2b346d28696 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:41.541440 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7cb5e909-df97-4e7a-9c4b-b2b346d28696 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:41.551857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7cb5e909-df97-4e7a-9c4b-b2b346d28696 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:41.551857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7cb5e909-df97-4e7a-9c4b-b2b346d28696 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:41.551857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7cb5e909-df97-4e7a-9c4b-b2b346d28696 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:41.552229 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7cb5e909-df97-4e7a-9c4b-b2b346d28696 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:41.552624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7cb5e909-df97-4e7a-9c4b-b2b346d28696 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:41.553053 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7cb5e909-df97-4e7a-9c4b-b2b346d28696 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:41.582216 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7cb5e909-df97-4e7a-9c4b-b2b346d28696 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047517 Aug 24 12:37:41.582794 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 391/787] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:41 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:42.344231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-78e003d7-e34c-48a1-98ef-8b222faa5a32 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:42.346354 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-78e003d7-e34c-48a1-98ef-8b222faa5a32 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:42.353154 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-78e003d7-e34c-48a1-98ef-8b222faa5a32 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:42.356517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-78e003d7-e34c-48a1-98ef-8b222faa5a32 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:42.356517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-78e003d7-e34c-48a1-98ef-8b222faa5a32 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:42.356517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-78e003d7-e34c-48a1-98ef-8b222faa5a32 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:42.356517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-78e003d7-e34c-48a1-98ef-8b222faa5a32 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:42.356891 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-78e003d7-e34c-48a1-98ef-8b222faa5a32 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:42.385602 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-78e003d7-e34c-48a1-98ef-8b222faa5a32 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045475 Aug 24 12:37:42.389326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 397/788] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:42 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:42.594902 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-61acf5f4-e85d-4fd7-982b-9fc6fee3a574 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:42.596937 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-61acf5f4-e85d-4fd7-982b-9fc6fee3a574 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:42.603231 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-61acf5f4-e85d-4fd7-982b-9fc6fee3a574 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:42.604216 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-61acf5f4-e85d-4fd7-982b-9fc6fee3a574 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:42.604668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-61acf5f4-e85d-4fd7-982b-9fc6fee3a574 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:42.605346 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-61acf5f4-e85d-4fd7-982b-9fc6fee3a574 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:42.605799 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-61acf5f4-e85d-4fd7-982b-9fc6fee3a574 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:42.606225 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-61acf5f4-e85d-4fd7-982b-9fc6fee3a574 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:42.634950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-61acf5f4-e85d-4fd7-982b-9fc6fee3a574 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044148 Aug 24 12:37:42.635501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 392/789] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:42 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:43.397309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9008769f-d28c-41ff-b09c-d0f1a51e8231 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:43.399470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9008769f-d28c-41ff-b09c-d0f1a51e8231 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:43.406313 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9008769f-d28c-41ff-b09c-d0f1a51e8231 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:43.406815 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9008769f-d28c-41ff-b09c-d0f1a51e8231 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:43.407242 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9008769f-d28c-41ff-b09c-d0f1a51e8231 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:43.407913 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9008769f-d28c-41ff-b09c-d0f1a51e8231 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:43.408355 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9008769f-d28c-41ff-b09c-d0f1a51e8231 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:43.408770 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9008769f-d28c-41ff-b09c-d0f1a51e8231 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:43.438055 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9008769f-d28c-41ff-b09c-d0f1a51e8231 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044595 Aug 24 12:37:43.438593 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 398/790] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:43 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:43.647379 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-eb7800d9-caa8-402c-af2b-055e366ad46c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:43.649473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-eb7800d9-caa8-402c-af2b-055e366ad46c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:43.656173 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eb7800d9-caa8-402c-af2b-055e366ad46c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:43.656658 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eb7800d9-caa8-402c-af2b-055e366ad46c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:43.657092 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eb7800d9-caa8-402c-af2b-055e366ad46c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:43.657777 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eb7800d9-caa8-402c-af2b-055e366ad46c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:43.658232 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eb7800d9-caa8-402c-af2b-055e366ad46c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:43.658680 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eb7800d9-caa8-402c-af2b-055e366ad46c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:43.686880 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-eb7800d9-caa8-402c-af2b-055e366ad46c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043547 Aug 24 12:37:43.687422 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 393/791] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:43 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:44.450828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-aec2abf8-a546-48bb-904d-1c406236f0e5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:44.452948 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-aec2abf8-a546-48bb-904d-1c406236f0e5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:44.459267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aec2abf8-a546-48bb-904d-1c406236f0e5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:44.459746 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aec2abf8-a546-48bb-904d-1c406236f0e5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:44.460172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aec2abf8-a546-48bb-904d-1c406236f0e5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:44.460853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aec2abf8-a546-48bb-904d-1c406236f0e5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:44.461301 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aec2abf8-a546-48bb-904d-1c406236f0e5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:44.461724 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aec2abf8-a546-48bb-904d-1c406236f0e5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:44.489716 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-aec2abf8-a546-48bb-904d-1c406236f0e5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043224 Aug 24 12:37:44.490255 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 399/792] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:44 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:44.699377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1c2216c7-8b8c-4b52-88e3-7d505fdb4711 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:44.701441 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1c2216c7-8b8c-4b52-88e3-7d505fdb4711 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:44.707819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1c2216c7-8b8c-4b52-88e3-7d505fdb4711 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:44.708301 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1c2216c7-8b8c-4b52-88e3-7d505fdb4711 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:44.708744 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1c2216c7-8b8c-4b52-88e3-7d505fdb4711 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:44.709481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1c2216c7-8b8c-4b52-88e3-7d505fdb4711 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:44.709945 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1c2216c7-8b8c-4b52-88e3-7d505fdb4711 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:44.710373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1c2216c7-8b8c-4b52-88e3-7d505fdb4711 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:44.739536 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1c2216c7-8b8c-4b52-88e3-7d505fdb4711 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044091 Aug 24 12:37:44.740086 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 394/793] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:44 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:45.501857 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c840b829-005d-406d-b4a3-0c029d999c28 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:45.503985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c840b829-005d-406d-b4a3-0c029d999c28 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:45.510309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c840b829-005d-406d-b4a3-0c029d999c28 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:45.510811 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c840b829-005d-406d-b4a3-0c029d999c28 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:45.511801 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c840b829-005d-406d-b4a3-0c029d999c28 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:45.512411 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c840b829-005d-406d-b4a3-0c029d999c28 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:45.512855 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c840b829-005d-406d-b4a3-0c029d999c28 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:45.513270 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c840b829-005d-406d-b4a3-0c029d999c28 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:45.541155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c840b829-005d-406d-b4a3-0c029d999c28 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043235 Aug 24 12:37:45.541689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 400/794] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:45 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:45.752418 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-53257b2d-980e-451a-a3b8-7ba0837962d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:45.754513 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-53257b2d-980e-451a-a3b8-7ba0837962d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:45.760846 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-53257b2d-980e-451a-a3b8-7ba0837962d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:45.762254 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-53257b2d-980e-451a-a3b8-7ba0837962d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:45.762800 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-53257b2d-980e-451a-a3b8-7ba0837962d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:45.763481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-53257b2d-980e-451a-a3b8-7ba0837962d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:45.763930 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-53257b2d-980e-451a-a3b8-7ba0837962d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:45.764345 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-53257b2d-980e-451a-a3b8-7ba0837962d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:45.792536 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-53257b2d-980e-451a-a3b8-7ba0837962d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044160 Aug 24 12:37:45.793081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 395/795] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:45 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:46.553448 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-376ea8d0-9677-4122-b70c-d6247e9fa83f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:46.555619 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-376ea8d0-9677-4122-b70c-d6247e9fa83f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:46.561541 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-376ea8d0-9677-4122-b70c-d6247e9fa83f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:46.562009 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-376ea8d0-9677-4122-b70c-d6247e9fa83f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:46.562435 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-376ea8d0-9677-4122-b70c-d6247e9fa83f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:46.563141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-376ea8d0-9677-4122-b70c-d6247e9fa83f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:46.563583 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-376ea8d0-9677-4122-b70c-d6247e9fa83f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:46.563999 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-376ea8d0-9677-4122-b70c-d6247e9fa83f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:46.591755 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-376ea8d0-9677-4122-b70c-d6247e9fa83f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042435 Aug 24 12:37:46.592299 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 401/796] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:46 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:46.804955 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bfcf541e-dd6f-44bd-bb1b-57456c035a70 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:46.807100 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bfcf541e-dd6f-44bd-bb1b-57456c035a70 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:46.813503 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bfcf541e-dd6f-44bd-bb1b-57456c035a70 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:46.813983 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bfcf541e-dd6f-44bd-bb1b-57456c035a70 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:46.814417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bfcf541e-dd6f-44bd-bb1b-57456c035a70 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:46.815143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bfcf541e-dd6f-44bd-bb1b-57456c035a70 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:46.815601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bfcf541e-dd6f-44bd-bb1b-57456c035a70 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:46.816026 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bfcf541e-dd6f-44bd-bb1b-57456c035a70 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:46.845730 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bfcf541e-dd6f-44bd-bb1b-57456c035a70 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044737 Aug 24 12:37:46.846270 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 396/797] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:46 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:47.603970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-64e8eb8f-8551-4a23-9633-39464899aa6b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:47.606593 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-64e8eb8f-8551-4a23-9633-39464899aa6b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:47.612950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64e8eb8f-8551-4a23-9633-39464899aa6b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:47.613429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64e8eb8f-8551-4a23-9633-39464899aa6b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:47.613864 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64e8eb8f-8551-4a23-9633-39464899aa6b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:47.614826 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64e8eb8f-8551-4a23-9633-39464899aa6b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:47.615276 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64e8eb8f-8551-4a23-9633-39464899aa6b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:47.615698 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64e8eb8f-8551-4a23-9633-39464899aa6b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:47.632308 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:47.644158 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-64e8eb8f-8551-4a23-9633-39464899aa6b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044140 Aug 24 12:37:47.648138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 402/798] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:47 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:47.858295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-868c8cef-bdc1-4395-a143-6535dce0e52c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:47.860349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-868c8cef-bdc1-4395-a143-6535dce0e52c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:47.867183 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-868c8cef-bdc1-4395-a143-6535dce0e52c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:47.867655 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-868c8cef-bdc1-4395-a143-6535dce0e52c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:47.868086 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-868c8cef-bdc1-4395-a143-6535dce0e52c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:47.868756 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-868c8cef-bdc1-4395-a143-6535dce0e52c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:47.869203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-868c8cef-bdc1-4395-a143-6535dce0e52c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:47.869617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-868c8cef-bdc1-4395-a143-6535dce0e52c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:47.898099 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-868c8cef-bdc1-4395-a143-6535dce0e52c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044658 Aug 24 12:37:47.898630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 397/799] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:47 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:48.656893 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-dfe9d961-77fb-4809-a245-e4411cf22c1e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:48.659041 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-dfe9d961-77fb-4809-a245-e4411cf22c1e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:48.665584 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dfe9d961-77fb-4809-a245-e4411cf22c1e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:48.666054 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dfe9d961-77fb-4809-a245-e4411cf22c1e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:48.666480 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dfe9d961-77fb-4809-a245-e4411cf22c1e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:48.667181 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dfe9d961-77fb-4809-a245-e4411cf22c1e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:48.667625 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dfe9d961-77fb-4809-a245-e4411cf22c1e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:48.668041 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dfe9d961-77fb-4809-a245-e4411cf22c1e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:48.696900 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-dfe9d961-77fb-4809-a245-e4411cf22c1e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044119 Aug 24 12:37:48.697366 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 403/800] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:48 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:48.912112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-be4a734b-6988-4121-996b-432a2d48a352 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:48.915221 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-be4a734b-6988-4121-996b-432a2d48a352 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:48.921622 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be4a734b-6988-4121-996b-432a2d48a352 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:48.925389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be4a734b-6988-4121-996b-432a2d48a352 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:48.925389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be4a734b-6988-4121-996b-432a2d48a352 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:48.925389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be4a734b-6988-4121-996b-432a2d48a352 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:48.925389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be4a734b-6988-4121-996b-432a2d48a352 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:48.925738 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be4a734b-6988-4121-996b-432a2d48a352 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:48.954159 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-be4a734b-6988-4121-996b-432a2d48a352 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046600 Aug 24 12:37:48.954631 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 398/801] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:48 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:49.710034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fc3833ca-53cf-4a0b-b409-d46bb1f1f9bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:49.712114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fc3833ca-53cf-4a0b-b409-d46bb1f1f9bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:49.718537 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc3833ca-53cf-4a0b-b409-d46bb1f1f9bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:49.719201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc3833ca-53cf-4a0b-b409-d46bb1f1f9bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:49.719471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc3833ca-53cf-4a0b-b409-d46bb1f1f9bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:49.720152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc3833ca-53cf-4a0b-b409-d46bb1f1f9bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:49.720603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc3833ca-53cf-4a0b-b409-d46bb1f1f9bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:49.721023 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc3833ca-53cf-4a0b-b409-d46bb1f1f9bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:49.749992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fc3833ca-53cf-4a0b-b409-d46bb1f1f9bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044331 Aug 24 12:37:49.750532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 404/802] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:49 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:49.966163 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-35202e36-e3ac-4ef4-ab0c-bb5fc076ded4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:49.968263 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-35202e36-e3ac-4ef4-ab0c-bb5fc076ded4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:49.974555 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35202e36-e3ac-4ef4-ab0c-bb5fc076ded4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:49.975070 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35202e36-e3ac-4ef4-ab0c-bb5fc076ded4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:49.975501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35202e36-e3ac-4ef4-ab0c-bb5fc076ded4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:49.976179 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35202e36-e3ac-4ef4-ab0c-bb5fc076ded4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:49.976627 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35202e36-e3ac-4ef4-ab0c-bb5fc076ded4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:49.977049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35202e36-e3ac-4ef4-ab0c-bb5fc076ded4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:50.006366 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-35202e36-e3ac-4ef4-ab0c-bb5fc076ded4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044237 Aug 24 12:37:50.006933 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 399/803] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:49 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:50.762107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-59ee35f3-86f4-418f-be07-dab885b6b1c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:50.764772 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-59ee35f3-86f4-418f-be07-dab885b6b1c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:50.771293 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59ee35f3-86f4-418f-be07-dab885b6b1c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:50.771775 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59ee35f3-86f4-418f-be07-dab885b6b1c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:50.772202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59ee35f3-86f4-418f-be07-dab885b6b1c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:50.772879 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59ee35f3-86f4-418f-be07-dab885b6b1c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:50.773339 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59ee35f3-86f4-418f-be07-dab885b6b1c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:50.773778 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59ee35f3-86f4-418f-be07-dab885b6b1c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:50.802173 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-59ee35f3-86f4-418f-be07-dab885b6b1c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044032 Aug 24 12:37:50.802745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 405/804] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:50 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:51.019384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-437cba8e-80c4-4ffa-93c1-c51ed64ca889 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:51.021411 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-437cba8e-80c4-4ffa-93c1-c51ed64ca889 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:51.027657 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-437cba8e-80c4-4ffa-93c1-c51ed64ca889 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:51.028135 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-437cba8e-80c4-4ffa-93c1-c51ed64ca889 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:51.028564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-437cba8e-80c4-4ffa-93c1-c51ed64ca889 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:51.029275 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-437cba8e-80c4-4ffa-93c1-c51ed64ca889 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:51.030056 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-437cba8e-80c4-4ffa-93c1-c51ed64ca889 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:51.030487 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-437cba8e-80c4-4ffa-93c1-c51ed64ca889 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:51.043834 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:51.059273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-437cba8e-80c4-4ffa-93c1-c51ed64ca889 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043930 Aug 24 12:37:51.065280 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 400/805] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:51 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:51.813604 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d7a9aac9-1dcb-4989-adeb-204c128f8ad4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:51.815787 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d7a9aac9-1dcb-4989-adeb-204c128f8ad4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:51.822165 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7a9aac9-1dcb-4989-adeb-204c128f8ad4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:51.822645 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7a9aac9-1dcb-4989-adeb-204c128f8ad4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:51.823107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7a9aac9-1dcb-4989-adeb-204c128f8ad4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:51.823795 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7a9aac9-1dcb-4989-adeb-204c128f8ad4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:51.824242 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7a9aac9-1dcb-4989-adeb-204c128f8ad4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:51.824662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7a9aac9-1dcb-4989-adeb-204c128f8ad4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:51.852886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d7a9aac9-1dcb-4989-adeb-204c128f8ad4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043385 Aug 24 12:37:51.853427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 406/806] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:51 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:52.076907 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4efa0a9b-4c52-4abb-a4ba-c6127ee93e15 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:52.079052 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4efa0a9b-4c52-4abb-a4ba-c6127ee93e15 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:52.085822 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4efa0a9b-4c52-4abb-a4ba-c6127ee93e15 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:52.086299 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4efa0a9b-4c52-4abb-a4ba-c6127ee93e15 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:52.086759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4efa0a9b-4c52-4abb-a4ba-c6127ee93e15 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:52.087438 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4efa0a9b-4c52-4abb-a4ba-c6127ee93e15 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:52.087888 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4efa0a9b-4c52-4abb-a4ba-c6127ee93e15 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:52.088306 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4efa0a9b-4c52-4abb-a4ba-c6127ee93e15 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:52.117657 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4efa0a9b-4c52-4abb-a4ba-c6127ee93e15 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045243 Aug 24 12:37:52.118217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 401/807] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:52 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:52.866338 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f9019c1d-df54-473e-bdde-c1e7781e7aab tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:52.868497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f9019c1d-df54-473e-bdde-c1e7781e7aab tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:52.875415 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f9019c1d-df54-473e-bdde-c1e7781e7aab tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:52.875889 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f9019c1d-df54-473e-bdde-c1e7781e7aab tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:52.876319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f9019c1d-df54-473e-bdde-c1e7781e7aab tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:52.876988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f9019c1d-df54-473e-bdde-c1e7781e7aab tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:52.877433 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f9019c1d-df54-473e-bdde-c1e7781e7aab tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:52.877849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f9019c1d-df54-473e-bdde-c1e7781e7aab tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:52.904997 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f9019c1d-df54-473e-bdde-c1e7781e7aab tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043169 Aug 24 12:37:52.905535 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 407/808] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:52 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:53.130550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bf1eb0a4-6e78-43c9-8aec-caa7b78acd54 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:53.132627 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bf1eb0a4-6e78-43c9-8aec-caa7b78acd54 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:53.139044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf1eb0a4-6e78-43c9-8aec-caa7b78acd54 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:53.139890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf1eb0a4-6e78-43c9-8aec-caa7b78acd54 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:53.140097 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf1eb0a4-6e78-43c9-8aec-caa7b78acd54 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:53.140802 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf1eb0a4-6e78-43c9-8aec-caa7b78acd54 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:53.141258 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf1eb0a4-6e78-43c9-8aec-caa7b78acd54 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:53.141683 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf1eb0a4-6e78-43c9-8aec-caa7b78acd54 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:53.170924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bf1eb0a4-6e78-43c9-8aec-caa7b78acd54 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044543 Aug 24 12:37:53.171475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 402/809] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:53 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:53.917366 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-822280a3-22e9-4374-8ab7-95f26d985b9b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:53.919944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-822280a3-22e9-4374-8ab7-95f26d985b9b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:53.926157 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-822280a3-22e9-4374-8ab7-95f26d985b9b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:53.926628 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-822280a3-22e9-4374-8ab7-95f26d985b9b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:53.927089 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-822280a3-22e9-4374-8ab7-95f26d985b9b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:53.927759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-822280a3-22e9-4374-8ab7-95f26d985b9b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:53.928202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-822280a3-22e9-4374-8ab7-95f26d985b9b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:53.928617 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-822280a3-22e9-4374-8ab7-95f26d985b9b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:53.957902 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-822280a3-22e9-4374-8ab7-95f26d985b9b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044369 Aug 24 12:37:53.958361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 408/810] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:53 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:54.183740 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bc5073a3-db87-4bfc-9340-63eb26c04b49 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:54.185849 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bc5073a3-db87-4bfc-9340-63eb26c04b49 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:54.192838 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc5073a3-db87-4bfc-9340-63eb26c04b49 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:54.193319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc5073a3-db87-4bfc-9340-63eb26c04b49 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:54.193757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc5073a3-db87-4bfc-9340-63eb26c04b49 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:54.194464 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc5073a3-db87-4bfc-9340-63eb26c04b49 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:54.194947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc5073a3-db87-4bfc-9340-63eb26c04b49 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:54.195372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc5073a3-db87-4bfc-9340-63eb26c04b49 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:54.223629 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bc5073a3-db87-4bfc-9340-63eb26c04b49 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043873 Aug 24 12:37:54.224104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 403/811] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:54 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:54.969856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-206e3147-3720-46cb-b4b9-c7ae3acd7bb3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:54.972049 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-206e3147-3720-46cb-b4b9-c7ae3acd7bb3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:54.978362 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-206e3147-3720-46cb-b4b9-c7ae3acd7bb3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:54.978880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-206e3147-3720-46cb-b4b9-c7ae3acd7bb3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:54.979314 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-206e3147-3720-46cb-b4b9-c7ae3acd7bb3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:54.979996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-206e3147-3720-46cb-b4b9-c7ae3acd7bb3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:54.980446 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-206e3147-3720-46cb-b4b9-c7ae3acd7bb3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:54.980870 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-206e3147-3720-46cb-b4b9-c7ae3acd7bb3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:55.010055 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-206e3147-3720-46cb-b4b9-c7ae3acd7bb3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044167 Aug 24 12:37:55.010597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 409/812] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:54 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:55.237600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-96d27848-1ef3-41cd-9c42-b60931e96398 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:55.240025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-96d27848-1ef3-41cd-9c42-b60931e96398 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:55.242247 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=52 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:55.246875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96d27848-1ef3-41cd-9c42-b60931e96398 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:55.247351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96d27848-1ef3-41cd-9c42-b60931e96398 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:55.247781 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96d27848-1ef3-41cd-9c42-b60931e96398 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:55.248465 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96d27848-1ef3-41cd-9c42-b60931e96398 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:55.248914 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96d27848-1ef3-41cd-9c42-b60931e96398 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:55.249331 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96d27848-1ef3-41cd-9c42-b60931e96398 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:55.278197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-96d27848-1ef3-41cd-9c42-b60931e96398 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046111 Aug 24 12:37:55.278759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 404/813] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:55 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:56.022744 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9e9a70e7-3173-4011-81b8-163b6ee204e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:56.024900 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9e9a70e7-3173-4011-81b8-163b6ee204e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:56.027269 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=56 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:56.032570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9e9a70e7-3173-4011-81b8-163b6ee204e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:56.033041 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9e9a70e7-3173-4011-81b8-163b6ee204e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:56.033476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9e9a70e7-3173-4011-81b8-163b6ee204e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:56.034147 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9e9a70e7-3173-4011-81b8-163b6ee204e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:56.034596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9e9a70e7-3173-4011-81b8-163b6ee204e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:56.035039 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9e9a70e7-3173-4011-81b8-163b6ee204e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:56.064103 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9e9a70e7-3173-4011-81b8-163b6ee204e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045387 Aug 24 12:37:56.064651 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 410/814] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:56 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:56.291130 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-72ad6193-cb54-4c24-8981-b4839a171538 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:56.293187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-72ad6193-cb54-4c24-8981-b4839a171538 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:56.299693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72ad6193-cb54-4c24-8981-b4839a171538 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:56.300170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72ad6193-cb54-4c24-8981-b4839a171538 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:56.300599 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72ad6193-cb54-4c24-8981-b4839a171538 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:56.301276 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72ad6193-cb54-4c24-8981-b4839a171538 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:56.301724 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72ad6193-cb54-4c24-8981-b4839a171538 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:56.302143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72ad6193-cb54-4c24-8981-b4839a171538 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:56.331014 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-72ad6193-cb54-4c24-8981-b4839a171538 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043910 Aug 24 12:37:56.331548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 405/815] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:56 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:57.076703 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6aef56be-1854-41d7-af4c-badb67a1fc57 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:57.079459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6aef56be-1854-41d7-af4c-badb67a1fc57 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:57.085530 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6aef56be-1854-41d7-af4c-badb67a1fc57 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:57.086004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6aef56be-1854-41d7-af4c-badb67a1fc57 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:57.086433 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6aef56be-1854-41d7-af4c-badb67a1fc57 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:57.087136 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6aef56be-1854-41d7-af4c-badb67a1fc57 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:57.087584 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6aef56be-1854-41d7-af4c-badb67a1fc57 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:57.088003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6aef56be-1854-41d7-af4c-badb67a1fc57 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:57.116392 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6aef56be-1854-41d7-af4c-badb67a1fc57 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044010 Aug 24 12:37:57.117197 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 411/816] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:57 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:57.343332 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-093879f8-95be-4b49-9c98-d491a2f8f831 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:57.345362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-093879f8-95be-4b49-9c98-d491a2f8f831 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:57.351827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-093879f8-95be-4b49-9c98-d491a2f8f831 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:57.352301 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-093879f8-95be-4b49-9c98-d491a2f8f831 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:57.352732 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-093879f8-95be-4b49-9c98-d491a2f8f831 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:57.353408 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-093879f8-95be-4b49-9c98-d491a2f8f831 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:57.353854 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-093879f8-95be-4b49-9c98-d491a2f8f831 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:57.354270 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-093879f8-95be-4b49-9c98-d491a2f8f831 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:57.383199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-093879f8-95be-4b49-9c98-d491a2f8f831 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043924 Aug 24 12:37:57.383903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 406/817] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:57 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:58.128862 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9ab7c2cb-bf72-45d5-a225-1223f6ed872a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:58.130988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9ab7c2cb-bf72-45d5-a225-1223f6ed872a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:58.137236 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9ab7c2cb-bf72-45d5-a225-1223f6ed872a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:58.137707 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9ab7c2cb-bf72-45d5-a225-1223f6ed872a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:58.138135 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9ab7c2cb-bf72-45d5-a225-1223f6ed872a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:58.138848 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9ab7c2cb-bf72-45d5-a225-1223f6ed872a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:58.139292 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9ab7c2cb-bf72-45d5-a225-1223f6ed872a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:58.139707 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9ab7c2cb-bf72-45d5-a225-1223f6ed872a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:58.168080 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9ab7c2cb-bf72-45d5-a225-1223f6ed872a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043272 Aug 24 12:37:58.168609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 412/818] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:58 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:58.395423 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-03a92647-cbd9-4a83-a134-6a6b126087f0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:58.397494 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-03a92647-cbd9-4a83-a134-6a6b126087f0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:58.403893 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03a92647-cbd9-4a83-a134-6a6b126087f0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:58.404385 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03a92647-cbd9-4a83-a134-6a6b126087f0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:58.404821 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03a92647-cbd9-4a83-a134-6a6b126087f0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:58.405508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03a92647-cbd9-4a83-a134-6a6b126087f0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:58.405964 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03a92647-cbd9-4a83-a134-6a6b126087f0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:58.406391 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03a92647-cbd9-4a83-a134-6a6b126087f0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:58.436012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-03a92647-cbd9-4a83-a134-6a6b126087f0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045305 Aug 24 12:37:58.436572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 407/819] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:58 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:59.180522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-281fc12e-b4d9-4908-9edd-1acec608176f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:59.182719 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-281fc12e-b4d9-4908-9edd-1acec608176f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:59.188919 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-281fc12e-b4d9-4908-9edd-1acec608176f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:59.189392 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-281fc12e-b4d9-4908-9edd-1acec608176f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:59.189823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-281fc12e-b4d9-4908-9edd-1acec608176f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:59.190492 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-281fc12e-b4d9-4908-9edd-1acec608176f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:59.190991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-281fc12e-b4d9-4908-9edd-1acec608176f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:59.191404 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-281fc12e-b4d9-4908-9edd-1acec608176f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:59.220154 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-281fc12e-b4d9-4908-9edd-1acec608176f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043629 Aug 24 12:37:59.221209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 413/820] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:59 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:59.448825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0d62ecc6-b77e-4da9-b100-e6c45b8859cc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:59.450891 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0d62ecc6-b77e-4da9-b100-e6c45b8859cc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:59.457662 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0d62ecc6-b77e-4da9-b100-e6c45b8859cc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:59.458141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0d62ecc6-b77e-4da9-b100-e6c45b8859cc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:59.458572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0d62ecc6-b77e-4da9-b100-e6c45b8859cc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:59.459277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0d62ecc6-b77e-4da9-b100-e6c45b8859cc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:59.459730 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0d62ecc6-b77e-4da9-b100-e6c45b8859cc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:59.460151 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0d62ecc6-b77e-4da9-b100-e6c45b8859cc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:59.488455 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0d62ecc6-b77e-4da9-b100-e6c45b8859cc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043685 Aug 24 12:37:59.488980 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 408/821] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:59 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:00.231734 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-06757c7d-bfde-4f6d-bc13-20be7c3d83f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:00.233873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-06757c7d-bfde-4f6d-bc13-20be7c3d83f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:00.240942 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-06757c7d-bfde-4f6d-bc13-20be7c3d83f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:00.241421 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-06757c7d-bfde-4f6d-bc13-20be7c3d83f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:00.241853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-06757c7d-bfde-4f6d-bc13-20be7c3d83f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:00.242536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-06757c7d-bfde-4f6d-bc13-20be7c3d83f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:00.243022 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-06757c7d-bfde-4f6d-bc13-20be7c3d83f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:00.243445 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-06757c7d-bfde-4f6d-bc13-20be7c3d83f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:00.271943 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-06757c7d-bfde-4f6d-bc13-20be7c3d83f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044200 Aug 24 12:38:00.274067 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 414/822] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:00 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:00.501517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7528882c-8069-406c-8a18-2b643405a146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:00.503578 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7528882c-8069-406c-8a18-2b643405a146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:00.509847 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7528882c-8069-406c-8a18-2b643405a146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:00.510324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7528882c-8069-406c-8a18-2b643405a146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:00.510782 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7528882c-8069-406c-8a18-2b643405a146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:00.511461 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7528882c-8069-406c-8a18-2b643405a146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:00.511909 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7528882c-8069-406c-8a18-2b643405a146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:00.512326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7528882c-8069-406c-8a18-2b643405a146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:00.540534 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7528882c-8069-406c-8a18-2b643405a146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043665 Aug 24 12:38:00.541072 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 409/823] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:00 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:01.283266 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c36b89bc-c025-4ac3-884f-9815290381bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:01.286456 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c36b89bc-c025-4ac3-884f-9815290381bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:01.292906 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c36b89bc-c025-4ac3-884f-9815290381bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:01.293391 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c36b89bc-c025-4ac3-884f-9815290381bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:01.293826 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c36b89bc-c025-4ac3-884f-9815290381bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:01.294507 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c36b89bc-c025-4ac3-884f-9815290381bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:01.294983 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c36b89bc-c025-4ac3-884f-9815290381bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:01.295406 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c36b89bc-c025-4ac3-884f-9815290381bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:01.328777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c36b89bc-c025-4ac3-884f-9815290381bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049434 Aug 24 12:38:01.330008 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 415/824] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:01 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:01.552534 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ee4bb288-9dcd-45d7-8520-4bf953ecc8d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:01.554582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ee4bb288-9dcd-45d7-8520-4bf953ecc8d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:01.560868 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee4bb288-9dcd-45d7-8520-4bf953ecc8d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:01.561339 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee4bb288-9dcd-45d7-8520-4bf953ecc8d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:01.561766 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee4bb288-9dcd-45d7-8520-4bf953ecc8d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:01.562436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee4bb288-9dcd-45d7-8520-4bf953ecc8d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:01.562919 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee4bb288-9dcd-45d7-8520-4bf953ecc8d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:01.563843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee4bb288-9dcd-45d7-8520-4bf953ecc8d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:01.592294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ee4bb288-9dcd-45d7-8520-4bf953ecc8d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043828 Aug 24 12:38:01.592835 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 410/825] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:01 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:02.341421 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3ed54521-f209-4816-bfa2-4c03587634c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:02.344220 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3ed54521-f209-4816-bfa2-4c03587634c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:02.351170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ed54521-f209-4816-bfa2-4c03587634c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:02.355604 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ed54521-f209-4816-bfa2-4c03587634c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:02.355604 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ed54521-f209-4816-bfa2-4c03587634c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:02.355604 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ed54521-f209-4816-bfa2-4c03587634c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:02.355604 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ed54521-f209-4816-bfa2-4c03587634c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:02.355931 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ed54521-f209-4816-bfa2-4c03587634c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:02.383560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3ed54521-f209-4816-bfa2-4c03587634c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046054 Aug 24 12:38:02.384117 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 416/826] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:02 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:02.604334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-664e36d2-52bb-4279-adb6-ca6eb5e929db tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:02.607554 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-664e36d2-52bb-4279-adb6-ca6eb5e929db tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:02.613321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-664e36d2-52bb-4279-adb6-ca6eb5e929db tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:02.613794 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-664e36d2-52bb-4279-adb6-ca6eb5e929db tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:02.614511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-664e36d2-52bb-4279-adb6-ca6eb5e929db tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:02.615261 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-664e36d2-52bb-4279-adb6-ca6eb5e929db tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:02.615750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-664e36d2-52bb-4279-adb6-ca6eb5e929db tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:02.616173 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-664e36d2-52bb-4279-adb6-ca6eb5e929db tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:02.645779 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-664e36d2-52bb-4279-adb6-ca6eb5e929db tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045475 Aug 24 12:38:02.646330 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 411/827] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:02 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:03.395795 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d8a42b60-5bc0-44bd-8221-df80ef917a44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:03.397928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d8a42b60-5bc0-44bd-8221-df80ef917a44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:03.404190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8a42b60-5bc0-44bd-8221-df80ef917a44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:03.404661 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8a42b60-5bc0-44bd-8221-df80ef917a44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:03.405088 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8a42b60-5bc0-44bd-8221-df80ef917a44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:03.405758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8a42b60-5bc0-44bd-8221-df80ef917a44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:03.406203 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8a42b60-5bc0-44bd-8221-df80ef917a44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:03.406619 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8a42b60-5bc0-44bd-8221-df80ef917a44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:03.435758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d8a42b60-5bc0-44bd-8221-df80ef917a44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044314 Aug 24 12:38:03.436257 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 417/828] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:03 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:03.658144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6a7d1b8d-50b0-4084-9f5c-a5d037733631 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:03.660276 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6a7d1b8d-50b0-4084-9f5c-a5d037733631 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:03.666524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a7d1b8d-50b0-4084-9f5c-a5d037733631 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:03.667042 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a7d1b8d-50b0-4084-9f5c-a5d037733631 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:03.667475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a7d1b8d-50b0-4084-9f5c-a5d037733631 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:03.668154 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a7d1b8d-50b0-4084-9f5c-a5d037733631 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:03.668603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a7d1b8d-50b0-4084-9f5c-a5d037733631 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:03.669022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a7d1b8d-50b0-4084-9f5c-a5d037733631 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:03.697265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6a7d1b8d-50b0-4084-9f5c-a5d037733631 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043146 Aug 24 12:38:03.697739 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 412/829] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:03 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:38:04.447476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a70918b3-e7d5-4ab3-ba3c-bb31eae747c0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:04.449577 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a70918b3-e7d5-4ab3-ba3c-bb31eae747c0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:04.455825 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a70918b3-e7d5-4ab3-ba3c-bb31eae747c0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:04.456294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a70918b3-e7d5-4ab3-ba3c-bb31eae747c0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:04.456719 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a70918b3-e7d5-4ab3-ba3c-bb31eae747c0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:04.457393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a70918b3-e7d5-4ab3-ba3c-bb31eae747c0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:04.457833 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a70918b3-e7d5-4ab3-ba3c-bb31eae747c0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:04.458248 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a70918b3-e7d5-4ab3-ba3c-bb31eae747c0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:04.486765 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a70918b3-e7d5-4ab3-ba3c-bb31eae747c0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042573 Aug 24 12:38:04.487301 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 418/830] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:04 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:38:04.710049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e8d88a30-20f0-4153-9d10-44d58b5da58f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:04.712112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e8d88a30-20f0-4153-9d10-44d58b5da58f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:04.718567 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8d88a30-20f0-4153-9d10-44d58b5da58f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:04.719083 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8d88a30-20f0-4153-9d10-44d58b5da58f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:04.719515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8d88a30-20f0-4153-9d10-44d58b5da58f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:04.720372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8d88a30-20f0-4153-9d10-44d58b5da58f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:04.721407 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8d88a30-20f0-4153-9d10-44d58b5da58f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:04.721833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8d88a30-20f0-4153-9d10-44d58b5da58f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:04.750854 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e8d88a30-20f0-4153-9d10-44d58b5da58f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044851 Aug 24 12:38:04.751391 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 413/831] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:04 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:05.498920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5de3c6d1-dc4d-4446-bb2f-cf8a8cc906c7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:05.501071 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5de3c6d1-dc4d-4446-bb2f-cf8a8cc906c7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:05.507976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5de3c6d1-dc4d-4446-bb2f-cf8a8cc906c7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:05.508454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5de3c6d1-dc4d-4446-bb2f-cf8a8cc906c7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:05.508884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5de3c6d1-dc4d-4446-bb2f-cf8a8cc906c7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:05.509562 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5de3c6d1-dc4d-4446-bb2f-cf8a8cc906c7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:05.510015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5de3c6d1-dc4d-4446-bb2f-cf8a8cc906c7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:05.510434 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5de3c6d1-dc4d-4446-bb2f-cf8a8cc906c7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:05.513938 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:05.537747 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5de3c6d1-dc4d-4446-bb2f-cf8a8cc906c7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042857 Aug 24 12:38:05.540821 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 419/832] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:05 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:05.763720 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5091a095-a441-4d26-972e-89b203a13fd2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:05.765866 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5091a095-a441-4d26-972e-89b203a13fd2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:05.772178 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5091a095-a441-4d26-972e-89b203a13fd2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:05.772654 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5091a095-a441-4d26-972e-89b203a13fd2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:05.773081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5091a095-a441-4d26-972e-89b203a13fd2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:05.773760 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5091a095-a441-4d26-972e-89b203a13fd2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:05.774208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5091a095-a441-4d26-972e-89b203a13fd2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:05.774627 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5091a095-a441-4d26-972e-89b203a13fd2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:05.803778 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5091a095-a441-4d26-972e-89b203a13fd2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043972 Aug 24 12:38:05.804332 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 414/833] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:05 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:06.551050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-59d204e2-7ec4-4c7b-9029-b9fc69ad1156 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:06.553219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-59d204e2-7ec4-4c7b-9029-b9fc69ad1156 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:06.559976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59d204e2-7ec4-4c7b-9029-b9fc69ad1156 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:06.560456 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59d204e2-7ec4-4c7b-9029-b9fc69ad1156 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:06.560895 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59d204e2-7ec4-4c7b-9029-b9fc69ad1156 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:06.561584 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59d204e2-7ec4-4c7b-9029-b9fc69ad1156 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:06.562036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59d204e2-7ec4-4c7b-9029-b9fc69ad1156 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:06.562463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59d204e2-7ec4-4c7b-9029-b9fc69ad1156 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:06.591282 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-59d204e2-7ec4-4c7b-9029-b9fc69ad1156 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044198 Aug 24 12:38:06.591828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 420/834] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:06 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:06.816259 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0e8281a8-0620-407f-b0f3-f9d35bffa9aa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:06.818298 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0e8281a8-0620-407f-b0f3-f9d35bffa9aa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:06.824389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0e8281a8-0620-407f-b0f3-f9d35bffa9aa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:06.824871 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0e8281a8-0620-407f-b0f3-f9d35bffa9aa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:06.825308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0e8281a8-0620-407f-b0f3-f9d35bffa9aa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:06.826002 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0e8281a8-0620-407f-b0f3-f9d35bffa9aa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:06.826457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0e8281a8-0620-407f-b0f3-f9d35bffa9aa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:06.826910 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0e8281a8-0620-407f-b0f3-f9d35bffa9aa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:06.856074 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0e8281a8-0620-407f-b0f3-f9d35bffa9aa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043946 Aug 24 12:38:06.856614 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 415/835] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:06 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:07.603679 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-45b333d3-7b58-46cd-a319-92c8c01d7b7c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:07.605812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-45b333d3-7b58-46cd-a319-92c8c01d7b7c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:07.612073 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-45b333d3-7b58-46cd-a319-92c8c01d7b7c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:07.613048 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-45b333d3-7b58-46cd-a319-92c8c01d7b7c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:07.613475 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-45b333d3-7b58-46cd-a319-92c8c01d7b7c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:07.614395 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-45b333d3-7b58-46cd-a319-92c8c01d7b7c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:07.614876 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-45b333d3-7b58-46cd-a319-92c8c01d7b7c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:07.615294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-45b333d3-7b58-46cd-a319-92c8c01d7b7c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:07.643325 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-45b333d3-7b58-46cd-a319-92c8c01d7b7c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043676 Aug 24 12:38:07.644034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 421/836] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:07 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:07.873531 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b4ee7009-1160-4ebe-b5e2-0eb6a5f88e8f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:07.875681 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b4ee7009-1160-4ebe-b5e2-0eb6a5f88e8f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:07.882926 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4ee7009-1160-4ebe-b5e2-0eb6a5f88e8f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:07.883415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4ee7009-1160-4ebe-b5e2-0eb6a5f88e8f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:07.883852 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4ee7009-1160-4ebe-b5e2-0eb6a5f88e8f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:07.884546 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4ee7009-1160-4ebe-b5e2-0eb6a5f88e8f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:07.885034 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4ee7009-1160-4ebe-b5e2-0eb6a5f88e8f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:07.885459 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4ee7009-1160-4ebe-b5e2-0eb6a5f88e8f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:07.915373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b4ee7009-1160-4ebe-b5e2-0eb6a5f88e8f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049889 Aug 24 12:38:07.916217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 416/837] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:07 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:08.655958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-074e741c-9b11-4701-a527-1ce088f8c434 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:08.658103 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-074e741c-9b11-4701-a527-1ce088f8c434 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:08.665018 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-074e741c-9b11-4701-a527-1ce088f8c434 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:08.665493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-074e741c-9b11-4701-a527-1ce088f8c434 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:08.665926 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-074e741c-9b11-4701-a527-1ce088f8c434 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:08.666606 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-074e741c-9b11-4701-a527-1ce088f8c434 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:08.667082 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-074e741c-9b11-4701-a527-1ce088f8c434 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:08.667504 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-074e741c-9b11-4701-a527-1ce088f8c434 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:08.695964 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-074e741c-9b11-4701-a527-1ce088f8c434 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043931 Aug 24 12:38:08.696449 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 422/838] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:08 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:08.928981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a82214ae-c7b3-40ca-84e0-6b22414fbed3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:08.931125 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a82214ae-c7b3-40ca-84e0-6b22414fbed3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:08.937387 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a82214ae-c7b3-40ca-84e0-6b22414fbed3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:08.937870 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a82214ae-c7b3-40ca-84e0-6b22414fbed3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:08.938306 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a82214ae-c7b3-40ca-84e0-6b22414fbed3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:08.939019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a82214ae-c7b3-40ca-84e0-6b22414fbed3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:08.939483 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a82214ae-c7b3-40ca-84e0-6b22414fbed3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:08.939908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a82214ae-c7b3-40ca-84e0-6b22414fbed3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:08.942191 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:08.969121 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a82214ae-c7b3-40ca-84e0-6b22414fbed3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044654 Aug 24 12:38:08.969592 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 417/839] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:08 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:09.866957 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8636a7a9-77ae-42e9-9e91-3906c75b29a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:09.869110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8636a7a9-77ae-42e9-9e91-3906c75b29a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:09.874901 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8636a7a9-77ae-42e9-9e91-3906c75b29a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:09.875383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8636a7a9-77ae-42e9-9e91-3906c75b29a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:09.875814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8636a7a9-77ae-42e9-9e91-3906c75b29a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:09.876493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8636a7a9-77ae-42e9-9e91-3906c75b29a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:09.876946 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8636a7a9-77ae-42e9-9e91-3906c75b29a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:09.877369 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8636a7a9-77ae-42e9-9e91-3906c75b29a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:09.905359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8636a7a9-77ae-42e9-9e91-3906c75b29a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202058 Aug 24 12:38:09.905895 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 423/840] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:09 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:09.981720 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4602d7a7-fd6c-462d-9dce-9d96e4c69008 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:09.983949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4602d7a7-fd6c-462d-9dce-9d96e4c69008 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:09.990624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4602d7a7-fd6c-462d-9dce-9d96e4c69008 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:09.991121 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4602d7a7-fd6c-462d-9dce-9d96e4c69008 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:09.991550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4602d7a7-fd6c-462d-9dce-9d96e4c69008 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:09.992226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4602d7a7-fd6c-462d-9dce-9d96e4c69008 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:09.992675 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4602d7a7-fd6c-462d-9dce-9d96e4c69008 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:09.993094 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4602d7a7-fd6c-462d-9dce-9d96e4c69008 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:10.021921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4602d7a7-fd6c-462d-9dce-9d96e4c69008 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044577 Aug 24 12:38:10.022456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 418/841] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:09 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:10.917840 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3922818b-b21c-4f17-a4ca-717acda70c7a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:10.920018 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3922818b-b21c-4f17-a4ca-717acda70c7a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:10.926947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3922818b-b21c-4f17-a4ca-717acda70c7a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:10.927438 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3922818b-b21c-4f17-a4ca-717acda70c7a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:10.927875 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3922818b-b21c-4f17-a4ca-717acda70c7a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:10.928557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3922818b-b21c-4f17-a4ca-717acda70c7a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:10.929011 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3922818b-b21c-4f17-a4ca-717acda70c7a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:10.929442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3922818b-b21c-4f17-a4ca-717acda70c7a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:10.957256 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3922818b-b21c-4f17-a4ca-717acda70c7a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043481 Aug 24 12:38:10.957801 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 424/842] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:10 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:11.033438 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-55c47b0b-aac6-471e-83bc-2c5943836a95 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:11.036137 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-55c47b0b-aac6-471e-83bc-2c5943836a95 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:11.042418 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55c47b0b-aac6-471e-83bc-2c5943836a95 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:11.042926 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55c47b0b-aac6-471e-83bc-2c5943836a95 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:11.043359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55c47b0b-aac6-471e-83bc-2c5943836a95 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:11.044032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55c47b0b-aac6-471e-83bc-2c5943836a95 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:11.044482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55c47b0b-aac6-471e-83bc-2c5943836a95 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:11.044902 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55c47b0b-aac6-471e-83bc-2c5943836a95 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:11.073750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-55c47b0b-aac6-471e-83bc-2c5943836a95 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044281 Aug 24 12:38:11.074523 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 419/843] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:11 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:11.969364 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-88549fee-6ab3-4335-991a-2f0bbc8c17cf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:11.971512 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-88549fee-6ab3-4335-991a-2f0bbc8c17cf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:11.978014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88549fee-6ab3-4335-991a-2f0bbc8c17cf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:11.978483 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88549fee-6ab3-4335-991a-2f0bbc8c17cf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:11.978959 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88549fee-6ab3-4335-991a-2f0bbc8c17cf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:11.979640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88549fee-6ab3-4335-991a-2f0bbc8c17cf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:11.980090 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88549fee-6ab3-4335-991a-2f0bbc8c17cf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:11.980513 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88549fee-6ab3-4335-991a-2f0bbc8c17cf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:12.010057 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-88549fee-6ab3-4335-991a-2f0bbc8c17cf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044582 Aug 24 12:38:12.010617 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 425/844] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:11 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:12.056332 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c3b189fe-cb9a-4141-bf00-36ff87fcca8d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:12.056814 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c3b189fe-cb9a-4141-bf00-36ff87fcca8d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:12.063047 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3b189fe-cb9a-4141-bf00-36ff87fcca8d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:12.063527 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3b189fe-cb9a-4141-bf00-36ff87fcca8d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:12.063958 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3b189fe-cb9a-4141-bf00-36ff87fcca8d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:12.064636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3b189fe-cb9a-4141-bf00-36ff87fcca8d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:12.065085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3b189fe-cb9a-4141-bf00-36ff87fcca8d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:12.065502 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3b189fe-cb9a-4141-bf00-36ff87fcca8d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:12.085544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fc7ded9d-3706-4635-aac7-161f10a13886 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:12.087684 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fc7ded9d-3706-4635-aac7-161f10a13886 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:12.093510 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc7ded9d-3706-4635-aac7-161f10a13886 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:12.094066 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc7ded9d-3706-4635-aac7-161f10a13886 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:12.094576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc7ded9d-3706-4635-aac7-161f10a13886 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:12.095380 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc7ded9d-3706-4635-aac7-161f10a13886 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:12.095818 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc7ded9d-3706-4635-aac7-161f10a13886 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:12.096246 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc7ded9d-3706-4635-aac7-161f10a13886 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:12.125792 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fc7ded9d-3706-4635-aac7-161f10a13886 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044272 Aug 24 12:38:12.126347 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 426/845] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:12 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:38:12.144607 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.objects.instance [None req-c3b189fe-cb9a-4141-bf00-36ff87fcca8d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lazy-loading 'services' on Instance uuid 50cb23a1-9864-46ef-ae19-411f522e9f10 {{(pid=121170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:38:12.376241 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c3b189fe-cb9a-4141-bf00-36ff87fcca8d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "DELETE /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments/ec20bae7-7644-4b28-bc2e-f28915eeb2cb" status: 202 len: 0 microversion: 2.1 time: 0.323168 Aug 24 12:38:12.377175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 420/846] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 24 12:38:12 2022] DELETE /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments/ec20bae7-7644-4b28-bc2e-f28915eeb2cb => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:38:12.392814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-43917d3d-e110-4ff6-993a-5f9af8612995 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:12.395236 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-43917d3d-e110-4ff6-993a-5f9af8612995 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:12.401002 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43917d3d-e110-4ff6-993a-5f9af8612995 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:12.401488 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43917d3d-e110-4ff6-993a-5f9af8612995 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:12.401925 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43917d3d-e110-4ff6-993a-5f9af8612995 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:12.402626 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43917d3d-e110-4ff6-993a-5f9af8612995 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:12.403488 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43917d3d-e110-4ff6-993a-5f9af8612995 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:12.403916 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43917d3d-e110-4ff6-993a-5f9af8612995 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:12.438588 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-43917d3d-e110-4ff6-993a-5f9af8612995 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049544 Aug 24 12:38:12.439168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 427/847] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:12 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:13.022548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-af23deac-dc8f-4bd4-9049-a328f17068a5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:13.024779 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-af23deac-dc8f-4bd4-9049-a328f17068a5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:13.030966 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af23deac-dc8f-4bd4-9049-a328f17068a5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:13.031457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af23deac-dc8f-4bd4-9049-a328f17068a5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:13.031892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af23deac-dc8f-4bd4-9049-a328f17068a5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:13.032588 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af23deac-dc8f-4bd4-9049-a328f17068a5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:13.033043 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af23deac-dc8f-4bd4-9049-a328f17068a5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:13.033471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af23deac-dc8f-4bd4-9049-a328f17068a5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:13.062156 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-af23deac-dc8f-4bd4-9049-a328f17068a5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044451 Aug 24 12:38:13.062794 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 421/848] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:13 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:13.138559 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bb001fb9-2d8d-4756-9c4d-00bb2ea3e218 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:13.140678 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-bb001fb9-2d8d-4756-9c4d-00bb2ea3e218 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:13.147491 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb001fb9-2d8d-4756-9c4d-00bb2ea3e218 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:13.147967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb001fb9-2d8d-4756-9c4d-00bb2ea3e218 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:13.148398 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb001fb9-2d8d-4756-9c4d-00bb2ea3e218 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:13.149075 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb001fb9-2d8d-4756-9c4d-00bb2ea3e218 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:13.149522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb001fb9-2d8d-4756-9c4d-00bb2ea3e218 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:13.149939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb001fb9-2d8d-4756-9c4d-00bb2ea3e218 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:13.178400 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bb001fb9-2d8d-4756-9c4d-00bb2ea3e218 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043749 Aug 24 12:38:13.178968 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 428/849] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:13 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:13.458861 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-cfec51bb-ad9c-4351-86f1-91ce7d1f476f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:13.460996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-cfec51bb-ad9c-4351-86f1-91ce7d1f476f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:13.466935 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cfec51bb-ad9c-4351-86f1-91ce7d1f476f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:13.467424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cfec51bb-ad9c-4351-86f1-91ce7d1f476f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:13.467866 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cfec51bb-ad9c-4351-86f1-91ce7d1f476f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:13.468554 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cfec51bb-ad9c-4351-86f1-91ce7d1f476f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:13.469010 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cfec51bb-ad9c-4351-86f1-91ce7d1f476f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:13.469436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cfec51bb-ad9c-4351-86f1-91ce7d1f476f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:13.497625 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-cfec51bb-ad9c-4351-86f1-91ce7d1f476f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043475 Aug 24 12:38:13.498168 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 422/850] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:13 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:14.073960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b6e8238e-6234-44b6-b8b7-b21e0a13f7a6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:14.076116 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b6e8238e-6234-44b6-b8b7-b21e0a13f7a6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:14.081894 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6e8238e-6234-44b6-b8b7-b21e0a13f7a6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:14.084676 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6e8238e-6234-44b6-b8b7-b21e0a13f7a6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:14.084676 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6e8238e-6234-44b6-b8b7-b21e0a13f7a6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:14.084676 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6e8238e-6234-44b6-b8b7-b21e0a13f7a6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:14.084676 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6e8238e-6234-44b6-b8b7-b21e0a13f7a6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:14.085065 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6e8238e-6234-44b6-b8b7-b21e0a13f7a6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:14.112737 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b6e8238e-6234-44b6-b8b7-b21e0a13f7a6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042709 Aug 24 12:38:14.113281 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 429/851] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:14 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:14.190520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a6b714fe-d26b-439e-89bb-0e972eeb0a14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:14.192638 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a6b714fe-d26b-439e-89bb-0e972eeb0a14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:14.198936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6b714fe-d26b-439e-89bb-0e972eeb0a14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:14.199417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6b714fe-d26b-439e-89bb-0e972eeb0a14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:14.199859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6b714fe-d26b-439e-89bb-0e972eeb0a14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:14.200543 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6b714fe-d26b-439e-89bb-0e972eeb0a14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:14.201007 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6b714fe-d26b-439e-89bb-0e972eeb0a14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:14.201450 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6b714fe-d26b-439e-89bb-0e972eeb0a14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:14.229974 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a6b714fe-d26b-439e-89bb-0e972eeb0a14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043404 Aug 24 12:38:14.230515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 423/852] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:14 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:14.509265 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-60ea5439-4b65-4135-ba43-912f36ac86f7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:14.511445 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-60ea5439-4b65-4135-ba43-912f36ac86f7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:14.517744 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-60ea5439-4b65-4135-ba43-912f36ac86f7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:14.518222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-60ea5439-4b65-4135-ba43-912f36ac86f7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:14.518674 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-60ea5439-4b65-4135-ba43-912f36ac86f7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:14.519366 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-60ea5439-4b65-4135-ba43-912f36ac86f7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:14.520328 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-60ea5439-4b65-4135-ba43-912f36ac86f7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:14.520752 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-60ea5439-4b65-4135-ba43-912f36ac86f7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:14.549113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-60ea5439-4b65-4135-ba43-912f36ac86f7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043690 Aug 24 12:38:14.549647 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 430/853] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:14 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:15.125711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ba22aa1e-a531-4c1a-9a57-647866dc108d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:15.127972 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ba22aa1e-a531-4c1a-9a57-647866dc108d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:15.134518 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba22aa1e-a531-4c1a-9a57-647866dc108d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:15.135057 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba22aa1e-a531-4c1a-9a57-647866dc108d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:15.135486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba22aa1e-a531-4c1a-9a57-647866dc108d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:15.136159 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba22aa1e-a531-4c1a-9a57-647866dc108d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:15.136614 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba22aa1e-a531-4c1a-9a57-647866dc108d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:15.137029 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba22aa1e-a531-4c1a-9a57-647866dc108d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:15.164720 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ba22aa1e-a531-4c1a-9a57-647866dc108d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042955 Aug 24 12:38:15.165260 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 424/854] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:15 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:15.242558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b1ee907c-6d68-4108-b7b9-d5a3405ff82f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:15.244687 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b1ee907c-6d68-4108-b7b9-d5a3405ff82f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:15.250596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b1ee907c-6d68-4108-b7b9-d5a3405ff82f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:15.251099 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b1ee907c-6d68-4108-b7b9-d5a3405ff82f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:15.251531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b1ee907c-6d68-4108-b7b9-d5a3405ff82f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:15.252209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b1ee907c-6d68-4108-b7b9-d5a3405ff82f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:15.252655 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b1ee907c-6d68-4108-b7b9-d5a3405ff82f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:15.253078 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b1ee907c-6d68-4108-b7b9-d5a3405ff82f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:15.281520 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b1ee907c-6d68-4108-b7b9-d5a3405ff82f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043670 Aug 24 12:38:15.282056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 431/855] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:15 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:15.561246 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-83430dba-e638-4c47-a64e-7784fc7e8659 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:15.563380 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-83430dba-e638-4c47-a64e-7784fc7e8659 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:15.569736 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83430dba-e638-4c47-a64e-7784fc7e8659 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:15.570208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83430dba-e638-4c47-a64e-7784fc7e8659 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:15.570676 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83430dba-e638-4c47-a64e-7784fc7e8659 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:15.571360 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83430dba-e638-4c47-a64e-7784fc7e8659 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:15.571819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83430dba-e638-4c47-a64e-7784fc7e8659 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:15.572246 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83430dba-e638-4c47-a64e-7784fc7e8659 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:15.600723 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-83430dba-e638-4c47-a64e-7784fc7e8659 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043516 Aug 24 12:38:15.601269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 425/856] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:15 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:16.176788 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fd00f0c9-49bd-481c-bc70-81d4d040ce50 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:16.178928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fd00f0c9-49bd-481c-bc70-81d4d040ce50 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:16.184883 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd00f0c9-49bd-481c-bc70-81d4d040ce50 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:16.185355 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd00f0c9-49bd-481c-bc70-81d4d040ce50 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:16.185782 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd00f0c9-49bd-481c-bc70-81d4d040ce50 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:16.186454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd00f0c9-49bd-481c-bc70-81d4d040ce50 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:16.186935 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd00f0c9-49bd-481c-bc70-81d4d040ce50 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:16.187356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd00f0c9-49bd-481c-bc70-81d4d040ce50 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:16.215722 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fd00f0c9-49bd-481c-bc70-81d4d040ce50 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042872 Aug 24 12:38:16.216253 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 432/857] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:16 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:16.293402 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-461af200-0feb-4661-9881-2a996fb5e6e6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:16.295554 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-461af200-0feb-4661-9881-2a996fb5e6e6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:16.302095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-461af200-0feb-4661-9881-2a996fb5e6e6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:16.302576 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-461af200-0feb-4661-9881-2a996fb5e6e6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:16.303039 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-461af200-0feb-4661-9881-2a996fb5e6e6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:16.303728 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-461af200-0feb-4661-9881-2a996fb5e6e6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:16.304187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-461af200-0feb-4661-9881-2a996fb5e6e6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:16.304617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-461af200-0feb-4661-9881-2a996fb5e6e6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:16.332736 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-461af200-0feb-4661-9881-2a996fb5e6e6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043295 Aug 24 12:38:16.333275 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 426/858] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:16 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:16.612801 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-08e3c77f-d788-4c4e-9990-fdb7b9010936 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:16.615209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-08e3c77f-d788-4c4e-9990-fdb7b9010936 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:16.621298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-08e3c77f-d788-4c4e-9990-fdb7b9010936 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:16.621899 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-08e3c77f-d788-4c4e-9990-fdb7b9010936 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:16.622403 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-08e3c77f-d788-4c4e-9990-fdb7b9010936 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:16.623126 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-08e3c77f-d788-4c4e-9990-fdb7b9010936 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:16.623577 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-08e3c77f-d788-4c4e-9990-fdb7b9010936 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:16.623997 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-08e3c77f-d788-4c4e-9990-fdb7b9010936 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:16.653650 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-08e3c77f-d788-4c4e-9990-fdb7b9010936 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044865 Aug 24 12:38:16.654205 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 433/859] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:16 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:17.227119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1498e56b-e723-4bd4-ba77-61d88e5ab2aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:17.229235 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1498e56b-e723-4bd4-ba77-61d88e5ab2aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:17.235554 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1498e56b-e723-4bd4-ba77-61d88e5ab2aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:17.236032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1498e56b-e723-4bd4-ba77-61d88e5ab2aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:17.236460 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1498e56b-e723-4bd4-ba77-61d88e5ab2aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:17.237136 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1498e56b-e723-4bd4-ba77-61d88e5ab2aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:17.237585 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1498e56b-e723-4bd4-ba77-61d88e5ab2aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:17.238004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1498e56b-e723-4bd4-ba77-61d88e5ab2aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:17.268141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1498e56b-e723-4bd4-ba77-61d88e5ab2aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044972 Aug 24 12:38:17.268682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 427/860] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:17 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:17.344953 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fa127489-4b38-47a0-ab7a-ee3d8ce58c12 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:17.347115 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fa127489-4b38-47a0-ab7a-ee3d8ce58c12 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:17.353468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa127489-4b38-47a0-ab7a-ee3d8ce58c12 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:17.353956 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa127489-4b38-47a0-ab7a-ee3d8ce58c12 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:17.354394 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa127489-4b38-47a0-ab7a-ee3d8ce58c12 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:17.355132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa127489-4b38-47a0-ab7a-ee3d8ce58c12 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:17.355585 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa127489-4b38-47a0-ab7a-ee3d8ce58c12 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:17.356012 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa127489-4b38-47a0-ab7a-ee3d8ce58c12 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:17.386226 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fa127489-4b38-47a0-ab7a-ee3d8ce58c12 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045265 Aug 24 12:38:17.386802 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 434/861] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:17 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:17.670994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d208dc15-a9d3-4bdc-b17c-96ab6405398c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:17.673117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d208dc15-a9d3-4bdc-b17c-96ab6405398c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:17.679764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d208dc15-a9d3-4bdc-b17c-96ab6405398c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:17.680249 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d208dc15-a9d3-4bdc-b17c-96ab6405398c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:17.680686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d208dc15-a9d3-4bdc-b17c-96ab6405398c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:17.681373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d208dc15-a9d3-4bdc-b17c-96ab6405398c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:17.681827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d208dc15-a9d3-4bdc-b17c-96ab6405398c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:17.682252 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d208dc15-a9d3-4bdc-b17c-96ab6405398c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:17.710417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d208dc15-a9d3-4bdc-b17c-96ab6405398c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044823 Aug 24 12:38:17.710989 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 428/862] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:17 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:18.281060 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-603562bc-caf4-4be4-917f-ee425b3194fd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:18.283182 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-603562bc-caf4-4be4-917f-ee425b3194fd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:18.289534 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-603562bc-caf4-4be4-917f-ee425b3194fd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:18.290004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-603562bc-caf4-4be4-917f-ee425b3194fd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:18.290430 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-603562bc-caf4-4be4-917f-ee425b3194fd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:18.291137 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-603562bc-caf4-4be4-917f-ee425b3194fd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:18.291579 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-603562bc-caf4-4be4-917f-ee425b3194fd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:18.291992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-603562bc-caf4-4be4-917f-ee425b3194fd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:18.315213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:18.319749 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-603562bc-caf4-4be4-917f-ee425b3194fd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042676 Aug 24 12:38:18.320304 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 435/863] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:18 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:18.398950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d040ec4f-33c2-4dcc-a29c-552dbcbd9c14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:18.401062 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d040ec4f-33c2-4dcc-a29c-552dbcbd9c14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:18.407437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d040ec4f-33c2-4dcc-a29c-552dbcbd9c14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:18.407918 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d040ec4f-33c2-4dcc-a29c-552dbcbd9c14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:18.408356 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d040ec4f-33c2-4dcc-a29c-552dbcbd9c14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:18.409041 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d040ec4f-33c2-4dcc-a29c-552dbcbd9c14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:18.409490 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d040ec4f-33c2-4dcc-a29c-552dbcbd9c14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:18.409912 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d040ec4f-33c2-4dcc-a29c-552dbcbd9c14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:18.438860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d040ec4f-33c2-4dcc-a29c-552dbcbd9c14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044318 Aug 24 12:38:18.439405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 429/864] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:18 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:18.724131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-15d9b4bf-e53d-433c-bcf4-b896b1d1f410 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:18.726451 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-15d9b4bf-e53d-433c-bcf4-b896b1d1f410 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:18.732993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15d9b4bf-e53d-433c-bcf4-b896b1d1f410 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:18.733479 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15d9b4bf-e53d-433c-bcf4-b896b1d1f410 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:18.734212 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15d9b4bf-e53d-433c-bcf4-b896b1d1f410 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:18.734816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15d9b4bf-e53d-433c-bcf4-b896b1d1f410 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:18.735272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15d9b4bf-e53d-433c-bcf4-b896b1d1f410 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:18.735712 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15d9b4bf-e53d-433c-bcf4-b896b1d1f410 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:18.765430 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-15d9b4bf-e53d-433c-bcf4-b896b1d1f410 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046727 Aug 24 12:38:18.765972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 436/865] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:18 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:19.339569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-61e420ba-5b8a-406f-b1a7-d0f2665f085a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:19.341685 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-61e420ba-5b8a-406f-b1a7-d0f2665f085a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:19.347579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-61e420ba-5b8a-406f-b1a7-d0f2665f085a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:19.348061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-61e420ba-5b8a-406f-b1a7-d0f2665f085a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:19.348498 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-61e420ba-5b8a-406f-b1a7-d0f2665f085a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:19.349186 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-61e420ba-5b8a-406f-b1a7-d0f2665f085a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:19.349642 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-61e420ba-5b8a-406f-b1a7-d0f2665f085a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:19.350064 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-61e420ba-5b8a-406f-b1a7-d0f2665f085a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:19.378296 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-61e420ba-5b8a-406f-b1a7-d0f2665f085a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042850 Aug 24 12:38:19.379440 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 430/866] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:19 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:19.451393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-69ba6140-a53c-4573-b2b4-d75f11b5ca6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:19.453593 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-69ba6140-a53c-4573-b2b4-d75f11b5ca6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:19.460199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69ba6140-a53c-4573-b2b4-d75f11b5ca6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:19.460680 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69ba6140-a53c-4573-b2b4-d75f11b5ca6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:19.461112 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69ba6140-a53c-4573-b2b4-d75f11b5ca6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:19.461791 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69ba6140-a53c-4573-b2b4-d75f11b5ca6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:19.462267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69ba6140-a53c-4573-b2b4-d75f11b5ca6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:19.462714 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69ba6140-a53c-4573-b2b4-d75f11b5ca6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:19.491238 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-69ba6140-a53c-4573-b2b4-d75f11b5ca6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043980 Aug 24 12:38:19.491773 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 437/867] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:19 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:19.779093 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f59367c7-aeca-460f-a76f-f21b8c0d3956 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:19.781361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f59367c7-aeca-460f-a76f-f21b8c0d3956 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:19.787658 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f59367c7-aeca-460f-a76f-f21b8c0d3956 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:19.788195 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f59367c7-aeca-460f-a76f-f21b8c0d3956 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:19.788632 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f59367c7-aeca-460f-a76f-f21b8c0d3956 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:19.789351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f59367c7-aeca-460f-a76f-f21b8c0d3956 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:19.789808 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f59367c7-aeca-460f-a76f-f21b8c0d3956 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:19.790229 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f59367c7-aeca-460f-a76f-f21b8c0d3956 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:19.819830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f59367c7-aeca-460f-a76f-f21b8c0d3956 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044782 Aug 24 12:38:19.820370 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 431/868] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:19 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:20.391304 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-913c0cbf-ad41-4ba3-9499-3106031c5544 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:20.393426 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-913c0cbf-ad41-4ba3-9499-3106031c5544 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:20.400189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-913c0cbf-ad41-4ba3-9499-3106031c5544 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:20.400670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-913c0cbf-ad41-4ba3-9499-3106031c5544 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:20.401101 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-913c0cbf-ad41-4ba3-9499-3106031c5544 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:20.401777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-913c0cbf-ad41-4ba3-9499-3106031c5544 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:20.402224 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-913c0cbf-ad41-4ba3-9499-3106031c5544 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:20.402640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-913c0cbf-ad41-4ba3-9499-3106031c5544 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:20.431337 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-913c0cbf-ad41-4ba3-9499-3106031c5544 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044008 Aug 24 12:38:20.431886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 438/869] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:20 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:20.503448 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-75ba7a79-d48a-4a5e-9f0d-4289d4a07328 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:20.505548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-75ba7a79-d48a-4a5e-9f0d-4289d4a07328 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:20.511437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75ba7a79-d48a-4a5e-9f0d-4289d4a07328 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:20.511916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75ba7a79-d48a-4a5e-9f0d-4289d4a07328 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:20.512351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75ba7a79-d48a-4a5e-9f0d-4289d4a07328 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:20.513033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75ba7a79-d48a-4a5e-9f0d-4289d4a07328 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:20.513491 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75ba7a79-d48a-4a5e-9f0d-4289d4a07328 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:20.513916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75ba7a79-d48a-4a5e-9f0d-4289d4a07328 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:20.542708 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-75ba7a79-d48a-4a5e-9f0d-4289d4a07328 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043187 Aug 24 12:38:20.543248 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 432/870] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:20 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:38:20.831518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-71377da5-8cc6-4a86-b2d0-734009fd658c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:20.834498 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-71377da5-8cc6-4a86-b2d0-734009fd658c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:20.841642 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-71377da5-8cc6-4a86-b2d0-734009fd658c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:20.842130 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-71377da5-8cc6-4a86-b2d0-734009fd658c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:20.842570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-71377da5-8cc6-4a86-b2d0-734009fd658c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:20.843290 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-71377da5-8cc6-4a86-b2d0-734009fd658c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:20.843932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-71377da5-8cc6-4a86-b2d0-734009fd658c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:20.844316 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-71377da5-8cc6-4a86-b2d0-734009fd658c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:20.875572 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-71377da5-8cc6-4a86-b2d0-734009fd658c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047569 Aug 24 12:38:20.876598 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 439/871] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:20 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:21.443551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-453c58f7-40ea-444b-a79e-94dc6267d72a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:21.446686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-453c58f7-40ea-444b-a79e-94dc6267d72a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:21.453297 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-453c58f7-40ea-444b-a79e-94dc6267d72a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:21.453783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-453c58f7-40ea-444b-a79e-94dc6267d72a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:21.454221 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-453c58f7-40ea-444b-a79e-94dc6267d72a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:21.454942 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-453c58f7-40ea-444b-a79e-94dc6267d72a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:21.455404 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-453c58f7-40ea-444b-a79e-94dc6267d72a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:21.455830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-453c58f7-40ea-444b-a79e-94dc6267d72a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:21.459559 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:21.484078 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-453c58f7-40ea-444b-a79e-94dc6267d72a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044577 Aug 24 12:38:21.484631 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 433/872] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:21 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:21.555557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bf184f18-e474-451e-a37e-f6619752737e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:21.557672 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-bf184f18-e474-451e-a37e-f6619752737e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:21.564016 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf184f18-e474-451e-a37e-f6619752737e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:21.564499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf184f18-e474-451e-a37e-f6619752737e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:21.564935 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf184f18-e474-451e-a37e-f6619752737e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:21.565625 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf184f18-e474-451e-a37e-f6619752737e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:21.566075 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf184f18-e474-451e-a37e-f6619752737e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:21.566499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf184f18-e474-451e-a37e-f6619752737e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:21.596382 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bf184f18-e474-451e-a37e-f6619752737e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045420 Aug 24 12:38:21.596926 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 440/873] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:21 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:21.888958 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-935f3456-98d6-48cf-a285-c232fc6237c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:21.891492 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-935f3456-98d6-48cf-a285-c232fc6237c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:21.899606 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-935f3456-98d6-48cf-a285-c232fc6237c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:21.900095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-935f3456-98d6-48cf-a285-c232fc6237c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:21.900532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-935f3456-98d6-48cf-a285-c232fc6237c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:21.901220 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-935f3456-98d6-48cf-a285-c232fc6237c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:21.901724 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-935f3456-98d6-48cf-a285-c232fc6237c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:21.902086 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-935f3456-98d6-48cf-a285-c232fc6237c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:21.932075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-935f3456-98d6-48cf-a285-c232fc6237c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047158 Aug 24 12:38:21.932633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 434/874] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:21 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:22.501980 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7f31ed41-bad4-467a-83fa-0efc5f5f3a39 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:22.504627 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7f31ed41-bad4-467a-83fa-0efc5f5f3a39 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:22.510702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7f31ed41-bad4-467a-83fa-0efc5f5f3a39 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:22.511193 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7f31ed41-bad4-467a-83fa-0efc5f5f3a39 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:22.511633 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7f31ed41-bad4-467a-83fa-0efc5f5f3a39 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:22.512325 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7f31ed41-bad4-467a-83fa-0efc5f5f3a39 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:22.512769 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7f31ed41-bad4-467a-83fa-0efc5f5f3a39 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:22.513198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7f31ed41-bad4-467a-83fa-0efc5f5f3a39 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:22.541650 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7f31ed41-bad4-467a-83fa-0efc5f5f3a39 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043681 Aug 24 12:38:22.542198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 441/875] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:22 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:22.609210 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bfde1b0a-13e0-40c6-8075-628d7ba69078 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:22.611378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bfde1b0a-13e0-40c6-8075-628d7ba69078 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:22.618604 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bfde1b0a-13e0-40c6-8075-628d7ba69078 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:22.619121 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bfde1b0a-13e0-40c6-8075-628d7ba69078 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:22.619558 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bfde1b0a-13e0-40c6-8075-628d7ba69078 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:22.620249 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bfde1b0a-13e0-40c6-8075-628d7ba69078 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:22.620705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bfde1b0a-13e0-40c6-8075-628d7ba69078 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:22.621127 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bfde1b0a-13e0-40c6-8075-628d7ba69078 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:22.650322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bfde1b0a-13e0-40c6-8075-628d7ba69078 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045094 Aug 24 12:38:22.650903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 435/876] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:22 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:22.944464 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d2a712eb-37aa-4aa9-85bd-61c52955532c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:22.946712 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d2a712eb-37aa-4aa9-85bd-61c52955532c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:22.952837 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d2a712eb-37aa-4aa9-85bd-61c52955532c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:22.953327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d2a712eb-37aa-4aa9-85bd-61c52955532c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:22.953760 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d2a712eb-37aa-4aa9-85bd-61c52955532c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:22.954457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d2a712eb-37aa-4aa9-85bd-61c52955532c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:22.954975 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d2a712eb-37aa-4aa9-85bd-61c52955532c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:22.955408 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d2a712eb-37aa-4aa9-85bd-61c52955532c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:22.991543 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d2a712eb-37aa-4aa9-85bd-61c52955532c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050890 Aug 24 12:38:22.992094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 442/877] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:22 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:23.553557 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8e102e56-3ada-463c-aead-57f32398fa35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:23.555695 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8e102e56-3ada-463c-aead-57f32398fa35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:23.561544 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8e102e56-3ada-463c-aead-57f32398fa35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:23.562022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8e102e56-3ada-463c-aead-57f32398fa35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:23.562449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8e102e56-3ada-463c-aead-57f32398fa35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:23.563153 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8e102e56-3ada-463c-aead-57f32398fa35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:23.563600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8e102e56-3ada-463c-aead-57f32398fa35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:23.564017 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8e102e56-3ada-463c-aead-57f32398fa35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:23.592465 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8e102e56-3ada-463c-aead-57f32398fa35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042911 Aug 24 12:38:23.593006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 436/878] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:23 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:23.663198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-679e06d0-6329-4d70-afea-afb5576e670a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:23.665311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-679e06d0-6329-4d70-afea-afb5576e670a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:23.671241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-679e06d0-6329-4d70-afea-afb5576e670a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:23.671719 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-679e06d0-6329-4d70-afea-afb5576e670a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:23.672159 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-679e06d0-6329-4d70-afea-afb5576e670a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:23.672840 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-679e06d0-6329-4d70-afea-afb5576e670a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:23.673285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-679e06d0-6329-4d70-afea-afb5576e670a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:23.673703 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-679e06d0-6329-4d70-afea-afb5576e670a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:23.703354 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-679e06d0-6329-4d70-afea-afb5576e670a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044716 Aug 24 12:38:23.704747 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 443/879] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:23 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:24.004134 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-92714ae8-98de-40dc-9d58-51201321a86f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:24.006247 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-92714ae8-98de-40dc-9d58-51201321a86f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:24.012694 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92714ae8-98de-40dc-9d58-51201321a86f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:24.013261 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92714ae8-98de-40dc-9d58-51201321a86f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:24.013705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92714ae8-98de-40dc-9d58-51201321a86f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:24.014398 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92714ae8-98de-40dc-9d58-51201321a86f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:24.014887 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92714ae8-98de-40dc-9d58-51201321a86f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:24.015354 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92714ae8-98de-40dc-9d58-51201321a86f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:24.047381 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-92714ae8-98de-40dc-9d58-51201321a86f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047534 Aug 24 12:38:24.047927 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 437/880] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:23 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:24.603726 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f218d2f3-ce1a-4f3d-ae7d-856fb25f29ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:24.605860 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f218d2f3-ce1a-4f3d-ae7d-856fb25f29ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:24.612211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f218d2f3-ce1a-4f3d-ae7d-856fb25f29ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:24.612685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f218d2f3-ce1a-4f3d-ae7d-856fb25f29ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:24.613117 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f218d2f3-ce1a-4f3d-ae7d-856fb25f29ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:24.613784 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f218d2f3-ce1a-4f3d-ae7d-856fb25f29ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:24.614493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f218d2f3-ce1a-4f3d-ae7d-856fb25f29ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:24.614935 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f218d2f3-ce1a-4f3d-ae7d-856fb25f29ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:24.642793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f218d2f3-ce1a-4f3d-ae7d-856fb25f29ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043000 Aug 24 12:38:24.643327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 444/881] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:24 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:24.716203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1370cb67-4fd7-4591-b688-b802c13556c0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:24.718254 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1370cb67-4fd7-4591-b688-b802c13556c0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:24.724101 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1370cb67-4fd7-4591-b688-b802c13556c0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:24.724574 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1370cb67-4fd7-4591-b688-b802c13556c0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:24.725006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1370cb67-4fd7-4591-b688-b802c13556c0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:24.725683 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1370cb67-4fd7-4591-b688-b802c13556c0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:24.726133 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1370cb67-4fd7-4591-b688-b802c13556c0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:24.726550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1370cb67-4fd7-4591-b688-b802c13556c0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:24.755381 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1370cb67-4fd7-4591-b688-b802c13556c0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043148 Aug 24 12:38:24.755954 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 438/882] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:24 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:38:25.059820 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-adb1feba-d8b6-4ba2-a198-a5a5a3784a04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:25.062274 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-adb1feba-d8b6-4ba2-a198-a5a5a3784a04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:25.069067 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-adb1feba-d8b6-4ba2-a198-a5a5a3784a04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:25.069552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-adb1feba-d8b6-4ba2-a198-a5a5a3784a04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:25.069986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-adb1feba-d8b6-4ba2-a198-a5a5a3784a04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:25.070707 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-adb1feba-d8b6-4ba2-a198-a5a5a3784a04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:25.071164 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-adb1feba-d8b6-4ba2-a198-a5a5a3784a04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:25.071590 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-adb1feba-d8b6-4ba2-a198-a5a5a3784a04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:25.103559 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-adb1feba-d8b6-4ba2-a198-a5a5a3784a04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047558 Aug 24 12:38:25.104110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 445/883] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:25 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:25.654931 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-129fc335-dc91-4f13-b1ee-e921d901a267 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:25.657302 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-129fc335-dc91-4f13-b1ee-e921d901a267 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:25.663665 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-129fc335-dc91-4f13-b1ee-e921d901a267 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:25.664143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-129fc335-dc91-4f13-b1ee-e921d901a267 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:25.664574 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-129fc335-dc91-4f13-b1ee-e921d901a267 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:25.665249 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-129fc335-dc91-4f13-b1ee-e921d901a267 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:25.665698 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-129fc335-dc91-4f13-b1ee-e921d901a267 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:25.666120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-129fc335-dc91-4f13-b1ee-e921d901a267 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:25.695790 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-129fc335-dc91-4f13-b1ee-e921d901a267 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044797 Aug 24 12:38:25.696260 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 439/884] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:25 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:25.767219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-12c6d057-b751-46c6-86ee-59ecbaac9a8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:25.769405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-12c6d057-b751-46c6-86ee-59ecbaac9a8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:25.775695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12c6d057-b751-46c6-86ee-59ecbaac9a8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:25.776174 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12c6d057-b751-46c6-86ee-59ecbaac9a8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:25.776608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12c6d057-b751-46c6-86ee-59ecbaac9a8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:25.777318 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12c6d057-b751-46c6-86ee-59ecbaac9a8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:25.777769 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12c6d057-b751-46c6-86ee-59ecbaac9a8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:25.778189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12c6d057-b751-46c6-86ee-59ecbaac9a8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:25.807016 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-12c6d057-b751-46c6-86ee-59ecbaac9a8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043743 Aug 24 12:38:25.807564 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 446/885] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:25 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:26.115789 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-48f7c512-31e3-4465-9611-b4d6ce7ea788 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:26.120496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-48f7c512-31e3-4465-9611-b4d6ce7ea788 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:26.123925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-48f7c512-31e3-4465-9611-b4d6ce7ea788 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:26.124404 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-48f7c512-31e3-4465-9611-b4d6ce7ea788 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:26.124898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-48f7c512-31e3-4465-9611-b4d6ce7ea788 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:26.125579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-48f7c512-31e3-4465-9611-b4d6ce7ea788 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:26.125956 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-48f7c512-31e3-4465-9611-b4d6ce7ea788 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:26.126375 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-48f7c512-31e3-4465-9611-b4d6ce7ea788 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:26.155626 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-48f7c512-31e3-4465-9611-b4d6ce7ea788 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044964 Aug 24 12:38:26.156184 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 440/886] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:26 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:26.707924 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c77ea32d-8d8a-4468-b663-43847aea4134 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:26.709977 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c77ea32d-8d8a-4468-b663-43847aea4134 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:26.715838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c77ea32d-8d8a-4468-b663-43847aea4134 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:26.716310 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c77ea32d-8d8a-4468-b663-43847aea4134 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:26.716743 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c77ea32d-8d8a-4468-b663-43847aea4134 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:26.717418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c77ea32d-8d8a-4468-b663-43847aea4134 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:26.717865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c77ea32d-8d8a-4468-b663-43847aea4134 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:26.718285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c77ea32d-8d8a-4468-b663-43847aea4134 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:26.747316 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c77ea32d-8d8a-4468-b663-43847aea4134 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043406 Aug 24 12:38:26.747858 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 447/887] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:26 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:38:26.818707 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6bc62d02-6662-491b-a06c-d9165a442146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:26.820864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6bc62d02-6662-491b-a06c-d9165a442146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:26.823140 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=74 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:26.827705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6bc62d02-6662-491b-a06c-d9165a442146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:26.828180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6bc62d02-6662-491b-a06c-d9165a442146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:26.828608 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6bc62d02-6662-491b-a06c-d9165a442146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:26.829284 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6bc62d02-6662-491b-a06c-d9165a442146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:26.829737 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6bc62d02-6662-491b-a06c-d9165a442146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:26.830259 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6bc62d02-6662-491b-a06c-d9165a442146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:26.859502 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6bc62d02-6662-491b-a06c-d9165a442146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044865 Aug 24 12:38:26.860038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 441/888] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:26 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:27.168296 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d6250bff-0386-42ef-a395-c2bad45099da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:27.170413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d6250bff-0386-42ef-a395-c2bad45099da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:27.172664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=76 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:27.177231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d6250bff-0386-42ef-a395-c2bad45099da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:27.177712 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d6250bff-0386-42ef-a395-c2bad45099da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:27.178146 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d6250bff-0386-42ef-a395-c2bad45099da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:27.183943 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d6250bff-0386-42ef-a395-c2bad45099da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:27.183943 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d6250bff-0386-42ef-a395-c2bad45099da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:27.183943 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d6250bff-0386-42ef-a395-c2bad45099da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:27.210470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d6250bff-0386-42ef-a395-c2bad45099da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046156 Aug 24 12:38:27.211043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 448/889] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:27 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:27.759897 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bc640745-7311-49af-a46d-e5d51665a654 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:27.762278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bc640745-7311-49af-a46d-e5d51665a654 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:27.768183 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc640745-7311-49af-a46d-e5d51665a654 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:27.768660 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc640745-7311-49af-a46d-e5d51665a654 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:27.769108 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc640745-7311-49af-a46d-e5d51665a654 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:27.769789 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc640745-7311-49af-a46d-e5d51665a654 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:27.770774 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc640745-7311-49af-a46d-e5d51665a654 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:27.771198 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc640745-7311-49af-a46d-e5d51665a654 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:27.799837 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bc640745-7311-49af-a46d-e5d51665a654 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043885 Aug 24 12:38:27.800379 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 442/890] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:27 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:27.871690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b6fa4dee-0da5-4238-ab73-c2df8f33c253 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:27.873798 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b6fa4dee-0da5-4238-ab73-c2df8f33c253 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:27.879566 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6fa4dee-0da5-4238-ab73-c2df8f33c253 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:27.880039 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6fa4dee-0da5-4238-ab73-c2df8f33c253 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:27.880470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6fa4dee-0da5-4238-ab73-c2df8f33c253 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:27.881134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6fa4dee-0da5-4238-ab73-c2df8f33c253 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:27.881576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6fa4dee-0da5-4238-ab73-c2df8f33c253 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:27.881990 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6fa4dee-0da5-4238-ab73-c2df8f33c253 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:27.909977 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b6fa4dee-0da5-4238-ab73-c2df8f33c253 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042252 Aug 24 12:38:27.910504 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 449/891] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:27 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:28.221252 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0fd6c499-101b-43de-a9cc-9d04248c8f70 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:28.223545 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0fd6c499-101b-43de-a9cc-9d04248c8f70 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:28.229735 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fd6c499-101b-43de-a9cc-9d04248c8f70 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:28.230215 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fd6c499-101b-43de-a9cc-9d04248c8f70 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:28.230644 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fd6c499-101b-43de-a9cc-9d04248c8f70 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:28.231347 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fd6c499-101b-43de-a9cc-9d04248c8f70 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:28.231842 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fd6c499-101b-43de-a9cc-9d04248c8f70 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:28.232263 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fd6c499-101b-43de-a9cc-9d04248c8f70 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:28.261512 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0fd6c499-101b-43de-a9cc-9d04248c8f70 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044105 Aug 24 12:38:28.262060 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 443/892] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:28 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:28.812044 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a5941a3d-6f06-41ab-b257-aa383615a1b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:28.814195 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a5941a3d-6f06-41ab-b257-aa383615a1b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:28.820565 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5941a3d-6f06-41ab-b257-aa383615a1b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:28.821045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5941a3d-6f06-41ab-b257-aa383615a1b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:28.821483 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5941a3d-6f06-41ab-b257-aa383615a1b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:28.822195 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5941a3d-6f06-41ab-b257-aa383615a1b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:28.822659 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5941a3d-6f06-41ab-b257-aa383615a1b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:28.823095 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5941a3d-6f06-41ab-b257-aa383615a1b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:28.851930 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a5941a3d-6f06-41ab-b257-aa383615a1b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043871 Aug 24 12:38:28.852451 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 450/893] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:28 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:28.922677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-97792fec-8e44-4139-be6a-44788bb4a13d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:28.924792 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-97792fec-8e44-4139-be6a-44788bb4a13d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:28.931347 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97792fec-8e44-4139-be6a-44788bb4a13d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:28.931832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97792fec-8e44-4139-be6a-44788bb4a13d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:28.932268 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97792fec-8e44-4139-be6a-44788bb4a13d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:28.932960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97792fec-8e44-4139-be6a-44788bb4a13d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:28.933416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97792fec-8e44-4139-be6a-44788bb4a13d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:28.933841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97792fec-8e44-4139-be6a-44788bb4a13d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:28.961685 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-97792fec-8e44-4139-be6a-44788bb4a13d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042973 Aug 24 12:38:28.962223 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 444/894] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:28 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:29.274027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7208570a-01d2-469d-b93b-9001d791febc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:29.276192 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7208570a-01d2-469d-b93b-9001d791febc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:29.282016 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7208570a-01d2-469d-b93b-9001d791febc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:29.282501 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7208570a-01d2-469d-b93b-9001d791febc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:29.282956 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7208570a-01d2-469d-b93b-9001d791febc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:29.283645 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7208570a-01d2-469d-b93b-9001d791febc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:29.284236 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7208570a-01d2-469d-b93b-9001d791febc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:29.284511 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7208570a-01d2-469d-b93b-9001d791febc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:29.316162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7208570a-01d2-469d-b93b-9001d791febc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045261 Aug 24 12:38:29.316162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 451/895] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:29 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:29.864809 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2c54371c-342c-4bb6-83fd-03118b0874ff tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:29.867039 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2c54371c-342c-4bb6-83fd-03118b0874ff tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:29.873829 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c54371c-342c-4bb6-83fd-03118b0874ff tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:29.874316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c54371c-342c-4bb6-83fd-03118b0874ff tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:29.874784 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c54371c-342c-4bb6-83fd-03118b0874ff tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:29.875478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c54371c-342c-4bb6-83fd-03118b0874ff tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:29.875937 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c54371c-342c-4bb6-83fd-03118b0874ff tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:29.876367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c54371c-342c-4bb6-83fd-03118b0874ff tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:29.904703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2c54371c-342c-4bb6-83fd-03118b0874ff tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044554 Aug 24 12:38:29.905261 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 445/896] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:29 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:29.974572 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5adf9909-29e9-4a4e-9d4b-0397ac7c925b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:29.976731 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5adf9909-29e9-4a4e-9d4b-0397ac7c925b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:29.983301 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5adf9909-29e9-4a4e-9d4b-0397ac7c925b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:29.983721 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5adf9909-29e9-4a4e-9d4b-0397ac7c925b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:29.984152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5adf9909-29e9-4a4e-9d4b-0397ac7c925b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:29.984841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5adf9909-29e9-4a4e-9d4b-0397ac7c925b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:29.985294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5adf9909-29e9-4a4e-9d4b-0397ac7c925b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:29.985714 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5adf9909-29e9-4a4e-9d4b-0397ac7c925b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:30.002522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:30.015475 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5adf9909-29e9-4a4e-9d4b-0397ac7c925b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045380 Aug 24 12:38:30.017050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 452/897] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:29 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:30.327095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-018206c6-c7d7-4a23-9a9c-09c0de964c57 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:30.329361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-018206c6-c7d7-4a23-9a9c-09c0de964c57 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:30.335278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-018206c6-c7d7-4a23-9a9c-09c0de964c57 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:30.335793 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-018206c6-c7d7-4a23-9a9c-09c0de964c57 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:30.336236 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-018206c6-c7d7-4a23-9a9c-09c0de964c57 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:30.336951 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-018206c6-c7d7-4a23-9a9c-09c0de964c57 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:30.337438 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-018206c6-c7d7-4a23-9a9c-09c0de964c57 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:30.337860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-018206c6-c7d7-4a23-9a9c-09c0de964c57 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:30.375589 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-018206c6-c7d7-4a23-9a9c-09c0de964c57 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052503 Aug 24 12:38:30.376349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 446/898] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:30 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:30.917728 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d1f64774-5e81-419f-992d-ada73a378c8f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:30.919882 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d1f64774-5e81-419f-992d-ada73a378c8f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:30.926144 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d1f64774-5e81-419f-992d-ada73a378c8f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:30.926612 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d1f64774-5e81-419f-992d-ada73a378c8f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:30.927072 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d1f64774-5e81-419f-992d-ada73a378c8f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:30.927767 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d1f64774-5e81-419f-992d-ada73a378c8f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:30.928209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d1f64774-5e81-419f-992d-ada73a378c8f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:30.928623 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d1f64774-5e81-419f-992d-ada73a378c8f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:30.955757 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d1f64774-5e81-419f-992d-ada73a378c8f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042001 Aug 24 12:38:30.956287 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 453/899] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:30 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:31.027939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f43fbe19-cd6a-4463-8e38-f0e8f1abf031 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:31.030343 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f43fbe19-cd6a-4463-8e38-f0e8f1abf031 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:31.037088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f43fbe19-cd6a-4463-8e38-f0e8f1abf031 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:31.037572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f43fbe19-cd6a-4463-8e38-f0e8f1abf031 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:31.038001 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f43fbe19-cd6a-4463-8e38-f0e8f1abf031 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:31.038848 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f43fbe19-cd6a-4463-8e38-f0e8f1abf031 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:31.039320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f43fbe19-cd6a-4463-8e38-f0e8f1abf031 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:31.039738 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f43fbe19-cd6a-4463-8e38-f0e8f1abf031 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:31.070184 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f43fbe19-cd6a-4463-8e38-f0e8f1abf031 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046134 Aug 24 12:38:31.070943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 447/900] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:31 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:31.388351 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-12a85b45-abd9-44ff-b8c3-34f517f9d07f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:31.390504 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-12a85b45-abd9-44ff-b8c3-34f517f9d07f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:31.396938 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12a85b45-abd9-44ff-b8c3-34f517f9d07f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:31.397427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12a85b45-abd9-44ff-b8c3-34f517f9d07f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:31.397862 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12a85b45-abd9-44ff-b8c3-34f517f9d07f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:31.398555 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12a85b45-abd9-44ff-b8c3-34f517f9d07f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:31.399031 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12a85b45-abd9-44ff-b8c3-34f517f9d07f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:31.399458 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12a85b45-abd9-44ff-b8c3-34f517f9d07f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:31.434214 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-12a85b45-abd9-44ff-b8c3-34f517f9d07f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049670 Aug 24 12:38:31.434796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 454/901] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:31 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:31.968426 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-48d7a681-a499-4ed1-9fa9-d029ab425044 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:31.970553 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-48d7a681-a499-4ed1-9fa9-d029ab425044 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:31.976527 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-48d7a681-a499-4ed1-9fa9-d029ab425044 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:31.977008 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-48d7a681-a499-4ed1-9fa9-d029ab425044 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:31.977440 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-48d7a681-a499-4ed1-9fa9-d029ab425044 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:31.978124 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-48d7a681-a499-4ed1-9fa9-d029ab425044 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:31.978577 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-48d7a681-a499-4ed1-9fa9-d029ab425044 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:31.979029 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-48d7a681-a499-4ed1-9fa9-d029ab425044 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:32.007175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-48d7a681-a499-4ed1-9fa9-d029ab425044 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042620 Aug 24 12:38:32.007640 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 448/902] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:31 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:32.082343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-51c3c508-6b6c-4eb2-9a92-2ec6745ecad5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:32.085057 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-51c3c508-6b6c-4eb2-9a92-2ec6745ecad5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:32.090931 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51c3c508-6b6c-4eb2-9a92-2ec6745ecad5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:32.091415 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51c3c508-6b6c-4eb2-9a92-2ec6745ecad5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:32.091845 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51c3c508-6b6c-4eb2-9a92-2ec6745ecad5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:32.092524 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51c3c508-6b6c-4eb2-9a92-2ec6745ecad5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:32.092970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51c3c508-6b6c-4eb2-9a92-2ec6745ecad5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:32.093397 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51c3c508-6b6c-4eb2-9a92-2ec6745ecad5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:32.122735 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-51c3c508-6b6c-4eb2-9a92-2ec6745ecad5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043751 Aug 24 12:38:32.123711 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 455/903] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:32 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:32.449330 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-da28eedf-62c8-4fa7-8c99-c1693639a94c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:32.451472 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-da28eedf-62c8-4fa7-8c99-c1693639a94c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:32.459240 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da28eedf-62c8-4fa7-8c99-c1693639a94c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:32.459840 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da28eedf-62c8-4fa7-8c99-c1693639a94c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:32.460277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da28eedf-62c8-4fa7-8c99-c1693639a94c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:32.460965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da28eedf-62c8-4fa7-8c99-c1693639a94c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:32.461416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da28eedf-62c8-4fa7-8c99-c1693639a94c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:32.461831 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da28eedf-62c8-4fa7-8c99-c1693639a94c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:32.489660 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:32.494495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-da28eedf-62c8-4fa7-8c99-c1693639a94c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049306 Aug 24 12:38:32.495274 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 449/904] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:32 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:33.019276 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1011a68b-f52a-4d3d-ac4e-5c687dfc778e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:33.022007 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1011a68b-f52a-4d3d-ac4e-5c687dfc778e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:33.028395 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1011a68b-f52a-4d3d-ac4e-5c687dfc778e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:33.028867 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1011a68b-f52a-4d3d-ac4e-5c687dfc778e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:33.029293 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1011a68b-f52a-4d3d-ac4e-5c687dfc778e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:33.029993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1011a68b-f52a-4d3d-ac4e-5c687dfc778e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:33.030437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1011a68b-f52a-4d3d-ac4e-5c687dfc778e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:33.030885 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1011a68b-f52a-4d3d-ac4e-5c687dfc778e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:33.059422 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1011a68b-f52a-4d3d-ac4e-5c687dfc778e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044005 Aug 24 12:38:33.059968 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 456/905] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:33 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:33.135922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5de777d5-2432-4a9b-a5c8-c922c953892f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:33.138131 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5de777d5-2432-4a9b-a5c8-c922c953892f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:33.144175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5de777d5-2432-4a9b-a5c8-c922c953892f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:33.144657 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5de777d5-2432-4a9b-a5c8-c922c953892f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:33.145604 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5de777d5-2432-4a9b-a5c8-c922c953892f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:33.146284 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5de777d5-2432-4a9b-a5c8-c922c953892f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:33.146764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5de777d5-2432-4a9b-a5c8-c922c953892f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:33.147193 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5de777d5-2432-4a9b-a5c8-c922c953892f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:33.176126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5de777d5-2432-4a9b-a5c8-c922c953892f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044519 Aug 24 12:38:33.176662 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 450/906] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:33 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:33.507838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-288ffc94-399c-43b9-8f4a-ef3c173dc7f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:33.509308 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-288ffc94-399c-43b9-8f4a-ef3c173dc7f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:33.515339 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-288ffc94-399c-43b9-8f4a-ef3c173dc7f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:33.523952 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-288ffc94-399c-43b9-8f4a-ef3c173dc7f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:33.523952 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-288ffc94-399c-43b9-8f4a-ef3c173dc7f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:33.523952 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-288ffc94-399c-43b9-8f4a-ef3c173dc7f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:33.523952 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-288ffc94-399c-43b9-8f4a-ef3c173dc7f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:33.524385 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-288ffc94-399c-43b9-8f4a-ef3c173dc7f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:33.548061 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-288ffc94-399c-43b9-8f4a-ef3c173dc7f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045403 Aug 24 12:38:33.548779 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 457/907] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:33 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:34.072400 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9a024f6f-4a55-4402-bed6-c929fa899ace tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:34.074510 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9a024f6f-4a55-4402-bed6-c929fa899ace tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:34.080841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a024f6f-4a55-4402-bed6-c929fa899ace tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:34.081323 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a024f6f-4a55-4402-bed6-c929fa899ace tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:34.081757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a024f6f-4a55-4402-bed6-c929fa899ace tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:34.084315 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a024f6f-4a55-4402-bed6-c929fa899ace tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:34.084315 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a024f6f-4a55-4402-bed6-c929fa899ace tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:34.084315 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a024f6f-4a55-4402-bed6-c929fa899ace tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:34.112471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9a024f6f-4a55-4402-bed6-c929fa899ace tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044073 Aug 24 12:38:34.113024 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 451/908] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:34 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:34.188300 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-31fd81e0-86bd-423b-a2a0-61e8551ebb74 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:34.190395 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-31fd81e0-86bd-423b-a2a0-61e8551ebb74 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:34.197403 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-31fd81e0-86bd-423b-a2a0-61e8551ebb74 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:34.197878 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-31fd81e0-86bd-423b-a2a0-61e8551ebb74 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:34.198336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-31fd81e0-86bd-423b-a2a0-61e8551ebb74 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:34.199080 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-31fd81e0-86bd-423b-a2a0-61e8551ebb74 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:34.199529 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-31fd81e0-86bd-423b-a2a0-61e8551ebb74 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:34.199950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-31fd81e0-86bd-423b-a2a0-61e8551ebb74 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:34.229514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-31fd81e0-86bd-423b-a2a0-61e8551ebb74 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045152 Aug 24 12:38:34.230060 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 458/909] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:34 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:34.572614 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e84d699d-22e0-49aa-9b36-53429f932fb7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:34.574754 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e84d699d-22e0-49aa-9b36-53429f932fb7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:34.580754 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e84d699d-22e0-49aa-9b36-53429f932fb7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:34.581237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e84d699d-22e0-49aa-9b36-53429f932fb7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:34.581667 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e84d699d-22e0-49aa-9b36-53429f932fb7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:34.582354 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e84d699d-22e0-49aa-9b36-53429f932fb7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:34.582835 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e84d699d-22e0-49aa-9b36-53429f932fb7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:34.583256 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e84d699d-22e0-49aa-9b36-53429f932fb7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:34.611571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e84d699d-22e0-49aa-9b36-53429f932fb7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042786 Aug 24 12:38:34.612278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 452/910] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:34 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:35.125078 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e99ae95a-5f8d-4617-9e2f-bc4a426d42ff tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:35.127210 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e99ae95a-5f8d-4617-9e2f-bc4a426d42ff tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:35.133110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e99ae95a-5f8d-4617-9e2f-bc4a426d42ff tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:35.133705 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e99ae95a-5f8d-4617-9e2f-bc4a426d42ff tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:35.134138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e99ae95a-5f8d-4617-9e2f-bc4a426d42ff tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:35.134848 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e99ae95a-5f8d-4617-9e2f-bc4a426d42ff tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:35.135290 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e99ae95a-5f8d-4617-9e2f-bc4a426d42ff tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:35.135704 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e99ae95a-5f8d-4617-9e2f-bc4a426d42ff tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:35.164081 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e99ae95a-5f8d-4617-9e2f-bc4a426d42ff tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042916 Aug 24 12:38:35.164611 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 459/911] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:35 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:35.242352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7ddfe7cd-155f-43de-a758-35157cdbf8e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:35.244504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7ddfe7cd-155f-43de-a758-35157cdbf8e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:35.250981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7ddfe7cd-155f-43de-a758-35157cdbf8e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:35.251468 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7ddfe7cd-155f-43de-a758-35157cdbf8e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:35.251907 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7ddfe7cd-155f-43de-a758-35157cdbf8e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:35.252606 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7ddfe7cd-155f-43de-a758-35157cdbf8e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:35.253081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7ddfe7cd-155f-43de-a758-35157cdbf8e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:35.253505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7ddfe7cd-155f-43de-a758-35157cdbf8e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:35.282825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7ddfe7cd-155f-43de-a758-35157cdbf8e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045366 Aug 24 12:38:35.283377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 453/912] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:35 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:35.624786 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9539fed0-e3d5-453b-a553-0e733056a617 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:35.626956 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9539fed0-e3d5-453b-a553-0e733056a617 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:35.634699 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9539fed0-e3d5-453b-a553-0e733056a617 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:35.634699 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9539fed0-e3d5-453b-a553-0e733056a617 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:35.634699 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9539fed0-e3d5-453b-a553-0e733056a617 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:35.635506 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9539fed0-e3d5-453b-a553-0e733056a617 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:35.635957 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9539fed0-e3d5-453b-a553-0e733056a617 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:35.636379 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9539fed0-e3d5-453b-a553-0e733056a617 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:35.666156 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9539fed0-e3d5-453b-a553-0e733056a617 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045312 Aug 24 12:38:35.668663 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 460/913] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:35 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:38:36.176198 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-34a02dc1-208f-40bb-b34f-1cfa34342a98 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:36.178290 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-34a02dc1-208f-40bb-b34f-1cfa34342a98 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:36.184348 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-34a02dc1-208f-40bb-b34f-1cfa34342a98 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:36.184828 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-34a02dc1-208f-40bb-b34f-1cfa34342a98 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:36.185264 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-34a02dc1-208f-40bb-b34f-1cfa34342a98 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:36.185950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-34a02dc1-208f-40bb-b34f-1cfa34342a98 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:36.186405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-34a02dc1-208f-40bb-b34f-1cfa34342a98 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:36.186855 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-34a02dc1-208f-40bb-b34f-1cfa34342a98 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:36.215706 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-34a02dc1-208f-40bb-b34f-1cfa34342a98 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043426 Aug 24 12:38:36.216269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 454/914] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:36 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:36.295649 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4197ddf1-af8d-45a5-a496-eab9eda15147 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:36.297762 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4197ddf1-af8d-45a5-a496-eab9eda15147 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:36.303683 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4197ddf1-af8d-45a5-a496-eab9eda15147 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:36.304165 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4197ddf1-af8d-45a5-a496-eab9eda15147 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:36.304598 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4197ddf1-af8d-45a5-a496-eab9eda15147 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:36.305280 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4197ddf1-af8d-45a5-a496-eab9eda15147 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:36.305735 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4197ddf1-af8d-45a5-a496-eab9eda15147 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:36.306159 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4197ddf1-af8d-45a5-a496-eab9eda15147 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:36.334701 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4197ddf1-af8d-45a5-a496-eab9eda15147 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043052 Aug 24 12:38:36.335242 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 461/915] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:36 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:36.678192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f29777cb-79a1-4277-844e-2969f7d6a644 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:36.680247 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f29777cb-79a1-4277-844e-2969f7d6a644 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:36.686440 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f29777cb-79a1-4277-844e-2969f7d6a644 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:36.686746 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f29777cb-79a1-4277-844e-2969f7d6a644 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:36.687136 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f29777cb-79a1-4277-844e-2969f7d6a644 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:36.687827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f29777cb-79a1-4277-844e-2969f7d6a644 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:36.688283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f29777cb-79a1-4277-844e-2969f7d6a644 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:36.688706 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f29777cb-79a1-4277-844e-2969f7d6a644 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:36.718423 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f29777cb-79a1-4277-844e-2969f7d6a644 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044456 Aug 24 12:38:36.718998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 455/916] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:36 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:37.228544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-61de5b17-db63-43e1-bc1f-9de08e3e07e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:37.230710 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-61de5b17-db63-43e1-bc1f-9de08e3e07e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:37.237102 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61de5b17-db63-43e1-bc1f-9de08e3e07e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:37.237580 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61de5b17-db63-43e1-bc1f-9de08e3e07e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:37.238011 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61de5b17-db63-43e1-bc1f-9de08e3e07e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:37.238735 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61de5b17-db63-43e1-bc1f-9de08e3e07e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:37.239756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61de5b17-db63-43e1-bc1f-9de08e3e07e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:37.240182 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61de5b17-db63-43e1-bc1f-9de08e3e07e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:37.268028 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-61de5b17-db63-43e1-bc1f-9de08e3e07e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043552 Aug 24 12:38:37.268565 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 462/917] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:37 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:37.346859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5acd3361-15c1-4d31-9286-281dca277cc3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:37.349448 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5acd3361-15c1-4d31-9286-281dca277cc3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:37.355294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5acd3361-15c1-4d31-9286-281dca277cc3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:37.355768 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5acd3361-15c1-4d31-9286-281dca277cc3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:37.356200 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5acd3361-15c1-4d31-9286-281dca277cc3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:37.356878 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5acd3361-15c1-4d31-9286-281dca277cc3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:37.357399 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5acd3361-15c1-4d31-9286-281dca277cc3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:37.357817 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5acd3361-15c1-4d31-9286-281dca277cc3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:37.386091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5acd3361-15c1-4d31-9286-281dca277cc3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043208 Aug 24 12:38:37.386634 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 456/918] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:37 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:38:37.730640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7d69a788-713c-48e8-8ecf-0db79b2b44b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:37.732764 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7d69a788-713c-48e8-8ecf-0db79b2b44b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:37.738594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7d69a788-713c-48e8-8ecf-0db79b2b44b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:37.739067 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7d69a788-713c-48e8-8ecf-0db79b2b44b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:37.739768 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7d69a788-713c-48e8-8ecf-0db79b2b44b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:37.740454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7d69a788-713c-48e8-8ecf-0db79b2b44b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:37.740898 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7d69a788-713c-48e8-8ecf-0db79b2b44b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:37.741318 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7d69a788-713c-48e8-8ecf-0db79b2b44b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:37.769834 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7d69a788-713c-48e8-8ecf-0db79b2b44b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043161 Aug 24 12:38:37.770918 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 463/919] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:37 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:38.280259 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c43e4709-1258-4f27-94d7-fd6d285c6304 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:38.282385 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c43e4709-1258-4f27-94d7-fd6d285c6304 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:38.288760 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c43e4709-1258-4f27-94d7-fd6d285c6304 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:38.289235 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c43e4709-1258-4f27-94d7-fd6d285c6304 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:38.289664 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c43e4709-1258-4f27-94d7-fd6d285c6304 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:38.290372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c43e4709-1258-4f27-94d7-fd6d285c6304 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:38.290855 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c43e4709-1258-4f27-94d7-fd6d285c6304 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:38.291278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c43e4709-1258-4f27-94d7-fd6d285c6304 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:38.319825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c43e4709-1258-4f27-94d7-fd6d285c6304 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043524 Aug 24 12:38:38.320367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 457/920] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:38 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:38.398139 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c43f631d-35fc-488f-9b2c-faf0b87c98d2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:38.400281 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c43f631d-35fc-488f-9b2c-faf0b87c98d2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:38.406635 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c43f631d-35fc-488f-9b2c-faf0b87c98d2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:38.407139 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c43f631d-35fc-488f-9b2c-faf0b87c98d2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:38.407565 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c43f631d-35fc-488f-9b2c-faf0b87c98d2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:38.408245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c43f631d-35fc-488f-9b2c-faf0b87c98d2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:38.408689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c43f631d-35fc-488f-9b2c-faf0b87c98d2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:38.409108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c43f631d-35fc-488f-9b2c-faf0b87c98d2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:38.438263 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c43f631d-35fc-488f-9b2c-faf0b87c98d2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043992 Aug 24 12:38:38.438853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 464/921] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:38 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:38.782034 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3c67f0dc-71f4-4891-a106-249acedc6b8a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:38.784189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3c67f0dc-71f4-4891-a106-249acedc6b8a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:38.790765 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c67f0dc-71f4-4891-a106-249acedc6b8a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:38.791252 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c67f0dc-71f4-4891-a106-249acedc6b8a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:38.791692 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c67f0dc-71f4-4891-a106-249acedc6b8a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:38.792381 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c67f0dc-71f4-4891-a106-249acedc6b8a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:38.792836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c67f0dc-71f4-4891-a106-249acedc6b8a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:38.793260 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c67f0dc-71f4-4891-a106-249acedc6b8a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:38.824101 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3c67f0dc-71f4-4891-a106-249acedc6b8a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046015 Aug 24 12:38:38.824654 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 458/922] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:38 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:39.331736 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-43fab00d-c51d-4215-a59e-f7164b0c94d0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:39.334470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-43fab00d-c51d-4215-a59e-f7164b0c94d0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:39.340464 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43fab00d-c51d-4215-a59e-f7164b0c94d0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:39.340948 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43fab00d-c51d-4215-a59e-f7164b0c94d0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:39.341381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43fab00d-c51d-4215-a59e-f7164b0c94d0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:39.342062 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43fab00d-c51d-4215-a59e-f7164b0c94d0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:39.342509 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43fab00d-c51d-4215-a59e-f7164b0c94d0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:39.342958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43fab00d-c51d-4215-a59e-f7164b0c94d0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:39.372001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-43fab00d-c51d-4215-a59e-f7164b0c94d0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044280 Aug 24 12:38:39.372544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 465/923] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:39 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:39.450798 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f1d537ae-3f0b-4bf7-80eb-fa1808938cd3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:39.452942 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f1d537ae-3f0b-4bf7-80eb-fa1808938cd3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:39.460006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1d537ae-3f0b-4bf7-80eb-fa1808938cd3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:39.461757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1d537ae-3f0b-4bf7-80eb-fa1808938cd3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:39.461757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1d537ae-3f0b-4bf7-80eb-fa1808938cd3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:39.461757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1d537ae-3f0b-4bf7-80eb-fa1808938cd3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:39.462179 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1d537ae-3f0b-4bf7-80eb-fa1808938cd3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:39.462419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1d537ae-3f0b-4bf7-80eb-fa1808938cd3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:39.490667 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f1d537ae-3f0b-4bf7-80eb-fa1808938cd3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043882 Aug 24 12:38:39.491224 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 459/924] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:39 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:39.836725 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d54e32bb-1163-4855-a56a-8d306ca4523a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:39.838943 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d54e32bb-1163-4855-a56a-8d306ca4523a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:39.845157 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d54e32bb-1163-4855-a56a-8d306ca4523a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:39.845628 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d54e32bb-1163-4855-a56a-8d306ca4523a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:39.846056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d54e32bb-1163-4855-a56a-8d306ca4523a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:39.846759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d54e32bb-1163-4855-a56a-8d306ca4523a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:39.847203 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d54e32bb-1163-4855-a56a-8d306ca4523a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:39.847618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d54e32bb-1163-4855-a56a-8d306ca4523a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:39.877041 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d54e32bb-1163-4855-a56a-8d306ca4523a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044697 Aug 24 12:38:39.877589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 466/925] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:39 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:40.384209 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0bffbef7-e94f-4135-b478-ff55bed86b06 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:40.386334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0bffbef7-e94f-4135-b478-ff55bed86b06 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:40.392258 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bffbef7-e94f-4135-b478-ff55bed86b06 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:40.392738 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bffbef7-e94f-4135-b478-ff55bed86b06 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:40.393174 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bffbef7-e94f-4135-b478-ff55bed86b06 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:40.393863 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bffbef7-e94f-4135-b478-ff55bed86b06 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:40.394321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bffbef7-e94f-4135-b478-ff55bed86b06 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:40.394807 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bffbef7-e94f-4135-b478-ff55bed86b06 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:40.423463 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0bffbef7-e94f-4135-b478-ff55bed86b06 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043204 Aug 24 12:38:40.424020 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 460/926] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:40 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:40.502823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ed8906cb-8b44-4575-bd27-c78e1aed337d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:40.504914 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ed8906cb-8b44-4575-bd27-c78e1aed337d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:40.510737 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ed8906cb-8b44-4575-bd27-c78e1aed337d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:40.511212 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ed8906cb-8b44-4575-bd27-c78e1aed337d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:40.511640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ed8906cb-8b44-4575-bd27-c78e1aed337d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:40.512317 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ed8906cb-8b44-4575-bd27-c78e1aed337d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:40.512759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ed8906cb-8b44-4575-bd27-c78e1aed337d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:40.513174 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ed8906cb-8b44-4575-bd27-c78e1aed337d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:40.541982 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ed8906cb-8b44-4575-bd27-c78e1aed337d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043157 Aug 24 12:38:40.542507 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 467/927] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:40 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:40.889064 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-253762aa-6a3f-43a7-a42d-f3062650ce99 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:40.891231 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-253762aa-6a3f-43a7-a42d-f3062650ce99 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:40.898152 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-253762aa-6a3f-43a7-a42d-f3062650ce99 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:40.898636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-253762aa-6a3f-43a7-a42d-f3062650ce99 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:40.899098 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-253762aa-6a3f-43a7-a42d-f3062650ce99 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:40.899784 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-253762aa-6a3f-43a7-a42d-f3062650ce99 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:40.900242 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-253762aa-6a3f-43a7-a42d-f3062650ce99 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:40.900666 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-253762aa-6a3f-43a7-a42d-f3062650ce99 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:40.929346 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-253762aa-6a3f-43a7-a42d-f3062650ce99 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044190 Aug 24 12:38:40.929900 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 461/928] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:40 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:41.436662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d10ccd76-1b9b-4db2-9be5-50427882755f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:41.438826 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d10ccd76-1b9b-4db2-9be5-50427882755f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:41.445743 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d10ccd76-1b9b-4db2-9be5-50427882755f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:41.446220 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d10ccd76-1b9b-4db2-9be5-50427882755f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:41.446675 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d10ccd76-1b9b-4db2-9be5-50427882755f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:41.447344 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d10ccd76-1b9b-4db2-9be5-50427882755f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:41.447787 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d10ccd76-1b9b-4db2-9be5-50427882755f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:41.448203 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d10ccd76-1b9b-4db2-9be5-50427882755f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:41.476487 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d10ccd76-1b9b-4db2-9be5-50427882755f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044141 Aug 24 12:38:41.477043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 468/929] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:41 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:41.555749 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e2e0dcb3-607a-4750-8180-95b976eb4d31 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:41.557854 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e2e0dcb3-607a-4750-8180-95b976eb4d31 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:41.563739 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2e0dcb3-607a-4750-8180-95b976eb4d31 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:41.564217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2e0dcb3-607a-4750-8180-95b976eb4d31 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:41.564651 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2e0dcb3-607a-4750-8180-95b976eb4d31 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:41.565341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2e0dcb3-607a-4750-8180-95b976eb4d31 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:41.565789 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2e0dcb3-607a-4750-8180-95b976eb4d31 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:41.566214 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2e0dcb3-607a-4750-8180-95b976eb4d31 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:41.595651 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e2e0dcb3-607a-4750-8180-95b976eb4d31 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044414 Aug 24 12:38:41.596196 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 462/930] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:41 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:41.941808 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0a2168f1-ac71-4890-979b-2cfcb06ab30f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:41.943997 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0a2168f1-ac71-4890-979b-2cfcb06ab30f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:41.950067 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a2168f1-ac71-4890-979b-2cfcb06ab30f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:41.950537 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a2168f1-ac71-4890-979b-2cfcb06ab30f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:41.950993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a2168f1-ac71-4890-979b-2cfcb06ab30f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:41.951670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a2168f1-ac71-4890-979b-2cfcb06ab30f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:41.952116 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a2168f1-ac71-4890-979b-2cfcb06ab30f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:41.952531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a2168f1-ac71-4890-979b-2cfcb06ab30f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:41.956200 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:41.983008 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0a2168f1-ac71-4890-979b-2cfcb06ab30f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045369 Aug 24 12:38:41.983567 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 469/931] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:41 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:42.488790 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f1cc36c6-910b-454d-a794-10de0dad20e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:42.491250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f1cc36c6-910b-454d-a794-10de0dad20e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:42.497515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1cc36c6-910b-454d-a794-10de0dad20e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:42.497996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1cc36c6-910b-454d-a794-10de0dad20e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:42.498433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1cc36c6-910b-454d-a794-10de0dad20e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:42.499147 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1cc36c6-910b-454d-a794-10de0dad20e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:42.499604 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1cc36c6-910b-454d-a794-10de0dad20e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:42.500028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1cc36c6-910b-454d-a794-10de0dad20e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:42.528525 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f1cc36c6-910b-454d-a794-10de0dad20e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043746 Aug 24 12:38:42.529063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 463/932] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:42 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:42.608740 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-149a9fc2-0505-4f98-9106-234825c1e885 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:42.610935 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-149a9fc2-0505-4f98-9106-234825c1e885 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:42.617930 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-149a9fc2-0505-4f98-9106-234825c1e885 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:42.618412 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-149a9fc2-0505-4f98-9106-234825c1e885 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:42.618912 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-149a9fc2-0505-4f98-9106-234825c1e885 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:42.619944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-149a9fc2-0505-4f98-9106-234825c1e885 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:42.620045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-149a9fc2-0505-4f98-9106-234825c1e885 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:42.620453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-149a9fc2-0505-4f98-9106-234825c1e885 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:42.650416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-149a9fc2-0505-4f98-9106-234825c1e885 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045908 Aug 24 12:38:42.650986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 470/933] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:42 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:42.996123 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b396ec96-cb2b-47c1-ab34-4521de51c6c1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:42.998475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b396ec96-cb2b-47c1-ab34-4521de51c6c1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:43.005209 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b396ec96-cb2b-47c1-ab34-4521de51c6c1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:43.005686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b396ec96-cb2b-47c1-ab34-4521de51c6c1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:43.006117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b396ec96-cb2b-47c1-ab34-4521de51c6c1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:43.006827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b396ec96-cb2b-47c1-ab34-4521de51c6c1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:43.007279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b396ec96-cb2b-47c1-ab34-4521de51c6c1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:43.007697 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b396ec96-cb2b-47c1-ab34-4521de51c6c1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:43.035849 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b396ec96-cb2b-47c1-ab34-4521de51c6c1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043717 Aug 24 12:38:43.036408 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 464/934] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:42 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:38:43.540404 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bd819039-c7c6-4603-b932-9a754bc61f07 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:43.542553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-bd819039-c7c6-4603-b932-9a754bc61f07 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:43.548574 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd819039-c7c6-4603-b932-9a754bc61f07 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:43.549057 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd819039-c7c6-4603-b932-9a754bc61f07 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:43.549494 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd819039-c7c6-4603-b932-9a754bc61f07 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:43.550175 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd819039-c7c6-4603-b932-9a754bc61f07 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:43.550629 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd819039-c7c6-4603-b932-9a754bc61f07 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:43.551080 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd819039-c7c6-4603-b932-9a754bc61f07 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:43.578413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bd819039-c7c6-4603-b932-9a754bc61f07 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042593 Aug 24 12:38:43.578998 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 471/935] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:43 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:43.663558 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-81991be5-1562-4271-b0b5-8d544e027a5d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:43.665690 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-81991be5-1562-4271-b0b5-8d544e027a5d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:43.671953 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81991be5-1562-4271-b0b5-8d544e027a5d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:43.672430 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81991be5-1562-4271-b0b5-8d544e027a5d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:43.672866 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81991be5-1562-4271-b0b5-8d544e027a5d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:43.673538 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81991be5-1562-4271-b0b5-8d544e027a5d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:43.673986 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81991be5-1562-4271-b0b5-8d544e027a5d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:43.674404 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81991be5-1562-4271-b0b5-8d544e027a5d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:43.702677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-81991be5-1562-4271-b0b5-8d544e027a5d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043797 Aug 24 12:38:43.702677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 465/936] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:43 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:38:44.047343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0e08d11e-135c-4548-804b-c8a53bd285e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:44.049474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0e08d11e-135c-4548-804b-c8a53bd285e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:44.055801 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0e08d11e-135c-4548-804b-c8a53bd285e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:44.056283 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0e08d11e-135c-4548-804b-c8a53bd285e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:44.056716 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0e08d11e-135c-4548-804b-c8a53bd285e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:44.057398 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0e08d11e-135c-4548-804b-c8a53bd285e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:44.057847 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0e08d11e-135c-4548-804b-c8a53bd285e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:44.058266 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0e08d11e-135c-4548-804b-c8a53bd285e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:44.088276 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0e08d11e-135c-4548-804b-c8a53bd285e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044825 Aug 24 12:38:44.089043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 472/937] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:44 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:44.592116 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-be6b41f3-7ecd-44d0-9569-8ddca22b7c4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:44.594307 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-be6b41f3-7ecd-44d0-9569-8ddca22b7c4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:44.600273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be6b41f3-7ecd-44d0-9569-8ddca22b7c4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:44.600751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be6b41f3-7ecd-44d0-9569-8ddca22b7c4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:44.601209 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be6b41f3-7ecd-44d0-9569-8ddca22b7c4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:44.601887 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be6b41f3-7ecd-44d0-9569-8ddca22b7c4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:44.602336 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be6b41f3-7ecd-44d0-9569-8ddca22b7c4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:44.602787 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be6b41f3-7ecd-44d0-9569-8ddca22b7c4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:44.616654 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:44.631793 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-be6b41f3-7ecd-44d0-9569-8ddca22b7c4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043610 Aug 24 12:38:44.635376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 466/938] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:44 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:44.715119 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3b039857-e5e6-46bb-84f8-3c8e6c959fd6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:44.717171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3b039857-e5e6-46bb-84f8-3c8e6c959fd6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:44.723568 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b039857-e5e6-46bb-84f8-3c8e6c959fd6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:44.724050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b039857-e5e6-46bb-84f8-3c8e6c959fd6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:44.724494 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b039857-e5e6-46bb-84f8-3c8e6c959fd6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:44.725177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b039857-e5e6-46bb-84f8-3c8e6c959fd6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:44.725627 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b039857-e5e6-46bb-84f8-3c8e6c959fd6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:44.726053 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b039857-e5e6-46bb-84f8-3c8e6c959fd6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:44.754869 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3b039857-e5e6-46bb-84f8-3c8e6c959fd6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043884 Aug 24 12:38:44.755409 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 473/939] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:44 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:38:45.100276 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d4340dcd-5b4e-44bb-a5cf-fa269b15a187 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:45.102478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d4340dcd-5b4e-44bb-a5cf-fa269b15a187 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:45.109201 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4340dcd-5b4e-44bb-a5cf-fa269b15a187 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:45.109679 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4340dcd-5b4e-44bb-a5cf-fa269b15a187 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:45.110116 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4340dcd-5b4e-44bb-a5cf-fa269b15a187 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:45.110836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4340dcd-5b4e-44bb-a5cf-fa269b15a187 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:45.111290 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4340dcd-5b4e-44bb-a5cf-fa269b15a187 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:45.111714 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4340dcd-5b4e-44bb-a5cf-fa269b15a187 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:45.142205 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d4340dcd-5b4e-44bb-a5cf-fa269b15a187 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046470 Aug 24 12:38:45.142782 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 467/940] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:45 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:45.644042 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c669bd7d-a08d-44e9-9b18-00e9f6fdf389 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:45.646845 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c669bd7d-a08d-44e9-9b18-00e9f6fdf389 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:45.652969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c669bd7d-a08d-44e9-9b18-00e9f6fdf389 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:45.653458 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c669bd7d-a08d-44e9-9b18-00e9f6fdf389 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:45.653897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c669bd7d-a08d-44e9-9b18-00e9f6fdf389 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:45.654581 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c669bd7d-a08d-44e9-9b18-00e9f6fdf389 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:45.655074 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c669bd7d-a08d-44e9-9b18-00e9f6fdf389 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:45.655500 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c669bd7d-a08d-44e9-9b18-00e9f6fdf389 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:45.684279 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c669bd7d-a08d-44e9-9b18-00e9f6fdf389 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044091 Aug 24 12:38:45.684753 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 474/941] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:45 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:45.767243 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6d0dd3c5-39ea-4c77-bf23-6e5f1bfe86d0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:45.769377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6d0dd3c5-39ea-4c77-bf23-6e5f1bfe86d0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:45.775694 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d0dd3c5-39ea-4c77-bf23-6e5f1bfe86d0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:45.776170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d0dd3c5-39ea-4c77-bf23-6e5f1bfe86d0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:45.776603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d0dd3c5-39ea-4c77-bf23-6e5f1bfe86d0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:45.777282 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d0dd3c5-39ea-4c77-bf23-6e5f1bfe86d0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:45.777728 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d0dd3c5-39ea-4c77-bf23-6e5f1bfe86d0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:45.778169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d0dd3c5-39ea-4c77-bf23-6e5f1bfe86d0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:45.806941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6d0dd3c5-39ea-4c77-bf23-6e5f1bfe86d0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043679 Aug 24 12:38:45.807488 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 468/942] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:45 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:46.155236 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e569e79b-3ee5-4daf-9ec6-a4c29532f761 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:46.157434 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e569e79b-3ee5-4daf-9ec6-a4c29532f761 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:46.163269 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e569e79b-3ee5-4daf-9ec6-a4c29532f761 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:46.163743 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e569e79b-3ee5-4daf-9ec6-a4c29532f761 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:46.164169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e569e79b-3ee5-4daf-9ec6-a4c29532f761 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:46.164847 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e569e79b-3ee5-4daf-9ec6-a4c29532f761 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:46.165291 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e569e79b-3ee5-4daf-9ec6-a4c29532f761 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:46.165739 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e569e79b-3ee5-4daf-9ec6-a4c29532f761 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:46.194072 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e569e79b-3ee5-4daf-9ec6-a4c29532f761 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042826 Aug 24 12:38:46.194613 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 475/943] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:46 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:46.697034 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-21e42c85-ec55-4b68-a371-5349de940967 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:46.699091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-21e42c85-ec55-4b68-a371-5349de940967 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:46.705506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-21e42c85-ec55-4b68-a371-5349de940967 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:46.705989 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-21e42c85-ec55-4b68-a371-5349de940967 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:46.706421 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-21e42c85-ec55-4b68-a371-5349de940967 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:46.707131 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-21e42c85-ec55-4b68-a371-5349de940967 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:46.707591 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-21e42c85-ec55-4b68-a371-5349de940967 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:46.708012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-21e42c85-ec55-4b68-a371-5349de940967 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:46.735606 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-21e42c85-ec55-4b68-a371-5349de940967 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042595 Aug 24 12:38:46.736148 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 469/944] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:46 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:46.819841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-dec14fd6-acff-4684-9c54-f5a8cc27b51a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:46.821964 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-dec14fd6-acff-4684-9c54-f5a8cc27b51a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:46.828203 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dec14fd6-acff-4684-9c54-f5a8cc27b51a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:46.828673 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dec14fd6-acff-4684-9c54-f5a8cc27b51a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:46.829097 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dec14fd6-acff-4684-9c54-f5a8cc27b51a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:46.829772 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dec14fd6-acff-4684-9c54-f5a8cc27b51a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:46.830213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dec14fd6-acff-4684-9c54-f5a8cc27b51a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:46.830627 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dec14fd6-acff-4684-9c54-f5a8cc27b51a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:46.858474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-dec14fd6-acff-4684-9c54-f5a8cc27b51a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043473 Aug 24 12:38:46.859042 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 476/945] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:46 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:47.206065 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-02162b59-f3ee-4cb5-b2c9-3fccc3e4bed9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:47.208225 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-02162b59-f3ee-4cb5-b2c9-3fccc3e4bed9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:47.213925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-02162b59-f3ee-4cb5-b2c9-3fccc3e4bed9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:47.214403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-02162b59-f3ee-4cb5-b2c9-3fccc3e4bed9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:47.214879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-02162b59-f3ee-4cb5-b2c9-3fccc3e4bed9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:47.215558 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-02162b59-f3ee-4cb5-b2c9-3fccc3e4bed9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:47.216005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-02162b59-f3ee-4cb5-b2c9-3fccc3e4bed9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:47.216422 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-02162b59-f3ee-4cb5-b2c9-3fccc3e4bed9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:47.245795 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-02162b59-f3ee-4cb5-b2c9-3fccc3e4bed9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043689 Aug 24 12:38:47.246341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 470/946] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:47 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:47.747488 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6e3c4f7e-1297-418c-adb6-8118841d9816 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:47.749594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6e3c4f7e-1297-418c-adb6-8118841d9816 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:47.756158 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e3c4f7e-1297-418c-adb6-8118841d9816 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:47.756641 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e3c4f7e-1297-418c-adb6-8118841d9816 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:47.757072 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e3c4f7e-1297-418c-adb6-8118841d9816 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:47.757781 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e3c4f7e-1297-418c-adb6-8118841d9816 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:47.758231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e3c4f7e-1297-418c-adb6-8118841d9816 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:47.758679 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e3c4f7e-1297-418c-adb6-8118841d9816 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:47.787139 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6e3c4f7e-1297-418c-adb6-8118841d9816 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043539 Aug 24 12:38:47.787676 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 477/947] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:47 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:47.870801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-80f8aab9-8f00-4cc8-bfd3-2f26b75e9f9b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:47.872906 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-80f8aab9-8f00-4cc8-bfd3-2f26b75e9f9b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:47.879745 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-80f8aab9-8f00-4cc8-bfd3-2f26b75e9f9b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:47.880225 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-80f8aab9-8f00-4cc8-bfd3-2f26b75e9f9b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:47.880658 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-80f8aab9-8f00-4cc8-bfd3-2f26b75e9f9b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:47.881338 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-80f8aab9-8f00-4cc8-bfd3-2f26b75e9f9b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:47.881791 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-80f8aab9-8f00-4cc8-bfd3-2f26b75e9f9b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:47.882213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-80f8aab9-8f00-4cc8-bfd3-2f26b75e9f9b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:47.913381 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-80f8aab9-8f00-4cc8-bfd3-2f26b75e9f9b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046438 Aug 24 12:38:47.913927 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 471/948] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:47 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:48.258562 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-88257de7-1295-492d-a19a-aadd1c5a71db tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:48.260777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-88257de7-1295-492d-a19a-aadd1c5a71db tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:48.267224 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88257de7-1295-492d-a19a-aadd1c5a71db tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:48.267708 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88257de7-1295-492d-a19a-aadd1c5a71db tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:48.268146 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88257de7-1295-492d-a19a-aadd1c5a71db tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:48.268842 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88257de7-1295-492d-a19a-aadd1c5a71db tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:48.269291 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88257de7-1295-492d-a19a-aadd1c5a71db tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:48.269711 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88257de7-1295-492d-a19a-aadd1c5a71db tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:48.297642 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-88257de7-1295-492d-a19a-aadd1c5a71db tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043725 Aug 24 12:38:48.298217 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 478/949] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:48 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:48.798986 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e84df73a-2418-41cc-aa10-b21696e10fdc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:48.801205 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e84df73a-2418-41cc-aa10-b21696e10fdc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:48.808233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e84df73a-2418-41cc-aa10-b21696e10fdc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:48.808711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e84df73a-2418-41cc-aa10-b21696e10fdc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:48.809138 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e84df73a-2418-41cc-aa10-b21696e10fdc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:48.809909 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e84df73a-2418-41cc-aa10-b21696e10fdc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:48.810363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e84df73a-2418-41cc-aa10-b21696e10fdc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:48.810811 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e84df73a-2418-41cc-aa10-b21696e10fdc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:48.839549 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e84df73a-2418-41cc-aa10-b21696e10fdc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044466 Aug 24 12:38:48.842466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 472/950] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:48 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:48.925766 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-656d834a-d584-4286-bf74-88eb42a991f4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:48.927908 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-656d834a-d584-4286-bf74-88eb42a991f4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:48.933729 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-656d834a-d584-4286-bf74-88eb42a991f4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:48.934203 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-656d834a-d584-4286-bf74-88eb42a991f4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:48.934634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-656d834a-d584-4286-bf74-88eb42a991f4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:48.935370 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-656d834a-d584-4286-bf74-88eb42a991f4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:48.935818 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-656d834a-d584-4286-bf74-88eb42a991f4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:48.936238 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-656d834a-d584-4286-bf74-88eb42a991f4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:48.964524 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-656d834a-d584-4286-bf74-88eb42a991f4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042719 Aug 24 12:38:48.965058 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 479/951] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:48 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:49.310529 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-46d44bf7-b304-4a66-9a3f-e5a928e9d7d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:49.312769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-46d44bf7-b304-4a66-9a3f-e5a928e9d7d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:49.319226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46d44bf7-b304-4a66-9a3f-e5a928e9d7d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:49.319712 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46d44bf7-b304-4a66-9a3f-e5a928e9d7d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:49.320155 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46d44bf7-b304-4a66-9a3f-e5a928e9d7d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:49.320837 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46d44bf7-b304-4a66-9a3f-e5a928e9d7d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:49.321336 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46d44bf7-b304-4a66-9a3f-e5a928e9d7d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:49.321764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46d44bf7-b304-4a66-9a3f-e5a928e9d7d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:49.351301 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-46d44bf7-b304-4a66-9a3f-e5a928e9d7d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044769 Aug 24 12:38:49.351846 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 473/952] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:49 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:49.853273 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-571b29a0-3f32-4764-913e-6c907292e106 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:49.855461 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-571b29a0-3f32-4764-913e-6c907292e106 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:49.861746 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-571b29a0-3f32-4764-913e-6c907292e106 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:49.862220 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-571b29a0-3f32-4764-913e-6c907292e106 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:49.862677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-571b29a0-3f32-4764-913e-6c907292e106 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:49.863362 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-571b29a0-3f32-4764-913e-6c907292e106 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:49.863806 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-571b29a0-3f32-4764-913e-6c907292e106 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:49.864494 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-571b29a0-3f32-4764-913e-6c907292e106 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:49.892560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-571b29a0-3f32-4764-913e-6c907292e106 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043208 Aug 24 12:38:49.893123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 480/953] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:49 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:49.976799 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3cf60d08-45bd-40ad-a5ca-2bd07619781a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:49.978924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3cf60d08-45bd-40ad-a5ca-2bd07619781a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:49.984725 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3cf60d08-45bd-40ad-a5ca-2bd07619781a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:49.985200 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3cf60d08-45bd-40ad-a5ca-2bd07619781a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:49.985650 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3cf60d08-45bd-40ad-a5ca-2bd07619781a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:49.986327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3cf60d08-45bd-40ad-a5ca-2bd07619781a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:49.986831 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3cf60d08-45bd-40ad-a5ca-2bd07619781a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:49.987255 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3cf60d08-45bd-40ad-a5ca-2bd07619781a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:50.016306 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3cf60d08-45bd-40ad-a5ca-2bd07619781a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043482 Aug 24 12:38:50.016788 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 474/954] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:49 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:38:50.364045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-37cc375d-a015-4169-820e-d92ab46b75f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:50.366392 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-37cc375d-a015-4169-820e-d92ab46b75f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:50.372219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37cc375d-a015-4169-820e-d92ab46b75f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:50.372695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37cc375d-a015-4169-820e-d92ab46b75f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:50.373127 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37cc375d-a015-4169-820e-d92ab46b75f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:50.373805 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37cc375d-a015-4169-820e-d92ab46b75f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:50.374254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37cc375d-a015-4169-820e-d92ab46b75f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:50.374697 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37cc375d-a015-4169-820e-d92ab46b75f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:50.403065 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-37cc375d-a015-4169-820e-d92ab46b75f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043537 Aug 24 12:38:50.403601 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 481/955] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:50 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:50.905528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-26419eb4-c0cf-49fc-a130-5da294f3d40e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:50.907724 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-26419eb4-c0cf-49fc-a130-5da294f3d40e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:50.914581 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-26419eb4-c0cf-49fc-a130-5da294f3d40e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:50.915099 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-26419eb4-c0cf-49fc-a130-5da294f3d40e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:50.915537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-26419eb4-c0cf-49fc-a130-5da294f3d40e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:50.916223 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-26419eb4-c0cf-49fc-a130-5da294f3d40e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:50.916679 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-26419eb4-c0cf-49fc-a130-5da294f3d40e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:50.917103 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-26419eb4-c0cf-49fc-a130-5da294f3d40e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:50.947903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-26419eb4-c0cf-49fc-a130-5da294f3d40e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046357 Aug 24 12:38:50.948471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 475/956] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:50 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:51.028256 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-02d5dd3f-97e0-4cb5-a2fa-7847230cd6ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:51.030373 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-02d5dd3f-97e0-4cb5-a2fa-7847230cd6ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:51.037305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02d5dd3f-97e0-4cb5-a2fa-7847230cd6ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:51.037780 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02d5dd3f-97e0-4cb5-a2fa-7847230cd6ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:51.038206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02d5dd3f-97e0-4cb5-a2fa-7847230cd6ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:51.038911 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02d5dd3f-97e0-4cb5-a2fa-7847230cd6ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:51.039356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02d5dd3f-97e0-4cb5-a2fa-7847230cd6ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:51.039771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02d5dd3f-97e0-4cb5-a2fa-7847230cd6ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:51.067966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-02d5dd3f-97e0-4cb5-a2fa-7847230cd6ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043630 Aug 24 12:38:51.068434 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 482/957] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:51 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:51.415257 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-93af4b41-4de8-4e5d-92dc-02322126814b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:51.417299 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-93af4b41-4de8-4e5d-92dc-02322126814b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:51.423433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-93af4b41-4de8-4e5d-92dc-02322126814b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:51.423918 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-93af4b41-4de8-4e5d-92dc-02322126814b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:51.424356 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-93af4b41-4de8-4e5d-92dc-02322126814b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:51.425047 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-93af4b41-4de8-4e5d-92dc-02322126814b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:51.425504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-93af4b41-4de8-4e5d-92dc-02322126814b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:51.425969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-93af4b41-4de8-4e5d-92dc-02322126814b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:51.454629 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-93af4b41-4de8-4e5d-92dc-02322126814b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043348 Aug 24 12:38:51.455197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 476/958] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:51 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:51.960796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-05de7f4b-54b4-4872-95c8-ebdda2efaa5d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:51.962944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-05de7f4b-54b4-4872-95c8-ebdda2efaa5d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:51.968807 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-05de7f4b-54b4-4872-95c8-ebdda2efaa5d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:51.969282 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-05de7f4b-54b4-4872-95c8-ebdda2efaa5d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:51.969714 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-05de7f4b-54b4-4872-95c8-ebdda2efaa5d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:51.970389 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-05de7f4b-54b4-4872-95c8-ebdda2efaa5d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:51.970870 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-05de7f4b-54b4-4872-95c8-ebdda2efaa5d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:51.971296 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-05de7f4b-54b4-4872-95c8-ebdda2efaa5d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:52.000036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-05de7f4b-54b4-4872-95c8-ebdda2efaa5d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043679 Aug 24 12:38:52.000505 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 483/959] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:51 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:52.079980 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b0c1dcda-1b63-4eb9-8954-1385bf50affe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:52.082604 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b0c1dcda-1b63-4eb9-8954-1385bf50affe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:52.088891 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0c1dcda-1b63-4eb9-8954-1385bf50affe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:52.089370 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0c1dcda-1b63-4eb9-8954-1385bf50affe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:52.089807 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0c1dcda-1b63-4eb9-8954-1385bf50affe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:52.090500 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0c1dcda-1b63-4eb9-8954-1385bf50affe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:52.090990 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0c1dcda-1b63-4eb9-8954-1385bf50affe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:52.091414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0c1dcda-1b63-4eb9-8954-1385bf50affe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:52.120166 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b0c1dcda-1b63-4eb9-8954-1385bf50affe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044100 Aug 24 12:38:52.120709 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 477/960] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:52 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:52.467352 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9f5a1dea-e002-48e2-b45e-4ca811f3fc53 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:52.469641 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9f5a1dea-e002-48e2-b45e-4ca811f3fc53 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:52.476262 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f5a1dea-e002-48e2-b45e-4ca811f3fc53 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:52.476743 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f5a1dea-e002-48e2-b45e-4ca811f3fc53 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:52.477249 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f5a1dea-e002-48e2-b45e-4ca811f3fc53 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:52.477927 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f5a1dea-e002-48e2-b45e-4ca811f3fc53 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:52.478394 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f5a1dea-e002-48e2-b45e-4ca811f3fc53 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:52.478899 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f5a1dea-e002-48e2-b45e-4ca811f3fc53 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:52.507857 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9f5a1dea-e002-48e2-b45e-4ca811f3fc53 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044644 Aug 24 12:38:52.508393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 484/961] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:52 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:53.011805 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-cecda58c-476f-4cd4-b5f7-f57523446497 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:53.013928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-cecda58c-476f-4cd4-b5f7-f57523446497 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:53.020482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cecda58c-476f-4cd4-b5f7-f57523446497 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:53.020954 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cecda58c-476f-4cd4-b5f7-f57523446497 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:53.021384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cecda58c-476f-4cd4-b5f7-f57523446497 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:53.022060 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cecda58c-476f-4cd4-b5f7-f57523446497 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:53.022508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cecda58c-476f-4cd4-b5f7-f57523446497 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:53.022950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cecda58c-476f-4cd4-b5f7-f57523446497 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:53.050040 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-cecda58c-476f-4cd4-b5f7-f57523446497 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042152 Aug 24 12:38:53.050571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 478/962] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:53 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:53.132854 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f7c81fb0-448c-404a-9804-5d099f536b6e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:53.134989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f7c81fb0-448c-404a-9804-5d099f536b6e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:53.141072 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f7c81fb0-448c-404a-9804-5d099f536b6e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:53.141557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f7c81fb0-448c-404a-9804-5d099f536b6e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:53.141996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f7c81fb0-448c-404a-9804-5d099f536b6e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:53.142713 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f7c81fb0-448c-404a-9804-5d099f536b6e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:53.143170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f7c81fb0-448c-404a-9804-5d099f536b6e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:53.143602 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f7c81fb0-448c-404a-9804-5d099f536b6e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:53.167954 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:53.172543 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f7c81fb0-448c-404a-9804-5d099f536b6e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044182 Aug 24 12:38:53.173084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 485/963] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:53 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:53.520043 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9ad84a29-9c61-4eae-94cc-bae54d9fff10 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:53.522182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9ad84a29-9c61-4eae-94cc-bae54d9fff10 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:53.529220 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ad84a29-9c61-4eae-94cc-bae54d9fff10 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:53.529704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ad84a29-9c61-4eae-94cc-bae54d9fff10 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:53.530143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ad84a29-9c61-4eae-94cc-bae54d9fff10 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:53.530867 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ad84a29-9c61-4eae-94cc-bae54d9fff10 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:53.531324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ad84a29-9c61-4eae-94cc-bae54d9fff10 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:53.531754 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ad84a29-9c61-4eae-94cc-bae54d9fff10 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:53.560906 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9ad84a29-9c61-4eae-94cc-bae54d9fff10 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044767 Aug 24 12:38:53.561464 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 479/964] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:53 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:54.061652 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5c5576d8-dd4a-4a47-a3b3-15013782d409 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:54.063811 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5c5576d8-dd4a-4a47-a3b3-15013782d409 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:54.070611 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c5576d8-dd4a-4a47-a3b3-15013782d409 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:54.071119 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c5576d8-dd4a-4a47-a3b3-15013782d409 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:54.071550 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c5576d8-dd4a-4a47-a3b3-15013782d409 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:54.072234 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c5576d8-dd4a-4a47-a3b3-15013782d409 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:54.072684 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c5576d8-dd4a-4a47-a3b3-15013782d409 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:54.073105 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c5576d8-dd4a-4a47-a3b3-15013782d409 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:54.102031 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5c5576d8-dd4a-4a47-a3b3-15013782d409 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044473 Aug 24 12:38:54.102586 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 486/965] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:54 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:54.184795 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-87d7e6d8-c851-490d-a2cd-ebdf57931854 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:54.186935 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-87d7e6d8-c851-490d-a2cd-ebdf57931854 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:54.192882 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-87d7e6d8-c851-490d-a2cd-ebdf57931854 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:54.193358 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-87d7e6d8-c851-490d-a2cd-ebdf57931854 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:54.193788 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-87d7e6d8-c851-490d-a2cd-ebdf57931854 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:54.194466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-87d7e6d8-c851-490d-a2cd-ebdf57931854 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:54.194982 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-87d7e6d8-c851-490d-a2cd-ebdf57931854 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:54.195668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-87d7e6d8-c851-490d-a2cd-ebdf57931854 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:54.229610 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-87d7e6d8-c851-490d-a2cd-ebdf57931854 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048749 Aug 24 12:38:54.230072 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 480/966] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:54 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:54.573160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6af2c534-4aa6-47de-bc4b-777d44106838 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:54.575327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6af2c534-4aa6-47de-bc4b-777d44106838 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:54.581162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6af2c534-4aa6-47de-bc4b-777d44106838 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:54.581638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6af2c534-4aa6-47de-bc4b-777d44106838 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:54.582743 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6af2c534-4aa6-47de-bc4b-777d44106838 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:54.583422 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6af2c534-4aa6-47de-bc4b-777d44106838 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:54.583868 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6af2c534-4aa6-47de-bc4b-777d44106838 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:54.584284 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6af2c534-4aa6-47de-bc4b-777d44106838 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:54.612016 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6af2c534-4aa6-47de-bc4b-777d44106838 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042927 Aug 24 12:38:54.612555 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 487/967] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:54 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:55.113421 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-349ca4c5-20e5-4107-81fe-284c572f4c61 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:55.115820 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-349ca4c5-20e5-4107-81fe-284c572f4c61 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:55.122210 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-349ca4c5-20e5-4107-81fe-284c572f4c61 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:55.122715 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-349ca4c5-20e5-4107-81fe-284c572f4c61 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:55.123152 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-349ca4c5-20e5-4107-81fe-284c572f4c61 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:55.123827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-349ca4c5-20e5-4107-81fe-284c572f4c61 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:55.124276 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-349ca4c5-20e5-4107-81fe-284c572f4c61 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:55.124697 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-349ca4c5-20e5-4107-81fe-284c572f4c61 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:55.153212 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-349ca4c5-20e5-4107-81fe-284c572f4c61 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043889 Aug 24 12:38:55.153757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 481/968] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:55 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:55.241577 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f5ac0d2e-c47e-4ff4-b628-fb7baa1bdf66 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:55.243722 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f5ac0d2e-c47e-4ff4-b628-fb7baa1bdf66 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:55.249985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5ac0d2e-c47e-4ff4-b628-fb7baa1bdf66 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:55.250454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5ac0d2e-c47e-4ff4-b628-fb7baa1bdf66 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:55.250938 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5ac0d2e-c47e-4ff4-b628-fb7baa1bdf66 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:55.251608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5ac0d2e-c47e-4ff4-b628-fb7baa1bdf66 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:55.252049 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5ac0d2e-c47e-4ff4-b628-fb7baa1bdf66 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:55.252465 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5ac0d2e-c47e-4ff4-b628-fb7baa1bdf66 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:55.285271 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f5ac0d2e-c47e-4ff4-b628-fb7baa1bdf66 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047925 Aug 24 12:38:55.285827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 488/969] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:55 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:55.624514 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c3e8ed4d-2275-4cb7-a1f6-8ec31e3d0fc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:55.626668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c3e8ed4d-2275-4cb7-a1f6-8ec31e3d0fc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:55.633117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3e8ed4d-2275-4cb7-a1f6-8ec31e3d0fc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:55.633592 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3e8ed4d-2275-4cb7-a1f6-8ec31e3d0fc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:55.634023 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3e8ed4d-2275-4cb7-a1f6-8ec31e3d0fc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:55.634718 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3e8ed4d-2275-4cb7-a1f6-8ec31e3d0fc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:55.635172 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3e8ed4d-2275-4cb7-a1f6-8ec31e3d0fc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:55.635591 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3e8ed4d-2275-4cb7-a1f6-8ec31e3d0fc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:55.663714 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c3e8ed4d-2275-4cb7-a1f6-8ec31e3d0fc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043169 Aug 24 12:38:55.664258 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 482/970] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:55 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:56.165828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ce24e1b8-c801-405e-b065-352f6e82004a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:56.168017 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ce24e1b8-c801-405e-b065-352f6e82004a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:56.173798 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce24e1b8-c801-405e-b065-352f6e82004a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:56.174271 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce24e1b8-c801-405e-b065-352f6e82004a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:56.174728 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce24e1b8-c801-405e-b065-352f6e82004a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:56.175404 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce24e1b8-c801-405e-b065-352f6e82004a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:56.176488 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce24e1b8-c801-405e-b065-352f6e82004a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:56.176908 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce24e1b8-c801-405e-b065-352f6e82004a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:56.204284 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ce24e1b8-c801-405e-b065-352f6e82004a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042363 Aug 24 12:38:56.204820 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 489/971] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:56 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:56.297495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2a881f05-3ed6-463d-8ec3-4ad77cd397ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:56.299642 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2a881f05-3ed6-463d-8ec3-4ad77cd397ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:56.305923 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a881f05-3ed6-463d-8ec3-4ad77cd397ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:56.306436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a881f05-3ed6-463d-8ec3-4ad77cd397ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:56.306911 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a881f05-3ed6-463d-8ec3-4ad77cd397ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:56.307608 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a881f05-3ed6-463d-8ec3-4ad77cd397ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:56.308066 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a881f05-3ed6-463d-8ec3-4ad77cd397ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:56.308494 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a881f05-3ed6-463d-8ec3-4ad77cd397ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:56.310827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:56.338663 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2a881f05-3ed6-463d-8ec3-4ad77cd397ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045150 Aug 24 12:38:56.339223 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 483/972] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:56 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:56.675912 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-62215449-ceea-4c80-b2f9-c9a8b1b30119 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:56.678173 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-62215449-ceea-4c80-b2f9-c9a8b1b30119 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:56.684598 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62215449-ceea-4c80-b2f9-c9a8b1b30119 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:56.685086 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62215449-ceea-4c80-b2f9-c9a8b1b30119 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:56.685525 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62215449-ceea-4c80-b2f9-c9a8b1b30119 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:56.686247 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62215449-ceea-4c80-b2f9-c9a8b1b30119 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:56.686733 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62215449-ceea-4c80-b2f9-c9a8b1b30119 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:56.687188 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62215449-ceea-4c80-b2f9-c9a8b1b30119 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:56.716520 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-62215449-ceea-4c80-b2f9-c9a8b1b30119 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044462 Aug 24 12:38:56.717062 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 490/973] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:56 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:57.216738 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-266e9a23-9b8d-45f3-8ce9-c10ed24de274 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:57.222398 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-266e9a23-9b8d-45f3-8ce9-c10ed24de274 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:57.222398 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=86 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:57.225762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-266e9a23-9b8d-45f3-8ce9-c10ed24de274 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:57.226240 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-266e9a23-9b8d-45f3-8ce9-c10ed24de274 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:57.226703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-266e9a23-9b8d-45f3-8ce9-c10ed24de274 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:57.227386 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-266e9a23-9b8d-45f3-8ce9-c10ed24de274 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:57.227836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-266e9a23-9b8d-45f3-8ce9-c10ed24de274 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:57.228253 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-266e9a23-9b8d-45f3-8ce9-c10ed24de274 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:57.258168 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-266e9a23-9b8d-45f3-8ce9-c10ed24de274 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045501 Aug 24 12:38:57.258729 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 484/974] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:57 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:57.351626 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cc6cf6ba-951e-4109-a891-86d0c2530ee2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:57.353722 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cc6cf6ba-951e-4109-a891-86d0c2530ee2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:57.355594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=86 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:57.360127 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc6cf6ba-951e-4109-a891-86d0c2530ee2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:57.360605 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc6cf6ba-951e-4109-a891-86d0c2530ee2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:57.361039 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc6cf6ba-951e-4109-a891-86d0c2530ee2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:57.361742 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc6cf6ba-951e-4109-a891-86d0c2530ee2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:57.362188 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc6cf6ba-951e-4109-a891-86d0c2530ee2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:57.362606 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc6cf6ba-951e-4109-a891-86d0c2530ee2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:57.392092 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cc6cf6ba-951e-4109-a891-86d0c2530ee2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045210 Aug 24 12:38:57.392632 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 491/975] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:57 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:57.729585 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-851ae31d-00d9-410a-a1e4-df03b5ef9a77 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:57.731875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-851ae31d-00d9-410a-a1e4-df03b5ef9a77 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:57.739438 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-851ae31d-00d9-410a-a1e4-df03b5ef9a77 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:57.739918 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-851ae31d-00d9-410a-a1e4-df03b5ef9a77 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:57.740348 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-851ae31d-00d9-410a-a1e4-df03b5ef9a77 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:57.741024 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-851ae31d-00d9-410a-a1e4-df03b5ef9a77 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:57.741473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-851ae31d-00d9-410a-a1e4-df03b5ef9a77 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:57.741891 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-851ae31d-00d9-410a-a1e4-df03b5ef9a77 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:57.918817 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-851ae31d-00d9-410a-a1e4-df03b5ef9a77 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193444 Aug 24 12:38:57.919357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 485/976] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:57 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:58.271187 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c8cb83cd-7310-4a75-b671-9bd4998a2a21 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:58.273311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c8cb83cd-7310-4a75-b671-9bd4998a2a21 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:58.280011 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c8cb83cd-7310-4a75-b671-9bd4998a2a21 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:58.280489 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c8cb83cd-7310-4a75-b671-9bd4998a2a21 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:58.280926 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c8cb83cd-7310-4a75-b671-9bd4998a2a21 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:58.281610 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c8cb83cd-7310-4a75-b671-9bd4998a2a21 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:58.282060 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c8cb83cd-7310-4a75-b671-9bd4998a2a21 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:58.282485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c8cb83cd-7310-4a75-b671-9bd4998a2a21 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:58.310411 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c8cb83cd-7310-4a75-b671-9bd4998a2a21 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043810 Aug 24 12:38:58.310980 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 492/977] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:58 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:58.405218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bb02ca44-163d-4e46-9040-2ae5f4102205 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:58.407391 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bb02ca44-163d-4e46-9040-2ae5f4102205 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:58.413537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb02ca44-163d-4e46-9040-2ae5f4102205 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:58.414035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb02ca44-163d-4e46-9040-2ae5f4102205 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:58.414478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb02ca44-163d-4e46-9040-2ae5f4102205 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:58.415189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb02ca44-163d-4e46-9040-2ae5f4102205 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:58.415640 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb02ca44-163d-4e46-9040-2ae5f4102205 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:58.416064 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb02ca44-163d-4e46-9040-2ae5f4102205 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:58.445497 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bb02ca44-163d-4e46-9040-2ae5f4102205 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044288 Aug 24 12:38:58.446024 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 486/978] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:58 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:58.931443 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2e9f5539-ca60-4cac-b1f0-814f36aaf077 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:58.933587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2e9f5539-ca60-4cac-b1f0-814f36aaf077 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:58.939396 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2e9f5539-ca60-4cac-b1f0-814f36aaf077 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:58.939869 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2e9f5539-ca60-4cac-b1f0-814f36aaf077 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:58.940326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2e9f5539-ca60-4cac-b1f0-814f36aaf077 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:58.941003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2e9f5539-ca60-4cac-b1f0-814f36aaf077 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:58.941448 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2e9f5539-ca60-4cac-b1f0-814f36aaf077 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:58.941866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2e9f5539-ca60-4cac-b1f0-814f36aaf077 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:58.969667 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2e9f5539-ca60-4cac-b1f0-814f36aaf077 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042173 Aug 24 12:38:58.970199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 493/979] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:58 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:59.322743 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ffc1471f-efc0-4d2a-bd36-c01b81ad3b66 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:59.324895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ffc1471f-efc0-4d2a-bd36-c01b81ad3b66 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:59.331405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ffc1471f-efc0-4d2a-bd36-c01b81ad3b66 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:59.332406 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ffc1471f-efc0-4d2a-bd36-c01b81ad3b66 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:59.332842 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ffc1471f-efc0-4d2a-bd36-c01b81ad3b66 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:59.333531 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ffc1471f-efc0-4d2a-bd36-c01b81ad3b66 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:59.333991 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ffc1471f-efc0-4d2a-bd36-c01b81ad3b66 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:59.334416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ffc1471f-efc0-4d2a-bd36-c01b81ad3b66 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:59.362977 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ffc1471f-efc0-4d2a-bd36-c01b81ad3b66 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044201 Aug 24 12:38:59.363514 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 487/980] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:59 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:59.458697 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8bb31a2e-464e-449a-8db8-a9b7d9828909 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:59.460919 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8bb31a2e-464e-449a-8db8-a9b7d9828909 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:59.466905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8bb31a2e-464e-449a-8db8-a9b7d9828909 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:59.467377 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8bb31a2e-464e-449a-8db8-a9b7d9828909 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:59.467820 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8bb31a2e-464e-449a-8db8-a9b7d9828909 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:59.468474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8bb31a2e-464e-449a-8db8-a9b7d9828909 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:59.468915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8bb31a2e-464e-449a-8db8-a9b7d9828909 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:59.469326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8bb31a2e-464e-449a-8db8-a9b7d9828909 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:59.498792 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8bb31a2e-464e-449a-8db8-a9b7d9828909 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044544 Aug 24 12:38:59.499331 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 494/981] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:38:59 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:59.982088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-369136e1-e762-4f72-86a2-b76b3e4a0805 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:59.984246 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-369136e1-e762-4f72-86a2-b76b3e4a0805 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:59.991009 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-369136e1-e762-4f72-86a2-b76b3e4a0805 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:59.991498 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-369136e1-e762-4f72-86a2-b76b3e4a0805 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:59.991931 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-369136e1-e762-4f72-86a2-b76b3e4a0805 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:59.992619 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-369136e1-e762-4f72-86a2-b76b3e4a0805 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:59.993069 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-369136e1-e762-4f72-86a2-b76b3e4a0805 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:59.993492 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-369136e1-e762-4f72-86a2-b76b3e4a0805 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:00.021883 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-369136e1-e762-4f72-86a2-b76b3e4a0805 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043650 Aug 24 12:39:00.022340 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 488/982] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:59 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:00.375619 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-90d56b93-10c1-4b17-8c9e-18a4d675d97d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:00.377661 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-90d56b93-10c1-4b17-8c9e-18a4d675d97d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:00.387884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-90d56b93-10c1-4b17-8c9e-18a4d675d97d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:00.388358 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-90d56b93-10c1-4b17-8c9e-18a4d675d97d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:00.388788 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-90d56b93-10c1-4b17-8c9e-18a4d675d97d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:00.389466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-90d56b93-10c1-4b17-8c9e-18a4d675d97d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:00.389920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-90d56b93-10c1-4b17-8c9e-18a4d675d97d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:00.390340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-90d56b93-10c1-4b17-8c9e-18a4d675d97d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:00.419045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-90d56b93-10c1-4b17-8c9e-18a4d675d97d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047463 Aug 24 12:39:00.419600 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 495/983] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:00 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:00.511417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c9204b71-84c4-4054-8874-866c0b51778a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:00.513583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c9204b71-84c4-4054-8874-866c0b51778a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:00.520150 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9204b71-84c4-4054-8874-866c0b51778a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:00.520643 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9204b71-84c4-4054-8874-866c0b51778a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:00.521080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9204b71-84c4-4054-8874-866c0b51778a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:00.521773 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9204b71-84c4-4054-8874-866c0b51778a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:00.522232 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9204b71-84c4-4054-8874-866c0b51778a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:00.522677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9204b71-84c4-4054-8874-866c0b51778a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:00.551100 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c9204b71-84c4-4054-8874-866c0b51778a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043584 Aug 24 12:39:00.551621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 489/984] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:00 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:01.033416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ee7ad6cd-abfe-4d8c-9e55-97d0fbe92501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:01.035780 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ee7ad6cd-abfe-4d8c-9e55-97d0fbe92501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:01.041673 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee7ad6cd-abfe-4d8c-9e55-97d0fbe92501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:01.042150 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee7ad6cd-abfe-4d8c-9e55-97d0fbe92501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:01.042794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee7ad6cd-abfe-4d8c-9e55-97d0fbe92501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:01.043280 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee7ad6cd-abfe-4d8c-9e55-97d0fbe92501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:01.043711 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee7ad6cd-abfe-4d8c-9e55-97d0fbe92501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:01.044124 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee7ad6cd-abfe-4d8c-9e55-97d0fbe92501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:01.073364 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ee7ad6cd-abfe-4d8c-9e55-97d0fbe92501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044023 Aug 24 12:39:01.073898 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 496/985] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:01 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:01.432259 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7a9f30a6-7659-43aa-905a-0235d74a8e36 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:01.434386 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7a9f30a6-7659-43aa-905a-0235d74a8e36 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:01.440370 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a9f30a6-7659-43aa-905a-0235d74a8e36 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:01.440852 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a9f30a6-7659-43aa-905a-0235d74a8e36 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:01.441291 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a9f30a6-7659-43aa-905a-0235d74a8e36 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:01.441983 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a9f30a6-7659-43aa-905a-0235d74a8e36 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:01.442450 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a9f30a6-7659-43aa-905a-0235d74a8e36 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:01.442912 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a9f30a6-7659-43aa-905a-0235d74a8e36 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:01.470133 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7a9f30a6-7659-43aa-905a-0235d74a8e36 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041848 Aug 24 12:39:01.470677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 490/986] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:01 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:01.563430 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e5326747-b2d0-4155-9e86-3f6ba6a97688 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:01.565702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e5326747-b2d0-4155-9e86-3f6ba6a97688 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:01.571418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e5326747-b2d0-4155-9e86-3f6ba6a97688 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:01.571897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e5326747-b2d0-4155-9e86-3f6ba6a97688 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:01.572329 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e5326747-b2d0-4155-9e86-3f6ba6a97688 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:01.573005 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e5326747-b2d0-4155-9e86-3f6ba6a97688 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:01.573454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e5326747-b2d0-4155-9e86-3f6ba6a97688 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:01.573873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e5326747-b2d0-4155-9e86-3f6ba6a97688 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:01.602784 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e5326747-b2d0-4155-9e86-3f6ba6a97688 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043415 Aug 24 12:39:01.603320 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 497/987] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:01 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:02.085553 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9ebb6371-b6c7-43a8-af32-f43ced1c7d32 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:02.087899 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9ebb6371-b6c7-43a8-af32-f43ced1c7d32 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:02.094382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ebb6371-b6c7-43a8-af32-f43ced1c7d32 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:02.094904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ebb6371-b6c7-43a8-af32-f43ced1c7d32 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:02.095348 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ebb6371-b6c7-43a8-af32-f43ced1c7d32 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:02.096042 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ebb6371-b6c7-43a8-af32-f43ced1c7d32 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:02.096504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ebb6371-b6c7-43a8-af32-f43ced1c7d32 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:02.097053 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ebb6371-b6c7-43a8-af32-f43ced1c7d32 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:02.131052 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9ebb6371-b6c7-43a8-af32-f43ced1c7d32 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049529 Aug 24 12:39:02.131599 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 491/988] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:02 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:02.483041 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6d73394e-0170-41eb-b4c2-fecf5c531797 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:02.485221 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6d73394e-0170-41eb-b4c2-fecf5c531797 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:02.491826 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d73394e-0170-41eb-b4c2-fecf5c531797 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:02.492333 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d73394e-0170-41eb-b4c2-fecf5c531797 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:02.492758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d73394e-0170-41eb-b4c2-fecf5c531797 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:02.493442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d73394e-0170-41eb-b4c2-fecf5c531797 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:02.493889 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d73394e-0170-41eb-b4c2-fecf5c531797 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:02.494309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d73394e-0170-41eb-b4c2-fecf5c531797 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:02.522178 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6d73394e-0170-41eb-b4c2-fecf5c531797 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043149 Aug 24 12:39:02.522732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 498/989] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:02 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:02.615775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0f5142fe-27d7-404b-b565-0ba836a1a215 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:02.617917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0f5142fe-27d7-404b-b565-0ba836a1a215 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:02.624952 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f5142fe-27d7-404b-b565-0ba836a1a215 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:02.625440 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f5142fe-27d7-404b-b565-0ba836a1a215 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:02.626010 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f5142fe-27d7-404b-b565-0ba836a1a215 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:02.626730 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f5142fe-27d7-404b-b565-0ba836a1a215 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:02.627191 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f5142fe-27d7-404b-b565-0ba836a1a215 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:02.627610 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f5142fe-27d7-404b-b565-0ba836a1a215 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:02.657583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0f5142fe-27d7-404b-b565-0ba836a1a215 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046580 Aug 24 12:39:02.658122 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 492/990] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:02 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:03.152277 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-83e44b11-71c0-46fb-99c3-0d704492ca21 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:03.154485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-83e44b11-71c0-46fb-99c3-0d704492ca21 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:03.160796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-83e44b11-71c0-46fb-99c3-0d704492ca21 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:03.161291 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-83e44b11-71c0-46fb-99c3-0d704492ca21 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:03.162312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-83e44b11-71c0-46fb-99c3-0d704492ca21 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:03.163037 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-83e44b11-71c0-46fb-99c3-0d704492ca21 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:03.163489 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-83e44b11-71c0-46fb-99c3-0d704492ca21 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:03.163996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-83e44b11-71c0-46fb-99c3-0d704492ca21 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:03.193379 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-83e44b11-71c0-46fb-99c3-0d704492ca21 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045146 Aug 24 12:39:03.193931 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 499/991] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:03 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:03.534453 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f1a7dce4-e728-43f2-b68c-e8ff903a7229 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:03.536587 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f1a7dce4-e728-43f2-b68c-e8ff903a7229 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:03.542845 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1a7dce4-e728-43f2-b68c-e8ff903a7229 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:03.543329 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1a7dce4-e728-43f2-b68c-e8ff903a7229 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:03.543759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1a7dce4-e728-43f2-b68c-e8ff903a7229 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:03.544440 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1a7dce4-e728-43f2-b68c-e8ff903a7229 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:03.544889 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1a7dce4-e728-43f2-b68c-e8ff903a7229 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:03.545321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1a7dce4-e728-43f2-b68c-e8ff903a7229 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:03.574036 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f1a7dce4-e728-43f2-b68c-e8ff903a7229 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043453 Aug 24 12:39:03.574505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 493/992] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:03 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:03.669952 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f39dad9b-d190-454c-824c-26302195e209 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:03.672206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f39dad9b-d190-454c-824c-26302195e209 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:03.678454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f39dad9b-d190-454c-824c-26302195e209 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:03.678969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f39dad9b-d190-454c-824c-26302195e209 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:03.679397 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f39dad9b-d190-454c-824c-26302195e209 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:03.680074 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f39dad9b-d190-454c-824c-26302195e209 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:03.680515 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f39dad9b-d190-454c-824c-26302195e209 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:03.680956 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f39dad9b-d190-454c-824c-26302195e209 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:03.710367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f39dad9b-d190-454c-824c-26302195e209 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044363 Aug 24 12:39:03.710938 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 500/993] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:03 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:04.205343 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3ed5c1c6-eec8-4f80-89dd-1a72160b7983 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:04.210226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3ed5c1c6-eec8-4f80-89dd-1a72160b7983 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:04.213461 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ed5c1c6-eec8-4f80-89dd-1a72160b7983 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:04.213988 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ed5c1c6-eec8-4f80-89dd-1a72160b7983 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:04.214377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ed5c1c6-eec8-4f80-89dd-1a72160b7983 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:04.215106 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ed5c1c6-eec8-4f80-89dd-1a72160b7983 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:04.215563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ed5c1c6-eec8-4f80-89dd-1a72160b7983 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:04.215995 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ed5c1c6-eec8-4f80-89dd-1a72160b7983 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:04.245671 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3ed5c1c6-eec8-4f80-89dd-1a72160b7983 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044173 Aug 24 12:39:04.246210 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 494/994] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:04 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:04.586856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c01bd8d7-f5be-45b4-8f3e-49f7471710aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:04.589022 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c01bd8d7-f5be-45b4-8f3e-49f7471710aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:04.594991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c01bd8d7-f5be-45b4-8f3e-49f7471710aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:04.595465 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c01bd8d7-f5be-45b4-8f3e-49f7471710aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:04.595896 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c01bd8d7-f5be-45b4-8f3e-49f7471710aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:04.596575 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c01bd8d7-f5be-45b4-8f3e-49f7471710aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:04.597028 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c01bd8d7-f5be-45b4-8f3e-49f7471710aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:04.597449 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c01bd8d7-f5be-45b4-8f3e-49f7471710aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:04.625941 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c01bd8d7-f5be-45b4-8f3e-49f7471710aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043581 Aug 24 12:39:04.626478 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 501/995] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:04 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:04.722564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a1f44d43-2c34-4fa3-8d8e-132127eff73a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:04.725292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a1f44d43-2c34-4fa3-8d8e-132127eff73a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:04.731469 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a1f44d43-2c34-4fa3-8d8e-132127eff73a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:04.731947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a1f44d43-2c34-4fa3-8d8e-132127eff73a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:04.732380 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a1f44d43-2c34-4fa3-8d8e-132127eff73a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:04.733060 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a1f44d43-2c34-4fa3-8d8e-132127eff73a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:04.733532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a1f44d43-2c34-4fa3-8d8e-132127eff73a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:04.733929 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a1f44d43-2c34-4fa3-8d8e-132127eff73a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:04.761827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a1f44d43-2c34-4fa3-8d8e-132127eff73a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043247 Aug 24 12:39:04.762357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 495/996] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:04 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:05.257280 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4a688374-275e-4fc4-9956-f85e3fad28c4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:05.259443 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4a688374-275e-4fc4-9956-f85e3fad28c4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:05.265575 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a688374-275e-4fc4-9956-f85e3fad28c4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:05.266050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a688374-275e-4fc4-9956-f85e3fad28c4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:05.266542 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a688374-275e-4fc4-9956-f85e3fad28c4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:05.267302 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a688374-275e-4fc4-9956-f85e3fad28c4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:05.267750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a688374-275e-4fc4-9956-f85e3fad28c4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:05.268171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a688374-275e-4fc4-9956-f85e3fad28c4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:05.284949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:05.298001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4a688374-275e-4fc4-9956-f85e3fad28c4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044598 Aug 24 12:39:05.298539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 502/997] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:05 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:05.637996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-46930884-2635-45f9-838c-d7e28e214389 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:05.640129 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-46930884-2635-45f9-838c-d7e28e214389 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:05.646534 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46930884-2635-45f9-838c-d7e28e214389 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:05.647041 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46930884-2635-45f9-838c-d7e28e214389 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:05.647473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46930884-2635-45f9-838c-d7e28e214389 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:05.648151 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46930884-2635-45f9-838c-d7e28e214389 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:05.648611 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46930884-2635-45f9-838c-d7e28e214389 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:05.649031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46930884-2635-45f9-838c-d7e28e214389 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:05.676525 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-46930884-2635-45f9-838c-d7e28e214389 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042420 Aug 24 12:39:05.677092 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 496/998] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:05 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:05.773986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f54c1222-f6af-40cc-a06a-6e45b8562280 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:05.776186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f54c1222-f6af-40cc-a06a-6e45b8562280 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:05.782406 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f54c1222-f6af-40cc-a06a-6e45b8562280 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:05.783025 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f54c1222-f6af-40cc-a06a-6e45b8562280 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:05.783456 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f54c1222-f6af-40cc-a06a-6e45b8562280 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:05.784140 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f54c1222-f6af-40cc-a06a-6e45b8562280 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:05.784584 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f54c1222-f6af-40cc-a06a-6e45b8562280 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:05.785001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f54c1222-f6af-40cc-a06a-6e45b8562280 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:05.812936 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f54c1222-f6af-40cc-a06a-6e45b8562280 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043514 Aug 24 12:39:05.813470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 503/999] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:05 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:06.320953 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5ca60fcc-4d1f-4ed6-8fa2-b52d3605d228 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:06.323390 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5ca60fcc-4d1f-4ed6-8fa2-b52d3605d228 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:06.329502 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5ca60fcc-4d1f-4ed6-8fa2-b52d3605d228 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:06.330114 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5ca60fcc-4d1f-4ed6-8fa2-b52d3605d228 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:06.330412 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5ca60fcc-4d1f-4ed6-8fa2-b52d3605d228 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:06.331197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5ca60fcc-4d1f-4ed6-8fa2-b52d3605d228 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:06.331648 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5ca60fcc-4d1f-4ed6-8fa2-b52d3605d228 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:06.332068 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5ca60fcc-4d1f-4ed6-8fa2-b52d3605d228 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:06.361077 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5ca60fcc-4d1f-4ed6-8fa2-b52d3605d228 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044928 Aug 24 12:39:06.361605 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 497/1000] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:06 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:39:06.689095 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2b9ee1f0-2d0f-4393-8ae7-7f251ea10e72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:06.691427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2b9ee1f0-2d0f-4393-8ae7-7f251ea10e72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:06.697871 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b9ee1f0-2d0f-4393-8ae7-7f251ea10e72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:06.698353 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b9ee1f0-2d0f-4393-8ae7-7f251ea10e72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:06.698832 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b9ee1f0-2d0f-4393-8ae7-7f251ea10e72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:06.699516 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b9ee1f0-2d0f-4393-8ae7-7f251ea10e72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:06.699961 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b9ee1f0-2d0f-4393-8ae7-7f251ea10e72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:06.700379 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b9ee1f0-2d0f-4393-8ae7-7f251ea10e72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:06.729101 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2b9ee1f0-2d0f-4393-8ae7-7f251ea10e72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044063 Aug 24 12:39:06.729644 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 504/1001] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:06 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:06.825118 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c62e7300-c29b-416a-a2ba-df8cb480af56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:06.827283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c62e7300-c29b-416a-a2ba-df8cb480af56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:06.833736 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c62e7300-c29b-416a-a2ba-df8cb480af56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:06.834216 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c62e7300-c29b-416a-a2ba-df8cb480af56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:06.834696 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c62e7300-c29b-416a-a2ba-df8cb480af56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:06.835380 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c62e7300-c29b-416a-a2ba-df8cb480af56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:06.835832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c62e7300-c29b-416a-a2ba-df8cb480af56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:06.836254 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c62e7300-c29b-416a-a2ba-df8cb480af56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:06.864822 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c62e7300-c29b-416a-a2ba-df8cb480af56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043375 Aug 24 12:39:06.865358 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 498/1002] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:06 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:07.374558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0dfe2c8d-6e7b-43ad-a29a-9d0580bebbc8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:07.376902 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0dfe2c8d-6e7b-43ad-a29a-9d0580bebbc8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:07.383365 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0dfe2c8d-6e7b-43ad-a29a-9d0580bebbc8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:07.383846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0dfe2c8d-6e7b-43ad-a29a-9d0580bebbc8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:07.384341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0dfe2c8d-6e7b-43ad-a29a-9d0580bebbc8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:07.385056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0dfe2c8d-6e7b-43ad-a29a-9d0580bebbc8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:07.385677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0dfe2c8d-6e7b-43ad-a29a-9d0580bebbc8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:07.385915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0dfe2c8d-6e7b-43ad-a29a-9d0580bebbc8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:07.414882 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0dfe2c8d-6e7b-43ad-a29a-9d0580bebbc8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044441 Aug 24 12:39:07.415431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 505/1003] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:07 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:07.741119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-caab3301-eecf-4ca9-b514-f33f53550369 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:07.743325 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-caab3301-eecf-4ca9-b514-f33f53550369 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:07.749740 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-caab3301-eecf-4ca9-b514-f33f53550369 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:07.750703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-caab3301-eecf-4ca9-b514-f33f53550369 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:07.750703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-caab3301-eecf-4ca9-b514-f33f53550369 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:07.751348 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-caab3301-eecf-4ca9-b514-f33f53550369 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:07.751802 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-caab3301-eecf-4ca9-b514-f33f53550369 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:07.752227 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-caab3301-eecf-4ca9-b514-f33f53550369 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:07.776196 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:07.780687 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-caab3301-eecf-4ca9-b514-f33f53550369 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044334 Aug 24 12:39:07.781223 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 499/1004] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:07 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:07.876997 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-219900a6-1643-487c-b242-cc7ac5f5471c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:07.879254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-219900a6-1643-487c-b242-cc7ac5f5471c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:07.885562 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-219900a6-1643-487c-b242-cc7ac5f5471c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:07.886095 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-219900a6-1643-487c-b242-cc7ac5f5471c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:07.886528 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-219900a6-1643-487c-b242-cc7ac5f5471c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:07.887241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-219900a6-1643-487c-b242-cc7ac5f5471c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:07.887692 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-219900a6-1643-487c-b242-cc7ac5f5471c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:07.888124 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-219900a6-1643-487c-b242-cc7ac5f5471c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:07.916928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-219900a6-1643-487c-b242-cc7ac5f5471c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043919 Aug 24 12:39:07.917470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 506/1005] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:07 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:08.427091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ea90af09-c185-49ac-ab81-8b940132a815 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:08.429325 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ea90af09-c185-49ac-ab81-8b940132a815 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:08.438275 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea90af09-c185-49ac-ab81-8b940132a815 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:08.438789 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea90af09-c185-49ac-ab81-8b940132a815 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:08.439228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea90af09-c185-49ac-ab81-8b940132a815 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:08.439922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea90af09-c185-49ac-ab81-8b940132a815 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:08.440382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea90af09-c185-49ac-ab81-8b940132a815 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:08.440809 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea90af09-c185-49ac-ab81-8b940132a815 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:08.470779 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ea90af09-c185-49ac-ab81-8b940132a815 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047512 Aug 24 12:39:08.471339 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 500/1006] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:08 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:08.793259 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-af818cfa-22cb-482f-8f3b-d76e191dddbb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:08.795416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-af818cfa-22cb-482f-8f3b-d76e191dddbb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:08.802516 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af818cfa-22cb-482f-8f3b-d76e191dddbb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:08.803041 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af818cfa-22cb-482f-8f3b-d76e191dddbb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:08.803482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af818cfa-22cb-482f-8f3b-d76e191dddbb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:08.804174 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af818cfa-22cb-482f-8f3b-d76e191dddbb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:08.804670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af818cfa-22cb-482f-8f3b-d76e191dddbb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:08.805096 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af818cfa-22cb-482f-8f3b-d76e191dddbb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:08.833558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-af818cfa-22cb-482f-8f3b-d76e191dddbb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044156 Aug 24 12:39:08.834286 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 507/1007] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:08 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:08.928358 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-14d5732f-1d61-4da6-b488-49ca591c6aa6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:08.930585 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-14d5732f-1d61-4da6-b488-49ca591c6aa6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:08.936888 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14d5732f-1d61-4da6-b488-49ca591c6aa6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:08.937398 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14d5732f-1d61-4da6-b488-49ca591c6aa6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:08.937830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14d5732f-1d61-4da6-b488-49ca591c6aa6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:08.938514 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14d5732f-1d61-4da6-b488-49ca591c6aa6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:08.939003 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14d5732f-1d61-4da6-b488-49ca591c6aa6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:08.939457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14d5732f-1d61-4da6-b488-49ca591c6aa6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:08.969022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-14d5732f-1d61-4da6-b488-49ca591c6aa6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044629 Aug 24 12:39:08.969566 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 501/1008] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:08 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:09.482501 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b134f3f6-b8e4-45f0-831e-f64151e4da7e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:09.484746 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b134f3f6-b8e4-45f0-831e-f64151e4da7e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:09.492006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b134f3f6-b8e4-45f0-831e-f64151e4da7e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:09.492543 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b134f3f6-b8e4-45f0-831e-f64151e4da7e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:09.492982 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b134f3f6-b8e4-45f0-831e-f64151e4da7e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:09.493686 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b134f3f6-b8e4-45f0-831e-f64151e4da7e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:09.494122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b134f3f6-b8e4-45f0-831e-f64151e4da7e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:09.494539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b134f3f6-b8e4-45f0-831e-f64151e4da7e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:09.523188 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b134f3f6-b8e4-45f0-831e-f64151e4da7e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044534 Aug 24 12:39:09.523732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 508/1009] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:09 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:09.845748 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4858b77d-9d7e-42ff-b5d1-b4a6764fd679 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:09.847917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4858b77d-9d7e-42ff-b5d1-b4a6764fd679 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:09.854470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4858b77d-9d7e-42ff-b5d1-b4a6764fd679 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:09.854981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4858b77d-9d7e-42ff-b5d1-b4a6764fd679 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:09.855418 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4858b77d-9d7e-42ff-b5d1-b4a6764fd679 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:09.856095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4858b77d-9d7e-42ff-b5d1-b4a6764fd679 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:09.856544 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4858b77d-9d7e-42ff-b5d1-b4a6764fd679 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:09.856963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4858b77d-9d7e-42ff-b5d1-b4a6764fd679 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:09.885530 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4858b77d-9d7e-42ff-b5d1-b4a6764fd679 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043728 Aug 24 12:39:09.886075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 502/1010] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:09 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:09.981308 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-30645627-c78b-48f3-b7b2-13215ff51e4c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:09.983558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-30645627-c78b-48f3-b7b2-13215ff51e4c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:09.989694 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-30645627-c78b-48f3-b7b2-13215ff51e4c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:09.990215 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-30645627-c78b-48f3-b7b2-13215ff51e4c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:09.990669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-30645627-c78b-48f3-b7b2-13215ff51e4c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:09.991352 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-30645627-c78b-48f3-b7b2-13215ff51e4c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:09.991803 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-30645627-c78b-48f3-b7b2-13215ff51e4c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:09.992225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-30645627-c78b-48f3-b7b2-13215ff51e4c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:10.020241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-30645627-c78b-48f3-b7b2-13215ff51e4c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042893 Aug 24 12:39:10.021297 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 509/1011] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:09 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:10.534925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a6ae191d-ee1e-4191-b36e-14703c5a91da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:10.537046 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a6ae191d-ee1e-4191-b36e-14703c5a91da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:10.543033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6ae191d-ee1e-4191-b36e-14703c5a91da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:10.543653 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6ae191d-ee1e-4191-b36e-14703c5a91da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:10.544091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6ae191d-ee1e-4191-b36e-14703c5a91da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:10.544774 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6ae191d-ee1e-4191-b36e-14703c5a91da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:10.545229 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6ae191d-ee1e-4191-b36e-14703c5a91da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:10.545652 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6ae191d-ee1e-4191-b36e-14703c5a91da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:10.575663 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a6ae191d-ee1e-4191-b36e-14703c5a91da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044552 Aug 24 12:39:10.576204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 503/1012] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:10 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:10.897881 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f399c6f5-5b6c-46ff-aff1-a4c91e600713 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:10.900155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f399c6f5-5b6c-46ff-aff1-a4c91e600713 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:10.906428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f399c6f5-5b6c-46ff-aff1-a4c91e600713 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:10.906931 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f399c6f5-5b6c-46ff-aff1-a4c91e600713 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:10.907358 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f399c6f5-5b6c-46ff-aff1-a4c91e600713 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:10.908026 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f399c6f5-5b6c-46ff-aff1-a4c91e600713 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:10.908466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f399c6f5-5b6c-46ff-aff1-a4c91e600713 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:10.908877 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f399c6f5-5b6c-46ff-aff1-a4c91e600713 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:10.937457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f399c6f5-5b6c-46ff-aff1-a4c91e600713 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043572 Aug 24 12:39:10.937989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 510/1013] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:10 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:11.033082 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-390387a2-7732-436e-8c39-2acb4a6f001f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:11.035206 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-390387a2-7732-436e-8c39-2acb4a6f001f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:11.041541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-390387a2-7732-436e-8c39-2acb4a6f001f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:11.042014 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-390387a2-7732-436e-8c39-2acb4a6f001f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:11.042443 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-390387a2-7732-436e-8c39-2acb4a6f001f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:11.043147 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-390387a2-7732-436e-8c39-2acb4a6f001f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:11.043599 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-390387a2-7732-436e-8c39-2acb4a6f001f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:11.044019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-390387a2-7732-436e-8c39-2acb4a6f001f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:11.072706 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-390387a2-7732-436e-8c39-2acb4a6f001f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043555 Aug 24 12:39:11.073245 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 504/1014] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:11 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:11.587693 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a937e450-d34f-48b3-a692-f1712a407789 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:11.589790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a937e450-d34f-48b3-a692-f1712a407789 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:11.595685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a937e450-d34f-48b3-a692-f1712a407789 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:11.596161 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a937e450-d34f-48b3-a692-f1712a407789 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:11.596597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a937e450-d34f-48b3-a692-f1712a407789 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:11.597311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a937e450-d34f-48b3-a692-f1712a407789 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:11.597721 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a937e450-d34f-48b3-a692-f1712a407789 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:11.598139 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a937e450-d34f-48b3-a692-f1712a407789 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:11.627920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a937e450-d34f-48b3-a692-f1712a407789 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044760 Aug 24 12:39:11.628467 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 511/1015] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:11 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:11.949155 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a5f5be25-321c-47c2-96b8-50d92e8bc346 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:11.951364 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a5f5be25-321c-47c2-96b8-50d92e8bc346 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:11.957670 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a5f5be25-321c-47c2-96b8-50d92e8bc346 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:11.958818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a5f5be25-321c-47c2-96b8-50d92e8bc346 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:11.959256 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a5f5be25-321c-47c2-96b8-50d92e8bc346 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:11.959965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a5f5be25-321c-47c2-96b8-50d92e8bc346 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:11.960418 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a5f5be25-321c-47c2-96b8-50d92e8bc346 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:11.960841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a5f5be25-321c-47c2-96b8-50d92e8bc346 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:11.988413 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a5f5be25-321c-47c2-96b8-50d92e8bc346 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043279 Aug 24 12:39:11.988954 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 505/1016] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:11 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:12.084826 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1e8483dc-a626-4fa0-9e50-f92d5efdd667 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:12.087000 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1e8483dc-a626-4fa0-9e50-f92d5efdd667 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:12.093236 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1e8483dc-a626-4fa0-9e50-f92d5efdd667 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:12.093707 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1e8483dc-a626-4fa0-9e50-f92d5efdd667 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:12.094133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1e8483dc-a626-4fa0-9e50-f92d5efdd667 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:12.094837 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1e8483dc-a626-4fa0-9e50-f92d5efdd667 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:12.095281 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1e8483dc-a626-4fa0-9e50-f92d5efdd667 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:12.095696 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1e8483dc-a626-4fa0-9e50-f92d5efdd667 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:12.124352 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1e8483dc-a626-4fa0-9e50-f92d5efdd667 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043562 Aug 24 12:39:12.124887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 512/1017] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:12 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:12.639604 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-97373270-bbf1-41c4-b39d-b565af2de36b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:12.641776 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-97373270-bbf1-41c4-b39d-b565af2de36b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:12.648398 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97373270-bbf1-41c4-b39d-b565af2de36b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:12.648881 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97373270-bbf1-41c4-b39d-b565af2de36b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:12.649316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97373270-bbf1-41c4-b39d-b565af2de36b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:12.650068 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97373270-bbf1-41c4-b39d-b565af2de36b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:12.650728 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97373270-bbf1-41c4-b39d-b565af2de36b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:12.651153 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97373270-bbf1-41c4-b39d-b565af2de36b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:12.682203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-97373270-bbf1-41c4-b39d-b565af2de36b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046411 Aug 24 12:39:12.682759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 506/1018] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:12 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:13.000747 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e2638e90-a1e0-46d1-83b0-de7b856742f9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:13.003015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e2638e90-a1e0-46d1-83b0-de7b856742f9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:13.009750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2638e90-a1e0-46d1-83b0-de7b856742f9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:13.010229 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2638e90-a1e0-46d1-83b0-de7b856742f9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:13.010669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2638e90-a1e0-46d1-83b0-de7b856742f9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:13.011367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2638e90-a1e0-46d1-83b0-de7b856742f9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:13.011816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2638e90-a1e0-46d1-83b0-de7b856742f9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:13.012229 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2638e90-a1e0-46d1-83b0-de7b856742f9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:13.040540 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e2638e90-a1e0-46d1-83b0-de7b856742f9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043715 Aug 24 12:39:13.041077 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 513/1019] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:12 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:13.136136 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-14c5bdc0-e720-4e52-b365-8051059658e2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:13.138240 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-14c5bdc0-e720-4e52-b365-8051059658e2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:13.144537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14c5bdc0-e720-4e52-b365-8051059658e2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:13.145016 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14c5bdc0-e720-4e52-b365-8051059658e2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:13.145451 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14c5bdc0-e720-4e52-b365-8051059658e2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:13.146131 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14c5bdc0-e720-4e52-b365-8051059658e2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:13.146578 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14c5bdc0-e720-4e52-b365-8051059658e2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:13.147024 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14c5bdc0-e720-4e52-b365-8051059658e2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:13.175838 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-14c5bdc0-e720-4e52-b365-8051059658e2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043661 Aug 24 12:39:13.176373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 507/1020] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:13 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:13.695847 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-69ad3073-a0c0-4f1b-bbe8-2f1c60b16800 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:13.696569 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-69ad3073-a0c0-4f1b-bbe8-2f1c60b16800 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:13.702899 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69ad3073-a0c0-4f1b-bbe8-2f1c60b16800 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:13.703384 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69ad3073-a0c0-4f1b-bbe8-2f1c60b16800 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:13.703820 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69ad3073-a0c0-4f1b-bbe8-2f1c60b16800 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:13.704511 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69ad3073-a0c0-4f1b-bbe8-2f1c60b16800 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:13.704960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69ad3073-a0c0-4f1b-bbe8-2f1c60b16800 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:13.705381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69ad3073-a0c0-4f1b-bbe8-2f1c60b16800 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:13.736569 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-69ad3073-a0c0-4f1b-bbe8-2f1c60b16800 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047230 Aug 24 12:39:13.737117 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 514/1021] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:13 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:14.051766 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9694bae5-0e44-4e5f-8725-5c9619a25204 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:14.053956 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9694bae5-0e44-4e5f-8725-5c9619a25204 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:14.059804 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9694bae5-0e44-4e5f-8725-5c9619a25204 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:14.060279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9694bae5-0e44-4e5f-8725-5c9619a25204 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:14.060708 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9694bae5-0e44-4e5f-8725-5c9619a25204 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:14.061385 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9694bae5-0e44-4e5f-8725-5c9619a25204 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:14.061833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9694bae5-0e44-4e5f-8725-5c9619a25204 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:14.062252 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9694bae5-0e44-4e5f-8725-5c9619a25204 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:14.090682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9694bae5-0e44-4e5f-8725-5c9619a25204 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042891 Aug 24 12:39:14.091211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 508/1022] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:14 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:14.187815 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9c171bcb-a522-4e02-9e0e-b12fa64cb607 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:14.189982 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9c171bcb-a522-4e02-9e0e-b12fa64cb607 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:14.196408 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9c171bcb-a522-4e02-9e0e-b12fa64cb607 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:14.196887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9c171bcb-a522-4e02-9e0e-b12fa64cb607 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:14.197319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9c171bcb-a522-4e02-9e0e-b12fa64cb607 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:14.198003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9c171bcb-a522-4e02-9e0e-b12fa64cb607 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:14.198516 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9c171bcb-a522-4e02-9e0e-b12fa64cb607 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:14.198933 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9c171bcb-a522-4e02-9e0e-b12fa64cb607 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:14.228215 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9c171bcb-a522-4e02-9e0e-b12fa64cb607 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044385 Aug 24 12:39:14.228762 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 515/1023] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:14 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:14.748725 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fa00522d-4a2a-4781-b03e-b8c1af658212 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:14.750869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fa00522d-4a2a-4781-b03e-b8c1af658212 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:14.757176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa00522d-4a2a-4781-b03e-b8c1af658212 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:14.757657 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa00522d-4a2a-4781-b03e-b8c1af658212 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:14.758090 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa00522d-4a2a-4781-b03e-b8c1af658212 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:14.758900 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa00522d-4a2a-4781-b03e-b8c1af658212 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:14.759241 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa00522d-4a2a-4781-b03e-b8c1af658212 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:14.759674 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa00522d-4a2a-4781-b03e-b8c1af658212 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:14.789066 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fa00522d-4a2a-4781-b03e-b8c1af658212 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044101 Aug 24 12:39:14.789403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 509/1024] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:14 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:15.102773 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0daa659a-cc1d-4494-8391-526f77fee0d5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:15.105060 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0daa659a-cc1d-4494-8391-526f77fee0d5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:15.111587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0daa659a-cc1d-4494-8391-526f77fee0d5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:15.112066 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0daa659a-cc1d-4494-8391-526f77fee0d5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:15.112497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0daa659a-cc1d-4494-8391-526f77fee0d5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:15.113178 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0daa659a-cc1d-4494-8391-526f77fee0d5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:15.113626 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0daa659a-cc1d-4494-8391-526f77fee0d5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:15.114566 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0daa659a-cc1d-4494-8391-526f77fee0d5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:15.142566 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0daa659a-cc1d-4494-8391-526f77fee0d5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043792 Aug 24 12:39:15.143139 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 516/1025] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:15 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:15.240941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0cb71db0-4524-40c4-b5f8-e43fb309c4fd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:15.243126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0cb71db0-4524-40c4-b5f8-e43fb309c4fd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:15.248942 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0cb71db0-4524-40c4-b5f8-e43fb309c4fd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:15.249424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0cb71db0-4524-40c4-b5f8-e43fb309c4fd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:15.249863 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0cb71db0-4524-40c4-b5f8-e43fb309c4fd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:15.250547 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0cb71db0-4524-40c4-b5f8-e43fb309c4fd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:15.251024 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0cb71db0-4524-40c4-b5f8-e43fb309c4fd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:15.251449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0cb71db0-4524-40c4-b5f8-e43fb309c4fd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:15.279509 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0cb71db0-4524-40c4-b5f8-e43fb309c4fd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043101 Aug 24 12:39:15.280044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 510/1026] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:15 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:15.800754 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fc832c99-8a29-4717-85c0-38af80d84c39 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:15.803079 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fc832c99-8a29-4717-85c0-38af80d84c39 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:15.809106 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc832c99-8a29-4717-85c0-38af80d84c39 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:15.809598 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc832c99-8a29-4717-85c0-38af80d84c39 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:15.810009 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc832c99-8a29-4717-85c0-38af80d84c39 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:15.810732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc832c99-8a29-4717-85c0-38af80d84c39 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:15.811184 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc832c99-8a29-4717-85c0-38af80d84c39 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:15.811610 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc832c99-8a29-4717-85c0-38af80d84c39 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:15.841371 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fc832c99-8a29-4717-85c0-38af80d84c39 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044496 Aug 24 12:39:15.841926 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 517/1027] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:15 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:16.154878 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d82dd50f-ef96-430e-99ef-594e763d10c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:16.156981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d82dd50f-ef96-430e-99ef-594e763d10c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:16.163341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d82dd50f-ef96-430e-99ef-594e763d10c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:16.163827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d82dd50f-ef96-430e-99ef-594e763d10c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:16.164265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d82dd50f-ef96-430e-99ef-594e763d10c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:16.164949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d82dd50f-ef96-430e-99ef-594e763d10c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:16.165406 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d82dd50f-ef96-430e-99ef-594e763d10c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:16.165829 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d82dd50f-ef96-430e-99ef-594e763d10c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:16.193716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d82dd50f-ef96-430e-99ef-594e763d10c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042914 Aug 24 12:39:16.194245 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 511/1028] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:16 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:16.291986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f03703f0-4598-4799-9cd5-d091cd599297 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:16.294083 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f03703f0-4598-4799-9cd5-d091cd599297 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:16.299918 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f03703f0-4598-4799-9cd5-d091cd599297 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:16.300390 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f03703f0-4598-4799-9cd5-d091cd599297 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:16.300819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f03703f0-4598-4799-9cd5-d091cd599297 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:16.301489 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f03703f0-4598-4799-9cd5-d091cd599297 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:16.301932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f03703f0-4598-4799-9cd5-d091cd599297 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:16.302345 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f03703f0-4598-4799-9cd5-d091cd599297 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:16.330956 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f03703f0-4598-4799-9cd5-d091cd599297 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042866 Aug 24 12:39:16.331486 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 518/1029] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:16 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:16.854031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-612bc562-daaf-4a11-8393-3b1801f39c05 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:16.856227 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-612bc562-daaf-4a11-8393-3b1801f39c05 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:16.862072 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-612bc562-daaf-4a11-8393-3b1801f39c05 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:16.862573 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-612bc562-daaf-4a11-8393-3b1801f39c05 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:16.863052 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-612bc562-daaf-4a11-8393-3b1801f39c05 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:16.863840 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-612bc562-daaf-4a11-8393-3b1801f39c05 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:16.865139 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-612bc562-daaf-4a11-8393-3b1801f39c05 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:16.865568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-612bc562-daaf-4a11-8393-3b1801f39c05 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:16.894895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-612bc562-daaf-4a11-8393-3b1801f39c05 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044916 Aug 24 12:39:16.895641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 512/1030] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:16 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:17.205463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-81666ee3-2bfe-4cf7-911d-51120b8eeebf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:17.207595 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-81666ee3-2bfe-4cf7-911d-51120b8eeebf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:17.214465 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81666ee3-2bfe-4cf7-911d-51120b8eeebf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:17.214984 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81666ee3-2bfe-4cf7-911d-51120b8eeebf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:17.215417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81666ee3-2bfe-4cf7-911d-51120b8eeebf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:17.216091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81666ee3-2bfe-4cf7-911d-51120b8eeebf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:17.216541 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81666ee3-2bfe-4cf7-911d-51120b8eeebf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:17.216969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81666ee3-2bfe-4cf7-911d-51120b8eeebf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:17.220514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:17.245540 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-81666ee3-2bfe-4cf7-911d-51120b8eeebf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044069 Aug 24 12:39:17.246082 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 519/1031] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:17 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:17.343877 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-71f26bd4-6c6d-4334-b9e8-c188c985d279 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:17.346021 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-71f26bd4-6c6d-4334-b9e8-c188c985d279 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:17.353009 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-71f26bd4-6c6d-4334-b9e8-c188c985d279 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:17.353494 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-71f26bd4-6c6d-4334-b9e8-c188c985d279 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:17.353930 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-71f26bd4-6c6d-4334-b9e8-c188c985d279 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:17.354618 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-71f26bd4-6c6d-4334-b9e8-c188c985d279 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:17.355101 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-71f26bd4-6c6d-4334-b9e8-c188c985d279 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:17.355528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-71f26bd4-6c6d-4334-b9e8-c188c985d279 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:17.383580 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-71f26bd4-6c6d-4334-b9e8-c188c985d279 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043759 Aug 24 12:39:17.384119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 513/1032] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:17 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:39:17.907563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a4a73df0-28ea-4d8e-81aa-223c36cf7a4a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:17.909752 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a4a73df0-28ea-4d8e-81aa-223c36cf7a4a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:17.915854 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a4a73df0-28ea-4d8e-81aa-223c36cf7a4a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:17.916331 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a4a73df0-28ea-4d8e-81aa-223c36cf7a4a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:17.916763 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a4a73df0-28ea-4d8e-81aa-223c36cf7a4a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:17.917446 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a4a73df0-28ea-4d8e-81aa-223c36cf7a4a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:17.917895 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a4a73df0-28ea-4d8e-81aa-223c36cf7a4a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:17.918315 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a4a73df0-28ea-4d8e-81aa-223c36cf7a4a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:17.948371 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a4a73df0-28ea-4d8e-81aa-223c36cf7a4a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044334 Aug 24 12:39:17.949841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 520/1033] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:17 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:18.258577 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b7e25517-5203-4f27-9d7b-fe73cd0af4ae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:18.260787 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b7e25517-5203-4f27-9d7b-fe73cd0af4ae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:18.266842 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7e25517-5203-4f27-9d7b-fe73cd0af4ae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:18.267328 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7e25517-5203-4f27-9d7b-fe73cd0af4ae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:18.267768 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7e25517-5203-4f27-9d7b-fe73cd0af4ae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:18.268455 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7e25517-5203-4f27-9d7b-fe73cd0af4ae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:18.268916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7e25517-5203-4f27-9d7b-fe73cd0af4ae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:18.269376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7e25517-5203-4f27-9d7b-fe73cd0af4ae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:18.296860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b7e25517-5203-4f27-9d7b-fe73cd0af4ae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042896 Aug 24 12:39:18.297395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 514/1034] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:18 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:18.395747 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e3e02768-990b-4ebc-93a2-b24af24d157d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:18.397856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e3e02768-990b-4ebc-93a2-b24af24d157d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:18.404133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e3e02768-990b-4ebc-93a2-b24af24d157d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:18.404603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e3e02768-990b-4ebc-93a2-b24af24d157d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:18.405027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e3e02768-990b-4ebc-93a2-b24af24d157d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:18.405701 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e3e02768-990b-4ebc-93a2-b24af24d157d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:18.406145 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e3e02768-990b-4ebc-93a2-b24af24d157d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:18.406563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e3e02768-990b-4ebc-93a2-b24af24d157d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:18.436146 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e3e02768-990b-4ebc-93a2-b24af24d157d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044301 Aug 24 12:39:18.436699 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 521/1035] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:18 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:18.961722 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ea2fca76-6a4c-42c7-95cd-a505323b415d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:18.963928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ea2fca76-6a4c-42c7-95cd-a505323b415d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:18.970468 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea2fca76-6a4c-42c7-95cd-a505323b415d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:18.970990 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea2fca76-6a4c-42c7-95cd-a505323b415d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:18.971436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea2fca76-6a4c-42c7-95cd-a505323b415d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:18.972136 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea2fca76-6a4c-42c7-95cd-a505323b415d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:18.972591 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea2fca76-6a4c-42c7-95cd-a505323b415d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:18.973021 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea2fca76-6a4c-42c7-95cd-a505323b415d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:19.007136 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ea2fca76-6a4c-42c7-95cd-a505323b415d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045718 Aug 24 12:39:19.007136 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 515/1036] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:18 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:19.309080 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cb697a90-c460-407f-96bd-1277ea400492 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:19.311236 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cb697a90-c460-407f-96bd-1277ea400492 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:19.317571 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cb697a90-c460-407f-96bd-1277ea400492 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:19.318049 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cb697a90-c460-407f-96bd-1277ea400492 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:19.318578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cb697a90-c460-407f-96bd-1277ea400492 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:19.319177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cb697a90-c460-407f-96bd-1277ea400492 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:19.319621 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cb697a90-c460-407f-96bd-1277ea400492 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:19.320038 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cb697a90-c460-407f-96bd-1277ea400492 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:19.348369 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cb697a90-c460-407f-96bd-1277ea400492 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043202 Aug 24 12:39:19.349204 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 522/1037] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:19 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:19.448951 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ef916236-7162-438a-9748-ceb3f8804843 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:19.451103 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ef916236-7162-438a-9748-ceb3f8804843 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:19.456956 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef916236-7162-438a-9748-ceb3f8804843 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:19.457426 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef916236-7162-438a-9748-ceb3f8804843 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:19.458478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef916236-7162-438a-9748-ceb3f8804843 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:19.459184 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef916236-7162-438a-9748-ceb3f8804843 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:19.459633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef916236-7162-438a-9748-ceb3f8804843 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:19.460050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef916236-7162-438a-9748-ceb3f8804843 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:19.473455 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:19.488244 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ef916236-7162-438a-9748-ceb3f8804843 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043296 Aug 24 12:39:19.488771 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 516/1038] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:19 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:39:20.014744 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f8377f3b-82b0-4f03-945c-14e91ad2d914 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:20.016883 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f8377f3b-82b0-4f03-945c-14e91ad2d914 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:20.024998 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f8377f3b-82b0-4f03-945c-14e91ad2d914 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:20.025480 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f8377f3b-82b0-4f03-945c-14e91ad2d914 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:20.025910 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f8377f3b-82b0-4f03-945c-14e91ad2d914 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:20.026601 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f8377f3b-82b0-4f03-945c-14e91ad2d914 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:20.027081 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f8377f3b-82b0-4f03-945c-14e91ad2d914 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:20.027496 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f8377f3b-82b0-4f03-945c-14e91ad2d914 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:20.060614 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f8377f3b-82b0-4f03-945c-14e91ad2d914 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049734 Aug 24 12:39:20.061297 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 523/1039] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:20 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:20.360704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a7c0046a-c53b-48d4-bfbb-9472611cce90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:20.362849 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a7c0046a-c53b-48d4-bfbb-9472611cce90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:20.369876 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7c0046a-c53b-48d4-bfbb-9472611cce90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:20.370353 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7c0046a-c53b-48d4-bfbb-9472611cce90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:20.370824 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7c0046a-c53b-48d4-bfbb-9472611cce90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:20.371501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7c0046a-c53b-48d4-bfbb-9472611cce90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:20.371954 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7c0046a-c53b-48d4-bfbb-9472611cce90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:20.372376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7c0046a-c53b-48d4-bfbb-9472611cce90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:20.400014 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a7c0046a-c53b-48d4-bfbb-9472611cce90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043366 Aug 24 12:39:20.400538 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 517/1040] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:20 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:20.501057 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-771f12cd-5909-4142-82d4-7ae0add70abc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:20.503168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-771f12cd-5909-4142-82d4-7ae0add70abc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:20.508960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-771f12cd-5909-4142-82d4-7ae0add70abc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:20.509432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-771f12cd-5909-4142-82d4-7ae0add70abc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:20.509859 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-771f12cd-5909-4142-82d4-7ae0add70abc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:20.510531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-771f12cd-5909-4142-82d4-7ae0add70abc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:20.511006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-771f12cd-5909-4142-82d4-7ae0add70abc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:20.511422 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-771f12cd-5909-4142-82d4-7ae0add70abc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:20.540260 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-771f12cd-5909-4142-82d4-7ae0add70abc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043138 Aug 24 12:39:20.540800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 524/1041] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:20 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:21.073604 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9be176a0-8615-49b0-84be-0f9f88d491bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:21.075794 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9be176a0-8615-49b0-84be-0f9f88d491bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:21.081779 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9be176a0-8615-49b0-84be-0f9f88d491bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:21.082272 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9be176a0-8615-49b0-84be-0f9f88d491bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:21.082748 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9be176a0-8615-49b0-84be-0f9f88d491bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:21.083450 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9be176a0-8615-49b0-84be-0f9f88d491bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:21.083916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9be176a0-8615-49b0-84be-0f9f88d491bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:21.084366 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9be176a0-8615-49b0-84be-0f9f88d491bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:21.119109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9be176a0-8615-49b0-84be-0f9f88d491bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043885 Aug 24 12:39:21.119109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 518/1042] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:21 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:21.412230 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f0d33f17-cece-4150-9dac-dfb9c6fd05d5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:21.414260 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f0d33f17-cece-4150-9dac-dfb9c6fd05d5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:21.420634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0d33f17-cece-4150-9dac-dfb9c6fd05d5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:21.421110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0d33f17-cece-4150-9dac-dfb9c6fd05d5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:21.421549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0d33f17-cece-4150-9dac-dfb9c6fd05d5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:21.422234 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0d33f17-cece-4150-9dac-dfb9c6fd05d5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:21.422703 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0d33f17-cece-4150-9dac-dfb9c6fd05d5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:21.423124 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0d33f17-cece-4150-9dac-dfb9c6fd05d5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:21.452180 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f0d33f17-cece-4150-9dac-dfb9c6fd05d5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044474 Aug 24 12:39:21.452724 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 525/1043] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:21 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:21.552238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9be23c84-cafc-4cc4-b6d9-02f2273bce6b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:21.554400 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9be23c84-cafc-4cc4-b6d9-02f2273bce6b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:21.560686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9be23c84-cafc-4cc4-b6d9-02f2273bce6b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:21.561170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9be23c84-cafc-4cc4-b6d9-02f2273bce6b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:21.564165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9be23c84-cafc-4cc4-b6d9-02f2273bce6b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:21.564165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9be23c84-cafc-4cc4-b6d9-02f2273bce6b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:21.564165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9be23c84-cafc-4cc4-b6d9-02f2273bce6b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:21.564165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9be23c84-cafc-4cc4-b6d9-02f2273bce6b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:21.591860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9be23c84-cafc-4cc4-b6d9-02f2273bce6b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044221 Aug 24 12:39:21.592395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 519/1044] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:21 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:22.125460 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5ec07dbe-bc10-436b-a485-c5357b039bd2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:22.127627 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5ec07dbe-bc10-436b-a485-c5357b039bd2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:22.133793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ec07dbe-bc10-436b-a485-c5357b039bd2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:22.134271 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ec07dbe-bc10-436b-a485-c5357b039bd2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:22.134723 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ec07dbe-bc10-436b-a485-c5357b039bd2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:22.135434 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ec07dbe-bc10-436b-a485-c5357b039bd2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:22.135883 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ec07dbe-bc10-436b-a485-c5357b039bd2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:22.136326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ec07dbe-bc10-436b-a485-c5357b039bd2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:22.165762 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5ec07dbe-bc10-436b-a485-c5357b039bd2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044203 Aug 24 12:39:22.166468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 526/1045] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:22 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:22.464595 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-31185a49-7fb4-4784-9f30-d8f31b4e4ab8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:22.466818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-31185a49-7fb4-4784-9f30-d8f31b4e4ab8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:22.472698 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31185a49-7fb4-4784-9f30-d8f31b4e4ab8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:22.473863 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31185a49-7fb4-4784-9f30-d8f31b4e4ab8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:22.474311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31185a49-7fb4-4784-9f30-d8f31b4e4ab8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:22.475019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31185a49-7fb4-4784-9f30-d8f31b4e4ab8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:22.475473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31185a49-7fb4-4784-9f30-d8f31b4e4ab8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:22.483796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31185a49-7fb4-4784-9f30-d8f31b4e4ab8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:22.503970 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-31185a49-7fb4-4784-9f30-d8f31b4e4ab8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043361 Aug 24 12:39:22.504499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 520/1046] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:22 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:22.604103 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-22a9e38f-fd74-4244-859c-646892b008ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:22.606198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-22a9e38f-fd74-4244-859c-646892b008ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:22.612672 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22a9e38f-fd74-4244-859c-646892b008ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:22.613149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22a9e38f-fd74-4244-859c-646892b008ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:22.613581 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22a9e38f-fd74-4244-859c-646892b008ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:22.614532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22a9e38f-fd74-4244-859c-646892b008ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:22.615014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22a9e38f-fd74-4244-859c-646892b008ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:22.615435 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22a9e38f-fd74-4244-859c-646892b008ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:22.643153 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-22a9e38f-fd74-4244-859c-646892b008ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043049 Aug 24 12:39:22.643695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 527/1047] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:22 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:23.178556 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4e72c24d-6268-4a2b-918d-febd71450ded tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:23.180194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4e72c24d-6268-4a2b-918d-febd71450ded tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:23.186600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e72c24d-6268-4a2b-918d-febd71450ded tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:23.187115 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e72c24d-6268-4a2b-918d-febd71450ded tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:23.188940 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e72c24d-6268-4a2b-918d-febd71450ded tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:23.188940 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e72c24d-6268-4a2b-918d-febd71450ded tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:23.188940 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e72c24d-6268-4a2b-918d-febd71450ded tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:23.189237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e72c24d-6268-4a2b-918d-febd71450ded tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:23.219062 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4e72c24d-6268-4a2b-918d-febd71450ded tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044912 Aug 24 12:39:23.223641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 521/1048] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:23 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:23.516374 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-031ceb63-2762-4393-9ba0-7943fa6354e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:23.518481 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-031ceb63-2762-4393-9ba0-7943fa6354e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:23.524378 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-031ceb63-2762-4393-9ba0-7943fa6354e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:23.524853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-031ceb63-2762-4393-9ba0-7943fa6354e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:23.525286 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-031ceb63-2762-4393-9ba0-7943fa6354e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:23.525955 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-031ceb63-2762-4393-9ba0-7943fa6354e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:23.526400 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-031ceb63-2762-4393-9ba0-7943fa6354e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:23.526880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-031ceb63-2762-4393-9ba0-7943fa6354e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:23.555669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-031ceb63-2762-4393-9ba0-7943fa6354e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043216 Aug 24 12:39:23.556217 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 528/1049] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:23 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:23.655950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2f6ad114-003a-45d9-bedf-28db16c8ceb9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:23.659168 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2f6ad114-003a-45d9-bedf-28db16c8ceb9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:23.664441 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f6ad114-003a-45d9-bedf-28db16c8ceb9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:23.664920 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f6ad114-003a-45d9-bedf-28db16c8ceb9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:23.665354 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f6ad114-003a-45d9-bedf-28db16c8ceb9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:23.666038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f6ad114-003a-45d9-bedf-28db16c8ceb9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:23.666490 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f6ad114-003a-45d9-bedf-28db16c8ceb9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:23.666941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f6ad114-003a-45d9-bedf-28db16c8ceb9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:23.695392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2f6ad114-003a-45d9-bedf-28db16c8ceb9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043393 Aug 24 12:39:23.696021 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 522/1050] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:23 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:24.231813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-353a6d40-2ed5-4644-b794-0f7527bcd957 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:24.234417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-353a6d40-2ed5-4644-b794-0f7527bcd957 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:24.240816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-353a6d40-2ed5-4644-b794-0f7527bcd957 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:24.241302 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-353a6d40-2ed5-4644-b794-0f7527bcd957 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:24.241735 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-353a6d40-2ed5-4644-b794-0f7527bcd957 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:24.242423 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-353a6d40-2ed5-4644-b794-0f7527bcd957 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:24.242907 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-353a6d40-2ed5-4644-b794-0f7527bcd957 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:24.243328 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-353a6d40-2ed5-4644-b794-0f7527bcd957 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:24.273594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-353a6d40-2ed5-4644-b794-0f7527bcd957 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045709 Aug 24 12:39:24.274365 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 529/1051] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:24 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:24.567345 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7e393b3f-6e3d-4af7-9a98-e6f33ac3ffb8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:24.569963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7e393b3f-6e3d-4af7-9a98-e6f33ac3ffb8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:24.576222 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e393b3f-6e3d-4af7-9a98-e6f33ac3ffb8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:24.576695 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e393b3f-6e3d-4af7-9a98-e6f33ac3ffb8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:24.577121 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e393b3f-6e3d-4af7-9a98-e6f33ac3ffb8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:24.577797 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e393b3f-6e3d-4af7-9a98-e6f33ac3ffb8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:24.578245 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e393b3f-6e3d-4af7-9a98-e6f33ac3ffb8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:24.578683 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e393b3f-6e3d-4af7-9a98-e6f33ac3ffb8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:24.606694 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7e393b3f-6e3d-4af7-9a98-e6f33ac3ffb8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043327 Aug 24 12:39:24.607230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 523/1052] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:24 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:24.707998 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e678e270-c1c9-47ec-9f9a-3a2948bb1796 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:24.710182 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e678e270-c1c9-47ec-9f9a-3a2948bb1796 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:24.716086 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e678e270-c1c9-47ec-9f9a-3a2948bb1796 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:24.716570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e678e270-c1c9-47ec-9f9a-3a2948bb1796 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:24.717004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e678e270-c1c9-47ec-9f9a-3a2948bb1796 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:24.717688 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e678e270-c1c9-47ec-9f9a-3a2948bb1796 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:24.718139 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e678e270-c1c9-47ec-9f9a-3a2948bb1796 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:24.718563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e678e270-c1c9-47ec-9f9a-3a2948bb1796 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:24.747785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e678e270-c1c9-47ec-9f9a-3a2948bb1796 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043897 Aug 24 12:39:24.748324 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 530/1053] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:24 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:25.289173 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ee2b4ec0-97bf-4b5a-a108-075eed0e6c69 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:25.291322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ee2b4ec0-97bf-4b5a-a108-075eed0e6c69 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:25.297249 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee2b4ec0-97bf-4b5a-a108-075eed0e6c69 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:25.298909 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee2b4ec0-97bf-4b5a-a108-075eed0e6c69 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:25.298909 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee2b4ec0-97bf-4b5a-a108-075eed0e6c69 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:25.298909 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee2b4ec0-97bf-4b5a-a108-075eed0e6c69 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:25.299298 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee2b4ec0-97bf-4b5a-a108-075eed0e6c69 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:25.299724 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee2b4ec0-97bf-4b5a-a108-075eed0e6c69 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:25.329765 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ee2b4ec0-97bf-4b5a-a108-075eed0e6c69 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044506 Aug 24 12:39:25.330356 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 524/1054] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:25 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:25.620054 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6db4a7c5-caf7-45c0-8b9d-401b0e60dac0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:25.622157 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6db4a7c5-caf7-45c0-8b9d-401b0e60dac0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:25.628682 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6db4a7c5-caf7-45c0-8b9d-401b0e60dac0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:25.629160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6db4a7c5-caf7-45c0-8b9d-401b0e60dac0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:25.629593 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6db4a7c5-caf7-45c0-8b9d-401b0e60dac0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:25.630279 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6db4a7c5-caf7-45c0-8b9d-401b0e60dac0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:25.631417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6db4a7c5-caf7-45c0-8b9d-401b0e60dac0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:25.631843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6db4a7c5-caf7-45c0-8b9d-401b0e60dac0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:25.659498 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6db4a7c5-caf7-45c0-8b9d-401b0e60dac0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043594 Aug 24 12:39:25.660043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 531/1055] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:25 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:25.760659 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5b91d0e3-757a-434b-9558-2b03b88d9318 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:25.762897 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5b91d0e3-757a-434b-9558-2b03b88d9318 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:25.769192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b91d0e3-757a-434b-9558-2b03b88d9318 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:25.769677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b91d0e3-757a-434b-9558-2b03b88d9318 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:25.770120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b91d0e3-757a-434b-9558-2b03b88d9318 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:25.770839 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b91d0e3-757a-434b-9558-2b03b88d9318 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:25.771299 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b91d0e3-757a-434b-9558-2b03b88d9318 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:25.771727 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b91d0e3-757a-434b-9558-2b03b88d9318 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:25.799806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5b91d0e3-757a-434b-9558-2b03b88d9318 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043819 Aug 24 12:39:25.800351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 525/1056] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:25 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:26.341922 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c7b0f597-e825-47dc-98a7-21177464a48c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:26.344091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c7b0f597-e825-47dc-98a7-21177464a48c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:26.350618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7b0f597-e825-47dc-98a7-21177464a48c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:26.351113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7b0f597-e825-47dc-98a7-21177464a48c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:26.351542 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7b0f597-e825-47dc-98a7-21177464a48c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:26.352227 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7b0f597-e825-47dc-98a7-21177464a48c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:26.352672 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7b0f597-e825-47dc-98a7-21177464a48c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:26.353087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7b0f597-e825-47dc-98a7-21177464a48c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:26.382697 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c7b0f597-e825-47dc-98a7-21177464a48c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044624 Aug 24 12:39:26.383493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 532/1057] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:26 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:26.671846 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d48675ec-d7b3-40d9-90df-541c7fbac4e4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:26.673948 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d48675ec-d7b3-40d9-90df-541c7fbac4e4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:26.679853 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d48675ec-d7b3-40d9-90df-541c7fbac4e4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:26.680339 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d48675ec-d7b3-40d9-90df-541c7fbac4e4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:26.680775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d48675ec-d7b3-40d9-90df-541c7fbac4e4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:26.681467 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d48675ec-d7b3-40d9-90df-541c7fbac4e4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:26.681927 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d48675ec-d7b3-40d9-90df-541c7fbac4e4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:26.682358 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d48675ec-d7b3-40d9-90df-541c7fbac4e4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:26.712925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d48675ec-d7b3-40d9-90df-541c7fbac4e4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045034 Aug 24 12:39:26.713474 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 526/1058] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:26 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:39:26.812676 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6f98f156-fe8e-419c-8d1a-4715a00b7d9b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:26.814845 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6f98f156-fe8e-419c-8d1a-4715a00b7d9b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:26.821646 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6f98f156-fe8e-419c-8d1a-4715a00b7d9b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:26.822126 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6f98f156-fe8e-419c-8d1a-4715a00b7d9b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:26.822563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6f98f156-fe8e-419c-8d1a-4715a00b7d9b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:26.823274 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6f98f156-fe8e-419c-8d1a-4715a00b7d9b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:26.823731 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6f98f156-fe8e-419c-8d1a-4715a00b7d9b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:26.824157 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6f98f156-fe8e-419c-8d1a-4715a00b7d9b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:26.852722 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6f98f156-fe8e-419c-8d1a-4715a00b7d9b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044035 Aug 24 12:39:26.853256 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 533/1059] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:26 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:27.394896 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9a3536ff-7176-4eb2-a0d2-bac39e635953 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:27.397088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9a3536ff-7176-4eb2-a0d2-bac39e635953 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:27.403464 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a3536ff-7176-4eb2-a0d2-bac39e635953 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:27.403954 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a3536ff-7176-4eb2-a0d2-bac39e635953 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:27.404401 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a3536ff-7176-4eb2-a0d2-bac39e635953 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:27.405204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a3536ff-7176-4eb2-a0d2-bac39e635953 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:27.405530 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a3536ff-7176-4eb2-a0d2-bac39e635953 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:27.405956 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a3536ff-7176-4eb2-a0d2-bac39e635953 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:27.436244 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9a3536ff-7176-4eb2-a0d2-bac39e635953 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045294 Aug 24 12:39:27.436800 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 527/1060] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:27 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:27.726218 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-51ce64c9-38ed-4bff-a17f-de342d4d0387 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:27.728262 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-51ce64c9-38ed-4bff-a17f-de342d4d0387 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:27.730061 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=86 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:27.734600 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51ce64c9-38ed-4bff-a17f-de342d4d0387 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:27.735174 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51ce64c9-38ed-4bff-a17f-de342d4d0387 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:27.735600 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51ce64c9-38ed-4bff-a17f-de342d4d0387 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:27.736272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51ce64c9-38ed-4bff-a17f-de342d4d0387 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:27.736743 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51ce64c9-38ed-4bff-a17f-de342d4d0387 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:27.737159 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51ce64c9-38ed-4bff-a17f-de342d4d0387 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:27.765763 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-51ce64c9-38ed-4bff-a17f-de342d4d0387 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044456 Aug 24 12:39:27.766304 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 534/1061] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:27 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:27.865082 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-94bae1f7-2833-4a8b-a847-44c674a60cd2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:27.867273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-94bae1f7-2833-4a8b-a847-44c674a60cd2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:27.869069 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=88 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:27.873625 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94bae1f7-2833-4a8b-a847-44c674a60cd2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:27.874105 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94bae1f7-2833-4a8b-a847-44c674a60cd2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:27.874550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94bae1f7-2833-4a8b-a847-44c674a60cd2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:27.875329 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94bae1f7-2833-4a8b-a847-44c674a60cd2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:27.875783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94bae1f7-2833-4a8b-a847-44c674a60cd2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:27.876207 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94bae1f7-2833-4a8b-a847-44c674a60cd2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:27.905396 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-94bae1f7-2833-4a8b-a847-44c674a60cd2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044501 Aug 24 12:39:27.905930 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 528/1062] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:27 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:28.448457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-abca8924-f4f8-4d50-9021-b9348fb49cb6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:28.450597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-abca8924-f4f8-4d50-9021-b9348fb49cb6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:28.457183 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-abca8924-f4f8-4d50-9021-b9348fb49cb6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:28.457657 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-abca8924-f4f8-4d50-9021-b9348fb49cb6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:28.458084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-abca8924-f4f8-4d50-9021-b9348fb49cb6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:28.459322 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-abca8924-f4f8-4d50-9021-b9348fb49cb6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:28.459768 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-abca8924-f4f8-4d50-9021-b9348fb49cb6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:28.460187 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-abca8924-f4f8-4d50-9021-b9348fb49cb6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:28.485078 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:28.489901 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-abca8924-f4f8-4d50-9021-b9348fb49cb6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045394 Aug 24 12:39:28.490534 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 535/1063] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:28 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:28.777950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ee5175cb-f05e-4794-9746-df677062116e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:28.780133 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ee5175cb-f05e-4794-9746-df677062116e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:28.786555 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee5175cb-f05e-4794-9746-df677062116e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:28.787634 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee5175cb-f05e-4794-9746-df677062116e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:28.788067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee5175cb-f05e-4794-9746-df677062116e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:28.788779 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee5175cb-f05e-4794-9746-df677062116e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:28.789232 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee5175cb-f05e-4794-9746-df677062116e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:28.789656 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee5175cb-f05e-4794-9746-df677062116e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:28.817144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ee5175cb-f05e-4794-9746-df677062116e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043172 Aug 24 12:39:28.817674 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 529/1064] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:28 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:28.917631 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cd597b4a-ff73-4b73-9311-7a07003b32e5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:28.919995 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cd597b4a-ff73-4b73-9311-7a07003b32e5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:28.926194 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd597b4a-ff73-4b73-9311-7a07003b32e5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:28.926678 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd597b4a-ff73-4b73-9311-7a07003b32e5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:28.927115 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd597b4a-ff73-4b73-9311-7a07003b32e5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:28.927816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd597b4a-ff73-4b73-9311-7a07003b32e5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:28.928255 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd597b4a-ff73-4b73-9311-7a07003b32e5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:28.928669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd597b4a-ff73-4b73-9311-7a07003b32e5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:28.957162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cd597b4a-ff73-4b73-9311-7a07003b32e5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043482 Aug 24 12:39:28.957693 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 536/1065] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:28 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:29.502001 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e28fe2e7-ec3a-4dfd-a1c6-296a85f7b536 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:29.504142 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e28fe2e7-ec3a-4dfd-a1c6-296a85f7b536 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:29.510027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e28fe2e7-ec3a-4dfd-a1c6-296a85f7b536 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:29.510508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e28fe2e7-ec3a-4dfd-a1c6-296a85f7b536 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:29.510988 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e28fe2e7-ec3a-4dfd-a1c6-296a85f7b536 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:29.511677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e28fe2e7-ec3a-4dfd-a1c6-296a85f7b536 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:29.512131 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e28fe2e7-ec3a-4dfd-a1c6-296a85f7b536 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:29.512557 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e28fe2e7-ec3a-4dfd-a1c6-296a85f7b536 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:29.542369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e28fe2e7-ec3a-4dfd-a1c6-296a85f7b536 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044324 Aug 24 12:39:29.542960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 530/1066] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:29 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:29.829254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-75e98d96-751e-4a0d-88fa-d7105ae3367f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:29.831401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-75e98d96-751e-4a0d-88fa-d7105ae3367f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:29.838386 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-75e98d96-751e-4a0d-88fa-d7105ae3367f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:29.838902 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-75e98d96-751e-4a0d-88fa-d7105ae3367f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:29.839336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-75e98d96-751e-4a0d-88fa-d7105ae3367f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:29.840014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-75e98d96-751e-4a0d-88fa-d7105ae3367f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:29.840459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-75e98d96-751e-4a0d-88fa-d7105ae3367f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:29.840880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-75e98d96-751e-4a0d-88fa-d7105ae3367f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:29.868575 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-75e98d96-751e-4a0d-88fa-d7105ae3367f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043342 Aug 24 12:39:29.869136 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 537/1067] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:29 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:29.970113 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fa64b36c-073f-4793-a92f-b840eae7b69f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:29.972315 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fa64b36c-073f-4793-a92f-b840eae7b69f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:29.978568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa64b36c-073f-4793-a92f-b840eae7b69f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:29.979077 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa64b36c-073f-4793-a92f-b840eae7b69f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:29.979509 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa64b36c-073f-4793-a92f-b840eae7b69f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:29.980190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa64b36c-073f-4793-a92f-b840eae7b69f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:29.980640 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa64b36c-073f-4793-a92f-b840eae7b69f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:29.981059 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa64b36c-073f-4793-a92f-b840eae7b69f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:30.011337 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fa64b36c-073f-4793-a92f-b840eae7b69f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045135 Aug 24 12:39:30.011802 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 531/1068] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:29 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:30.553666 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2b233235-4e64-4bd6-adfe-4601a50a3298 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:30.555800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2b233235-4e64-4bd6-adfe-4601a50a3298 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:30.561749 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b233235-4e64-4bd6-adfe-4601a50a3298 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:30.562222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b233235-4e64-4bd6-adfe-4601a50a3298 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:30.562666 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b233235-4e64-4bd6-adfe-4601a50a3298 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:30.563358 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b233235-4e64-4bd6-adfe-4601a50a3298 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:30.563807 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b233235-4e64-4bd6-adfe-4601a50a3298 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:30.564229 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b233235-4e64-4bd6-adfe-4601a50a3298 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:30.593808 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2b233235-4e64-4bd6-adfe-4601a50a3298 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044054 Aug 24 12:39:30.594366 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 538/1069] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:30 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:30.880729 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-cca124a8-32c2-4d24-8847-fc21f49d9816 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:30.882897 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-cca124a8-32c2-4d24-8847-fc21f49d9816 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:30.888819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cca124a8-32c2-4d24-8847-fc21f49d9816 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:30.889299 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cca124a8-32c2-4d24-8847-fc21f49d9816 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:30.889737 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cca124a8-32c2-4d24-8847-fc21f49d9816 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:30.890419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cca124a8-32c2-4d24-8847-fc21f49d9816 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:30.890908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cca124a8-32c2-4d24-8847-fc21f49d9816 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:30.891336 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cca124a8-32c2-4d24-8847-fc21f49d9816 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:30.920152 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-cca124a8-32c2-4d24-8847-fc21f49d9816 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043389 Aug 24 12:39:30.920679 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 532/1070] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:30 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:31.023338 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e02e3313-854c-41c8-9949-3abb3c0f6191 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:31.025447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e02e3313-854c-41c8-9949-3abb3c0f6191 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:31.031716 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e02e3313-854c-41c8-9949-3abb3c0f6191 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:31.032191 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e02e3313-854c-41c8-9949-3abb3c0f6191 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:31.032625 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e02e3313-854c-41c8-9949-3abb3c0f6191 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:31.033299 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e02e3313-854c-41c8-9949-3abb3c0f6191 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:31.033745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e02e3313-854c-41c8-9949-3abb3c0f6191 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:31.034159 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e02e3313-854c-41c8-9949-3abb3c0f6191 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:31.062090 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e02e3313-854c-41c8-9949-3abb3c0f6191 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042720 Aug 24 12:39:31.062625 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 539/1071] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:31 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:31.605897 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1b6653e3-78a4-43bb-9838-7114bfc5eb9a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:31.608126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1b6653e3-78a4-43bb-9838-7114bfc5eb9a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:31.615021 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b6653e3-78a4-43bb-9838-7114bfc5eb9a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:31.615516 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b6653e3-78a4-43bb-9838-7114bfc5eb9a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:31.615957 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b6653e3-78a4-43bb-9838-7114bfc5eb9a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:31.616677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b6653e3-78a4-43bb-9838-7114bfc5eb9a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:31.617132 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b6653e3-78a4-43bb-9838-7114bfc5eb9a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:31.617557 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b6653e3-78a4-43bb-9838-7114bfc5eb9a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:31.620134 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:31.650609 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1b6653e3-78a4-43bb-9838-7114bfc5eb9a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048785 Aug 24 12:39:31.651194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 533/1072] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:31 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:31.932870 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1c1f9291-09a0-463c-b47c-e5401dd45c7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:31.934968 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1c1f9291-09a0-463c-b47c-e5401dd45c7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:31.940764 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c1f9291-09a0-463c-b47c-e5401dd45c7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:31.941237 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c1f9291-09a0-463c-b47c-e5401dd45c7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:31.941663 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c1f9291-09a0-463c-b47c-e5401dd45c7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:31.942333 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c1f9291-09a0-463c-b47c-e5401dd45c7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:31.942803 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c1f9291-09a0-463c-b47c-e5401dd45c7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:31.943218 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c1f9291-09a0-463c-b47c-e5401dd45c7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:31.970393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1c1f9291-09a0-463c-b47c-e5401dd45c7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041561 Aug 24 12:39:31.971023 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 540/1073] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:31 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:32.073574 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-31fa50d3-172d-4ffb-ace8-349e76a330e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:32.075780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-31fa50d3-172d-4ffb-ace8-349e76a330e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:32.081547 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31fa50d3-172d-4ffb-ace8-349e76a330e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:32.082030 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31fa50d3-172d-4ffb-ace8-349e76a330e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:32.082465 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31fa50d3-172d-4ffb-ace8-349e76a330e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:32.083187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31fa50d3-172d-4ffb-ace8-349e76a330e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:32.083644 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31fa50d3-172d-4ffb-ace8-349e76a330e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:32.084067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31fa50d3-172d-4ffb-ace8-349e76a330e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:32.112471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-31fa50d3-172d-4ffb-ace8-349e76a330e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043056 Aug 24 12:39:32.113011 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 534/1074] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:32 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:32.662518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-60ffc325-9c30-424e-b3a7-23a2621c3d2c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:32.664733 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-60ffc325-9c30-424e-b3a7-23a2621c3d2c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:32.671051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-60ffc325-9c30-424e-b3a7-23a2621c3d2c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:32.671532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-60ffc325-9c30-424e-b3a7-23a2621c3d2c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:32.671966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-60ffc325-9c30-424e-b3a7-23a2621c3d2c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:32.672648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-60ffc325-9c30-424e-b3a7-23a2621c3d2c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:32.673097 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-60ffc325-9c30-424e-b3a7-23a2621c3d2c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:32.673521 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-60ffc325-9c30-424e-b3a7-23a2621c3d2c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:32.704267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-60ffc325-9c30-424e-b3a7-23a2621c3d2c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045634 Aug 24 12:39:32.704831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 541/1075] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:32 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:32.983149 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6d3021a5-66f0-4964-8e7b-2d6570227dce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:32.985294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6d3021a5-66f0-4964-8e7b-2d6570227dce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:32.992381 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d3021a5-66f0-4964-8e7b-2d6570227dce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:32.992856 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d3021a5-66f0-4964-8e7b-2d6570227dce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:32.993285 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d3021a5-66f0-4964-8e7b-2d6570227dce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:32.993963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d3021a5-66f0-4964-8e7b-2d6570227dce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:32.994412 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d3021a5-66f0-4964-8e7b-2d6570227dce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:32.994869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d3021a5-66f0-4964-8e7b-2d6570227dce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:33.022942 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6d3021a5-66f0-4964-8e7b-2d6570227dce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043746 Aug 24 12:39:33.023481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 535/1076] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:32 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:33.125869 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d93f33e7-f14a-4adb-87d1-3e0dda37b8bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:33.128007 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d93f33e7-f14a-4adb-87d1-3e0dda37b8bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:33.134459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d93f33e7-f14a-4adb-87d1-3e0dda37b8bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:33.134969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d93f33e7-f14a-4adb-87d1-3e0dda37b8bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:33.135404 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d93f33e7-f14a-4adb-87d1-3e0dda37b8bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:33.136084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d93f33e7-f14a-4adb-87d1-3e0dda37b8bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:33.136531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d93f33e7-f14a-4adb-87d1-3e0dda37b8bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:33.136954 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d93f33e7-f14a-4adb-87d1-3e0dda37b8bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:33.165235 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d93f33e7-f14a-4adb-87d1-3e0dda37b8bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043443 Aug 24 12:39:33.165773 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 542/1077] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:33 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:33.716843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d221a93d-ccf2-41a9-bd9f-9c23c97e7d18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:33.718954 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d221a93d-ccf2-41a9-bd9f-9c23c97e7d18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:33.725551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d221a93d-ccf2-41a9-bd9f-9c23c97e7d18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:33.726031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d221a93d-ccf2-41a9-bd9f-9c23c97e7d18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:33.726466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d221a93d-ccf2-41a9-bd9f-9c23c97e7d18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:33.727192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d221a93d-ccf2-41a9-bd9f-9c23c97e7d18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:33.727654 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d221a93d-ccf2-41a9-bd9f-9c23c97e7d18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:33.728089 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d221a93d-ccf2-41a9-bd9f-9c23c97e7d18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:33.756965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d221a93d-ccf2-41a9-bd9f-9c23c97e7d18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044134 Aug 24 12:39:33.757647 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 536/1078] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:33 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:34.035295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-64182352-62fc-4500-bb94-0ed3b52a0165 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:34.038138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-64182352-62fc-4500-bb94-0ed3b52a0165 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:34.044504 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64182352-62fc-4500-bb94-0ed3b52a0165 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:34.054076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64182352-62fc-4500-bb94-0ed3b52a0165 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:34.054076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64182352-62fc-4500-bb94-0ed3b52a0165 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:34.054076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64182352-62fc-4500-bb94-0ed3b52a0165 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:34.054076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64182352-62fc-4500-bb94-0ed3b52a0165 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:34.054503 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64182352-62fc-4500-bb94-0ed3b52a0165 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:34.075507 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-64182352-62fc-4500-bb94-0ed3b52a0165 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044174 Aug 24 12:39:34.077031 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 543/1079] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:34 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:34.177236 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-37aee6cb-93e4-4796-8eb2-fa10a2fc7499 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:34.179599 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-37aee6cb-93e4-4796-8eb2-fa10a2fc7499 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:34.185991 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37aee6cb-93e4-4796-8eb2-fa10a2fc7499 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:34.186474 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37aee6cb-93e4-4796-8eb2-fa10a2fc7499 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:34.186940 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37aee6cb-93e4-4796-8eb2-fa10a2fc7499 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:34.187639 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37aee6cb-93e4-4796-8eb2-fa10a2fc7499 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:34.188094 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37aee6cb-93e4-4796-8eb2-fa10a2fc7499 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:34.188520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37aee6cb-93e4-4796-8eb2-fa10a2fc7499 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:34.218498 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-37aee6cb-93e4-4796-8eb2-fa10a2fc7499 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045233 Aug 24 12:39:34.219081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 537/1080] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:34 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:34.769219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-200329d1-a012-4073-96c1-77ceead3d521 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:34.771953 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-200329d1-a012-4073-96c1-77ceead3d521 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:34.777850 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-200329d1-a012-4073-96c1-77ceead3d521 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:34.778327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-200329d1-a012-4073-96c1-77ceead3d521 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:34.778790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-200329d1-a012-4073-96c1-77ceead3d521 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:34.779472 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-200329d1-a012-4073-96c1-77ceead3d521 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:34.779923 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-200329d1-a012-4073-96c1-77ceead3d521 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:34.780341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-200329d1-a012-4073-96c1-77ceead3d521 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:34.809327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-200329d1-a012-4073-96c1-77ceead3d521 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044113 Aug 24 12:39:34.809866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 544/1081] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:34 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:35.088252 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-72b40718-72e0-4aee-9eda-09ae1c57c106 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:35.090326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-72b40718-72e0-4aee-9eda-09ae1c57c106 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:35.096200 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72b40718-72e0-4aee-9eda-09ae1c57c106 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:35.096680 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72b40718-72e0-4aee-9eda-09ae1c57c106 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:35.097119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72b40718-72e0-4aee-9eda-09ae1c57c106 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:35.097805 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72b40718-72e0-4aee-9eda-09ae1c57c106 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:35.098264 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72b40718-72e0-4aee-9eda-09ae1c57c106 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:35.098727 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72b40718-72e0-4aee-9eda-09ae1c57c106 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:35.126168 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-72b40718-72e0-4aee-9eda-09ae1c57c106 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042512 Aug 24 12:39:35.126727 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 538/1082] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:35 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:35.230787 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-132393ba-31ee-4e8f-9fdb-08991a1b4a08 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:35.232871 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-132393ba-31ee-4e8f-9fdb-08991a1b4a08 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:35.239414 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-132393ba-31ee-4e8f-9fdb-08991a1b4a08 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:35.240418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-132393ba-31ee-4e8f-9fdb-08991a1b4a08 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:35.240844 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-132393ba-31ee-4e8f-9fdb-08991a1b4a08 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:35.241512 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-132393ba-31ee-4e8f-9fdb-08991a1b4a08 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:35.241949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-132393ba-31ee-4e8f-9fdb-08991a1b4a08 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:35.242360 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-132393ba-31ee-4e8f-9fdb-08991a1b4a08 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:35.270479 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-132393ba-31ee-4e8f-9fdb-08991a1b4a08 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043648 Aug 24 12:39:35.271131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 545/1083] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:35 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:35.821559 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dba970fc-2297-4af4-99af-8bd0884964b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:35.824162 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dba970fc-2297-4af4-99af-8bd0884964b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:35.830512 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dba970fc-2297-4af4-99af-8bd0884964b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:35.831023 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dba970fc-2297-4af4-99af-8bd0884964b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:35.831462 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dba970fc-2297-4af4-99af-8bd0884964b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:35.832146 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dba970fc-2297-4af4-99af-8bd0884964b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:35.832602 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dba970fc-2297-4af4-99af-8bd0884964b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:35.833027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dba970fc-2297-4af4-99af-8bd0884964b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:35.861852 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dba970fc-2297-4af4-99af-8bd0884964b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044308 Aug 24 12:39:35.862384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 539/1084] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:35 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:36.139058 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3982f32c-3aaf-4116-a39d-a0844ac7e852 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:36.141127 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3982f32c-3aaf-4116-a39d-a0844ac7e852 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:36.147625 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3982f32c-3aaf-4116-a39d-a0844ac7e852 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:36.148135 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3982f32c-3aaf-4116-a39d-a0844ac7e852 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:36.148571 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3982f32c-3aaf-4116-a39d-a0844ac7e852 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:36.149252 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3982f32c-3aaf-4116-a39d-a0844ac7e852 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:36.149702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3982f32c-3aaf-4116-a39d-a0844ac7e852 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:36.150129 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3982f32c-3aaf-4116-a39d-a0844ac7e852 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:36.179238 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3982f32c-3aaf-4116-a39d-a0844ac7e852 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044466 Aug 24 12:39:36.179781 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 546/1085] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:36 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:36.282541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fc9df4f1-46fb-437c-80d8-b66602b23601 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:36.284689 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fc9df4f1-46fb-437c-80d8-b66602b23601 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:36.291282 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc9df4f1-46fb-437c-80d8-b66602b23601 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:36.291762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc9df4f1-46fb-437c-80d8-b66602b23601 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:36.292199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc9df4f1-46fb-437c-80d8-b66602b23601 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:36.292931 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc9df4f1-46fb-437c-80d8-b66602b23601 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:36.293390 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc9df4f1-46fb-437c-80d8-b66602b23601 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:36.293813 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc9df4f1-46fb-437c-80d8-b66602b23601 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:36.322800 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fc9df4f1-46fb-437c-80d8-b66602b23601 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044337 Aug 24 12:39:36.323336 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 540/1086] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:36 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:39:36.875362 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c39845fe-c693-426b-b3aa-7125a2b3c47e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:36.877536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c39845fe-c693-426b-b3aa-7125a2b3c47e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:36.883961 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c39845fe-c693-426b-b3aa-7125a2b3c47e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:36.884442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c39845fe-c693-426b-b3aa-7125a2b3c47e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:36.884880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c39845fe-c693-426b-b3aa-7125a2b3c47e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:36.885567 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c39845fe-c693-426b-b3aa-7125a2b3c47e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:36.886020 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c39845fe-c693-426b-b3aa-7125a2b3c47e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:36.886445 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c39845fe-c693-426b-b3aa-7125a2b3c47e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:36.915676 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c39845fe-c693-426b-b3aa-7125a2b3c47e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044326 Aug 24 12:39:36.916216 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 547/1087] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:36 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:37.192077 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7b959d1a-6320-47d7-8b8b-133e218fc7b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:37.194830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7b959d1a-6320-47d7-8b8b-133e218fc7b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:37.201458 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b959d1a-6320-47d7-8b8b-133e218fc7b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:37.201929 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b959d1a-6320-47d7-8b8b-133e218fc7b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:37.202367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b959d1a-6320-47d7-8b8b-133e218fc7b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:37.203081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b959d1a-6320-47d7-8b8b-133e218fc7b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:37.203536 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b959d1a-6320-47d7-8b8b-133e218fc7b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:37.203959 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b959d1a-6320-47d7-8b8b-133e218fc7b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:37.234035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7b959d1a-6320-47d7-8b8b-133e218fc7b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046050 Aug 24 12:39:37.234576 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 541/1088] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:37 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:37.335667 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d0f6e599-c939-442c-9d67-eef25a9194bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:37.337820 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d0f6e599-c939-442c-9d67-eef25a9194bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:37.343917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0f6e599-c939-442c-9d67-eef25a9194bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:37.344455 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0f6e599-c939-442c-9d67-eef25a9194bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:37.344892 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0f6e599-c939-442c-9d67-eef25a9194bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:37.345572 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0f6e599-c939-442c-9d67-eef25a9194bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:37.346016 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0f6e599-c939-442c-9d67-eef25a9194bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:37.346463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0f6e599-c939-442c-9d67-eef25a9194bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:37.374818 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d0f6e599-c939-442c-9d67-eef25a9194bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043822 Aug 24 12:39:37.375359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 548/1089] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:37 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:37.928371 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f2784881-c885-46a8-8fc7-7475f88078e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:37.930550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f2784881-c885-46a8-8fc7-7475f88078e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:37.936526 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2784881-c885-46a8-8fc7-7475f88078e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:37.937006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2784881-c885-46a8-8fc7-7475f88078e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:37.937445 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2784881-c885-46a8-8fc7-7475f88078e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:37.938130 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2784881-c885-46a8-8fc7-7475f88078e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:37.938584 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2784881-c885-46a8-8fc7-7475f88078e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:37.939031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2784881-c885-46a8-8fc7-7475f88078e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:37.966881 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f2784881-c885-46a8-8fc7-7475f88078e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043081 Aug 24 12:39:37.967415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 542/1090] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:37 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:38.246606 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e0ae312f-8fa1-4feb-b327-3585234a2a0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:38.248759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e0ae312f-8fa1-4feb-b327-3585234a2a0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:38.255107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0ae312f-8fa1-4feb-b327-3585234a2a0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:38.255566 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0ae312f-8fa1-4feb-b327-3585234a2a0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:38.255991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0ae312f-8fa1-4feb-b327-3585234a2a0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:38.256659 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0ae312f-8fa1-4feb-b327-3585234a2a0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:38.257100 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0ae312f-8fa1-4feb-b327-3585234a2a0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:38.257514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0ae312f-8fa1-4feb-b327-3585234a2a0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:38.285205 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e0ae312f-8fa1-4feb-b327-3585234a2a0e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042509 Aug 24 12:39:38.285686 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 549/1091] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:38 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:38.386596 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e357b46c-3018-40b0-971c-cd0978e46202 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:38.388746 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e357b46c-3018-40b0-971c-cd0978e46202 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:38.395016 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e357b46c-3018-40b0-971c-cd0978e46202 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:38.395493 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e357b46c-3018-40b0-971c-cd0978e46202 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:38.396421 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e357b46c-3018-40b0-971c-cd0978e46202 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:38.397098 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e357b46c-3018-40b0-971c-cd0978e46202 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:38.397546 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e357b46c-3018-40b0-971c-cd0978e46202 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:38.397963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e357b46c-3018-40b0-971c-cd0978e46202 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:38.426667 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e357b46c-3018-40b0-971c-cd0978e46202 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043988 Aug 24 12:39:38.427221 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 543/1092] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:38 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:38.979542 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-91672332-4a01-458b-b00e-9740b1dd6651 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:38.981634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-91672332-4a01-458b-b00e-9740b1dd6651 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:38.987468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91672332-4a01-458b-b00e-9740b1dd6651 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:38.987939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91672332-4a01-458b-b00e-9740b1dd6651 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:38.988368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91672332-4a01-458b-b00e-9740b1dd6651 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:38.989291 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91672332-4a01-458b-b00e-9740b1dd6651 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:38.989749 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91672332-4a01-458b-b00e-9740b1dd6651 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:38.990167 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91672332-4a01-458b-b00e-9740b1dd6651 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:39.017855 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-91672332-4a01-458b-b00e-9740b1dd6651 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042248 Aug 24 12:39:39.018383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 550/1093] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:38 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:39.298043 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-595c4c5c-d567-4069-8cb6-3bd7e1001544 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:39.300293 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-595c4c5c-d567-4069-8cb6-3bd7e1001544 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:39.306198 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-595c4c5c-d567-4069-8cb6-3bd7e1001544 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:39.306694 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-595c4c5c-d567-4069-8cb6-3bd7e1001544 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:39.307136 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-595c4c5c-d567-4069-8cb6-3bd7e1001544 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:39.307815 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-595c4c5c-d567-4069-8cb6-3bd7e1001544 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:39.308268 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-595c4c5c-d567-4069-8cb6-3bd7e1001544 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:39.308690 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-595c4c5c-d567-4069-8cb6-3bd7e1001544 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:39.337601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-595c4c5c-d567-4069-8cb6-3bd7e1001544 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043686 Aug 24 12:39:39.338166 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 544/1094] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:39 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:39.438992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ca5ba9a9-ecb5-40a5-9320-13508ad16ae6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:39.441116 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ca5ba9a9-ecb5-40a5-9320-13508ad16ae6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:39.448007 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca5ba9a9-ecb5-40a5-9320-13508ad16ae6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:39.448486 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca5ba9a9-ecb5-40a5-9320-13508ad16ae6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:39.448922 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca5ba9a9-ecb5-40a5-9320-13508ad16ae6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:39.449604 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca5ba9a9-ecb5-40a5-9320-13508ad16ae6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:39.450053 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca5ba9a9-ecb5-40a5-9320-13508ad16ae6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:39.450475 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca5ba9a9-ecb5-40a5-9320-13508ad16ae6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:39.478814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ca5ba9a9-ecb5-40a5-9320-13508ad16ae6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043801 Aug 24 12:39:39.479349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 551/1095] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:39 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:40.030477 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b9cd8dfb-4eba-484e-8519-150c8d1c0475 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:40.032578 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b9cd8dfb-4eba-484e-8519-150c8d1c0475 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:40.039582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b9cd8dfb-4eba-484e-8519-150c8d1c0475 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:40.040059 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b9cd8dfb-4eba-484e-8519-150c8d1c0475 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:40.040491 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b9cd8dfb-4eba-484e-8519-150c8d1c0475 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:40.041170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b9cd8dfb-4eba-484e-8519-150c8d1c0475 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:40.041622 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b9cd8dfb-4eba-484e-8519-150c8d1c0475 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:40.042038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b9cd8dfb-4eba-484e-8519-150c8d1c0475 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:40.071171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b9cd8dfb-4eba-484e-8519-150c8d1c0475 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044608 Aug 24 12:39:40.071749 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 545/1096] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:40 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:40.349468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bbd8a922-8467-438e-a6d2-b98720a4ebe8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:40.351528 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-bbd8a922-8467-438e-a6d2-b98720a4ebe8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:40.357358 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bbd8a922-8467-438e-a6d2-b98720a4ebe8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:40.357824 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bbd8a922-8467-438e-a6d2-b98720a4ebe8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:40.358250 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bbd8a922-8467-438e-a6d2-b98720a4ebe8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:40.358944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bbd8a922-8467-438e-a6d2-b98720a4ebe8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:40.359389 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bbd8a922-8467-438e-a6d2-b98720a4ebe8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:40.359803 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bbd8a922-8467-438e-a6d2-b98720a4ebe8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:40.376211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:40.388936 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bbd8a922-8467-438e-a6d2-b98720a4ebe8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043513 Aug 24 12:39:40.389491 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 552/1097] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:40 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:40.491876 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-64084c29-e3d9-4374-86ae-5235fcff7395 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:40.494016 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-64084c29-e3d9-4374-86ae-5235fcff7395 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:40.499895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-64084c29-e3d9-4374-86ae-5235fcff7395 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:40.500379 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-64084c29-e3d9-4374-86ae-5235fcff7395 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:40.500819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-64084c29-e3d9-4374-86ae-5235fcff7395 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:40.501518 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-64084c29-e3d9-4374-86ae-5235fcff7395 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:40.501973 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-64084c29-e3d9-4374-86ae-5235fcff7395 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:40.502401 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-64084c29-e3d9-4374-86ae-5235fcff7395 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:40.530833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-64084c29-e3d9-4374-86ae-5235fcff7395 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043724 Aug 24 12:39:40.531372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 546/1098] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:40 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:41.083862 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1437fe50-87d0-4aca-94ef-101bb2fc7e14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:41.085988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1437fe50-87d0-4aca-94ef-101bb2fc7e14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:41.092343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1437fe50-87d0-4aca-94ef-101bb2fc7e14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:41.092843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1437fe50-87d0-4aca-94ef-101bb2fc7e14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:41.093278 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1437fe50-87d0-4aca-94ef-101bb2fc7e14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:41.093958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1437fe50-87d0-4aca-94ef-101bb2fc7e14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:41.094407 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1437fe50-87d0-4aca-94ef-101bb2fc7e14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:41.094854 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1437fe50-87d0-4aca-94ef-101bb2fc7e14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:41.123840 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1437fe50-87d0-4aca-94ef-101bb2fc7e14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044281 Aug 24 12:39:41.124374 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 553/1099] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:41 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:41.401668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-55b7ae29-b07c-482d-a737-a7dab029580c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:41.403767 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-55b7ae29-b07c-482d-a737-a7dab029580c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:41.410090 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55b7ae29-b07c-482d-a737-a7dab029580c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:41.410572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55b7ae29-b07c-482d-a737-a7dab029580c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:41.411051 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55b7ae29-b07c-482d-a737-a7dab029580c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:41.412374 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55b7ae29-b07c-482d-a737-a7dab029580c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:41.412836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55b7ae29-b07c-482d-a737-a7dab029580c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:41.413267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55b7ae29-b07c-482d-a737-a7dab029580c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:41.441745 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-55b7ae29-b07c-482d-a737-a7dab029580c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044023 Aug 24 12:39:41.442292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 547/1100] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:41 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:41.543663 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7527e4ed-ae16-43ed-b8bc-d89d47107d51 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:41.545867 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7527e4ed-ae16-43ed-b8bc-d89d47107d51 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:41.551771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7527e4ed-ae16-43ed-b8bc-d89d47107d51 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:41.552243 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7527e4ed-ae16-43ed-b8bc-d89d47107d51 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:41.552670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7527e4ed-ae16-43ed-b8bc-d89d47107d51 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:41.553345 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7527e4ed-ae16-43ed-b8bc-d89d47107d51 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:41.553787 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7527e4ed-ae16-43ed-b8bc-d89d47107d51 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:41.554209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7527e4ed-ae16-43ed-b8bc-d89d47107d51 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:41.584654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7527e4ed-ae16-43ed-b8bc-d89d47107d51 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044950 Aug 24 12:39:41.585207 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 554/1101] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:41 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:42.136067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-37b11d29-8c48-497b-a59c-1474c2c9ef68 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:42.138140 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-37b11d29-8c48-497b-a59c-1474c2c9ef68 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:42.144230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37b11d29-8c48-497b-a59c-1474c2c9ef68 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:42.144707 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37b11d29-8c48-497b-a59c-1474c2c9ef68 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:42.145139 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37b11d29-8c48-497b-a59c-1474c2c9ef68 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:42.146381 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37b11d29-8c48-497b-a59c-1474c2c9ef68 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:42.146874 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37b11d29-8c48-497b-a59c-1474c2c9ef68 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:42.147300 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37b11d29-8c48-497b-a59c-1474c2c9ef68 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:42.175588 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-37b11d29-8c48-497b-a59c-1474c2c9ef68 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043601 Aug 24 12:39:42.176126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 548/1102] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:42 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:42.453999 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0ea0db20-65d1-4454-b7ef-dcc9fad37624 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:42.466218 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0ea0db20-65d1-4454-b7ef-dcc9fad37624 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:42.466218 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ea0db20-65d1-4454-b7ef-dcc9fad37624 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:42.466218 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ea0db20-65d1-4454-b7ef-dcc9fad37624 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:42.466218 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ea0db20-65d1-4454-b7ef-dcc9fad37624 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:42.466640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ea0db20-65d1-4454-b7ef-dcc9fad37624 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:42.466640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ea0db20-65d1-4454-b7ef-dcc9fad37624 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:42.466640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ea0db20-65d1-4454-b7ef-dcc9fad37624 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:42.597628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b850ddca-fb2b-4185-8b21-ac2224d2c210 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:42.600466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b850ddca-fb2b-4185-8b21-ac2224d2c210 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:42.607414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b850ddca-fb2b-4185-8b21-ac2224d2c210 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:42.607895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b850ddca-fb2b-4185-8b21-ac2224d2c210 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:42.608327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b850ddca-fb2b-4185-8b21-ac2224d2c210 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:42.609029 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b850ddca-fb2b-4185-8b21-ac2224d2c210 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:42.609476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b850ddca-fb2b-4185-8b21-ac2224d2c210 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:42.609895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b850ddca-fb2b-4185-8b21-ac2224d2c210 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:42.636899 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:42.641578 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b850ddca-fb2b-4185-8b21-ac2224d2c210 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048228 Aug 24 12:39:42.642328 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 549/1103] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:42 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:39:42.643940 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0ea0db20-65d1-4454-b7ef-dcc9fad37624 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193562 Aug 24 12:39:42.644320 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 555/1104] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:42 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:43.188124 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f6572534-2849-4a3e-b495-bbd55e9cfe44 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:43.190232 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f6572534-2849-4a3e-b495-bbd55e9cfe44 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:43.196122 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6572534-2849-4a3e-b495-bbd55e9cfe44 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:43.196613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6572534-2849-4a3e-b495-bbd55e9cfe44 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:43.197030 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6572534-2849-4a3e-b495-bbd55e9cfe44 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:43.197703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6572534-2849-4a3e-b495-bbd55e9cfe44 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:43.198153 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6572534-2849-4a3e-b495-bbd55e9cfe44 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:43.198570 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6572534-2849-4a3e-b495-bbd55e9cfe44 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:43.227183 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f6572534-2849-4a3e-b495-bbd55e9cfe44 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043421 Aug 24 12:39:43.227716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 550/1105] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:43 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:43.654122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-eaca5c4d-ece4-40e7-bc53-5680403fa944 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:43.656227 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-eaca5c4d-ece4-40e7-bc53-5680403fa944 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:43.658822 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-902fb31a-3da4-4b58-ba3b-4e7b0bbea3de tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:43.660909 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-902fb31a-3da4-4b58-ba3b-4e7b0bbea3de tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:43.663231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eaca5c4d-ece4-40e7-bc53-5680403fa944 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:43.663715 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eaca5c4d-ece4-40e7-bc53-5680403fa944 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:43.664146 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eaca5c4d-ece4-40e7-bc53-5680403fa944 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:43.664840 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eaca5c4d-ece4-40e7-bc53-5680403fa944 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:43.665292 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eaca5c4d-ece4-40e7-bc53-5680403fa944 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:43.665826 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eaca5c4d-ece4-40e7-bc53-5680403fa944 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:43.667821 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-902fb31a-3da4-4b58-ba3b-4e7b0bbea3de tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:43.668301 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-902fb31a-3da4-4b58-ba3b-4e7b0bbea3de tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:43.668733 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-902fb31a-3da4-4b58-ba3b-4e7b0bbea3de tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:43.669416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-902fb31a-3da4-4b58-ba3b-4e7b0bbea3de tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:43.669862 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-902fb31a-3da4-4b58-ba3b-4e7b0bbea3de tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:43.670285 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-902fb31a-3da4-4b58-ba3b-4e7b0bbea3de tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:43.694415 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-eaca5c4d-ece4-40e7-bc53-5680403fa944 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044233 Aug 24 12:39:43.694994 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 556/1106] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:43 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:43.699073 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-902fb31a-3da4-4b58-ba3b-4e7b0bbea3de tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044081 Aug 24 12:39:43.699614 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 551/1107] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:43 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:39:44.240112 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b810c4e1-358e-4984-a575-fe65fc3cfd74 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:44.242346 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b810c4e1-358e-4984-a575-fe65fc3cfd74 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:44.248288 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b810c4e1-358e-4984-a575-fe65fc3cfd74 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:44.248767 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b810c4e1-358e-4984-a575-fe65fc3cfd74 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:44.249198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b810c4e1-358e-4984-a575-fe65fc3cfd74 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:44.249882 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b810c4e1-358e-4984-a575-fe65fc3cfd74 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:44.250339 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b810c4e1-358e-4984-a575-fe65fc3cfd74 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:44.250796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b810c4e1-358e-4984-a575-fe65fc3cfd74 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:44.280587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b810c4e1-358e-4984-a575-fe65fc3cfd74 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045208 Aug 24 12:39:44.281122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 557/1108] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:44 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:44.707096 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2c2a2fe6-b7e1-4613-97de-85c402ced167 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:44.709264 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2c2a2fe6-b7e1-4613-97de-85c402ced167 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:44.710224 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3ba46080-98d8-4fbc-a1c5-6e1f2ff89477 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:44.712351 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3ba46080-98d8-4fbc-a1c5-6e1f2ff89477 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:44.715783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c2a2fe6-b7e1-4613-97de-85c402ced167 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:44.716267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c2a2fe6-b7e1-4613-97de-85c402ced167 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:44.716705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c2a2fe6-b7e1-4613-97de-85c402ced167 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:44.717398 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c2a2fe6-b7e1-4613-97de-85c402ced167 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:44.717852 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c2a2fe6-b7e1-4613-97de-85c402ced167 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:44.718276 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c2a2fe6-b7e1-4613-97de-85c402ced167 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:44.718726 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ba46080-98d8-4fbc-a1c5-6e1f2ff89477 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:44.719201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ba46080-98d8-4fbc-a1c5-6e1f2ff89477 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:44.719630 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ba46080-98d8-4fbc-a1c5-6e1f2ff89477 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:44.720308 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ba46080-98d8-4fbc-a1c5-6e1f2ff89477 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:44.720756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ba46080-98d8-4fbc-a1c5-6e1f2ff89477 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:44.721171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ba46080-98d8-4fbc-a1c5-6e1f2ff89477 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:44.748498 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2c2a2fe6-b7e1-4613-97de-85c402ced167 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045706 Aug 24 12:39:44.749045 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 552/1109] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:44 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:44.750333 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3ba46080-98d8-4fbc-a1c5-6e1f2ff89477 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044012 Aug 24 12:39:44.750892 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 558/1110] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:44 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:39:45.293176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1c1e9a16-469d-406b-9327-07e40a046b95 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:45.295335 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1c1e9a16-469d-406b-9327-07e40a046b95 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:45.301208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1c1e9a16-469d-406b-9327-07e40a046b95 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:45.301689 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1c1e9a16-469d-406b-9327-07e40a046b95 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:45.302125 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1c1e9a16-469d-406b-9327-07e40a046b95 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:45.302846 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1c1e9a16-469d-406b-9327-07e40a046b95 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:45.303303 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1c1e9a16-469d-406b-9327-07e40a046b95 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:45.303728 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1c1e9a16-469d-406b-9327-07e40a046b95 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:45.332048 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1c1e9a16-469d-406b-9327-07e40a046b95 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042864 Aug 24 12:39:45.332580 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 553/1111] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:45 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:45.761444 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a15fab0e-8fc3-4966-9eb6-3a7dda790492 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:45.762122 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c4780fbd-ffaf-4477-8e5b-27ac0e6331d0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:45.763620 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a15fab0e-8fc3-4966-9eb6-3a7dda790492 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:45.764267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c4780fbd-ffaf-4477-8e5b-27ac0e6331d0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:45.769671 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a15fab0e-8fc3-4966-9eb6-3a7dda790492 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:45.770156 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a15fab0e-8fc3-4966-9eb6-3a7dda790492 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:45.770583 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a15fab0e-8fc3-4966-9eb6-3a7dda790492 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:45.770799 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c4780fbd-ffaf-4477-8e5b-27ac0e6331d0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:45.771182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c4780fbd-ffaf-4477-8e5b-27ac0e6331d0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:45.771291 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a15fab0e-8fc3-4966-9eb6-3a7dda790492 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:45.771628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c4780fbd-ffaf-4477-8e5b-27ac0e6331d0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:45.771731 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a15fab0e-8fc3-4966-9eb6-3a7dda790492 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:45.772129 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a15fab0e-8fc3-4966-9eb6-3a7dda790492 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:45.772308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c4780fbd-ffaf-4477-8e5b-27ac0e6331d0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:45.772762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c4780fbd-ffaf-4477-8e5b-27ac0e6331d0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:45.773187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c4780fbd-ffaf-4477-8e5b-27ac0e6331d0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:45.800794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a15fab0e-8fc3-4966-9eb6-3a7dda790492 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043386 Aug 24 12:39:45.801277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c4780fbd-ffaf-4477-8e5b-27ac0e6331d0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042963 Aug 24 12:39:45.801445 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 559/1112] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:45 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:45.802579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 554/1113] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:45 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:39:46.344001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b6cee217-5ec8-4dc4-a9fa-4aaa209e3b63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:46.346113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b6cee217-5ec8-4dc4-a9fa-4aaa209e3b63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:46.352679 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6cee217-5ec8-4dc4-a9fa-4aaa209e3b63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:46.353162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6cee217-5ec8-4dc4-a9fa-4aaa209e3b63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:46.353599 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6cee217-5ec8-4dc4-a9fa-4aaa209e3b63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:46.354285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6cee217-5ec8-4dc4-a9fa-4aaa209e3b63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:46.354764 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6cee217-5ec8-4dc4-a9fa-4aaa209e3b63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:46.355193 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6cee217-5ec8-4dc4-a9fa-4aaa209e3b63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:46.384092 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b6cee217-5ec8-4dc4-a9fa-4aaa209e3b63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044132 Aug 24 12:39:46.384620 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 560/1114] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:46 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:46.813541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-85b2ec91-798b-46dd-8596-1cc6981e87eb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:46.814127 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0e3626d7-5727-46da-a77b-ebf327ef55f3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:46.815704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-85b2ec91-798b-46dd-8596-1cc6981e87eb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:46.816042 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0e3626d7-5727-46da-a77b-ebf327ef55f3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:46.822604 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-85b2ec91-798b-46dd-8596-1cc6981e87eb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:46.822815 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0e3626d7-5727-46da-a77b-ebf327ef55f3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:46.823113 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-85b2ec91-798b-46dd-8596-1cc6981e87eb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:46.823298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0e3626d7-5727-46da-a77b-ebf327ef55f3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:46.823542 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-85b2ec91-798b-46dd-8596-1cc6981e87eb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:46.823734 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0e3626d7-5727-46da-a77b-ebf327ef55f3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:46.824233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-85b2ec91-798b-46dd-8596-1cc6981e87eb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:46.824426 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0e3626d7-5727-46da-a77b-ebf327ef55f3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:46.824685 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-85b2ec91-798b-46dd-8596-1cc6981e87eb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:46.824878 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0e3626d7-5727-46da-a77b-ebf327ef55f3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:46.825107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-85b2ec91-798b-46dd-8596-1cc6981e87eb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:46.825305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0e3626d7-5727-46da-a77b-ebf327ef55f3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:46.854523 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-85b2ec91-798b-46dd-8596-1cc6981e87eb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044930 Aug 24 12:39:46.855097 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 555/1115] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:46 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:46.855390 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0e3626d7-5727-46da-a77b-ebf327ef55f3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045384 Aug 24 12:39:46.855930 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 561/1116] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:46 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:39:47.396714 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6b801a64-25fa-4440-a941-1c885522f8d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:47.398864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6b801a64-25fa-4440-a941-1c885522f8d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:47.404695 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b801a64-25fa-4440-a941-1c885522f8d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:47.405172 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b801a64-25fa-4440-a941-1c885522f8d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:47.405601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b801a64-25fa-4440-a941-1c885522f8d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:47.406308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b801a64-25fa-4440-a941-1c885522f8d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:47.406780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b801a64-25fa-4440-a941-1c885522f8d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:47.407199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b801a64-25fa-4440-a941-1c885522f8d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:47.436434 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6b801a64-25fa-4440-a941-1c885522f8d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044158 Aug 24 12:39:47.436983 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 556/1117] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:47 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:47.867125 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-11916247-0db7-4702-ae43-d4ba8bc69013 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:47.867786 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6b168744-81b3-4955-8aba-fccbd106cb82 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:47.869354 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6b168744-81b3-4955-8aba-fccbd106cb82 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:47.869480 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-11916247-0db7-4702-ae43-d4ba8bc69013 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:47.875460 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11916247-0db7-4702-ae43-d4ba8bc69013 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:47.875617 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6b168744-81b3-4955-8aba-fccbd106cb82 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:47.875943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11916247-0db7-4702-ae43-d4ba8bc69013 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:47.876058 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6b168744-81b3-4955-8aba-fccbd106cb82 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:47.876380 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11916247-0db7-4702-ae43-d4ba8bc69013 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:47.876493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6b168744-81b3-4955-8aba-fccbd106cb82 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:47.877069 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11916247-0db7-4702-ae43-d4ba8bc69013 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:47.877169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6b168744-81b3-4955-8aba-fccbd106cb82 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:47.877522 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11916247-0db7-4702-ae43-d4ba8bc69013 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:47.877642 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6b168744-81b3-4955-8aba-fccbd106cb82 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:47.877984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11916247-0db7-4702-ae43-d4ba8bc69013 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:47.878108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6b168744-81b3-4955-8aba-fccbd106cb82 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:47.907010 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-11916247-0db7-4702-ae43-d4ba8bc69013 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043967 Aug 24 12:39:47.907238 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6b168744-81b3-4955-8aba-fccbd106cb82 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044332 Aug 24 12:39:47.907558 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 557/1118] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:47 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:47.907920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 562/1119] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:47 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:48.448677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-367a7500-3015-4e63-957f-d2a696b4ce76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:48.450845 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-367a7500-3015-4e63-957f-d2a696b4ce76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:48.456918 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-367a7500-3015-4e63-957f-d2a696b4ce76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:48.457398 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-367a7500-3015-4e63-957f-d2a696b4ce76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:48.457828 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-367a7500-3015-4e63-957f-d2a696b4ce76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:48.458507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-367a7500-3015-4e63-957f-d2a696b4ce76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:48.458985 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-367a7500-3015-4e63-957f-d2a696b4ce76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:48.459405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-367a7500-3015-4e63-957f-d2a696b4ce76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:48.487770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-367a7500-3015-4e63-957f-d2a696b4ce76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043080 Aug 24 12:39:48.488306 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 558/1120] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:48 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:48.919405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e0d229d0-70c3-4f4b-ad92-d09980459324 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:48.919933 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a95ef146-8ed5-4ffb-a613-ed995bdb9067 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:48.921500 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e0d229d0-70c3-4f4b-ad92-d09980459324 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:48.921650 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a95ef146-8ed5-4ffb-a613-ed995bdb9067 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:48.927923 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a95ef146-8ed5-4ffb-a613-ed995bdb9067 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:48.928076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0d229d0-70c3-4f4b-ad92-d09980459324 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:48.928367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0d229d0-70c3-4f4b-ad92-d09980459324 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:48.928472 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a95ef146-8ed5-4ffb-a613-ed995bdb9067 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:48.928801 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0d229d0-70c3-4f4b-ad92-d09980459324 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:48.928909 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a95ef146-8ed5-4ffb-a613-ed995bdb9067 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:48.929560 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a95ef146-8ed5-4ffb-a613-ed995bdb9067 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:48.929671 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0d229d0-70c3-4f4b-ad92-d09980459324 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:48.930010 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0d229d0-70c3-4f4b-ad92-d09980459324 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:48.930124 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a95ef146-8ed5-4ffb-a613-ed995bdb9067 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:48.930424 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0d229d0-70c3-4f4b-ad92-d09980459324 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:48.930523 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a95ef146-8ed5-4ffb-a613-ed995bdb9067 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:48.959587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e0d229d0-70c3-4f4b-ad92-d09980459324 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044080 Aug 24 12:39:48.959912 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a95ef146-8ed5-4ffb-a613-ed995bdb9067 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044384 Aug 24 12:39:48.960141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 563/1121] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:48 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:48.960462 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 559/1122] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:48 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:49.500688 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3c2a4e29-5a57-4a2f-94ed-c4de6f0092b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:49.502833 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3c2a4e29-5a57-4a2f-94ed-c4de6f0092b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:49.508719 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c2a4e29-5a57-4a2f-94ed-c4de6f0092b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:49.509198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c2a4e29-5a57-4a2f-94ed-c4de6f0092b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:49.509628 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c2a4e29-5a57-4a2f-94ed-c4de6f0092b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:49.510309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c2a4e29-5a57-4a2f-94ed-c4de6f0092b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:49.510784 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c2a4e29-5a57-4a2f-94ed-c4de6f0092b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:49.511204 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c2a4e29-5a57-4a2f-94ed-c4de6f0092b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:49.541517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3c2a4e29-5a57-4a2f-94ed-c4de6f0092b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044711 Aug 24 12:39:49.542052 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 564/1123] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:49 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:49.972320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-49e6a22f-36b2-4674-ad79-b58f69db7c99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:49.972882 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3c5f9485-a77c-4d12-a31c-cd4396dc6941 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:49.974462 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3c5f9485-a77c-4d12-a31c-cd4396dc6941 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:49.974589 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-49e6a22f-36b2-4674-ad79-b58f69db7c99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:49.980847 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c5f9485-a77c-4d12-a31c-cd4396dc6941 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:49.981002 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49e6a22f-36b2-4674-ad79-b58f69db7c99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:49.981322 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c5f9485-a77c-4d12-a31c-cd4396dc6941 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:49.981452 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49e6a22f-36b2-4674-ad79-b58f69db7c99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:49.981751 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c5f9485-a77c-4d12-a31c-cd4396dc6941 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:49.981864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49e6a22f-36b2-4674-ad79-b58f69db7c99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:49.982434 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c5f9485-a77c-4d12-a31c-cd4396dc6941 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:49.982563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49e6a22f-36b2-4674-ad79-b58f69db7c99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:49.982901 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c5f9485-a77c-4d12-a31c-cd4396dc6941 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:49.983005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49e6a22f-36b2-4674-ad79-b58f69db7c99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:49.983317 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c5f9485-a77c-4d12-a31c-cd4396dc6941 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:49.983416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49e6a22f-36b2-4674-ad79-b58f69db7c99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:50.012119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-49e6a22f-36b2-4674-ad79-b58f69db7c99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043778 Aug 24 12:39:50.012453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3c5f9485-a77c-4d12-a31c-cd4396dc6941 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044139 Aug 24 12:39:50.016498 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 560/1124] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:49 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:50.016653 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 565/1125] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:49 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:39:50.554268 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b5cac770-f845-4cfd-a0e8-5ab9ef479748 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:50.556434 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b5cac770-f845-4cfd-a0e8-5ab9ef479748 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:50.562340 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b5cac770-f845-4cfd-a0e8-5ab9ef479748 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:50.562922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b5cac770-f845-4cfd-a0e8-5ab9ef479748 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:50.563362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b5cac770-f845-4cfd-a0e8-5ab9ef479748 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:50.564044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b5cac770-f845-4cfd-a0e8-5ab9ef479748 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:50.564500 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b5cac770-f845-4cfd-a0e8-5ab9ef479748 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:50.564924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b5cac770-f845-4cfd-a0e8-5ab9ef479748 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:50.592906 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b5cac770-f845-4cfd-a0e8-5ab9ef479748 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043287 Aug 24 12:39:50.593440 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 561/1126] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:50 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:51.024048 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0df45c6a-78cc-434d-900b-bea244cf3904 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:51.024571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dca33c8a-58cd-4743-9869-91a643649fa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:51.026158 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0df45c6a-78cc-434d-900b-bea244cf3904 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:51.026278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dca33c8a-58cd-4743-9869-91a643649fa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:51.032568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dca33c8a-58cd-4743-9869-91a643649fa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:51.032758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0df45c6a-78cc-434d-900b-bea244cf3904 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:51.033058 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dca33c8a-58cd-4743-9869-91a643649fa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:51.033196 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0df45c6a-78cc-434d-900b-bea244cf3904 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:51.033495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dca33c8a-58cd-4743-9869-91a643649fa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:51.033605 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0df45c6a-78cc-434d-900b-bea244cf3904 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:51.034188 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dca33c8a-58cd-4743-9869-91a643649fa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:51.034316 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0df45c6a-78cc-434d-900b-bea244cf3904 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:51.034641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dca33c8a-58cd-4743-9869-91a643649fa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:51.034760 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0df45c6a-78cc-434d-900b-bea244cf3904 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:51.035093 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dca33c8a-58cd-4743-9869-91a643649fa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:51.035194 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0df45c6a-78cc-434d-900b-bea244cf3904 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:51.063700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dca33c8a-58cd-4743-9869-91a643649fa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043517 Aug 24 12:39:51.064001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0df45c6a-78cc-434d-900b-bea244cf3904 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043896 Aug 24 12:39:51.064254 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 562/1127] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:51 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:39:51.064529 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 566/1128] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:51 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:39:51.605979 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a9fd0bd8-b2de-4b35-a608-cf2ac79baaf6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:51.608143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a9fd0bd8-b2de-4b35-a608-cf2ac79baaf6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:51.613938 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a9fd0bd8-b2de-4b35-a608-cf2ac79baaf6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:51.614694 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a9fd0bd8-b2de-4b35-a608-cf2ac79baaf6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:51.615780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a9fd0bd8-b2de-4b35-a608-cf2ac79baaf6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:51.616460 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a9fd0bd8-b2de-4b35-a608-cf2ac79baaf6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:51.616909 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a9fd0bd8-b2de-4b35-a608-cf2ac79baaf6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:51.617328 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a9fd0bd8-b2de-4b35-a608-cf2ac79baaf6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:51.645111 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a9fd0bd8-b2de-4b35-a608-cf2ac79baaf6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043437 Aug 24 12:39:51.645640 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 563/1129] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:51 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:52.076502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-834abe7c-da10-4b47-ac76-023598501629 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:52.077033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-810f829f-668d-46ed-a681-81367f29434b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:52.078616 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-834abe7c-da10-4b47-ac76-023598501629 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:52.078878 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-810f829f-668d-46ed-a681-81367f29434b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:52.085447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-834abe7c-da10-4b47-ac76-023598501629 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:52.085588 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-810f829f-668d-46ed-a681-81367f29434b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:52.085919 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-834abe7c-da10-4b47-ac76-023598501629 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:52.086032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-810f829f-668d-46ed-a681-81367f29434b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:52.086349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-834abe7c-da10-4b47-ac76-023598501629 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:52.086451 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-810f829f-668d-46ed-a681-81367f29434b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:52.087070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-834abe7c-da10-4b47-ac76-023598501629 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:52.087223 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-810f829f-668d-46ed-a681-81367f29434b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:52.087520 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-834abe7c-da10-4b47-ac76-023598501629 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:52.087644 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-810f829f-668d-46ed-a681-81367f29434b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:52.087941 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-834abe7c-da10-4b47-ac76-023598501629 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:52.088044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-810f829f-668d-46ed-a681-81367f29434b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:52.116498 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-834abe7c-da10-4b47-ac76-023598501629 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043959 Aug 24 12:39:52.116731 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-810f829f-668d-46ed-a681-81367f29434b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043547 Aug 24 12:39:52.117047 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 564/1131] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:52 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:39:52.117172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 567/1131] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:52 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:52.657769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4284cc6a-aca3-49fa-8f1f-f99186d202bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:52.659941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4284cc6a-aca3-49fa-8f1f-f99186d202bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:52.665917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4284cc6a-aca3-49fa-8f1f-f99186d202bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:52.666392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4284cc6a-aca3-49fa-8f1f-f99186d202bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:52.666854 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4284cc6a-aca3-49fa-8f1f-f99186d202bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:52.667666 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4284cc6a-aca3-49fa-8f1f-f99186d202bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:52.668123 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4284cc6a-aca3-49fa-8f1f-f99186d202bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:52.668542 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4284cc6a-aca3-49fa-8f1f-f99186d202bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:52.697438 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4284cc6a-aca3-49fa-8f1f-f99186d202bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043665 Aug 24 12:39:52.697906 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 565/1132] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:52 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:53.127826 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-28a592f9-d729-46da-bb78-e771377697fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:53.128506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3a24e934-e430-45ea-aa95-370fa510c62e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:53.129965 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-28a592f9-d729-46da-bb78-e771377697fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:53.130624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3a24e934-e430-45ea-aa95-370fa510c62e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:53.136297 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28a592f9-d729-46da-bb78-e771377697fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:53.136774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28a592f9-d729-46da-bb78-e771377697fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:53.136913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a24e934-e430-45ea-aa95-370fa510c62e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:53.137205 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28a592f9-d729-46da-bb78-e771377697fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:53.137362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a24e934-e430-45ea-aa95-370fa510c62e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:53.137670 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a24e934-e430-45ea-aa95-370fa510c62e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:53.137884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28a592f9-d729-46da-bb78-e771377697fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:53.138326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28a592f9-d729-46da-bb78-e771377697fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:53.138434 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a24e934-e430-45ea-aa95-370fa510c62e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:53.138773 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28a592f9-d729-46da-bb78-e771377697fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:53.138884 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a24e934-e430-45ea-aa95-370fa510c62e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:53.139228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a24e934-e430-45ea-aa95-370fa510c62e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:53.153658 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:53.167988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-28a592f9-d729-46da-bb78-e771377697fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044125 Aug 24 12:39:53.168536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 568/1133] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:53 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:53.176903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3a24e934-e430-45ea-aa95-370fa510c62e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045102 Aug 24 12:39:53.176903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 566/1134] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:53 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:39:53.710467 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c39a249d-5d0f-4561-b4f1-797738d03c29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:53.712581 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c39a249d-5d0f-4561-b4f1-797738d03c29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:53.718384 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c39a249d-5d0f-4561-b4f1-797738d03c29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:53.718900 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c39a249d-5d0f-4561-b4f1-797738d03c29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:53.719326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c39a249d-5d0f-4561-b4f1-797738d03c29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:53.720004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c39a249d-5d0f-4561-b4f1-797738d03c29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:53.720447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c39a249d-5d0f-4561-b4f1-797738d03c29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:53.720863 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c39a249d-5d0f-4561-b4f1-797738d03c29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:53.724352 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:53.749166 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c39a249d-5d0f-4561-b4f1-797738d03c29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043272 Aug 24 12:39:53.749699 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 569/1135] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:53 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:54.188028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dfbe6ddb-b294-45b7-9bad-f37b784dfb74 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:54.188517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6debc3de-29cf-4d3d-9545-abcb1bef860d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:54.190201 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dfbe6ddb-b294-45b7-9bad-f37b784dfb74 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:54.190500 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6debc3de-29cf-4d3d-9545-abcb1bef860d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:54.197700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dfbe6ddb-b294-45b7-9bad-f37b784dfb74 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:54.200367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dfbe6ddb-b294-45b7-9bad-f37b784dfb74 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:54.200367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dfbe6ddb-b294-45b7-9bad-f37b784dfb74 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:54.200592 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6debc3de-29cf-4d3d-9545-abcb1bef860d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:54.200695 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dfbe6ddb-b294-45b7-9bad-f37b784dfb74 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:54.200786 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6debc3de-29cf-4d3d-9545-abcb1bef860d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:54.200879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dfbe6ddb-b294-45b7-9bad-f37b784dfb74 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:54.200969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6debc3de-29cf-4d3d-9545-abcb1bef860d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:54.201055 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dfbe6ddb-b294-45b7-9bad-f37b784dfb74 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:54.201134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6debc3de-29cf-4d3d-9545-abcb1bef860d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:54.201340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6debc3de-29cf-4d3d-9545-abcb1bef860d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:54.201756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6debc3de-29cf-4d3d-9545-abcb1bef860d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:54.230357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dfbe6ddb-b294-45b7-9bad-f37b784dfb74 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046480 Aug 24 12:39:54.235001 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 567/1136] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:54 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:54.235135 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6debc3de-29cf-4d3d-9545-abcb1bef860d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047386 Aug 24 12:39:54.235135 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 570/1137] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:54 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:39:54.760827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-67a5bf75-c9c5-42a4-9f39-16b3db967327 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:54.763027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-67a5bf75-c9c5-42a4-9f39-16b3db967327 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:54.768925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67a5bf75-c9c5-42a4-9f39-16b3db967327 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:54.769409 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67a5bf75-c9c5-42a4-9f39-16b3db967327 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:54.769853 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67a5bf75-c9c5-42a4-9f39-16b3db967327 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:54.770541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67a5bf75-c9c5-42a4-9f39-16b3db967327 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:54.771026 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67a5bf75-c9c5-42a4-9f39-16b3db967327 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:54.771986 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67a5bf75-c9c5-42a4-9f39-16b3db967327 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:54.800543 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-67a5bf75-c9c5-42a4-9f39-16b3db967327 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043660 Aug 24 12:39:54.801089 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 568/1138] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:54 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:55.243773 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b075ed3a-8f71-4716-b008-38e92c34aff1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:55.244340 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7e0c7d8b-4e26-41cc-a6d1-8aa47a08e88e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:55.246035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b075ed3a-8f71-4716-b008-38e92c34aff1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:55.246393 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7e0c7d8b-4e26-41cc-a6d1-8aa47a08e88e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:55.252587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b075ed3a-8f71-4716-b008-38e92c34aff1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:55.252766 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e0c7d8b-4e26-41cc-a6d1-8aa47a08e88e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:55.253066 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b075ed3a-8f71-4716-b008-38e92c34aff1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:55.253276 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e0c7d8b-4e26-41cc-a6d1-8aa47a08e88e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:55.253503 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b075ed3a-8f71-4716-b008-38e92c34aff1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:55.253707 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e0c7d8b-4e26-41cc-a6d1-8aa47a08e88e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:55.254190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b075ed3a-8f71-4716-b008-38e92c34aff1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:55.254403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e0c7d8b-4e26-41cc-a6d1-8aa47a08e88e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:55.254643 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b075ed3a-8f71-4716-b008-38e92c34aff1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:55.254870 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e0c7d8b-4e26-41cc-a6d1-8aa47a08e88e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:55.255084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b075ed3a-8f71-4716-b008-38e92c34aff1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:55.255288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e0c7d8b-4e26-41cc-a6d1-8aa47a08e88e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:55.283311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b075ed3a-8f71-4716-b008-38e92c34aff1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044382 Aug 24 12:39:55.283574 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7e0c7d8b-4e26-41cc-a6d1-8aa47a08e88e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043785 Aug 24 12:39:55.283863 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 571/1139] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:55 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:55.284104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 569/1140] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:55 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:39:55.812654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b6c13b76-b97c-43d3-bad1-55ef66788bcb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:55.814798 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b6c13b76-b97c-43d3-bad1-55ef66788bcb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:55.820958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6c13b76-b97c-43d3-bad1-55ef66788bcb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:55.821451 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6c13b76-b97c-43d3-bad1-55ef66788bcb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:55.821874 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6c13b76-b97c-43d3-bad1-55ef66788bcb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:55.822886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6c13b76-b97c-43d3-bad1-55ef66788bcb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:55.823344 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6c13b76-b97c-43d3-bad1-55ef66788bcb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:55.823770 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6c13b76-b97c-43d3-bad1-55ef66788bcb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:55.856206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b6c13b76-b97c-43d3-bad1-55ef66788bcb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047510 Aug 24 12:39:55.856749 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 572/1141] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:55 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:56.296049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-88c0c9d2-62b6-43b2-b84b-2fdcb0595e2f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:56.296578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a73ccd3c-6e11-4b20-9c58-8432a864ae54 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:56.298186 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-88c0c9d2-62b6-43b2-b84b-2fdcb0595e2f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:56.298378 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a73ccd3c-6e11-4b20-9c58-8432a864ae54 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:56.304582 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a73ccd3c-6e11-4b20-9c58-8432a864ae54 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:56.304773 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-88c0c9d2-62b6-43b2-b84b-2fdcb0595e2f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:56.305051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a73ccd3c-6e11-4b20-9c58-8432a864ae54 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:56.305169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-88c0c9d2-62b6-43b2-b84b-2fdcb0595e2f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:56.305476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a73ccd3c-6e11-4b20-9c58-8432a864ae54 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:56.305597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-88c0c9d2-62b6-43b2-b84b-2fdcb0595e2f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:56.306158 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a73ccd3c-6e11-4b20-9c58-8432a864ae54 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:56.306270 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-88c0c9d2-62b6-43b2-b84b-2fdcb0595e2f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:56.306599 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a73ccd3c-6e11-4b20-9c58-8432a864ae54 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:56.306732 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-88c0c9d2-62b6-43b2-b84b-2fdcb0595e2f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:56.307051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a73ccd3c-6e11-4b20-9c58-8432a864ae54 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:56.307160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-88c0c9d2-62b6-43b2-b84b-2fdcb0595e2f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:56.336370 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-88c0c9d2-62b6-43b2-b84b-2fdcb0595e2f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044209 Aug 24 12:39:56.336578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a73ccd3c-6e11-4b20-9c58-8432a864ae54 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044133 Aug 24 12:39:56.337118 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 573/1142] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:56 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:39:56.337356 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 570/1143] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:56 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:56.868562 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9f3a91b4-65c2-4c3a-87a8-d2abd0cf5853 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:56.870747 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9f3a91b4-65c2-4c3a-87a8-d2abd0cf5853 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:56.876721 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f3a91b4-65c2-4c3a-87a8-d2abd0cf5853 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:56.877191 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f3a91b4-65c2-4c3a-87a8-d2abd0cf5853 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:56.877628 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f3a91b4-65c2-4c3a-87a8-d2abd0cf5853 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:56.878301 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f3a91b4-65c2-4c3a-87a8-d2abd0cf5853 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:56.878773 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f3a91b4-65c2-4c3a-87a8-d2abd0cf5853 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:56.879189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f3a91b4-65c2-4c3a-87a8-d2abd0cf5853 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:56.907856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9f3a91b4-65c2-4c3a-87a8-d2abd0cf5853 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043546 Aug 24 12:39:56.908382 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 574/1144] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:56 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:57.348842 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9ff97c30-ba43-48b3-9bc6-6eb3583e8926 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:57.349908 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fe893d18-131c-4762-b4e8-37eabd8a1abd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:57.351470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9ff97c30-ba43-48b3-9bc6-6eb3583e8926 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:57.351593 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fe893d18-131c-4762-b4e8-37eabd8a1abd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:57.357655 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ff97c30-ba43-48b3-9bc6-6eb3583e8926 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:57.357836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fe893d18-131c-4762-b4e8-37eabd8a1abd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:57.358134 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ff97c30-ba43-48b3-9bc6-6eb3583e8926 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:57.358324 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fe893d18-131c-4762-b4e8-37eabd8a1abd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:57.358570 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ff97c30-ba43-48b3-9bc6-6eb3583e8926 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:57.358799 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fe893d18-131c-4762-b4e8-37eabd8a1abd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:57.359280 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ff97c30-ba43-48b3-9bc6-6eb3583e8926 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:57.359487 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fe893d18-131c-4762-b4e8-37eabd8a1abd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:57.359726 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ff97c30-ba43-48b3-9bc6-6eb3583e8926 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:57.359933 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fe893d18-131c-4762-b4e8-37eabd8a1abd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:57.360144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ff97c30-ba43-48b3-9bc6-6eb3583e8926 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:57.360354 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fe893d18-131c-4762-b4e8-37eabd8a1abd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:57.389454 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9ff97c30-ba43-48b3-9bc6-6eb3583e8926 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044539 Aug 24 12:39:57.389735 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fe893d18-131c-4762-b4e8-37eabd8a1abd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044729 Aug 24 12:39:57.389995 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 571/1145] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:57 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:57.390271 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 575/1146] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:57 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:39:57.920032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7f7da884-fb6e-49c4-9c71-0f3f9e025382 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:57.922173 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7f7da884-fb6e-49c4-9c71-0f3f9e025382 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:57.924112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=88 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:57.928724 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7f7da884-fb6e-49c4-9c71-0f3f9e025382 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:57.929208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7f7da884-fb6e-49c4-9c71-0f3f9e025382 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:57.929647 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7f7da884-fb6e-49c4-9c71-0f3f9e025382 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:57.930328 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7f7da884-fb6e-49c4-9c71-0f3f9e025382 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:57.930827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7f7da884-fb6e-49c4-9c71-0f3f9e025382 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:57.931254 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7f7da884-fb6e-49c4-9c71-0f3f9e025382 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:57.959984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7f7da884-fb6e-49c4-9c71-0f3f9e025382 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043930 Aug 24 12:39:57.960520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 572/1147] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:57 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:58.401780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-68fd3ded-67a5-4e29-ad4c-80406517d89a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:58.402387 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9bbf0559-42ed-4285-9498-5f2e2bedf890 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:58.403851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9bbf0559-42ed-4285-9498-5f2e2bedf890 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:58.403979 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-68fd3ded-67a5-4e29-ad4c-80406517d89a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:58.406100 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=84 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:58.410406 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-68fd3ded-67a5-4e29-ad4c-80406517d89a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:58.410621 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bbf0559-42ed-4285-9498-5f2e2bedf890 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:58.410923 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-68fd3ded-67a5-4e29-ad4c-80406517d89a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:58.411123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bbf0559-42ed-4285-9498-5f2e2bedf890 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:58.411361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-68fd3ded-67a5-4e29-ad4c-80406517d89a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:58.412293 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bbf0559-42ed-4285-9498-5f2e2bedf890 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:58.412645 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-68fd3ded-67a5-4e29-ad4c-80406517d89a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:58.412996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bbf0559-42ed-4285-9498-5f2e2bedf890 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:58.413114 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-68fd3ded-67a5-4e29-ad4c-80406517d89a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:58.413439 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bbf0559-42ed-4285-9498-5f2e2bedf890 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:58.413548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-68fd3ded-67a5-4e29-ad4c-80406517d89a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:58.413858 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bbf0559-42ed-4285-9498-5f2e2bedf890 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:58.442793 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-68fd3ded-67a5-4e29-ad4c-80406517d89a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044904 Aug 24 12:39:58.443357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 573/1148] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:58 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:58.443636 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9bbf0559-42ed-4285-9498-5f2e2bedf890 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045790 Aug 24 12:39:58.444174 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 576/1149] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:58 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:58.971252 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0b05cb11-e2fb-4955-a57e-bdcaa4b49006 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:58.973380 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0b05cb11-e2fb-4955-a57e-bdcaa4b49006 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:58.979570 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b05cb11-e2fb-4955-a57e-bdcaa4b49006 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:58.980050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b05cb11-e2fb-4955-a57e-bdcaa4b49006 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:58.980567 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b05cb11-e2fb-4955-a57e-bdcaa4b49006 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:58.981250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b05cb11-e2fb-4955-a57e-bdcaa4b49006 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:58.981700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b05cb11-e2fb-4955-a57e-bdcaa4b49006 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:58.982123 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b05cb11-e2fb-4955-a57e-bdcaa4b49006 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:59.010841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0b05cb11-e2fb-4955-a57e-bdcaa4b49006 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043515 Aug 24 12:39:59.011367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 574/1150] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:58 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:59.206955 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:39:59.207121 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 12:39:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:39:59.455485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b7d19cad-ad17-4868-9443-a7ebec74d822 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:59.455986 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d7a34b06-6bde-4690-83ad-6b9adb875931 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:59.457594 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d7a34b06-6bde-4690-83ad-6b9adb875931 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:59.457709 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b7d19cad-ad17-4868-9443-a7ebec74d822 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:59.464458 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b7d19cad-ad17-4868-9443-a7ebec74d822 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:59.464596 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7a34b06-6bde-4690-83ad-6b9adb875931 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:59.464940 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b7d19cad-ad17-4868-9443-a7ebec74d822 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:59.465074 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7a34b06-6bde-4690-83ad-6b9adb875931 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:59.465370 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7a34b06-6bde-4690-83ad-6b9adb875931 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:59.465556 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b7d19cad-ad17-4868-9443-a7ebec74d822 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:59.466051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b7d19cad-ad17-4868-9443-a7ebec74d822 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:59.466170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7a34b06-6bde-4690-83ad-6b9adb875931 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:59.466497 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7a34b06-6bde-4690-83ad-6b9adb875931 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:59.466600 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b7d19cad-ad17-4868-9443-a7ebec74d822 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:59.466941 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b7d19cad-ad17-4868-9443-a7ebec74d822 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:59.467044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7a34b06-6bde-4690-83ad-6b9adb875931 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:59.495868 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b7d19cad-ad17-4868-9443-a7ebec74d822 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044405 Aug 24 12:39:59.496397 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 577/1151] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:59 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:59.497292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d7a34b06-6bde-4690-83ad-6b9adb875931 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045671 Aug 24 12:39:59.497840 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 575/1152] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:39:59 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:40:00.022886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5e9c40aa-47e4-4eec-b024-6d457799b85f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:00.025053 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5e9c40aa-47e4-4eec-b024-6d457799b85f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:00.030912 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5e9c40aa-47e4-4eec-b024-6d457799b85f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:00.031394 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5e9c40aa-47e4-4eec-b024-6d457799b85f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:00.031825 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5e9c40aa-47e4-4eec-b024-6d457799b85f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:00.032499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5e9c40aa-47e4-4eec-b024-6d457799b85f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:00.032943 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5e9c40aa-47e4-4eec-b024-6d457799b85f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:00.033361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5e9c40aa-47e4-4eec-b024-6d457799b85f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:00.061510 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5e9c40aa-47e4-4eec-b024-6d457799b85f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042612 Aug 24 12:40:00.062042 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 578/1153] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:00 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:00.508151 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-747c73c7-94bf-4f62-b415-8d78038ade3b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:00.508811 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-50a4c53a-9f3f-48d2-9a16-876a3208c3a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:00.510290 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-747c73c7-94bf-4f62-b415-8d78038ade3b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:00.510911 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-50a4c53a-9f3f-48d2-9a16-876a3208c3a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:00.517143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-747c73c7-94bf-4f62-b415-8d78038ade3b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:00.517297 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-50a4c53a-9f3f-48d2-9a16-876a3208c3a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:00.517630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-747c73c7-94bf-4f62-b415-8d78038ade3b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:00.517758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-50a4c53a-9f3f-48d2-9a16-876a3208c3a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:00.518067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-747c73c7-94bf-4f62-b415-8d78038ade3b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:00.518211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-50a4c53a-9f3f-48d2-9a16-876a3208c3a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:00.518786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-747c73c7-94bf-4f62-b415-8d78038ade3b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:00.518890 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-50a4c53a-9f3f-48d2-9a16-876a3208c3a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:00.519251 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-747c73c7-94bf-4f62-b415-8d78038ade3b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:00.519361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-50a4c53a-9f3f-48d2-9a16-876a3208c3a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:00.519677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-747c73c7-94bf-4f62-b415-8d78038ade3b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:00.519776 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-50a4c53a-9f3f-48d2-9a16-876a3208c3a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:00.547967 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-747c73c7-94bf-4f62-b415-8d78038ade3b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043754 Aug 24 12:40:00.548274 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-50a4c53a-9f3f-48d2-9a16-876a3208c3a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043444 Aug 24 12:40:00.548515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 576/1154] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:00 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:00.548812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 579/1155] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:00 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:40:01.073899 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ac79b365-6503-410a-942a-1ab35c573bf1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:01.076106 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ac79b365-6503-410a-942a-1ab35c573bf1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:01.081960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac79b365-6503-410a-942a-1ab35c573bf1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:01.082437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac79b365-6503-410a-942a-1ab35c573bf1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:01.082910 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac79b365-6503-410a-942a-1ab35c573bf1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:01.084236 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac79b365-6503-410a-942a-1ab35c573bf1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:01.084688 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac79b365-6503-410a-942a-1ab35c573bf1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:01.085109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac79b365-6503-410a-942a-1ab35c573bf1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:01.113552 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ac79b365-6503-410a-942a-1ab35c573bf1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043572 Aug 24 12:40:01.114339 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 577/1156] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:01 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:01.561146 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7876c63c-ec24-4304-afec-93dc9471a52c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:01.563419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7876c63c-ec24-4304-afec-93dc9471a52c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:01.570422 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7876c63c-ec24-4304-afec-93dc9471a52c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:01.570928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7876c63c-ec24-4304-afec-93dc9471a52c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:01.571365 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7876c63c-ec24-4304-afec-93dc9471a52c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:01.572056 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7876c63c-ec24-4304-afec-93dc9471a52c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:01.572525 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7876c63c-ec24-4304-afec-93dc9471a52c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:01.572929 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7876c63c-ec24-4304-afec-93dc9471a52c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:01.601889 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7876c63c-ec24-4304-afec-93dc9471a52c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044682 Aug 24 12:40:01.602436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 578/1157] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:01 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:01.607366 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ceef412d-1adb-4e8f-ad93-8f0f7b71ae1e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:01.609464 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ceef412d-1adb-4e8f-ad93-8f0f7b71ae1e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:01.616457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ceef412d-1adb-4e8f-ad93-8f0f7b71ae1e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:01.616939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ceef412d-1adb-4e8f-ad93-8f0f7b71ae1e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:01.617375 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ceef412d-1adb-4e8f-ad93-8f0f7b71ae1e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:01.618055 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ceef412d-1adb-4e8f-ad93-8f0f7b71ae1e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:01.618501 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ceef412d-1adb-4e8f-ad93-8f0f7b71ae1e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:01.619033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ceef412d-1adb-4e8f-ad93-8f0f7b71ae1e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:01.647508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ceef412d-1adb-4e8f-ad93-8f0f7b71ae1e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090357 Aug 24 12:40:01.648063 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 580/1158] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:01 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:02.126114 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-71726e3f-d0b0-494b-ac7a-0e9af5cf25ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:02.128228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-71726e3f-d0b0-494b-ac7a-0e9af5cf25ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:02.134319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-71726e3f-d0b0-494b-ac7a-0e9af5cf25ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:02.134842 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-71726e3f-d0b0-494b-ac7a-0e9af5cf25ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:02.135281 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-71726e3f-d0b0-494b-ac7a-0e9af5cf25ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:02.136000 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-71726e3f-d0b0-494b-ac7a-0e9af5cf25ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:02.136449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-71726e3f-d0b0-494b-ac7a-0e9af5cf25ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:02.136867 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-71726e3f-d0b0-494b-ac7a-0e9af5cf25ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:02.165975 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-71726e3f-d0b0-494b-ac7a-0e9af5cf25ec tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043925 Aug 24 12:40:02.166504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 579/1159] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:02 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:02.613803 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cbe52e63-e9e8-4749-bdb6-02414a00c276 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:02.616215 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cbe52e63-e9e8-4749-bdb6-02414a00c276 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:02.622584 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cbe52e63-e9e8-4749-bdb6-02414a00c276 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:02.623094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cbe52e63-e9e8-4749-bdb6-02414a00c276 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:02.623528 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cbe52e63-e9e8-4749-bdb6-02414a00c276 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:02.624211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cbe52e63-e9e8-4749-bdb6-02414a00c276 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:02.624662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cbe52e63-e9e8-4749-bdb6-02414a00c276 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:02.625085 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cbe52e63-e9e8-4749-bdb6-02414a00c276 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:02.655382 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cbe52e63-e9e8-4749-bdb6-02414a00c276 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045503 Aug 24 12:40:02.656085 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 581/1160] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:02 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:40:02.659757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-137e82fd-ae38-4ea3-869c-2afa84f1fe83 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:02.661889 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-137e82fd-ae38-4ea3-869c-2afa84f1fe83 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:02.668399 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-137e82fd-ae38-4ea3-869c-2afa84f1fe83 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:02.668889 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-137e82fd-ae38-4ea3-869c-2afa84f1fe83 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:02.669334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-137e82fd-ae38-4ea3-869c-2afa84f1fe83 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:02.670027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-137e82fd-ae38-4ea3-869c-2afa84f1fe83 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:02.670482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-137e82fd-ae38-4ea3-869c-2afa84f1fe83 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:02.670985 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-137e82fd-ae38-4ea3-869c-2afa84f1fe83 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:02.699936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-137e82fd-ae38-4ea3-869c-2afa84f1fe83 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044187 Aug 24 12:40:02.700457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 580/1161] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:02 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:40:02.998967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:40:02.999158 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 12:40:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:40:03.178666 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-32dce5e4-bae6-43ad-8983-99bc7f6749b1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:03.180769 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-32dce5e4-bae6-43ad-8983-99bc7f6749b1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:03.186637 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-32dce5e4-bae6-43ad-8983-99bc7f6749b1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:03.187143 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-32dce5e4-bae6-43ad-8983-99bc7f6749b1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:03.187572 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-32dce5e4-bae6-43ad-8983-99bc7f6749b1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:03.188276 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-32dce5e4-bae6-43ad-8983-99bc7f6749b1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:03.188722 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-32dce5e4-bae6-43ad-8983-99bc7f6749b1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:03.189138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-32dce5e4-bae6-43ad-8983-99bc7f6749b1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:03.217796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-32dce5e4-bae6-43ad-8983-99bc7f6749b1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043511 Aug 24 12:40:03.218332 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 582/1162] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:03 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:03.668282 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6de7e481-258d-4f61-9033-ce69338af7f3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:03.670326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6de7e481-258d-4f61-9033-ce69338af7f3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:03.676611 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6de7e481-258d-4f61-9033-ce69338af7f3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:03.677089 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6de7e481-258d-4f61-9033-ce69338af7f3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:03.677588 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6de7e481-258d-4f61-9033-ce69338af7f3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:03.678268 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6de7e481-258d-4f61-9033-ce69338af7f3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:03.678748 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6de7e481-258d-4f61-9033-ce69338af7f3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:03.679171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6de7e481-258d-4f61-9033-ce69338af7f3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:03.706478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6de7e481-258d-4f61-9033-ce69338af7f3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042247 Aug 24 12:40:03.707034 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 581/1163] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:03 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:03.712542 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c0bb7860-997f-40a8-acc2-d089ac2bde17 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:03.714729 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c0bb7860-997f-40a8-acc2-d089ac2bde17 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:03.721114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0bb7860-997f-40a8-acc2-d089ac2bde17 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:03.721598 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0bb7860-997f-40a8-acc2-d089ac2bde17 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:03.722037 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0bb7860-997f-40a8-acc2-d089ac2bde17 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:03.722754 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0bb7860-997f-40a8-acc2-d089ac2bde17 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:03.723209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0bb7860-997f-40a8-acc2-d089ac2bde17 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:03.723633 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0bb7860-997f-40a8-acc2-d089ac2bde17 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:03.752375 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c0bb7860-997f-40a8-acc2-d089ac2bde17 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045100 Aug 24 12:40:03.752920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 583/1164] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:03 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:40:04.230847 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-911e19e5-f74f-40cc-ae6b-0da0ed6ad4f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:04.233083 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-911e19e5-f74f-40cc-ae6b-0da0ed6ad4f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:04.239503 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-911e19e5-f74f-40cc-ae6b-0da0ed6ad4f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:04.240009 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-911e19e5-f74f-40cc-ae6b-0da0ed6ad4f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:04.240442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-911e19e5-f74f-40cc-ae6b-0da0ed6ad4f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:04.241131 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-911e19e5-f74f-40cc-ae6b-0da0ed6ad4f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:04.241580 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-911e19e5-f74f-40cc-ae6b-0da0ed6ad4f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:04.242000 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-911e19e5-f74f-40cc-ae6b-0da0ed6ad4f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:04.271637 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-911e19e5-f74f-40cc-ae6b-0da0ed6ad4f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045493 Aug 24 12:40:04.272195 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 582/1165] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:04 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:04.718802 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d3267734-5899-4f64-97aa-e0598dbb3be7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:04.720926 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d3267734-5899-4f64-97aa-e0598dbb3be7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:04.727327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3267734-5899-4f64-97aa-e0598dbb3be7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:04.727801 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3267734-5899-4f64-97aa-e0598dbb3be7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:04.728234 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3267734-5899-4f64-97aa-e0598dbb3be7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:04.728920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3267734-5899-4f64-97aa-e0598dbb3be7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:04.729370 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3267734-5899-4f64-97aa-e0598dbb3be7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:04.729797 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3267734-5899-4f64-97aa-e0598dbb3be7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:04.759534 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d3267734-5899-4f64-97aa-e0598dbb3be7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044725 Aug 24 12:40:04.760231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 584/1166] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:04 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:04.763936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-67d93eee-0f70-4f6d-9edd-7e00c17499dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:04.766127 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-67d93eee-0f70-4f6d-9edd-7e00c17499dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:04.772397 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67d93eee-0f70-4f6d-9edd-7e00c17499dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:04.772870 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67d93eee-0f70-4f6d-9edd-7e00c17499dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:04.773303 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67d93eee-0f70-4f6d-9edd-7e00c17499dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:04.773985 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67d93eee-0f70-4f6d-9edd-7e00c17499dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:04.774433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67d93eee-0f70-4f6d-9edd-7e00c17499dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:04.774881 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67d93eee-0f70-4f6d-9edd-7e00c17499dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:04.777159 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:04.804873 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-67d93eee-0f70-4f6d-9edd-7e00c17499dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044929 Aug 24 12:40:04.805413 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 583/1167] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:04 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:40:05.283808 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9ad8452d-144b-493b-b7e6-6b50b60a1f26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:05.285961 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9ad8452d-144b-493b-b7e6-6b50b60a1f26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:05.291817 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9ad8452d-144b-493b-b7e6-6b50b60a1f26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:05.292297 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9ad8452d-144b-493b-b7e6-6b50b60a1f26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:05.292727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9ad8452d-144b-493b-b7e6-6b50b60a1f26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:05.293396 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9ad8452d-144b-493b-b7e6-6b50b60a1f26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:05.293841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9ad8452d-144b-493b-b7e6-6b50b60a1f26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:05.294274 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9ad8452d-144b-493b-b7e6-6b50b60a1f26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:05.319543 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:05.324075 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9ad8452d-144b-493b-b7e6-6b50b60a1f26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044251 Aug 24 12:40:05.324611 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 585/1168] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:05 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:05.772146 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fa002b59-5f10-49aa-8f13-d03184caa928 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:05.774283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fa002b59-5f10-49aa-8f13-d03184caa928 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:05.780766 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa002b59-5f10-49aa-8f13-d03184caa928 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:05.781251 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa002b59-5f10-49aa-8f13-d03184caa928 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:05.781687 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa002b59-5f10-49aa-8f13-d03184caa928 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:05.782370 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa002b59-5f10-49aa-8f13-d03184caa928 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:05.782855 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa002b59-5f10-49aa-8f13-d03184caa928 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:05.783281 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa002b59-5f10-49aa-8f13-d03184caa928 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:05.812099 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fa002b59-5f10-49aa-8f13-d03184caa928 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044299 Aug 24 12:40:05.812642 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 584/1169] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:05 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:05.817497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-140e0270-8389-4123-a932-8076b1de1482 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:05.819714 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-140e0270-8389-4123-a932-8076b1de1482 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:05.826014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-140e0270-8389-4123-a932-8076b1de1482 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:05.826495 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-140e0270-8389-4123-a932-8076b1de1482 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:05.826954 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-140e0270-8389-4123-a932-8076b1de1482 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:05.827641 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-140e0270-8389-4123-a932-8076b1de1482 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:05.828092 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-140e0270-8389-4123-a932-8076b1de1482 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:05.828519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-140e0270-8389-4123-a932-8076b1de1482 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:05.857028 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-140e0270-8389-4123-a932-8076b1de1482 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043993 Aug 24 12:40:05.857560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 586/1170] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:05 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:40:06.337183 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e811890c-4f59-4922-97b6-d53ad634ef58 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:06.339356 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e811890c-4f59-4922-97b6-d53ad634ef58 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:06.345263 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e811890c-4f59-4922-97b6-d53ad634ef58 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:06.345742 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e811890c-4f59-4922-97b6-d53ad634ef58 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:06.346188 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e811890c-4f59-4922-97b6-d53ad634ef58 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:06.346894 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e811890c-4f59-4922-97b6-d53ad634ef58 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:06.347353 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e811890c-4f59-4922-97b6-d53ad634ef58 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:06.347775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e811890c-4f59-4922-97b6-d53ad634ef58 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:06.376470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e811890c-4f59-4922-97b6-d53ad634ef58 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044039 Aug 24 12:40:06.377007 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 585/1171] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:06 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:06.824518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b5d0df32-260f-45ca-a1f9-dedc144bc0a8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:06.826644 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b5d0df32-260f-45ca-a1f9-dedc144bc0a8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:06.832965 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b5d0df32-260f-45ca-a1f9-dedc144bc0a8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:06.833446 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b5d0df32-260f-45ca-a1f9-dedc144bc0a8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:06.833887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b5d0df32-260f-45ca-a1f9-dedc144bc0a8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:06.834565 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b5d0df32-260f-45ca-a1f9-dedc144bc0a8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:06.835032 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b5d0df32-260f-45ca-a1f9-dedc144bc0a8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:06.835451 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b5d0df32-260f-45ca-a1f9-dedc144bc0a8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:06.862775 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b5d0df32-260f-45ca-a1f9-dedc144bc0a8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042195 Aug 24 12:40:06.863480 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 587/1172] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:06 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:06.870207 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fd73e959-90b9-4b9b-96e6-2f5677c50313 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:06.872349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fd73e959-90b9-4b9b-96e6-2f5677c50313 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:06.878150 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fd73e959-90b9-4b9b-96e6-2f5677c50313 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:06.878624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fd73e959-90b9-4b9b-96e6-2f5677c50313 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:06.879091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fd73e959-90b9-4b9b-96e6-2f5677c50313 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:06.879773 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fd73e959-90b9-4b9b-96e6-2f5677c50313 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:06.880868 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fd73e959-90b9-4b9b-96e6-2f5677c50313 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:06.881313 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fd73e959-90b9-4b9b-96e6-2f5677c50313 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:06.909797 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fd73e959-90b9-4b9b-96e6-2f5677c50313 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043476 Aug 24 12:40:06.910323 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 586/1173] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:06 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:07.389014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-91f5b1cb-c0f3-4ebf-985a-46361e5acf1c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:07.391159 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-91f5b1cb-c0f3-4ebf-985a-46361e5acf1c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:07.397674 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91f5b1cb-c0f3-4ebf-985a-46361e5acf1c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:07.398144 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91f5b1cb-c0f3-4ebf-985a-46361e5acf1c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:07.398569 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91f5b1cb-c0f3-4ebf-985a-46361e5acf1c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:07.399275 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91f5b1cb-c0f3-4ebf-985a-46361e5acf1c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:07.399717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91f5b1cb-c0f3-4ebf-985a-46361e5acf1c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:07.400136 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91f5b1cb-c0f3-4ebf-985a-46361e5acf1c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:07.428787 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-91f5b1cb-c0f3-4ebf-985a-46361e5acf1c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043690 Aug 24 12:40:07.429326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 588/1174] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:07 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:07.875778 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-93ae21d7-6e33-4a19-b104-67226286f42f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:07.877920 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-93ae21d7-6e33-4a19-b104-67226286f42f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:07.886535 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-93ae21d7-6e33-4a19-b104-67226286f42f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:07.887061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-93ae21d7-6e33-4a19-b104-67226286f42f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:07.887525 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-93ae21d7-6e33-4a19-b104-67226286f42f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:07.888206 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-93ae21d7-6e33-4a19-b104-67226286f42f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:07.888661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-93ae21d7-6e33-4a19-b104-67226286f42f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:07.889084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-93ae21d7-6e33-4a19-b104-67226286f42f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:07.919021 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-93ae21d7-6e33-4a19-b104-67226286f42f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047074 Aug 24 12:40:07.919537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 587/1175] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:07 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:07.926020 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6941e1c3-5eba-46d4-a0f3-e74ce56c99e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:07.930263 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6941e1c3-5eba-46d4-a0f3-e74ce56c99e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:07.942336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6941e1c3-5eba-46d4-a0f3-e74ce56c99e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:07.943048 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6941e1c3-5eba-46d4-a0f3-e74ce56c99e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:07.943746 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6941e1c3-5eba-46d4-a0f3-e74ce56c99e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:07.945526 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6941e1c3-5eba-46d4-a0f3-e74ce56c99e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:07.946334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6941e1c3-5eba-46d4-a0f3-e74ce56c99e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:07.947054 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6941e1c3-5eba-46d4-a0f3-e74ce56c99e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:07.981468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6941e1c3-5eba-46d4-a0f3-e74ce56c99e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062526 Aug 24 12:40:07.982020 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 589/1176] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:07 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:40:08.440784 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fa7cfec9-f4df-4d0c-9c3b-f1a376290331 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:08.442962 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fa7cfec9-f4df-4d0c-9c3b-f1a376290331 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:08.449526 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa7cfec9-f4df-4d0c-9c3b-f1a376290331 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:08.450014 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa7cfec9-f4df-4d0c-9c3b-f1a376290331 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:08.450446 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa7cfec9-f4df-4d0c-9c3b-f1a376290331 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:08.451227 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa7cfec9-f4df-4d0c-9c3b-f1a376290331 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:08.451680 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa7cfec9-f4df-4d0c-9c3b-f1a376290331 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:08.452100 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa7cfec9-f4df-4d0c-9c3b-f1a376290331 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:08.480279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fa7cfec9-f4df-4d0c-9c3b-f1a376290331 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043423 Aug 24 12:40:08.480818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 588/1177] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:08 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:08.931911 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ebcffc8b-a3a3-4206-a3aa-49d9562feb39 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:08.933970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ebcffc8b-a3a3-4206-a3aa-49d9562feb39 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:08.940302 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ebcffc8b-a3a3-4206-a3aa-49d9562feb39 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:08.940778 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ebcffc8b-a3a3-4206-a3aa-49d9562feb39 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:08.941213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ebcffc8b-a3a3-4206-a3aa-49d9562feb39 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:08.941896 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ebcffc8b-a3a3-4206-a3aa-49d9562feb39 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:08.942346 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ebcffc8b-a3a3-4206-a3aa-49d9562feb39 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:08.942795 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ebcffc8b-a3a3-4206-a3aa-49d9562feb39 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:08.970828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ebcffc8b-a3a3-4206-a3aa-49d9562feb39 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042979 Aug 24 12:40:08.971364 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 590/1178] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:08 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:08.993596 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f4dab56c-d2d1-485e-adc1-6776091a9d05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:08.995831 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f4dab56c-d2d1-485e-adc1-6776091a9d05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:09.002244 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4dab56c-d2d1-485e-adc1-6776091a9d05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:09.002757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4dab56c-d2d1-485e-adc1-6776091a9d05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:09.003200 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4dab56c-d2d1-485e-adc1-6776091a9d05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:09.003896 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4dab56c-d2d1-485e-adc1-6776091a9d05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:09.004357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4dab56c-d2d1-485e-adc1-6776091a9d05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:09.004786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4dab56c-d2d1-485e-adc1-6776091a9d05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:09.033531 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f4dab56c-d2d1-485e-adc1-6776091a9d05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044153 Aug 24 12:40:09.034064 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 589/1179] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:08 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:09.492659 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1faeaad9-edb9-479a-86e2-02f41bede94a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:09.494826 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1faeaad9-edb9-479a-86e2-02f41bede94a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:09.500883 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1faeaad9-edb9-479a-86e2-02f41bede94a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:09.501366 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1faeaad9-edb9-479a-86e2-02f41bede94a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:09.501826 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1faeaad9-edb9-479a-86e2-02f41bede94a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:09.502512 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1faeaad9-edb9-479a-86e2-02f41bede94a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:09.502993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1faeaad9-edb9-479a-86e2-02f41bede94a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:09.503441 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1faeaad9-edb9-479a-86e2-02f41bede94a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:09.533000 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1faeaad9-edb9-479a-86e2-02f41bede94a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044552 Aug 24 12:40:09.533527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 591/1180] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:09 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:09.983700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b1cc27a4-0f28-4de4-acf4-089e08725902 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:09.985845 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b1cc27a4-0f28-4de4-acf4-089e08725902 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:09.992532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1cc27a4-0f28-4de4-acf4-089e08725902 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:09.993012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1cc27a4-0f28-4de4-acf4-089e08725902 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:09.993448 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1cc27a4-0f28-4de4-acf4-089e08725902 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:09.994138 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1cc27a4-0f28-4de4-acf4-089e08725902 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:09.994727 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1cc27a4-0f28-4de4-acf4-089e08725902 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:09.995063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1cc27a4-0f28-4de4-acf4-089e08725902 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:10.023474 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b1cc27a4-0f28-4de4-acf4-089e08725902 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043688 Aug 24 12:40:10.024016 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 590/1181] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:09 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:10.045905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d3b71717-b28f-4a97-a44d-b7ba5e2be70c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:10.048062 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d3b71717-b28f-4a97-a44d-b7ba5e2be70c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:10.054970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3b71717-b28f-4a97-a44d-b7ba5e2be70c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:10.055447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3b71717-b28f-4a97-a44d-b7ba5e2be70c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:10.055881 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3b71717-b28f-4a97-a44d-b7ba5e2be70c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:10.056563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3b71717-b28f-4a97-a44d-b7ba5e2be70c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:10.057012 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3b71717-b28f-4a97-a44d-b7ba5e2be70c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:10.057437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3b71717-b28f-4a97-a44d-b7ba5e2be70c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:10.085397 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d3b71717-b28f-4a97-a44d-b7ba5e2be70c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043398 Aug 24 12:40:10.085931 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 592/1182] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:10 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:10.545102 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d7571d89-8d48-40ad-9c20-c68a154e919a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:10.547266 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d7571d89-8d48-40ad-9c20-c68a154e919a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:10.553254 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7571d89-8d48-40ad-9c20-c68a154e919a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:10.553733 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7571d89-8d48-40ad-9c20-c68a154e919a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:10.554171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7571d89-8d48-40ad-9c20-c68a154e919a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:10.554886 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7571d89-8d48-40ad-9c20-c68a154e919a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:10.555344 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7571d89-8d48-40ad-9c20-c68a154e919a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:10.555773 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7571d89-8d48-40ad-9c20-c68a154e919a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:10.588579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d7571d89-8d48-40ad-9c20-c68a154e919a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047387 Aug 24 12:40:10.589124 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 591/1183] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:10 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:11.035912 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-26c50f1b-5397-4bf2-b4d4-abf09cb8557f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:11.038147 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-26c50f1b-5397-4bf2-b4d4-abf09cb8557f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:11.043994 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26c50f1b-5397-4bf2-b4d4-abf09cb8557f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:11.044457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26c50f1b-5397-4bf2-b4d4-abf09cb8557f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:11.044881 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26c50f1b-5397-4bf2-b4d4-abf09cb8557f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:11.045553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26c50f1b-5397-4bf2-b4d4-abf09cb8557f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:11.045994 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26c50f1b-5397-4bf2-b4d4-abf09cb8557f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:11.046522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26c50f1b-5397-4bf2-b4d4-abf09cb8557f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:11.075009 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-26c50f1b-5397-4bf2-b4d4-abf09cb8557f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043015 Aug 24 12:40:11.075604 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 593/1184] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:11 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:11.097325 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6fcc7e93-e4b1-4033-9246-89f1bfe44451 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:11.099505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6fcc7e93-e4b1-4033-9246-89f1bfe44451 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:11.105791 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6fcc7e93-e4b1-4033-9246-89f1bfe44451 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:11.106272 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6fcc7e93-e4b1-4033-9246-89f1bfe44451 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:11.106740 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6fcc7e93-e4b1-4033-9246-89f1bfe44451 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:11.107433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6fcc7e93-e4b1-4033-9246-89f1bfe44451 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:11.107892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6fcc7e93-e4b1-4033-9246-89f1bfe44451 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:11.108324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6fcc7e93-e4b1-4033-9246-89f1bfe44451 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:11.137440 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6fcc7e93-e4b1-4033-9246-89f1bfe44451 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044065 Aug 24 12:40:11.137979 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 592/1185] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:11 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:11.601562 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-deadda93-5932-463f-827d-e623b85a242e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:11.603738 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-deadda93-5932-463f-827d-e623b85a242e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:11.609516 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-deadda93-5932-463f-827d-e623b85a242e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:11.609993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-deadda93-5932-463f-827d-e623b85a242e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:11.610462 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-deadda93-5932-463f-827d-e623b85a242e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:11.611169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-deadda93-5932-463f-827d-e623b85a242e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:11.611613 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-deadda93-5932-463f-827d-e623b85a242e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:11.612816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-deadda93-5932-463f-827d-e623b85a242e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:11.640965 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-deadda93-5932-463f-827d-e623b85a242e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044110 Aug 24 12:40:11.641540 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 594/1186] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:11 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:12.033738 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:40:12.034475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 12:40:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:40:12.087332 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d627e3ba-49a8-44ac-be99-3a6bde808859 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:12.089499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d627e3ba-49a8-44ac-be99-3a6bde808859 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:12.095434 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d627e3ba-49a8-44ac-be99-3a6bde808859 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:12.095918 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d627e3ba-49a8-44ac-be99-3a6bde808859 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:12.096357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d627e3ba-49a8-44ac-be99-3a6bde808859 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:12.097038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d627e3ba-49a8-44ac-be99-3a6bde808859 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:12.097493 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d627e3ba-49a8-44ac-be99-3a6bde808859 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:12.098021 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d627e3ba-49a8-44ac-be99-3a6bde808859 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:12.126434 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d627e3ba-49a8-44ac-be99-3a6bde808859 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043664 Aug 24 12:40:12.127004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 593/1187] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:12 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:12.150095 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3c160cec-aa12-45eb-ba14-7480019f712b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:12.152293 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3c160cec-aa12-45eb-ba14-7480019f712b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:12.158677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c160cec-aa12-45eb-ba14-7480019f712b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:12.159154 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c160cec-aa12-45eb-ba14-7480019f712b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:12.159614 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c160cec-aa12-45eb-ba14-7480019f712b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:12.160294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c160cec-aa12-45eb-ba14-7480019f712b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:12.160742 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c160cec-aa12-45eb-ba14-7480019f712b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:12.161170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c160cec-aa12-45eb-ba14-7480019f712b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:12.190143 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3c160cec-aa12-45eb-ba14-7480019f712b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044691 Aug 24 12:40:12.190874 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 595/1188] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:12 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:12.511848 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:40:12.512029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 12:40:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:40:12.653200 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-56d4f82e-117b-4868-85f0-84ec19c8a808 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:12.655401 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-56d4f82e-117b-4868-85f0-84ec19c8a808 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:12.661374 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-56d4f82e-117b-4868-85f0-84ec19c8a808 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:12.661861 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-56d4f82e-117b-4868-85f0-84ec19c8a808 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:12.662298 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-56d4f82e-117b-4868-85f0-84ec19c8a808 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:12.663050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-56d4f82e-117b-4868-85f0-84ec19c8a808 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:12.663504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-56d4f82e-117b-4868-85f0-84ec19c8a808 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:12.663929 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-56d4f82e-117b-4868-85f0-84ec19c8a808 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:12.692496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-56d4f82e-117b-4868-85f0-84ec19c8a808 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043238 Aug 24 12:40:12.692965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 594/1189] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:12 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:13.138803 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4c88c0c4-b1ca-4802-95bb-9f43f957d9a4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:13.140958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4c88c0c4-b1ca-4802-95bb-9f43f957d9a4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:13.146883 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4c88c0c4-b1ca-4802-95bb-9f43f957d9a4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:13.147357 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4c88c0c4-b1ca-4802-95bb-9f43f957d9a4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:13.147782 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4c88c0c4-b1ca-4802-95bb-9f43f957d9a4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:13.148454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4c88c0c4-b1ca-4802-95bb-9f43f957d9a4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:13.148895 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4c88c0c4-b1ca-4802-95bb-9f43f957d9a4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:13.149307 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4c88c0c4-b1ca-4802-95bb-9f43f957d9a4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:13.178052 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4c88c0c4-b1ca-4802-95bb-9f43f957d9a4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043259 Aug 24 12:40:13.179476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 596/1190] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:13 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:13.204773 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-27d1c77d-87c2-42d4-a2e6-9e832167cb59 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:13.207141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-27d1c77d-87c2-42d4-a2e6-9e832167cb59 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:13.213527 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-27d1c77d-87c2-42d4-a2e6-9e832167cb59 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:13.214006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-27d1c77d-87c2-42d4-a2e6-9e832167cb59 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:13.214443 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-27d1c77d-87c2-42d4-a2e6-9e832167cb59 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:13.215167 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-27d1c77d-87c2-42d4-a2e6-9e832167cb59 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:13.215624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-27d1c77d-87c2-42d4-a2e6-9e832167cb59 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:13.216050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-27d1c77d-87c2-42d4-a2e6-9e832167cb59 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:13.246458 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-27d1c77d-87c2-42d4-a2e6-9e832167cb59 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048503 Aug 24 12:40:13.247033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 595/1191] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:13 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:13.705217 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-00e1a3e7-c13b-4fda-900e-fecfa810adba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:13.707320 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-00e1a3e7-c13b-4fda-900e-fecfa810adba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:13.713224 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00e1a3e7-c13b-4fda-900e-fecfa810adba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:13.713732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00e1a3e7-c13b-4fda-900e-fecfa810adba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:13.714169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00e1a3e7-c13b-4fda-900e-fecfa810adba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:13.714873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00e1a3e7-c13b-4fda-900e-fecfa810adba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:13.715325 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00e1a3e7-c13b-4fda-900e-fecfa810adba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:13.715751 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00e1a3e7-c13b-4fda-900e-fecfa810adba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:13.744344 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-00e1a3e7-c13b-4fda-900e-fecfa810adba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043155 Aug 24 12:40:13.744881 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 597/1192] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:13 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:14.200332 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-77aa9b06-98bb-4473-82b7-6935dbdfa513 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:14.202560 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-77aa9b06-98bb-4473-82b7-6935dbdfa513 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:14.208477 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-77aa9b06-98bb-4473-82b7-6935dbdfa513 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:14.208984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-77aa9b06-98bb-4473-82b7-6935dbdfa513 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:14.209419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-77aa9b06-98bb-4473-82b7-6935dbdfa513 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:14.210055 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-77aa9b06-98bb-4473-82b7-6935dbdfa513 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:14.210505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-77aa9b06-98bb-4473-82b7-6935dbdfa513 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:14.211458 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-77aa9b06-98bb-4473-82b7-6935dbdfa513 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:14.240736 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-77aa9b06-98bb-4473-82b7-6935dbdfa513 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044333 Aug 24 12:40:14.241273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 596/1193] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:14 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:14.258583 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-41c96dc9-5894-4c0b-affe-a73e62de93a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:14.260761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-41c96dc9-5894-4c0b-affe-a73e62de93a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:14.267109 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41c96dc9-5894-4c0b-affe-a73e62de93a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:14.267585 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41c96dc9-5894-4c0b-affe-a73e62de93a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:14.268015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41c96dc9-5894-4c0b-affe-a73e62de93a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:14.268694 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41c96dc9-5894-4c0b-affe-a73e62de93a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:14.269139 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41c96dc9-5894-4c0b-affe-a73e62de93a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:14.269556 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41c96dc9-5894-4c0b-affe-a73e62de93a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:14.299224 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-41c96dc9-5894-4c0b-affe-a73e62de93a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044547 Aug 24 12:40:14.299763 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 598/1194] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:14 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:14.756695 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1464eb5e-749c-4f80-9ff0-a629ce999ac6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:14.759351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1464eb5e-749c-4f80-9ff0-a629ce999ac6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:14.765174 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1464eb5e-749c-4f80-9ff0-a629ce999ac6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:14.765646 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1464eb5e-749c-4f80-9ff0-a629ce999ac6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:14.766075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1464eb5e-749c-4f80-9ff0-a629ce999ac6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:14.766780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1464eb5e-749c-4f80-9ff0-a629ce999ac6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:14.767230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1464eb5e-749c-4f80-9ff0-a629ce999ac6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:14.767652 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1464eb5e-749c-4f80-9ff0-a629ce999ac6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:14.796916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1464eb5e-749c-4f80-9ff0-a629ce999ac6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044183 Aug 24 12:40:14.797448 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 597/1195] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:14 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:15.252944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a25f41b9-dc32-4355-b27c-29d1c2c27b59 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:15.255125 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a25f41b9-dc32-4355-b27c-29d1c2c27b59 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:15.261117 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a25f41b9-dc32-4355-b27c-29d1c2c27b59 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:15.261678 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a25f41b9-dc32-4355-b27c-29d1c2c27b59 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:15.262006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a25f41b9-dc32-4355-b27c-29d1c2c27b59 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:15.262708 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a25f41b9-dc32-4355-b27c-29d1c2c27b59 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:15.263159 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a25f41b9-dc32-4355-b27c-29d1c2c27b59 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:15.263582 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a25f41b9-dc32-4355-b27c-29d1c2c27b59 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:15.292240 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a25f41b9-dc32-4355-b27c-29d1c2c27b59 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043216 Aug 24 12:40:15.292782 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 599/1196] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:15 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:15.311259 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0c49eb9b-fab9-475d-a4e7-ee23893a02d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:15.313402 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0c49eb9b-fab9-475d-a4e7-ee23893a02d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:15.319711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0c49eb9b-fab9-475d-a4e7-ee23893a02d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:15.320232 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0c49eb9b-fab9-475d-a4e7-ee23893a02d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:15.320677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0c49eb9b-fab9-475d-a4e7-ee23893a02d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:15.321362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0c49eb9b-fab9-475d-a4e7-ee23893a02d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:15.321809 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0c49eb9b-fab9-475d-a4e7-ee23893a02d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:15.322230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0c49eb9b-fab9-475d-a4e7-ee23893a02d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:15.350160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0c49eb9b-fab9-475d-a4e7-ee23893a02d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042840 Aug 24 12:40:15.350709 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 598/1197] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:15 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:15.808303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fc86ce2f-ff27-4e33-b85e-43baef333924 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:15.810431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fc86ce2f-ff27-4e33-b85e-43baef333924 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:15.816468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc86ce2f-ff27-4e33-b85e-43baef333924 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:15.816945 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc86ce2f-ff27-4e33-b85e-43baef333924 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:15.817379 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc86ce2f-ff27-4e33-b85e-43baef333924 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:15.818062 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc86ce2f-ff27-4e33-b85e-43baef333924 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:15.818512 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc86ce2f-ff27-4e33-b85e-43baef333924 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:15.818966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc86ce2f-ff27-4e33-b85e-43baef333924 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:15.847221 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fc86ce2f-ff27-4e33-b85e-43baef333924 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042963 Aug 24 12:40:15.847746 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 600/1198] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:15 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:16.304430 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-af6317d3-ad48-44b0-976e-8b3152ada3af tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:16.306481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-af6317d3-ad48-44b0-976e-8b3152ada3af tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:16.312426 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af6317d3-ad48-44b0-976e-8b3152ada3af tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:16.312977 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af6317d3-ad48-44b0-976e-8b3152ada3af tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:16.313324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af6317d3-ad48-44b0-976e-8b3152ada3af tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:16.314005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af6317d3-ad48-44b0-976e-8b3152ada3af tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:16.314457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af6317d3-ad48-44b0-976e-8b3152ada3af tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:16.314912 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af6317d3-ad48-44b0-976e-8b3152ada3af tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:16.339494 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:16.344103 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-af6317d3-ad48-44b0-976e-8b3152ada3af tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043708 Aug 24 12:40:16.344643 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 599/1199] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:16 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:16.362800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-98d7e440-0249-4e5e-9119-a07657833e09 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:16.365224 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-98d7e440-0249-4e5e-9119-a07657833e09 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:16.371627 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98d7e440-0249-4e5e-9119-a07657833e09 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:16.372101 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98d7e440-0249-4e5e-9119-a07657833e09 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:16.372531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98d7e440-0249-4e5e-9119-a07657833e09 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:16.373214 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98d7e440-0249-4e5e-9119-a07657833e09 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:16.373662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98d7e440-0249-4e5e-9119-a07657833e09 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:16.374085 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98d7e440-0249-4e5e-9119-a07657833e09 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:16.402958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-98d7e440-0249-4e5e-9119-a07657833e09 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044121 Aug 24 12:40:16.403496 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 601/1200] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:16 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:16.860049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-97f5e744-df20-4a21-9372-1dd63112f456 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:16.862211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-97f5e744-df20-4a21-9372-1dd63112f456 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:16.869289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97f5e744-df20-4a21-9372-1dd63112f456 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:16.869764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97f5e744-df20-4a21-9372-1dd63112f456 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:16.870193 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97f5e744-df20-4a21-9372-1dd63112f456 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:16.870896 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97f5e744-df20-4a21-9372-1dd63112f456 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:16.871345 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97f5e744-df20-4a21-9372-1dd63112f456 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:16.871763 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97f5e744-df20-4a21-9372-1dd63112f456 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:16.900173 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-97f5e744-df20-4a21-9372-1dd63112f456 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044033 Aug 24 12:40:16.900716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 600/1201] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:16 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:17.355497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-23a879ea-932a-4606-bbea-9b8343389282 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:17.358264 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-23a879ea-932a-4606-bbea-9b8343389282 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:17.364863 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-23a879ea-932a-4606-bbea-9b8343389282 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:17.365406 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-23a879ea-932a-4606-bbea-9b8343389282 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:17.365746 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-23a879ea-932a-4606-bbea-9b8343389282 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:17.366416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-23a879ea-932a-4606-bbea-9b8343389282 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:17.366881 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-23a879ea-932a-4606-bbea-9b8343389282 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:17.367323 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-23a879ea-932a-4606-bbea-9b8343389282 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:17.383416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:17.397177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-23a879ea-932a-4606-bbea-9b8343389282 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043671 Aug 24 12:40:17.397177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 602/1202] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:17 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:17.415942 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-95f3f068-3bbf-4893-8735-8b99698d3fde tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:17.418091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-95f3f068-3bbf-4893-8735-8b99698d3fde tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:17.424554 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95f3f068-3bbf-4893-8735-8b99698d3fde tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:17.425037 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95f3f068-3bbf-4893-8735-8b99698d3fde tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:17.425474 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95f3f068-3bbf-4893-8735-8b99698d3fde tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:17.426185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95f3f068-3bbf-4893-8735-8b99698d3fde tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:17.426622 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95f3f068-3bbf-4893-8735-8b99698d3fde tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:17.427076 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95f3f068-3bbf-4893-8735-8b99698d3fde tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:17.455891 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-95f3f068-3bbf-4893-8735-8b99698d3fde tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044598 Aug 24 12:40:17.456434 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 601/1203] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:17 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:17.912677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8f71354e-3fbb-4d80-aaf8-a04ef94f2b2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:17.914815 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8f71354e-3fbb-4d80-aaf8-a04ef94f2b2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:17.920652 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f71354e-3fbb-4d80-aaf8-a04ef94f2b2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:17.921125 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f71354e-3fbb-4d80-aaf8-a04ef94f2b2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:17.921555 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f71354e-3fbb-4d80-aaf8-a04ef94f2b2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:17.922226 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f71354e-3fbb-4d80-aaf8-a04ef94f2b2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:17.922691 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f71354e-3fbb-4d80-aaf8-a04ef94f2b2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:17.923113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f71354e-3fbb-4d80-aaf8-a04ef94f2b2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:17.951720 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8f71354e-3fbb-4d80-aaf8-a04ef94f2b2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043397 Aug 24 12:40:17.952247 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 603/1204] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:17 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:18.408076 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-127b3bde-3252-4d85-b3e3-fec4c1349696 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:18.410256 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-127b3bde-3252-4d85-b3e3-fec4c1349696 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:18.416733 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-127b3bde-3252-4d85-b3e3-fec4c1349696 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:18.417316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-127b3bde-3252-4d85-b3e3-fec4c1349696 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:18.417652 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-127b3bde-3252-4d85-b3e3-fec4c1349696 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:18.418348 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-127b3bde-3252-4d85-b3e3-fec4c1349696 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:18.418835 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-127b3bde-3252-4d85-b3e3-fec4c1349696 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:18.419265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-127b3bde-3252-4d85-b3e3-fec4c1349696 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:18.448512 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-127b3bde-3252-4d85-b3e3-fec4c1349696 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044361 Aug 24 12:40:18.449053 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 602/1205] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:18 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:18.468071 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0a98ba8e-5882-4ec2-a35a-23e9b2b7c64c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:18.470186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0a98ba8e-5882-4ec2-a35a-23e9b2b7c64c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:18.476514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a98ba8e-5882-4ec2-a35a-23e9b2b7c64c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:18.477523 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a98ba8e-5882-4ec2-a35a-23e9b2b7c64c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:18.477951 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a98ba8e-5882-4ec2-a35a-23e9b2b7c64c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:18.478625 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a98ba8e-5882-4ec2-a35a-23e9b2b7c64c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:18.479096 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a98ba8e-5882-4ec2-a35a-23e9b2b7c64c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:18.479514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a98ba8e-5882-4ec2-a35a-23e9b2b7c64c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:18.508107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0a98ba8e-5882-4ec2-a35a-23e9b2b7c64c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044044 Aug 24 12:40:18.508638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 604/1206] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:18 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:18.963965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9b61b402-146e-4bfa-8745-48cbd8a007de tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:18.966111 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9b61b402-146e-4bfa-8745-48cbd8a007de tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:18.971961 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9b61b402-146e-4bfa-8745-48cbd8a007de tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:18.972437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9b61b402-146e-4bfa-8745-48cbd8a007de tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:18.972865 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9b61b402-146e-4bfa-8745-48cbd8a007de tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:18.973545 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9b61b402-146e-4bfa-8745-48cbd8a007de tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:18.973991 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9b61b402-146e-4bfa-8745-48cbd8a007de tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:18.974411 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9b61b402-146e-4bfa-8745-48cbd8a007de tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:19.003611 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9b61b402-146e-4bfa-8745-48cbd8a007de tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043666 Aug 24 12:40:19.004149 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 603/1207] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:18 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:40:19.460457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c57754cf-b7f0-4db3-ab06-4a195d9b316a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:19.464451 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c57754cf-b7f0-4db3-ab06-4a195d9b316a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:19.469181 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c57754cf-b7f0-4db3-ab06-4a195d9b316a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:19.469768 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c57754cf-b7f0-4db3-ab06-4a195d9b316a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:19.470067 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c57754cf-b7f0-4db3-ab06-4a195d9b316a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:19.470771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c57754cf-b7f0-4db3-ab06-4a195d9b316a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:19.471238 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c57754cf-b7f0-4db3-ab06-4a195d9b316a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:19.471651 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c57754cf-b7f0-4db3-ab06-4a195d9b316a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:19.500362 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c57754cf-b7f0-4db3-ab06-4a195d9b316a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043909 Aug 24 12:40:19.500889 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 605/1208] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:19 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:19.520234 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ecb7596d-aa0e-41df-9e39-0b5ee1646de4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:19.522413 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ecb7596d-aa0e-41df-9e39-0b5ee1646de4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:19.529226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ecb7596d-aa0e-41df-9e39-0b5ee1646de4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:19.529697 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ecb7596d-aa0e-41df-9e39-0b5ee1646de4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:19.530130 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ecb7596d-aa0e-41df-9e39-0b5ee1646de4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:19.530838 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ecb7596d-aa0e-41df-9e39-0b5ee1646de4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:19.531290 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ecb7596d-aa0e-41df-9e39-0b5ee1646de4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:19.531704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ecb7596d-aa0e-41df-9e39-0b5ee1646de4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:19.560346 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ecb7596d-aa0e-41df-9e39-0b5ee1646de4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044086 Aug 24 12:40:19.560903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 604/1209] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:19 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:20.015259 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-701a0270-f0de-4423-8024-6f3c276b626a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:20.017413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-701a0270-f0de-4423-8024-6f3c276b626a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:20.023396 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-701a0270-f0de-4423-8024-6f3c276b626a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:20.024684 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-701a0270-f0de-4423-8024-6f3c276b626a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:20.025138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-701a0270-f0de-4423-8024-6f3c276b626a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:20.025847 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-701a0270-f0de-4423-8024-6f3c276b626a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:20.026306 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-701a0270-f0de-4423-8024-6f3c276b626a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:20.026771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-701a0270-f0de-4423-8024-6f3c276b626a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:20.064443 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-701a0270-f0de-4423-8024-6f3c276b626a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052835 Aug 24 12:40:20.064929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 606/1210] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:20 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:20.512670 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-815ac794-f952-4d00-a834-7606e1af18eb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:20.514928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-815ac794-f952-4d00-a834-7606e1af18eb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:20.521005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-815ac794-f952-4d00-a834-7606e1af18eb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:20.521569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-815ac794-f952-4d00-a834-7606e1af18eb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:20.521901 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-815ac794-f952-4d00-a834-7606e1af18eb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:20.522586 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-815ac794-f952-4d00-a834-7606e1af18eb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:20.523065 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-815ac794-f952-4d00-a834-7606e1af18eb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:20.523486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-815ac794-f952-4d00-a834-7606e1af18eb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:20.552840 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-815ac794-f952-4d00-a834-7606e1af18eb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044176 Aug 24 12:40:20.553374 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 605/1211] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:20 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:20.572558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2d15aef3-d833-4063-a9ac-f59fa4fc34f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:20.574720 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2d15aef3-d833-4063-a9ac-f59fa4fc34f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:20.580973 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d15aef3-d833-4063-a9ac-f59fa4fc34f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:20.581450 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d15aef3-d833-4063-a9ac-f59fa4fc34f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:20.581882 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d15aef3-d833-4063-a9ac-f59fa4fc34f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:20.582566 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d15aef3-d833-4063-a9ac-f59fa4fc34f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:20.583038 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d15aef3-d833-4063-a9ac-f59fa4fc34f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:20.583460 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d15aef3-d833-4063-a9ac-f59fa4fc34f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:20.611801 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2d15aef3-d833-4063-a9ac-f59fa4fc34f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043368 Aug 24 12:40:20.612330 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 607/1212] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:20 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:21.075810 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b24d396f-cffe-40f9-893d-0fccbdddaf27 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:21.077994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b24d396f-cffe-40f9-893d-0fccbdddaf27 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:21.083916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b24d396f-cffe-40f9-893d-0fccbdddaf27 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:21.084403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b24d396f-cffe-40f9-893d-0fccbdddaf27 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:21.084843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b24d396f-cffe-40f9-893d-0fccbdddaf27 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:21.085537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b24d396f-cffe-40f9-893d-0fccbdddaf27 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:21.086517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b24d396f-cffe-40f9-893d-0fccbdddaf27 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:21.087048 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b24d396f-cffe-40f9-893d-0fccbdddaf27 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:21.115850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b24d396f-cffe-40f9-893d-0fccbdddaf27 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044077 Aug 24 12:40:21.116389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 606/1213] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:21 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:21.565652 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1bedf87b-f7e2-46ac-aa3c-41fe6be8cb84 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:21.567841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1bedf87b-f7e2-46ac-aa3c-41fe6be8cb84 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:21.574232 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1bedf87b-f7e2-46ac-aa3c-41fe6be8cb84 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:21.574821 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1bedf87b-f7e2-46ac-aa3c-41fe6be8cb84 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:21.575161 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1bedf87b-f7e2-46ac-aa3c-41fe6be8cb84 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:21.575842 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1bedf87b-f7e2-46ac-aa3c-41fe6be8cb84 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:21.576338 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1bedf87b-f7e2-46ac-aa3c-41fe6be8cb84 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:21.576709 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1bedf87b-f7e2-46ac-aa3c-41fe6be8cb84 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:21.605953 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1bedf87b-f7e2-46ac-aa3c-41fe6be8cb84 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044283 Aug 24 12:40:21.606490 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 608/1214] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:21 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:21.624145 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2bea4096-a680-45e3-9006-d53e1b1362f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:21.626273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2bea4096-a680-45e3-9006-d53e1b1362f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:21.632656 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2bea4096-a680-45e3-9006-d53e1b1362f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:21.633788 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2bea4096-a680-45e3-9006-d53e1b1362f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:21.634228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2bea4096-a680-45e3-9006-d53e1b1362f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:21.634955 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2bea4096-a680-45e3-9006-d53e1b1362f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:21.635416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2bea4096-a680-45e3-9006-d53e1b1362f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:21.635840 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2bea4096-a680-45e3-9006-d53e1b1362f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:21.664096 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2bea4096-a680-45e3-9006-d53e1b1362f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043908 Aug 24 12:40:21.664637 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 607/1215] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:21 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:22.128131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-308c8ce4-007d-41f3-af51-1bfd23c8d117 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:22.130267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-308c8ce4-007d-41f3-af51-1bfd23c8d117 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:22.136402 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-308c8ce4-007d-41f3-af51-1bfd23c8d117 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:22.136941 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-308c8ce4-007d-41f3-af51-1bfd23c8d117 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:22.137385 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-308c8ce4-007d-41f3-af51-1bfd23c8d117 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:22.138074 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-308c8ce4-007d-41f3-af51-1bfd23c8d117 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:22.138522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-308c8ce4-007d-41f3-af51-1bfd23c8d117 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:22.138971 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-308c8ce4-007d-41f3-af51-1bfd23c8d117 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:22.167532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-308c8ce4-007d-41f3-af51-1bfd23c8d117 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043395 Aug 24 12:40:22.168060 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 609/1216] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:22 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:22.618261 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a2bcda50-a60b-4473-bcfa-9840a283e26c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:22.620417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a2bcda50-a60b-4473-bcfa-9840a283e26c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:22.626286 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a2bcda50-a60b-4473-bcfa-9840a283e26c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:22.626905 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a2bcda50-a60b-4473-bcfa-9840a283e26c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:22.627285 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a2bcda50-a60b-4473-bcfa-9840a283e26c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:22.627961 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a2bcda50-a60b-4473-bcfa-9840a283e26c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:22.628411 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a2bcda50-a60b-4473-bcfa-9840a283e26c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:22.628830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a2bcda50-a60b-4473-bcfa-9840a283e26c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:22.657222 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a2bcda50-a60b-4473-bcfa-9840a283e26c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043093 Aug 24 12:40:22.657693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 608/1217] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:22 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:22.675512 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a69f5c99-3750-4c6e-9f58-e84ac9c0a06c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:22.677655 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a69f5c99-3750-4c6e-9f58-e84ac9c0a06c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:22.683935 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a69f5c99-3750-4c6e-9f58-e84ac9c0a06c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:22.684403 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a69f5c99-3750-4c6e-9f58-e84ac9c0a06c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:22.684836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a69f5c99-3750-4c6e-9f58-e84ac9c0a06c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:22.685524 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a69f5c99-3750-4c6e-9f58-e84ac9c0a06c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:22.685973 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a69f5c99-3750-4c6e-9f58-e84ac9c0a06c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:22.686393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a69f5c99-3750-4c6e-9f58-e84ac9c0a06c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:22.715743 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a69f5c99-3750-4c6e-9f58-e84ac9c0a06c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044226 Aug 24 12:40:22.716274 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 610/1218] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:22 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:23.180110 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-988eea72-763d-4f88-9309-35d5cc0c8d6c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:23.182226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-988eea72-763d-4f88-9309-35d5cc0c8d6c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:23.188087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-988eea72-763d-4f88-9309-35d5cc0c8d6c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:23.188567 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-988eea72-763d-4f88-9309-35d5cc0c8d6c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:23.189000 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-988eea72-763d-4f88-9309-35d5cc0c8d6c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:23.189677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-988eea72-763d-4f88-9309-35d5cc0c8d6c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:23.190127 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-988eea72-763d-4f88-9309-35d5cc0c8d6c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:23.190546 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-988eea72-763d-4f88-9309-35d5cc0c8d6c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:23.219702 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-988eea72-763d-4f88-9309-35d5cc0c8d6c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044056 Aug 24 12:40:23.220229 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 609/1219] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:23 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:23.669694 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ddc8d385-80a0-408f-aab6-023763eb211f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:23.671835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ddc8d385-80a0-408f-aab6-023763eb211f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:23.677682 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ddc8d385-80a0-408f-aab6-023763eb211f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:23.678220 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ddc8d385-80a0-408f-aab6-023763eb211f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:23.678568 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ddc8d385-80a0-408f-aab6-023763eb211f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:23.679363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ddc8d385-80a0-408f-aab6-023763eb211f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:23.680431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ddc8d385-80a0-408f-aab6-023763eb211f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:23.680846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ddc8d385-80a0-408f-aab6-023763eb211f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:23.710430 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ddc8d385-80a0-408f-aab6-023763eb211f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045117 Aug 24 12:40:23.710955 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 611/1220] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:23 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:23.730132 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e3812491-cdbe-4089-8cc8-90603e040850 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:23.732309 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e3812491-cdbe-4089-8cc8-90603e040850 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:23.738758 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3812491-cdbe-4089-8cc8-90603e040850 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:23.739503 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3812491-cdbe-4089-8cc8-90603e040850 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:23.739941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3812491-cdbe-4089-8cc8-90603e040850 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:23.740636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3812491-cdbe-4089-8cc8-90603e040850 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:23.741119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3812491-cdbe-4089-8cc8-90603e040850 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:23.741547 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3812491-cdbe-4089-8cc8-90603e040850 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:23.770632 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e3812491-cdbe-4089-8cc8-90603e040850 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045130 Aug 24 12:40:23.771203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 610/1221] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:23 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:24.231781 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d8058104-7495-473a-828f-8ab74a770d24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:24.233933 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d8058104-7495-473a-828f-8ab74a770d24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:24.240097 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8058104-7495-473a-828f-8ab74a770d24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:24.240580 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8058104-7495-473a-828f-8ab74a770d24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:24.241019 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8058104-7495-473a-828f-8ab74a770d24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:24.241703 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8058104-7495-473a-828f-8ab74a770d24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:24.242157 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8058104-7495-473a-828f-8ab74a770d24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:24.242586 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8058104-7495-473a-828f-8ab74a770d24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:24.271751 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d8058104-7495-473a-828f-8ab74a770d24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044044 Aug 24 12:40:24.272294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 612/1222] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:24 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:24.722197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a6998b52-346d-43b9-94d5-d8c529c2dcb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:24.724349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a6998b52-346d-43b9-94d5-d8c529c2dcb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:24.730303 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6998b52-346d-43b9-94d5-d8c529c2dcb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:24.730912 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6998b52-346d-43b9-94d5-d8c529c2dcb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:24.731233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6998b52-346d-43b9-94d5-d8c529c2dcb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:24.731928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6998b52-346d-43b9-94d5-d8c529c2dcb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:24.732379 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6998b52-346d-43b9-94d5-d8c529c2dcb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:24.732798 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6998b52-346d-43b9-94d5-d8c529c2dcb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:24.762231 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a6998b52-346d-43b9-94d5-d8c529c2dcb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043858 Aug 24 12:40:24.762713 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 611/1223] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:24 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:24.782666 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3e7db638-1372-447a-a1a2-d1472d651f63 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:24.784831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3e7db638-1372-447a-a1a2-d1472d651f63 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:24.791138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e7db638-1372-447a-a1a2-d1472d651f63 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:24.791609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e7db638-1372-447a-a1a2-d1472d651f63 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:24.792036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e7db638-1372-447a-a1a2-d1472d651f63 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:24.792707 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e7db638-1372-447a-a1a2-d1472d651f63 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:24.793149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e7db638-1372-447a-a1a2-d1472d651f63 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:24.793562 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e7db638-1372-447a-a1a2-d1472d651f63 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:24.822527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3e7db638-1372-447a-a1a2-d1472d651f63 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043754 Aug 24 12:40:24.823085 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 613/1224] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:24 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:25.284554 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ae502653-0490-4d9b-a3be-9e60d700cfa2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:25.286744 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ae502653-0490-4d9b-a3be-9e60d700cfa2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:25.293176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae502653-0490-4d9b-a3be-9e60d700cfa2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:25.293648 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae502653-0490-4d9b-a3be-9e60d700cfa2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:25.294079 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae502653-0490-4d9b-a3be-9e60d700cfa2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:25.294785 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae502653-0490-4d9b-a3be-9e60d700cfa2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:25.295239 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae502653-0490-4d9b-a3be-9e60d700cfa2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:25.295657 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae502653-0490-4d9b-a3be-9e60d700cfa2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:25.324189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ae502653-0490-4d9b-a3be-9e60d700cfa2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043604 Aug 24 12:40:25.324722 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 612/1225] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:25 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:25.774441 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d99767a4-5bae-4cf0-ae5e-69aaad80d396 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:25.776654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d99767a4-5bae-4cf0-ae5e-69aaad80d396 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:25.783440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d99767a4-5bae-4cf0-ae5e-69aaad80d396 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:25.784019 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d99767a4-5bae-4cf0-ae5e-69aaad80d396 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:25.784349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d99767a4-5bae-4cf0-ae5e-69aaad80d396 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:25.785060 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d99767a4-5bae-4cf0-ae5e-69aaad80d396 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:25.785554 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d99767a4-5bae-4cf0-ae5e-69aaad80d396 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:25.785928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d99767a4-5bae-4cf0-ae5e-69aaad80d396 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:25.814170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d99767a4-5bae-4cf0-ae5e-69aaad80d396 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043618 Aug 24 12:40:25.814725 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 614/1226] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:25 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:25.834604 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7fcb07e5-17a4-4bbf-9b5b-1eda67431f0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:25.836734 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7fcb07e5-17a4-4bbf-9b5b-1eda67431f0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:25.843682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7fcb07e5-17a4-4bbf-9b5b-1eda67431f0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:25.844155 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7fcb07e5-17a4-4bbf-9b5b-1eda67431f0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:25.844588 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7fcb07e5-17a4-4bbf-9b5b-1eda67431f0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:25.845271 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7fcb07e5-17a4-4bbf-9b5b-1eda67431f0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:25.845718 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7fcb07e5-17a4-4bbf-9b5b-1eda67431f0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:25.846134 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7fcb07e5-17a4-4bbf-9b5b-1eda67431f0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:25.874256 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7fcb07e5-17a4-4bbf-9b5b-1eda67431f0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043573 Aug 24 12:40:25.874812 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 613/1227] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:25 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:26.336459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-11c80cba-99ea-44b5-b836-59edf60c60d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:26.338584 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-11c80cba-99ea-44b5-b836-59edf60c60d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:26.344526 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-11c80cba-99ea-44b5-b836-59edf60c60d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:26.345004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-11c80cba-99ea-44b5-b836-59edf60c60d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:26.345438 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-11c80cba-99ea-44b5-b836-59edf60c60d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:26.346116 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-11c80cba-99ea-44b5-b836-59edf60c60d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:26.346592 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-11c80cba-99ea-44b5-b836-59edf60c60d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:26.347043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-11c80cba-99ea-44b5-b836-59edf60c60d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:26.376108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-11c80cba-99ea-44b5-b836-59edf60c60d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043675 Aug 24 12:40:26.376643 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 615/1228] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:26 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:26.826307 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ee0d4b62-6c02-4665-85b3-8e73cd6274b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:26.828513 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ee0d4b62-6c02-4665-85b3-8e73cd6274b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:26.834591 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee0d4b62-6c02-4665-85b3-8e73cd6274b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:26.835107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee0d4b62-6c02-4665-85b3-8e73cd6274b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:26.835632 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee0d4b62-6c02-4665-85b3-8e73cd6274b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:26.836214 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee0d4b62-6c02-4665-85b3-8e73cd6274b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:26.836668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee0d4b62-6c02-4665-85b3-8e73cd6274b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:26.837092 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee0d4b62-6c02-4665-85b3-8e73cd6274b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:26.865997 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ee0d4b62-6c02-4665-85b3-8e73cd6274b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043600 Aug 24 12:40:26.866465 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 614/1229] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:26 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:26.885352 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8baed090-8f85-486a-94ea-158aad5cc4ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:26.887516 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8baed090-8f85-486a-94ea-158aad5cc4ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:26.894289 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8baed090-8f85-486a-94ea-158aad5cc4ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:26.894910 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8baed090-8f85-486a-94ea-158aad5cc4ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:26.895352 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8baed090-8f85-486a-94ea-158aad5cc4ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:26.896059 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8baed090-8f85-486a-94ea-158aad5cc4ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:26.896517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8baed090-8f85-486a-94ea-158aad5cc4ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:26.896943 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8baed090-8f85-486a-94ea-158aad5cc4ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:26.927104 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8baed090-8f85-486a-94ea-158aad5cc4ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045648 Aug 24 12:40:26.927647 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 616/1230] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:26 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:27.389396 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-97255dd5-2eeb-400d-88c0-c16bdc0a086f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:27.391569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-97255dd5-2eeb-400d-88c0-c16bdc0a086f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:27.397469 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97255dd5-2eeb-400d-88c0-c16bdc0a086f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:27.397957 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97255dd5-2eeb-400d-88c0-c16bdc0a086f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:27.398396 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97255dd5-2eeb-400d-88c0-c16bdc0a086f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:27.399125 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97255dd5-2eeb-400d-88c0-c16bdc0a086f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:27.399585 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97255dd5-2eeb-400d-88c0-c16bdc0a086f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:27.400014 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97255dd5-2eeb-400d-88c0-c16bdc0a086f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:27.429138 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-97255dd5-2eeb-400d-88c0-c16bdc0a086f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044262 Aug 24 12:40:27.429693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 615/1231] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:27 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:27.724754 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:40:27.724916 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 12:40:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:40:27.858739 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:40:27.859150 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 12:40:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:40:27.878443 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c1375898-a68a-48c2-ae5c-751b7e9dc697 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:27.880692 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c1375898-a68a-48c2-ae5c-751b7e9dc697 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:27.886826 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1375898-a68a-48c2-ae5c-751b7e9dc697 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:27.887365 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1375898-a68a-48c2-ae5c-751b7e9dc697 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:27.887722 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1375898-a68a-48c2-ae5c-751b7e9dc697 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:27.888404 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1375898-a68a-48c2-ae5c-751b7e9dc697 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:27.888848 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1375898-a68a-48c2-ae5c-751b7e9dc697 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:27.889264 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1375898-a68a-48c2-ae5c-751b7e9dc697 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:27.917526 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c1375898-a68a-48c2-ae5c-751b7e9dc697 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042973 Aug 24 12:40:27.917996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 617/1232] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:27 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:27.940102 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-33397c9d-a72b-46f2-a279-f3372d927e05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:27.942365 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-33397c9d-a72b-46f2-a279-f3372d927e05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:27.948752 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33397c9d-a72b-46f2-a279-f3372d927e05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:27.949238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33397c9d-a72b-46f2-a279-f3372d927e05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:27.949682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33397c9d-a72b-46f2-a279-f3372d927e05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:27.950374 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33397c9d-a72b-46f2-a279-f3372d927e05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:27.950879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33397c9d-a72b-46f2-a279-f3372d927e05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:27.951316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33397c9d-a72b-46f2-a279-f3372d927e05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:27.964772 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:27.980226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-33397c9d-a72b-46f2-a279-f3372d927e05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044723 Aug 24 12:40:27.984185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 616/1233] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:27 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:28.441924 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-405e5189-b6b3-4c21-a8a6-35e34c7a172d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:28.444138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-405e5189-b6b3-4c21-a8a6-35e34c7a172d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:28.445944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=84 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:28.450570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-405e5189-b6b3-4c21-a8a6-35e34c7a172d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:28.451078 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-405e5189-b6b3-4c21-a8a6-35e34c7a172d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:28.452130 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-405e5189-b6b3-4c21-a8a6-35e34c7a172d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:28.453767 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-405e5189-b6b3-4c21-a8a6-35e34c7a172d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:28.454221 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-405e5189-b6b3-4c21-a8a6-35e34c7a172d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:28.454645 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-405e5189-b6b3-4c21-a8a6-35e34c7a172d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:28.483866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-405e5189-b6b3-4c21-a8a6-35e34c7a172d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045897 Aug 24 12:40:28.484392 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 618/1234] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:28 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:28.929971 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-63943d60-1c1e-4eb1-8457-2c9aa2ab98a9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:28.932156 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-63943d60-1c1e-4eb1-8457-2c9aa2ab98a9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:28.934378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=90 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:28.939442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63943d60-1c1e-4eb1-8457-2c9aa2ab98a9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:28.939912 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63943d60-1c1e-4eb1-8457-2c9aa2ab98a9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:28.940342 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63943d60-1c1e-4eb1-8457-2c9aa2ab98a9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:28.941022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63943d60-1c1e-4eb1-8457-2c9aa2ab98a9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:28.941472 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63943d60-1c1e-4eb1-8457-2c9aa2ab98a9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:28.941891 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63943d60-1c1e-4eb1-8457-2c9aa2ab98a9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:28.969818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-63943d60-1c1e-4eb1-8457-2c9aa2ab98a9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043774 Aug 24 12:40:28.970346 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 617/1235] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:28 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:28.994750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1507246b-d384-4da8-86a3-b7adee452978 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:28.996887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1507246b-d384-4da8-86a3-b7adee452978 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:29.003671 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1507246b-d384-4da8-86a3-b7adee452978 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:29.004149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1507246b-d384-4da8-86a3-b7adee452978 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:29.004581 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1507246b-d384-4da8-86a3-b7adee452978 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:29.005260 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1507246b-d384-4da8-86a3-b7adee452978 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:29.005730 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1507246b-d384-4da8-86a3-b7adee452978 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:29.006168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1507246b-d384-4da8-86a3-b7adee452978 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:29.009697 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:29.035294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1507246b-d384-4da8-86a3-b7adee452978 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044612 Aug 24 12:40:29.035829 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 619/1236] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:28 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:29.496012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-adce9f17-2ce0-48d1-a9ce-911e94eefaf0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:29.498258 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-adce9f17-2ce0-48d1-a9ce-911e94eefaf0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:29.504795 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-adce9f17-2ce0-48d1-a9ce-911e94eefaf0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:29.505271 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-adce9f17-2ce0-48d1-a9ce-911e94eefaf0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:29.505712 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-adce9f17-2ce0-48d1-a9ce-911e94eefaf0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:29.506392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-adce9f17-2ce0-48d1-a9ce-911e94eefaf0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:29.506941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-adce9f17-2ce0-48d1-a9ce-911e94eefaf0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:29.507363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-adce9f17-2ce0-48d1-a9ce-911e94eefaf0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:29.535101 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-adce9f17-2ce0-48d1-a9ce-911e94eefaf0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043007 Aug 24 12:40:29.535631 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 618/1237] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:29 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:29.981706 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-95544e81-fd02-4ef5-bd3a-a71b394c7d8a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:29.984449 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-95544e81-fd02-4ef5-bd3a-a71b394c7d8a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:29.990794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-95544e81-fd02-4ef5-bd3a-a71b394c7d8a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:29.991268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-95544e81-fd02-4ef5-bd3a-a71b394c7d8a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:29.991698 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-95544e81-fd02-4ef5-bd3a-a71b394c7d8a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:29.992375 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-95544e81-fd02-4ef5-bd3a-a71b394c7d8a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:29.992820 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-95544e81-fd02-4ef5-bd3a-a71b394c7d8a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:29.993231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-95544e81-fd02-4ef5-bd3a-a71b394c7d8a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:30.021778 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-95544e81-fd02-4ef5-bd3a-a71b394c7d8a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044362 Aug 24 12:40:30.022339 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 620/1238] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:29 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:30.047926 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1e607e1a-e67d-4833-a47d-07fa63948184 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:30.050057 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1e607e1a-e67d-4833-a47d-07fa63948184 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:30.056324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e607e1a-e67d-4833-a47d-07fa63948184 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:30.056798 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e607e1a-e67d-4833-a47d-07fa63948184 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:30.057230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e607e1a-e67d-4833-a47d-07fa63948184 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:30.057906 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e607e1a-e67d-4833-a47d-07fa63948184 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:30.058361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e607e1a-e67d-4833-a47d-07fa63948184 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:30.058808 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e607e1a-e67d-4833-a47d-07fa63948184 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:30.087989 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1e607e1a-e67d-4833-a47d-07fa63948184 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044475 Aug 24 12:40:30.088530 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 619/1239] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:30 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:30.547759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-31c006b4-36ea-4b97-be92-220b01a3562d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:30.549870 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-31c006b4-36ea-4b97-be92-220b01a3562d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:30.555777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-31c006b4-36ea-4b97-be92-220b01a3562d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:30.556249 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-31c006b4-36ea-4b97-be92-220b01a3562d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:30.556684 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-31c006b4-36ea-4b97-be92-220b01a3562d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:30.557359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-31c006b4-36ea-4b97-be92-220b01a3562d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:30.557806 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-31c006b4-36ea-4b97-be92-220b01a3562d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:30.558226 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-31c006b4-36ea-4b97-be92-220b01a3562d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:30.586019 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-31c006b4-36ea-4b97-be92-220b01a3562d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042789 Aug 24 12:40:30.586545 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 621/1240] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:30 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:31.034440 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0651f552-1a56-4751-b026-c2c842060c4c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:31.036556 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0651f552-1a56-4751-b026-c2c842060c4c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:31.042502 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0651f552-1a56-4751-b026-c2c842060c4c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:31.043003 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0651f552-1a56-4751-b026-c2c842060c4c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:31.043434 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0651f552-1a56-4751-b026-c2c842060c4c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:31.044113 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0651f552-1a56-4751-b026-c2c842060c4c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:31.044564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0651f552-1a56-4751-b026-c2c842060c4c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:31.044989 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0651f552-1a56-4751-b026-c2c842060c4c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:31.073335 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0651f552-1a56-4751-b026-c2c842060c4c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042920 Aug 24 12:40:31.073941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 620/1241] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:31 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:31.099960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0d108ce6-cc60-41aa-9639-2c271605d3c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:31.102101 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0d108ce6-cc60-41aa-9639-2c271605d3c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:31.108418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d108ce6-cc60-41aa-9639-2c271605d3c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:31.108892 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d108ce6-cc60-41aa-9639-2c271605d3c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:31.109326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d108ce6-cc60-41aa-9639-2c271605d3c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:31.110009 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d108ce6-cc60-41aa-9639-2c271605d3c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:31.110463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d108ce6-cc60-41aa-9639-2c271605d3c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:31.110911 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d108ce6-cc60-41aa-9639-2c271605d3c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:31.139259 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0d108ce6-cc60-41aa-9639-2c271605d3c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042686 Aug 24 12:40:31.139788 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 622/1242] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:31 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:31.598921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-75c57d7b-0c71-4efd-b868-fa6f52bd6302 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:31.601026 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-75c57d7b-0c71-4efd-b868-fa6f52bd6302 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:31.607220 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75c57d7b-0c71-4efd-b868-fa6f52bd6302 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:31.608025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75c57d7b-0c71-4efd-b868-fa6f52bd6302 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:31.608228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75c57d7b-0c71-4efd-b868-fa6f52bd6302 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:31.608877 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75c57d7b-0c71-4efd-b868-fa6f52bd6302 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:31.609328 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75c57d7b-0c71-4efd-b868-fa6f52bd6302 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:31.609766 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75c57d7b-0c71-4efd-b868-fa6f52bd6302 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:31.639746 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-75c57d7b-0c71-4efd-b868-fa6f52bd6302 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044352 Aug 24 12:40:31.640493 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 621/1243] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:31 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:32.086003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a9991b6b-083e-4450-b974-3c848e7eb8ad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:32.088071 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a9991b6b-083e-4450-b974-3c848e7eb8ad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:32.093899 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a9991b6b-083e-4450-b974-3c848e7eb8ad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:32.094377 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a9991b6b-083e-4450-b974-3c848e7eb8ad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:32.094868 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a9991b6b-083e-4450-b974-3c848e7eb8ad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:32.095546 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a9991b6b-083e-4450-b974-3c848e7eb8ad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:32.095990 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a9991b6b-083e-4450-b974-3c848e7eb8ad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:32.096410 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a9991b6b-083e-4450-b974-3c848e7eb8ad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:32.124531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a9991b6b-083e-4450-b974-3c848e7eb8ad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042523 Aug 24 12:40:32.125094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 623/1244] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:32 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:32.151317 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-258b46d2-6ca3-4647-a3cd-e885afa08dbe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:32.153429 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-258b46d2-6ca3-4647-a3cd-e885afa08dbe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:32.159707 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-258b46d2-6ca3-4647-a3cd-e885afa08dbe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:32.160184 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-258b46d2-6ca3-4647-a3cd-e885afa08dbe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:32.160780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-258b46d2-6ca3-4647-a3cd-e885afa08dbe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:32.161475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-258b46d2-6ca3-4647-a3cd-e885afa08dbe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:32.161926 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-258b46d2-6ca3-4647-a3cd-e885afa08dbe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:32.162344 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-258b46d2-6ca3-4647-a3cd-e885afa08dbe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:32.191171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-258b46d2-6ca3-4647-a3cd-e885afa08dbe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043726 Aug 24 12:40:32.191722 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 622/1245] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:32 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:40:32.652062 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-54eddd02-4df0-4f74-8406-19cc21ce9f69 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:32.654201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-54eddd02-4df0-4f74-8406-19cc21ce9f69 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:32.660506 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-54eddd02-4df0-4f74-8406-19cc21ce9f69 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:32.660976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-54eddd02-4df0-4f74-8406-19cc21ce9f69 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:32.661403 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-54eddd02-4df0-4f74-8406-19cc21ce9f69 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:32.662079 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-54eddd02-4df0-4f74-8406-19cc21ce9f69 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:32.662522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-54eddd02-4df0-4f74-8406-19cc21ce9f69 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:32.662961 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-54eddd02-4df0-4f74-8406-19cc21ce9f69 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:32.691334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-54eddd02-4df0-4f74-8406-19cc21ce9f69 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043198 Aug 24 12:40:32.691800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 624/1246] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:32 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:33.136217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b1d6c969-f6e5-42a0-81d2-f331f3a2456e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:33.138408 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b1d6c969-f6e5-42a0-81d2-f331f3a2456e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:33.144849 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1d6c969-f6e5-42a0-81d2-f331f3a2456e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:33.145331 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1d6c969-f6e5-42a0-81d2-f331f3a2456e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:33.145767 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1d6c969-f6e5-42a0-81d2-f331f3a2456e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:33.146449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1d6c969-f6e5-42a0-81d2-f331f3a2456e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:33.146934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1d6c969-f6e5-42a0-81d2-f331f3a2456e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:33.147364 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1d6c969-f6e5-42a0-81d2-f331f3a2456e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:33.175667 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b1d6c969-f6e5-42a0-81d2-f331f3a2456e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043369 Aug 24 12:40:33.176288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 623/1247] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:33 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:33.203659 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9b657b78-2595-479f-ad79-4058c757e20b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:33.205781 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9b657b78-2595-479f-ad79-4058c757e20b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:33.212314 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b657b78-2595-479f-ad79-4058c757e20b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:33.212796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b657b78-2595-479f-ad79-4058c757e20b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:33.213231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b657b78-2595-479f-ad79-4058c757e20b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:33.213915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b657b78-2595-479f-ad79-4058c757e20b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:33.214360 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b657b78-2595-479f-ad79-4058c757e20b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:33.214834 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b657b78-2595-479f-ad79-4058c757e20b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:33.243663 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9b657b78-2595-479f-ad79-4058c757e20b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044424 Aug 24 12:40:33.244195 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 625/1248] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:33 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:33.703607 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7b2ac97e-4411-49c3-a277-8957a62f64ca tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:33.705683 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7b2ac97e-4411-49c3-a277-8957a62f64ca tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:33.711584 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b2ac97e-4411-49c3-a277-8957a62f64ca tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:33.712067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b2ac97e-4411-49c3-a277-8957a62f64ca tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:33.712504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b2ac97e-4411-49c3-a277-8957a62f64ca tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:33.713185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b2ac97e-4411-49c3-a277-8957a62f64ca tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:33.713637 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b2ac97e-4411-49c3-a277-8957a62f64ca tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:33.714063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b2ac97e-4411-49c3-a277-8957a62f64ca tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:33.743361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7b2ac97e-4411-49c3-a277-8957a62f64ca tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043805 Aug 24 12:40:33.743898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 624/1249] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:33 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:34.188544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bac40e89-ab08-4a75-9042-664422023eee tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:34.190743 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-bac40e89-ab08-4a75-9042-664422023eee tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:34.196615 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bac40e89-ab08-4a75-9042-664422023eee tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:34.197092 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bac40e89-ab08-4a75-9042-664422023eee tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:34.201748 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bac40e89-ab08-4a75-9042-664422023eee tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:34.201748 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bac40e89-ab08-4a75-9042-664422023eee tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:34.201748 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bac40e89-ab08-4a75-9042-664422023eee tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:34.201748 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bac40e89-ab08-4a75-9042-664422023eee tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:34.228726 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bac40e89-ab08-4a75-9042-664422023eee tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045216 Aug 24 12:40:34.229351 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 626/1250] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:34 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:34.255791 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0354cfda-44d4-4ce8-bcfe-e1fe5e378141 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:34.257943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0354cfda-44d4-4ce8-bcfe-e1fe5e378141 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:34.265083 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0354cfda-44d4-4ce8-bcfe-e1fe5e378141 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:34.265559 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0354cfda-44d4-4ce8-bcfe-e1fe5e378141 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:34.265989 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0354cfda-44d4-4ce8-bcfe-e1fe5e378141 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:34.268044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0354cfda-44d4-4ce8-bcfe-e1fe5e378141 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:34.268044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0354cfda-44d4-4ce8-bcfe-e1fe5e378141 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:34.268044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0354cfda-44d4-4ce8-bcfe-e1fe5e378141 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:34.297068 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0354cfda-44d4-4ce8-bcfe-e1fe5e378141 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045170 Aug 24 12:40:34.297623 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 625/1251] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:34 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:34.755396 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e88eff61-3762-4001-9012-088beb9e1d93 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:34.757550 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e88eff61-3762-4001-9012-088beb9e1d93 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:34.763453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e88eff61-3762-4001-9012-088beb9e1d93 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:34.763929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e88eff61-3762-4001-9012-088beb9e1d93 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:34.764359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e88eff61-3762-4001-9012-088beb9e1d93 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:34.765037 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e88eff61-3762-4001-9012-088beb9e1d93 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:34.765484 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e88eff61-3762-4001-9012-088beb9e1d93 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:34.765903 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e88eff61-3762-4001-9012-088beb9e1d93 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:34.793798 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e88eff61-3762-4001-9012-088beb9e1d93 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042370 Aug 24 12:40:34.794323 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 627/1252] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:34 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:35.241261 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dd6c4fb6-d7b8-4152-a68f-2352028eb67b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:35.243481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dd6c4fb6-d7b8-4152-a68f-2352028eb67b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:35.250053 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dd6c4fb6-d7b8-4152-a68f-2352028eb67b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:35.250539 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dd6c4fb6-d7b8-4152-a68f-2352028eb67b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:35.251014 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dd6c4fb6-d7b8-4152-a68f-2352028eb67b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:35.251728 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dd6c4fb6-d7b8-4152-a68f-2352028eb67b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:35.252212 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dd6c4fb6-d7b8-4152-a68f-2352028eb67b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:35.252669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dd6c4fb6-d7b8-4152-a68f-2352028eb67b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:35.281384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dd6c4fb6-d7b8-4152-a68f-2352028eb67b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044236 Aug 24 12:40:35.282011 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 626/1253] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:35 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:35.309114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-936764c3-21f1-49a0-ae03-49f0cfe26deb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:35.311949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-936764c3-21f1-49a0-ae03-49f0cfe26deb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:35.318213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-936764c3-21f1-49a0-ae03-49f0cfe26deb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:35.318716 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-936764c3-21f1-49a0-ae03-49f0cfe26deb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:35.319154 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-936764c3-21f1-49a0-ae03-49f0cfe26deb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:35.319832 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-936764c3-21f1-49a0-ae03-49f0cfe26deb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:35.320278 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-936764c3-21f1-49a0-ae03-49f0cfe26deb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:35.320698 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-936764c3-21f1-49a0-ae03-49f0cfe26deb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:35.348812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-936764c3-21f1-49a0-ae03-49f0cfe26deb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043598 Aug 24 12:40:35.349344 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 628/1254] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:35 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:35.806477 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-71b82538-be1a-4dfa-a818-0ecff2d25b38 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:35.808651 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-71b82538-be1a-4dfa-a818-0ecff2d25b38 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:35.814510 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-71b82538-be1a-4dfa-a818-0ecff2d25b38 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:35.815019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-71b82538-be1a-4dfa-a818-0ecff2d25b38 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:35.815453 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-71b82538-be1a-4dfa-a818-0ecff2d25b38 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:35.816128 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-71b82538-be1a-4dfa-a818-0ecff2d25b38 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:35.816583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-71b82538-be1a-4dfa-a818-0ecff2d25b38 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:35.817004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-71b82538-be1a-4dfa-a818-0ecff2d25b38 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:35.849768 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-71b82538-be1a-4dfa-a818-0ecff2d25b38 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047277 Aug 24 12:40:35.850304 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 627/1255] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:35 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:36.293522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a44f9040-f0cf-4df2-83c1-b0d57c3f1814 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:36.295691 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a44f9040-f0cf-4df2-83c1-b0d57c3f1814 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:36.301621 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a44f9040-f0cf-4df2-83c1-b0d57c3f1814 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:36.302041 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a44f9040-f0cf-4df2-83c1-b0d57c3f1814 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:36.302474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a44f9040-f0cf-4df2-83c1-b0d57c3f1814 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:36.303200 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a44f9040-f0cf-4df2-83c1-b0d57c3f1814 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:36.303630 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a44f9040-f0cf-4df2-83c1-b0d57c3f1814 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:36.304048 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a44f9040-f0cf-4df2-83c1-b0d57c3f1814 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:36.332508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a44f9040-f0cf-4df2-83c1-b0d57c3f1814 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043033 Aug 24 12:40:36.333096 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 629/1256] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:36 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:36.361098 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e3158574-ae20-458c-83f4-8e93be9f65ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:36.363295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e3158574-ae20-458c-83f4-8e93be9f65ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:36.369400 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3158574-ae20-458c-83f4-8e93be9f65ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:36.369887 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3158574-ae20-458c-83f4-8e93be9f65ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:36.370326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3158574-ae20-458c-83f4-8e93be9f65ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:36.371043 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3158574-ae20-458c-83f4-8e93be9f65ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:36.371503 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3158574-ae20-458c-83f4-8e93be9f65ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:36.371928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3158574-ae20-458c-83f4-8e93be9f65ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:36.400640 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e3158574-ae20-458c-83f4-8e93be9f65ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043638 Aug 24 12:40:36.401176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 628/1257] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:36 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:36.861645 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e656983d-6078-4ada-968b-4c2335d22a9e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:36.863798 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e656983d-6078-4ada-968b-4c2335d22a9e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:36.869907 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e656983d-6078-4ada-968b-4c2335d22a9e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:36.870381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e656983d-6078-4ada-968b-4c2335d22a9e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:36.870855 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e656983d-6078-4ada-968b-4c2335d22a9e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:36.871538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e656983d-6078-4ada-968b-4c2335d22a9e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:36.871989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e656983d-6078-4ada-968b-4c2335d22a9e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:36.872412 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e656983d-6078-4ada-968b-4c2335d22a9e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:36.900768 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e656983d-6078-4ada-968b-4c2335d22a9e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043642 Aug 24 12:40:36.901297 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 630/1258] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:36 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:37.345271 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-01013b6c-613e-4979-ac27-673444fbc141 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:37.347457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-01013b6c-613e-4979-ac27-673444fbc141 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:37.353382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01013b6c-613e-4979-ac27-673444fbc141 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:37.353867 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01013b6c-613e-4979-ac27-673444fbc141 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:37.354316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01013b6c-613e-4979-ac27-673444fbc141 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:37.355043 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01013b6c-613e-4979-ac27-673444fbc141 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:37.355503 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01013b6c-613e-4979-ac27-673444fbc141 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:37.355933 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01013b6c-613e-4979-ac27-673444fbc141 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:37.385156 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-01013b6c-613e-4979-ac27-673444fbc141 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044417 Aug 24 12:40:37.385752 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 629/1259] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:37 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:37.413283 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-51436acc-f922-486d-a887-2e1137ccdd7b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:37.415451 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-51436acc-f922-486d-a887-2e1137ccdd7b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:37.422476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51436acc-f922-486d-a887-2e1137ccdd7b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:37.422983 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51436acc-f922-486d-a887-2e1137ccdd7b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:37.423418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51436acc-f922-486d-a887-2e1137ccdd7b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:37.424105 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51436acc-f922-486d-a887-2e1137ccdd7b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:37.424548 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51436acc-f922-486d-a887-2e1137ccdd7b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:37.424972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51436acc-f922-486d-a887-2e1137ccdd7b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:37.453601 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-51436acc-f922-486d-a887-2e1137ccdd7b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044217 Aug 24 12:40:37.454131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 631/1260] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:37 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:37.912735 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8aa4dfa3-d3b8-4d89-a94b-ad5b74fc0034 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:37.914900 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8aa4dfa3-d3b8-4d89-a94b-ad5b74fc0034 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:37.920741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8aa4dfa3-d3b8-4d89-a94b-ad5b74fc0034 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:37.921225 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8aa4dfa3-d3b8-4d89-a94b-ad5b74fc0034 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:37.921665 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8aa4dfa3-d3b8-4d89-a94b-ad5b74fc0034 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:37.922350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8aa4dfa3-d3b8-4d89-a94b-ad5b74fc0034 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:37.922835 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8aa4dfa3-d3b8-4d89-a94b-ad5b74fc0034 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:37.923263 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8aa4dfa3-d3b8-4d89-a94b-ad5b74fc0034 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:37.951383 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8aa4dfa3-d3b8-4d89-a94b-ad5b74fc0034 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042240 Aug 24 12:40:37.951567 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 630/1261] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:37 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:38.397571 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-dcba3a2c-afdd-43f0-bb11-1cbf73064efd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:38.399722 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-dcba3a2c-afdd-43f0-bb11-1cbf73064efd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:38.405695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dcba3a2c-afdd-43f0-bb11-1cbf73064efd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:38.406169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dcba3a2c-afdd-43f0-bb11-1cbf73064efd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:38.406600 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dcba3a2c-afdd-43f0-bb11-1cbf73064efd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:38.407306 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dcba3a2c-afdd-43f0-bb11-1cbf73064efd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:38.407784 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dcba3a2c-afdd-43f0-bb11-1cbf73064efd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:38.408169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dcba3a2c-afdd-43f0-bb11-1cbf73064efd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:38.436576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-dcba3a2c-afdd-43f0-bb11-1cbf73064efd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043018 Aug 24 12:40:38.437618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 632/1262] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:38 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:38.465842 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-206fb17d-f968-4063-a659-b29c52dbc413 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:38.468013 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-206fb17d-f968-4063-a659-b29c52dbc413 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:38.474399 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-206fb17d-f968-4063-a659-b29c52dbc413 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:38.474904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-206fb17d-f968-4063-a659-b29c52dbc413 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:38.475330 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-206fb17d-f968-4063-a659-b29c52dbc413 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:38.476011 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-206fb17d-f968-4063-a659-b29c52dbc413 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:38.476461 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-206fb17d-f968-4063-a659-b29c52dbc413 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:38.476880 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-206fb17d-f968-4063-a659-b29c52dbc413 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:38.505750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-206fb17d-f968-4063-a659-b29c52dbc413 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043820 Aug 24 12:40:38.506294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 631/1263] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:38 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:38.963307 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fc6799e6-0ac3-4559-9c64-ef7ae23d1831 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:38.965432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fc6799e6-0ac3-4559-9c64-ef7ae23d1831 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:38.971304 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc6799e6-0ac3-4559-9c64-ef7ae23d1831 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:38.971781 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc6799e6-0ac3-4559-9c64-ef7ae23d1831 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:38.972209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc6799e6-0ac3-4559-9c64-ef7ae23d1831 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:38.972878 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc6799e6-0ac3-4559-9c64-ef7ae23d1831 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:38.973325 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc6799e6-0ac3-4559-9c64-ef7ae23d1831 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:38.973767 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc6799e6-0ac3-4559-9c64-ef7ae23d1831 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:39.002934 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fc6799e6-0ac3-4559-9c64-ef7ae23d1831 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043554 Aug 24 12:40:39.003461 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 633/1264] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:38 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:39.449272 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-93d6fb4d-c27f-4c1b-9db8-bed4150caa11 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:39.451480 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-93d6fb4d-c27f-4c1b-9db8-bed4150caa11 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:39.457853 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-93d6fb4d-c27f-4c1b-9db8-bed4150caa11 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:39.458357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-93d6fb4d-c27f-4c1b-9db8-bed4150caa11 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:39.458876 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-93d6fb4d-c27f-4c1b-9db8-bed4150caa11 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:39.459567 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-93d6fb4d-c27f-4c1b-9db8-bed4150caa11 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:39.460024 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-93d6fb4d-c27f-4c1b-9db8-bed4150caa11 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:39.460462 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-93d6fb4d-c27f-4c1b-9db8-bed4150caa11 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:39.489779 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-93d6fb4d-c27f-4c1b-9db8-bed4150caa11 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044573 Aug 24 12:40:39.490401 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 632/1265] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:39 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:39.518405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8420ccc9-a48c-4f91-91e1-1fe46366ff4b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:39.520528 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8420ccc9-a48c-4f91-91e1-1fe46366ff4b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:39.526796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8420ccc9-a48c-4f91-91e1-1fe46366ff4b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:39.527268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8420ccc9-a48c-4f91-91e1-1fe46366ff4b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:39.527697 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8420ccc9-a48c-4f91-91e1-1fe46366ff4b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:39.528368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8420ccc9-a48c-4f91-91e1-1fe46366ff4b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:39.528810 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8420ccc9-a48c-4f91-91e1-1fe46366ff4b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:39.529225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8420ccc9-a48c-4f91-91e1-1fe46366ff4b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:39.557296 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8420ccc9-a48c-4f91-91e1-1fe46366ff4b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043332 Aug 24 12:40:39.557821 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 634/1266] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:39 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:40.015032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5794d9f0-c537-4184-b196-925993f39fd7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:40.017208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5794d9f0-c537-4184-b196-925993f39fd7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:40.023704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5794d9f0-c537-4184-b196-925993f39fd7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:40.024189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5794d9f0-c537-4184-b196-925993f39fd7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:40.024629 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5794d9f0-c537-4184-b196-925993f39fd7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:40.025328 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5794d9f0-c537-4184-b196-925993f39fd7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:40.025783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5794d9f0-c537-4184-b196-925993f39fd7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:40.026209 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5794d9f0-c537-4184-b196-925993f39fd7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:40.028573 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:40.055892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5794d9f0-c537-4184-b196-925993f39fd7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044812 Aug 24 12:40:40.056359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 633/1267] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:40 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:40.502638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4730fe6d-9e27-4fd6-b233-04862644d37c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:40.504765 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4730fe6d-9e27-4fd6-b233-04862644d37c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:40.510591 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4730fe6d-9e27-4fd6-b233-04862644d37c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:40.511094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4730fe6d-9e27-4fd6-b233-04862644d37c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:40.511521 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4730fe6d-9e27-4fd6-b233-04862644d37c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:40.512193 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4730fe6d-9e27-4fd6-b233-04862644d37c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:40.512631 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4730fe6d-9e27-4fd6-b233-04862644d37c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:40.513043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4730fe6d-9e27-4fd6-b233-04862644d37c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:40.536902 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:40.541434 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4730fe6d-9e27-4fd6-b233-04862644d37c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043373 Aug 24 12:40:40.541959 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 635/1268] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:40 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:40.570504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-af53f13c-910e-4caf-945a-aced091740ab tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:40.572589 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-af53f13c-910e-4caf-945a-aced091740ab tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:40.578952 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af53f13c-910e-4caf-945a-aced091740ab tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:40.579432 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af53f13c-910e-4caf-945a-aced091740ab tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:40.579867 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af53f13c-910e-4caf-945a-aced091740ab tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:40.580549 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af53f13c-910e-4caf-945a-aced091740ab tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:40.581000 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af53f13c-910e-4caf-945a-aced091740ab tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:40.581425 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af53f13c-910e-4caf-945a-aced091740ab tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:40.609234 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-af53f13c-910e-4caf-945a-aced091740ab tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043221 Aug 24 12:40:40.609766 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 634/1269] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:40 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:41.068144 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-78de63ad-3f10-4aa1-aa95-203efebd4307 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:41.070246 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-78de63ad-3f10-4aa1-aa95-203efebd4307 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:41.076066 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-78de63ad-3f10-4aa1-aa95-203efebd4307 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:41.076539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-78de63ad-3f10-4aa1-aa95-203efebd4307 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:41.076966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-78de63ad-3f10-4aa1-aa95-203efebd4307 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:41.077642 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-78de63ad-3f10-4aa1-aa95-203efebd4307 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:41.078089 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-78de63ad-3f10-4aa1-aa95-203efebd4307 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:41.078508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-78de63ad-3f10-4aa1-aa95-203efebd4307 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:41.106473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-78de63ad-3f10-4aa1-aa95-203efebd4307 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042683 Aug 24 12:40:41.107035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 636/1270] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:41 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:41.553569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-17870416-da88-44c0-a95c-cf6707303b41 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:41.555759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-17870416-da88-44c0-a95c-cf6707303b41 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:41.561545 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-17870416-da88-44c0-a95c-cf6707303b41 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:41.562029 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-17870416-da88-44c0-a95c-cf6707303b41 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:41.562494 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-17870416-da88-44c0-a95c-cf6707303b41 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:41.563267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-17870416-da88-44c0-a95c-cf6707303b41 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:41.563705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-17870416-da88-44c0-a95c-cf6707303b41 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:41.567483 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-17870416-da88-44c0-a95c-cf6707303b41 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:41.592907 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-17870416-da88-44c0-a95c-cf6707303b41 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043319 Aug 24 12:40:41.593511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 635/1271] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:41 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:41.621874 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-02ba0353-0490-4786-8ab0-822efb730069 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:41.624032 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-02ba0353-0490-4786-8ab0-822efb730069 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:41.630789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02ba0353-0490-4786-8ab0-822efb730069 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:41.631258 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02ba0353-0490-4786-8ab0-822efb730069 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:41.631683 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02ba0353-0490-4786-8ab0-822efb730069 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:41.632357 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02ba0353-0490-4786-8ab0-822efb730069 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:41.632802 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02ba0353-0490-4786-8ab0-822efb730069 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:41.633223 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02ba0353-0490-4786-8ab0-822efb730069 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:41.661749 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-02ba0353-0490-4786-8ab0-822efb730069 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043813 Aug 24 12:40:41.662278 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 637/1272] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:41 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:42.120163 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b53d0c07-7480-4a84-aa5a-3a2410977793 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:42.123205 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b53d0c07-7480-4a84-aa5a-3a2410977793 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:42.129095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b53d0c07-7480-4a84-aa5a-3a2410977793 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:42.129582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b53d0c07-7480-4a84-aa5a-3a2410977793 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:42.130004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b53d0c07-7480-4a84-aa5a-3a2410977793 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:42.130707 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b53d0c07-7480-4a84-aa5a-3a2410977793 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:42.131161 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b53d0c07-7480-4a84-aa5a-3a2410977793 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:42.131582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b53d0c07-7480-4a84-aa5a-3a2410977793 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:42.160579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b53d0c07-7480-4a84-aa5a-3a2410977793 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044494 Aug 24 12:40:42.161114 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 636/1273] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:42 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:42.605493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3f2eded6-1325-4198-84e3-2b5cd587242a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:42.607625 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3f2eded6-1325-4198-84e3-2b5cd587242a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:42.614601 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f2eded6-1325-4198-84e3-2b5cd587242a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:42.615105 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f2eded6-1325-4198-84e3-2b5cd587242a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:42.615536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f2eded6-1325-4198-84e3-2b5cd587242a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:42.616213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f2eded6-1325-4198-84e3-2b5cd587242a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:42.616665 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f2eded6-1325-4198-84e3-2b5cd587242a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:42.617082 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f2eded6-1325-4198-84e3-2b5cd587242a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:42.645155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3f2eded6-1325-4198-84e3-2b5cd587242a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043580 Aug 24 12:40:42.645745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 638/1274] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:42 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:42.673433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8efa8834-39df-4770-bdca-d5f5dc63901c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:42.676250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8efa8834-39df-4770-bdca-d5f5dc63901c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:42.682493 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8efa8834-39df-4770-bdca-d5f5dc63901c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:42.683012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8efa8834-39df-4770-bdca-d5f5dc63901c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:42.683451 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8efa8834-39df-4770-bdca-d5f5dc63901c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:42.689486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8efa8834-39df-4770-bdca-d5f5dc63901c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:42.689486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8efa8834-39df-4770-bdca-d5f5dc63901c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:42.689486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8efa8834-39df-4770-bdca-d5f5dc63901c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:42.714532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8efa8834-39df-4770-bdca-d5f5dc63901c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045076 Aug 24 12:40:42.716996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 637/1275] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:42 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:43.172958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d6d04397-8c55-4c1a-90a7-14c3a698a9ca tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:43.175131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d6d04397-8c55-4c1a-90a7-14c3a698a9ca tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:43.181099 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d6d04397-8c55-4c1a-90a7-14c3a698a9ca tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:43.181583 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d6d04397-8c55-4c1a-90a7-14c3a698a9ca tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:43.182020 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d6d04397-8c55-4c1a-90a7-14c3a698a9ca tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:43.182741 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d6d04397-8c55-4c1a-90a7-14c3a698a9ca tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:43.183194 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d6d04397-8c55-4c1a-90a7-14c3a698a9ca tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:43.183618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d6d04397-8c55-4c1a-90a7-14c3a698a9ca tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:43.212917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d6d04397-8c55-4c1a-90a7-14c3a698a9ca tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043945 Aug 24 12:40:43.213457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 639/1276] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:43 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:43.657269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fdae1073-baed-4a9d-9a06-113e4cedc200 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:43.659425 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fdae1073-baed-4a9d-9a06-113e4cedc200 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:43.665590 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fdae1073-baed-4a9d-9a06-113e4cedc200 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:43.666062 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fdae1073-baed-4a9d-9a06-113e4cedc200 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:43.666492 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fdae1073-baed-4a9d-9a06-113e4cedc200 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:43.667200 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fdae1073-baed-4a9d-9a06-113e4cedc200 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:43.667648 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fdae1073-baed-4a9d-9a06-113e4cedc200 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:43.668063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fdae1073-baed-4a9d-9a06-113e4cedc200 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:43.696678 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fdae1073-baed-4a9d-9a06-113e4cedc200 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043258 Aug 24 12:40:43.697254 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 638/1277] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:43 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:43.726881 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f831fc38-54c6-4ac7-9d34-20f43049502b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:43.729005 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f831fc38-54c6-4ac7-9d34-20f43049502b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:43.735394 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f831fc38-54c6-4ac7-9d34-20f43049502b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:43.735874 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f831fc38-54c6-4ac7-9d34-20f43049502b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:43.736311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f831fc38-54c6-4ac7-9d34-20f43049502b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:43.736997 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f831fc38-54c6-4ac7-9d34-20f43049502b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:43.737445 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f831fc38-54c6-4ac7-9d34-20f43049502b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:43.738385 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f831fc38-54c6-4ac7-9d34-20f43049502b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:43.767253 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f831fc38-54c6-4ac7-9d34-20f43049502b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044406 Aug 24 12:40:43.767858 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 640/1278] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:43 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:44.225981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b0d345ea-772c-47dc-b85e-32a4275fd59b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:44.228150 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b0d345ea-772c-47dc-b85e-32a4275fd59b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:44.234170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0d345ea-772c-47dc-b85e-32a4275fd59b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:44.234662 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0d345ea-772c-47dc-b85e-32a4275fd59b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:44.235115 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0d345ea-772c-47dc-b85e-32a4275fd59b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:44.235806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0d345ea-772c-47dc-b85e-32a4275fd59b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:44.236257 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0d345ea-772c-47dc-b85e-32a4275fd59b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:44.236677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0d345ea-772c-47dc-b85e-32a4275fd59b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:44.267668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b0d345ea-772c-47dc-b85e-32a4275fd59b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046168 Aug 24 12:40:44.268475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 639/1279] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:44 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:44.709675 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fdb4ca1b-5696-4ec5-a454-ec5249aa90e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:44.712016 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fdb4ca1b-5696-4ec5-a454-ec5249aa90e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:44.718283 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fdb4ca1b-5696-4ec5-a454-ec5249aa90e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:44.718788 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fdb4ca1b-5696-4ec5-a454-ec5249aa90e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:44.719219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fdb4ca1b-5696-4ec5-a454-ec5249aa90e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:44.719914 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fdb4ca1b-5696-4ec5-a454-ec5249aa90e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:44.720360 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fdb4ca1b-5696-4ec5-a454-ec5249aa90e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:44.720772 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fdb4ca1b-5696-4ec5-a454-ec5249aa90e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:44.750897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fdb4ca1b-5696-4ec5-a454-ec5249aa90e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045686 Aug 24 12:40:44.751586 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 641/1280] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:44 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:44.779533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-23bec4f8-6c44-40d3-881f-b4aa3a21e7c1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:44.784166 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-23bec4f8-6c44-40d3-881f-b4aa3a21e7c1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:44.788472 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-23bec4f8-6c44-40d3-881f-b4aa3a21e7c1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:44.788948 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-23bec4f8-6c44-40d3-881f-b4aa3a21e7c1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:44.789380 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-23bec4f8-6c44-40d3-881f-b4aa3a21e7c1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:44.790066 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-23bec4f8-6c44-40d3-881f-b4aa3a21e7c1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:44.790520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-23bec4f8-6c44-40d3-881f-b4aa3a21e7c1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:44.790979 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-23bec4f8-6c44-40d3-881f-b4aa3a21e7c1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:44.820289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-23bec4f8-6c44-40d3-881f-b4aa3a21e7c1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044701 Aug 24 12:40:44.820834 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 640/1281] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:44 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:45.280604 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fa3b8e96-7081-42ee-a2af-f39696da3b19 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:45.282818 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fa3b8e96-7081-42ee-a2af-f39696da3b19 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:45.289303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa3b8e96-7081-42ee-a2af-f39696da3b19 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:45.289776 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa3b8e96-7081-42ee-a2af-f39696da3b19 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:45.290204 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa3b8e96-7081-42ee-a2af-f39696da3b19 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:45.290909 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa3b8e96-7081-42ee-a2af-f39696da3b19 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:45.291375 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa3b8e96-7081-42ee-a2af-f39696da3b19 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:45.291783 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa3b8e96-7081-42ee-a2af-f39696da3b19 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:45.319805 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fa3b8e96-7081-42ee-a2af-f39696da3b19 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043187 Aug 24 12:40:45.320336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 642/1282] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:45 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:45.763802 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3e903006-02cb-4c55-9e3d-a669f4e0dfd0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:45.766071 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3e903006-02cb-4c55-9e3d-a669f4e0dfd0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:45.771929 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e903006-02cb-4c55-9e3d-a669f4e0dfd0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:45.772406 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e903006-02cb-4c55-9e3d-a669f4e0dfd0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:45.772836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e903006-02cb-4c55-9e3d-a669f4e0dfd0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:45.773511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e903006-02cb-4c55-9e3d-a669f4e0dfd0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:45.773959 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e903006-02cb-4c55-9e3d-a669f4e0dfd0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:45.774487 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e903006-02cb-4c55-9e3d-a669f4e0dfd0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:45.802820 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3e903006-02cb-4c55-9e3d-a669f4e0dfd0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042944 Aug 24 12:40:45.803354 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 641/1283] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:45 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:45.833184 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-eeb1dd6c-c507-47f4-b5d1-d59aa745c313 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:45.835293 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-eeb1dd6c-c507-47f4-b5d1-d59aa745c313 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:45.841137 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eeb1dd6c-c507-47f4-b5d1-d59aa745c313 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:45.841609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eeb1dd6c-c507-47f4-b5d1-d59aa745c313 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:45.842042 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eeb1dd6c-c507-47f4-b5d1-d59aa745c313 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:45.842746 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eeb1dd6c-c507-47f4-b5d1-d59aa745c313 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:45.843197 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eeb1dd6c-c507-47f4-b5d1-d59aa745c313 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:45.843648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eeb1dd6c-c507-47f4-b5d1-d59aa745c313 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:45.872654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-eeb1dd6c-c507-47f4-b5d1-d59aa745c313 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043664 Aug 24 12:40:45.873184 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 643/1284] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:45 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:46.332338 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-aca0d51e-a819-45a3-85db-c01dc0aa2694 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:46.334532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-aca0d51e-a819-45a3-85db-c01dc0aa2694 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:46.340434 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aca0d51e-a819-45a3-85db-c01dc0aa2694 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:46.340915 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aca0d51e-a819-45a3-85db-c01dc0aa2694 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:46.341353 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aca0d51e-a819-45a3-85db-c01dc0aa2694 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:46.342039 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aca0d51e-a819-45a3-85db-c01dc0aa2694 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:46.342528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aca0d51e-a819-45a3-85db-c01dc0aa2694 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:46.342984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aca0d51e-a819-45a3-85db-c01dc0aa2694 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:46.372450 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-aca0d51e-a819-45a3-85db-c01dc0aa2694 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044168 Aug 24 12:40:46.372979 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 642/1285] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:46 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:46.814939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8321719a-e9fb-48e7-a9ae-d31c457cb740 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:46.817122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8321719a-e9fb-48e7-a9ae-d31c457cb740 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:46.823088 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8321719a-e9fb-48e7-a9ae-d31c457cb740 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:46.823568 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8321719a-e9fb-48e7-a9ae-d31c457cb740 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:46.824001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8321719a-e9fb-48e7-a9ae-d31c457cb740 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:46.824690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8321719a-e9fb-48e7-a9ae-d31c457cb740 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:46.825136 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8321719a-e9fb-48e7-a9ae-d31c457cb740 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:46.825560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8321719a-e9fb-48e7-a9ae-d31c457cb740 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:46.854496 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8321719a-e9fb-48e7-a9ae-d31c457cb740 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043577 Aug 24 12:40:46.855115 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 644/1286] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:46 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:46.884564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-af5165ae-578e-4246-b7fb-cdcabb4d6aae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:46.886716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-af5165ae-578e-4246-b7fb-cdcabb4d6aae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:46.893234 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af5165ae-578e-4246-b7fb-cdcabb4d6aae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:46.893721 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af5165ae-578e-4246-b7fb-cdcabb4d6aae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:46.894812 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af5165ae-578e-4246-b7fb-cdcabb4d6aae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:46.895501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af5165ae-578e-4246-b7fb-cdcabb4d6aae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:46.895957 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af5165ae-578e-4246-b7fb-cdcabb4d6aae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:46.896382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af5165ae-578e-4246-b7fb-cdcabb4d6aae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:46.924248 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-af5165ae-578e-4246-b7fb-cdcabb4d6aae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043717 Aug 24 12:40:46.924776 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 643/1287] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:46 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:47.384273 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e52f55e9-9dda-47a7-ac86-d4a33ca07391 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:47.386420 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e52f55e9-9dda-47a7-ac86-d4a33ca07391 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:47.392285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e52f55e9-9dda-47a7-ac86-d4a33ca07391 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:47.392750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e52f55e9-9dda-47a7-ac86-d4a33ca07391 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:47.393175 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e52f55e9-9dda-47a7-ac86-d4a33ca07391 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:47.393845 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e52f55e9-9dda-47a7-ac86-d4a33ca07391 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:47.394290 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e52f55e9-9dda-47a7-ac86-d4a33ca07391 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:47.394730 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e52f55e9-9dda-47a7-ac86-d4a33ca07391 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:47.422645 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e52f55e9-9dda-47a7-ac86-d4a33ca07391 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042271 Aug 24 12:40:47.423203 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 645/1288] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:47 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:47.866405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9af4e434-6a74-4871-9e41-2d9c2b97fac0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:47.868592 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9af4e434-6a74-4871-9e41-2d9c2b97fac0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:47.874569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9af4e434-6a74-4871-9e41-2d9c2b97fac0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:47.875086 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9af4e434-6a74-4871-9e41-2d9c2b97fac0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:47.875571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9af4e434-6a74-4871-9e41-2d9c2b97fac0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:47.876264 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9af4e434-6a74-4871-9e41-2d9c2b97fac0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:47.876750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9af4e434-6a74-4871-9e41-2d9c2b97fac0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:47.877182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9af4e434-6a74-4871-9e41-2d9c2b97fac0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:47.906502 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9af4e434-6a74-4871-9e41-2d9c2b97fac0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044297 Aug 24 12:40:47.907135 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 644/1289] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:47 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:47.936008 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cf0bf22e-3a45-48b5-9f40-555d799ff81e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:47.938079 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cf0bf22e-3a45-48b5-9f40-555d799ff81e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:47.944852 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf0bf22e-3a45-48b5-9f40-555d799ff81e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:47.945322 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf0bf22e-3a45-48b5-9f40-555d799ff81e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:47.945749 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf0bf22e-3a45-48b5-9f40-555d799ff81e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:47.946426 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf0bf22e-3a45-48b5-9f40-555d799ff81e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:47.946897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf0bf22e-3a45-48b5-9f40-555d799ff81e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:47.947315 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf0bf22e-3a45-48b5-9f40-555d799ff81e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:47.976066 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cf0bf22e-3a45-48b5-9f40-555d799ff81e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043993 Aug 24 12:40:47.976594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 646/1290] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:47 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:48.434399 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8b99e7d5-54a9-4ce3-bd27-82456905443f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:48.436619 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8b99e7d5-54a9-4ce3-bd27-82456905443f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:48.442531 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b99e7d5-54a9-4ce3-bd27-82456905443f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:48.443135 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b99e7d5-54a9-4ce3-bd27-82456905443f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:48.443577 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b99e7d5-54a9-4ce3-bd27-82456905443f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:48.444256 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b99e7d5-54a9-4ce3-bd27-82456905443f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:48.444709 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b99e7d5-54a9-4ce3-bd27-82456905443f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:48.445130 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b99e7d5-54a9-4ce3-bd27-82456905443f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:48.476507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8b99e7d5-54a9-4ce3-bd27-82456905443f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045912 Aug 24 12:40:48.476970 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 645/1291] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:48 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:48.918209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4f87d29b-eeac-4ca3-b6f3-89d917a45d9b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:48.920397 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4f87d29b-eeac-4ca3-b6f3-89d917a45d9b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:48.926385 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f87d29b-eeac-4ca3-b6f3-89d917a45d9b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:48.926902 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f87d29b-eeac-4ca3-b6f3-89d917a45d9b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:48.927336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f87d29b-eeac-4ca3-b6f3-89d917a45d9b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:48.928014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f87d29b-eeac-4ca3-b6f3-89d917a45d9b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:48.928457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f87d29b-eeac-4ca3-b6f3-89d917a45d9b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:48.928881 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f87d29b-eeac-4ca3-b6f3-89d917a45d9b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:48.956975 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4f87d29b-eeac-4ca3-b6f3-89d917a45d9b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042230 Aug 24 12:40:48.957577 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 647/1292] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:48 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:40:48.988737 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bb311813-1e9b-4037-a738-9cc4ed308e32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:48.991194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bb311813-1e9b-4037-a738-9cc4ed308e32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:48.997804 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb311813-1e9b-4037-a738-9cc4ed308e32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:48.998329 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb311813-1e9b-4037-a738-9cc4ed308e32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:48.998798 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb311813-1e9b-4037-a738-9cc4ed308e32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:48.999506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb311813-1e9b-4037-a738-9cc4ed308e32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:48.999962 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb311813-1e9b-4037-a738-9cc4ed308e32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:49.000382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb311813-1e9b-4037-a738-9cc4ed308e32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:49.029234 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bb311813-1e9b-4037-a738-9cc4ed308e32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045130 Aug 24 12:40:49.029775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 646/1293] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:48 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:49.489290 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ec8beab6-4a62-4f79-9149-0ba9e2382997 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:49.502535 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ec8beab6-4a62-4f79-9149-0ba9e2382997 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:49.502535 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ec8beab6-4a62-4f79-9149-0ba9e2382997 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:49.502535 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ec8beab6-4a62-4f79-9149-0ba9e2382997 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:49.502535 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ec8beab6-4a62-4f79-9149-0ba9e2382997 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:49.503014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ec8beab6-4a62-4f79-9149-0ba9e2382997 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:49.503014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ec8beab6-4a62-4f79-9149-0ba9e2382997 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:49.503014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ec8beab6-4a62-4f79-9149-0ba9e2382997 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:49.528796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ec8beab6-4a62-4f79-9149-0ba9e2382997 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044172 Aug 24 12:40:49.529332 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 648/1294] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:49 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:49.968816 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-492cd30f-3822-429a-aba0-b16737e79de4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:49.971021 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-492cd30f-3822-429a-aba0-b16737e79de4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:49.977437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-492cd30f-3822-429a-aba0-b16737e79de4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:49.977914 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-492cd30f-3822-429a-aba0-b16737e79de4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:49.978350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-492cd30f-3822-429a-aba0-b16737e79de4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:49.979062 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-492cd30f-3822-429a-aba0-b16737e79de4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:49.979518 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-492cd30f-3822-429a-aba0-b16737e79de4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:49.979945 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-492cd30f-3822-429a-aba0-b16737e79de4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:50.008443 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-492cd30f-3822-429a-aba0-b16737e79de4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043545 Aug 24 12:40:50.009053 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 647/1295] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:49 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:50.041499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-abfcd8f3-cf34-4171-ae88-4eee5a8d032a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:50.043623 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-abfcd8f3-cf34-4171-ae88-4eee5a8d032a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:50.049893 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-abfcd8f3-cf34-4171-ae88-4eee5a8d032a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:50.051038 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-abfcd8f3-cf34-4171-ae88-4eee5a8d032a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:50.051481 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-abfcd8f3-cf34-4171-ae88-4eee5a8d032a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:50.052168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-abfcd8f3-cf34-4171-ae88-4eee5a8d032a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:50.052616 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-abfcd8f3-cf34-4171-ae88-4eee5a8d032a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:50.053043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-abfcd8f3-cf34-4171-ae88-4eee5a8d032a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:50.081048 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-abfcd8f3-cf34-4171-ae88-4eee5a8d032a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043558 Aug 24 12:40:50.081586 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 649/1296] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:50 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:50.541773 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fbc46fbd-e8f0-4b92-8563-2763ebfb5baf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:50.543965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fbc46fbd-e8f0-4b92-8563-2763ebfb5baf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:50.549847 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fbc46fbd-e8f0-4b92-8563-2763ebfb5baf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:50.550331 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fbc46fbd-e8f0-4b92-8563-2763ebfb5baf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:50.550800 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fbc46fbd-e8f0-4b92-8563-2763ebfb5baf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:50.551489 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fbc46fbd-e8f0-4b92-8563-2763ebfb5baf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:50.551945 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fbc46fbd-e8f0-4b92-8563-2763ebfb5baf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:50.552373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fbc46fbd-e8f0-4b92-8563-2763ebfb5baf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:50.580544 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fbc46fbd-e8f0-4b92-8563-2763ebfb5baf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042799 Aug 24 12:40:50.581084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 648/1297] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:50 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:51.019981 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4dce3a2b-eae5-4c98-af1b-99f3927e1e3a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:51.022122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4dce3a2b-eae5-4c98-af1b-99f3927e1e3a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:51.028025 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4dce3a2b-eae5-4c98-af1b-99f3927e1e3a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:51.028494 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4dce3a2b-eae5-4c98-af1b-99f3927e1e3a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:51.028920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4dce3a2b-eae5-4c98-af1b-99f3927e1e3a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:51.029593 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4dce3a2b-eae5-4c98-af1b-99f3927e1e3a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:51.030037 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4dce3a2b-eae5-4c98-af1b-99f3927e1e3a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:51.030453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4dce3a2b-eae5-4c98-af1b-99f3927e1e3a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:51.058588 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4dce3a2b-eae5-4c98-af1b-99f3927e1e3a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042421 Aug 24 12:40:51.059214 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 650/1298] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:51 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:51.093058 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-aa038621-4e54-43f8-b246-774afed446ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:51.095200 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-aa038621-4e54-43f8-b246-774afed446ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:51.101452 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aa038621-4e54-43f8-b246-774afed446ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:51.101930 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aa038621-4e54-43f8-b246-774afed446ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:51.102363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aa038621-4e54-43f8-b246-774afed446ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:51.103063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aa038621-4e54-43f8-b246-774afed446ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:51.103514 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aa038621-4e54-43f8-b246-774afed446ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:51.103949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aa038621-4e54-43f8-b246-774afed446ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:51.127915 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:51.133016 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-aa038621-4e54-43f8-b246-774afed446ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043860 Aug 24 12:40:51.138841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 649/1299] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:51 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:51.658271 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1f30a9ae-ee5a-4a9a-8254-c2d7270fafa5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:51.661207 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1f30a9ae-ee5a-4a9a-8254-c2d7270fafa5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:51.667061 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1f30a9ae-ee5a-4a9a-8254-c2d7270fafa5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:51.667541 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1f30a9ae-ee5a-4a9a-8254-c2d7270fafa5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:51.667972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1f30a9ae-ee5a-4a9a-8254-c2d7270fafa5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:51.668655 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1f30a9ae-ee5a-4a9a-8254-c2d7270fafa5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:51.669106 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1f30a9ae-ee5a-4a9a-8254-c2d7270fafa5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:51.669524 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1f30a9ae-ee5a-4a9a-8254-c2d7270fafa5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:51.698429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1f30a9ae-ee5a-4a9a-8254-c2d7270fafa5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109029 Aug 24 12:40:51.698938 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 651/1300] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:51 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:52.071184 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-efe2f4e6-30ce-4001-b4ac-02a2633afdd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:52.073339 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-efe2f4e6-30ce-4001-b4ac-02a2633afdd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:52.079706 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-efe2f4e6-30ce-4001-b4ac-02a2633afdd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:52.080184 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-efe2f4e6-30ce-4001-b4ac-02a2633afdd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:52.080618 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-efe2f4e6-30ce-4001-b4ac-02a2633afdd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:52.081295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-efe2f4e6-30ce-4001-b4ac-02a2633afdd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:52.081744 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-efe2f4e6-30ce-4001-b4ac-02a2633afdd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:52.082788 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-efe2f4e6-30ce-4001-b4ac-02a2633afdd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:52.110193 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-efe2f4e6-30ce-4001-b4ac-02a2633afdd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043099 Aug 24 12:40:52.110776 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 650/1301] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:52 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:52.148626 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fd6edf04-e966-4c38-815f-2bc272f93f00 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:52.150765 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fd6edf04-e966-4c38-815f-2bc272f93f00 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:52.157011 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd6edf04-e966-4c38-815f-2bc272f93f00 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:52.157485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd6edf04-e966-4c38-815f-2bc272f93f00 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:52.157916 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd6edf04-e966-4c38-815f-2bc272f93f00 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:52.158595 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd6edf04-e966-4c38-815f-2bc272f93f00 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:52.159067 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd6edf04-e966-4c38-815f-2bc272f93f00 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:52.159486 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd6edf04-e966-4c38-815f-2bc272f93f00 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:52.175346 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:52.187845 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fd6edf04-e966-4c38-815f-2bc272f93f00 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043756 Aug 24 12:40:52.191720 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 652/1302] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:52 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:52.709703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-230ebb31-7172-4f07-9f49-8c3a90cce6eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:52.711804 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-230ebb31-7172-4f07-9f49-8c3a90cce6eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:52.717715 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-230ebb31-7172-4f07-9f49-8c3a90cce6eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:52.718198 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-230ebb31-7172-4f07-9f49-8c3a90cce6eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:52.718638 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-230ebb31-7172-4f07-9f49-8c3a90cce6eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:52.719346 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-230ebb31-7172-4f07-9f49-8c3a90cce6eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:52.719804 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-230ebb31-7172-4f07-9f49-8c3a90cce6eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:52.720233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-230ebb31-7172-4f07-9f49-8c3a90cce6eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:52.748941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-230ebb31-7172-4f07-9f49-8c3a90cce6eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043334 Aug 24 12:40:52.749512 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 651/1303] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:52 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:53.122812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9619f502-e4a8-47e6-8469-e4e3964e6fdc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:53.124968 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9619f502-e4a8-47e6-8469-e4e3964e6fdc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:53.131154 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9619f502-e4a8-47e6-8469-e4e3964e6fdc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:53.131631 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9619f502-e4a8-47e6-8469-e4e3964e6fdc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:53.132063 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9619f502-e4a8-47e6-8469-e4e3964e6fdc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:53.132738 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9619f502-e4a8-47e6-8469-e4e3964e6fdc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:53.133186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9619f502-e4a8-47e6-8469-e4e3964e6fdc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:53.133604 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9619f502-e4a8-47e6-8469-e4e3964e6fdc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:53.162157 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9619f502-e4a8-47e6-8469-e4e3964e6fdc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043676 Aug 24 12:40:53.162782 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 653/1304] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:53 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:53.201781 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0bb295fd-02f8-4c64-bfde-2fda5daf96d4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:53.203968 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0bb295fd-02f8-4c64-bfde-2fda5daf96d4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:53.210742 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bb295fd-02f8-4c64-bfde-2fda5daf96d4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:53.211218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bb295fd-02f8-4c64-bfde-2fda5daf96d4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:53.211681 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bb295fd-02f8-4c64-bfde-2fda5daf96d4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:53.212362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bb295fd-02f8-4c64-bfde-2fda5daf96d4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:53.212815 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bb295fd-02f8-4c64-bfde-2fda5daf96d4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:53.213236 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bb295fd-02f8-4c64-bfde-2fda5daf96d4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:53.241837 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0bb295fd-02f8-4c64-bfde-2fda5daf96d4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043975 Aug 24 12:40:53.242372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 652/1305] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:53 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:53.760253 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6efbaa71-7ca7-49b3-a76a-55cb4e5783ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:53.762364 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6efbaa71-7ca7-49b3-a76a-55cb4e5783ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:53.768267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6efbaa71-7ca7-49b3-a76a-55cb4e5783ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:53.768742 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6efbaa71-7ca7-49b3-a76a-55cb4e5783ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:53.769177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6efbaa71-7ca7-49b3-a76a-55cb4e5783ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:53.769904 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6efbaa71-7ca7-49b3-a76a-55cb4e5783ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:53.770368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6efbaa71-7ca7-49b3-a76a-55cb4e5783ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:53.770810 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6efbaa71-7ca7-49b3-a76a-55cb4e5783ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:53.800284 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6efbaa71-7ca7-49b3-a76a-55cb4e5783ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044038 Aug 24 12:40:53.801419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 654/1306] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:53 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:54.173392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2e7b7dd2-f909-427e-8b5e-54fc9b5e8228 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:54.175629 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2e7b7dd2-f909-427e-8b5e-54fc9b5e8228 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:54.181533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2e7b7dd2-f909-427e-8b5e-54fc9b5e8228 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:54.184310 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2e7b7dd2-f909-427e-8b5e-54fc9b5e8228 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:54.184310 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2e7b7dd2-f909-427e-8b5e-54fc9b5e8228 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:54.184310 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2e7b7dd2-f909-427e-8b5e-54fc9b5e8228 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:54.184310 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2e7b7dd2-f909-427e-8b5e-54fc9b5e8228 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:54.184977 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2e7b7dd2-f909-427e-8b5e-54fc9b5e8228 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:54.214006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2e7b7dd2-f909-427e-8b5e-54fc9b5e8228 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044511 Aug 24 12:40:54.214643 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 653/1307] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:54 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:54.254169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8546930e-ea7b-436f-8c7a-9b6c5a0bdef7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:54.256432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8546930e-ea7b-436f-8c7a-9b6c5a0bdef7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:54.262990 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8546930e-ea7b-436f-8c7a-9b6c5a0bdef7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:54.263409 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8546930e-ea7b-436f-8c7a-9b6c5a0bdef7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:54.263843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8546930e-ea7b-436f-8c7a-9b6c5a0bdef7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:54.264523 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8546930e-ea7b-436f-8c7a-9b6c5a0bdef7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:54.264970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8546930e-ea7b-436f-8c7a-9b6c5a0bdef7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:54.265390 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8546930e-ea7b-436f-8c7a-9b6c5a0bdef7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:54.295098 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8546930e-ea7b-436f-8c7a-9b6c5a0bdef7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044866 Aug 24 12:40:54.295624 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 655/1308] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:54 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:54.813177 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0a65c091-ca0a-4c10-9dab-84ba4a2dae14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:54.815353 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0a65c091-ca0a-4c10-9dab-84ba4a2dae14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:54.822020 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a65c091-ca0a-4c10-9dab-84ba4a2dae14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:54.822501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a65c091-ca0a-4c10-9dab-84ba4a2dae14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:54.822971 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a65c091-ca0a-4c10-9dab-84ba4a2dae14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:54.823658 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a65c091-ca0a-4c10-9dab-84ba4a2dae14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:54.824108 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a65c091-ca0a-4c10-9dab-84ba4a2dae14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:54.824529 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a65c091-ca0a-4c10-9dab-84ba4a2dae14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:54.852473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0a65c091-ca0a-4c10-9dab-84ba4a2dae14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043236 Aug 24 12:40:54.853011 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 654/1309] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:54 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:55.226330 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e22e8d6d-e8fc-403d-b0f8-ef49f056e665 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:55.228500 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e22e8d6d-e8fc-403d-b0f8-ef49f056e665 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:55.234336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e22e8d6d-e8fc-403d-b0f8-ef49f056e665 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:55.234850 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e22e8d6d-e8fc-403d-b0f8-ef49f056e665 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:55.235288 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e22e8d6d-e8fc-403d-b0f8-ef49f056e665 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:55.235969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e22e8d6d-e8fc-403d-b0f8-ef49f056e665 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:55.236423 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e22e8d6d-e8fc-403d-b0f8-ef49f056e665 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:55.236850 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e22e8d6d-e8fc-403d-b0f8-ef49f056e665 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:55.265445 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e22e8d6d-e8fc-403d-b0f8-ef49f056e665 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043587 Aug 24 12:40:55.266074 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 656/1310] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:55 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:55.307693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-11b4fd39-0b72-46ec-a2ec-117fed9576d0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:55.309882 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-11b4fd39-0b72-46ec-a2ec-117fed9576d0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:55.316253 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11b4fd39-0b72-46ec-a2ec-117fed9576d0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:55.316681 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11b4fd39-0b72-46ec-a2ec-117fed9576d0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:55.317118 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11b4fd39-0b72-46ec-a2ec-117fed9576d0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:55.317815 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11b4fd39-0b72-46ec-a2ec-117fed9576d0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:55.318253 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11b4fd39-0b72-46ec-a2ec-117fed9576d0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:55.318699 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11b4fd39-0b72-46ec-a2ec-117fed9576d0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:55.347148 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-11b4fd39-0b72-46ec-a2ec-117fed9576d0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043374 Aug 24 12:40:55.348208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 655/1311] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:55 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:55.864548 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7858b9ee-e30f-4c80-a1c2-24d11e3f5b23 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:55.866730 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7858b9ee-e30f-4c80-a1c2-24d11e3f5b23 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:55.872678 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7858b9ee-e30f-4c80-a1c2-24d11e3f5b23 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:55.873148 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7858b9ee-e30f-4c80-a1c2-24d11e3f5b23 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:55.873578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7858b9ee-e30f-4c80-a1c2-24d11e3f5b23 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:55.874255 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7858b9ee-e30f-4c80-a1c2-24d11e3f5b23 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:55.874727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7858b9ee-e30f-4c80-a1c2-24d11e3f5b23 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:55.875150 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7858b9ee-e30f-4c80-a1c2-24d11e3f5b23 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:55.904302 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7858b9ee-e30f-4c80-a1c2-24d11e3f5b23 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043941 Aug 24 12:40:55.904852 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 657/1312] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:55 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:56.276686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-303fdc99-7d82-41c1-8af4-ce0dda2fed34 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:56.278894 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-303fdc99-7d82-41c1-8af4-ce0dda2fed34 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:56.285137 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-303fdc99-7d82-41c1-8af4-ce0dda2fed34 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:56.285623 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-303fdc99-7d82-41c1-8af4-ce0dda2fed34 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:56.286063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-303fdc99-7d82-41c1-8af4-ce0dda2fed34 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:56.286781 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-303fdc99-7d82-41c1-8af4-ce0dda2fed34 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:56.287239 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-303fdc99-7d82-41c1-8af4-ce0dda2fed34 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:56.287667 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-303fdc99-7d82-41c1-8af4-ce0dda2fed34 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:56.317152 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-303fdc99-7d82-41c1-8af4-ce0dda2fed34 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043819 Aug 24 12:40:56.317717 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 656/1313] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:56 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:56.359484 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9c3768ba-03c7-45cf-bff4-1c86d3ca7c64 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:56.361616 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9c3768ba-03c7-45cf-bff4-1c86d3ca7c64 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:56.369156 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9c3768ba-03c7-45cf-bff4-1c86d3ca7c64 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:56.369672 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9c3768ba-03c7-45cf-bff4-1c86d3ca7c64 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:56.370109 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9c3768ba-03c7-45cf-bff4-1c86d3ca7c64 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:56.370841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9c3768ba-03c7-45cf-bff4-1c86d3ca7c64 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:56.371380 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9c3768ba-03c7-45cf-bff4-1c86d3ca7c64 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:56.371747 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9c3768ba-03c7-45cf-bff4-1c86d3ca7c64 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:56.400325 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9c3768ba-03c7-45cf-bff4-1c86d3ca7c64 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044927 Aug 24 12:40:56.400874 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 658/1314] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:56 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:56.916477 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-30744a05-be6d-4d30-b575-ce5598d4d55e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:56.918586 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-30744a05-be6d-4d30-b575-ce5598d4d55e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:56.924532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30744a05-be6d-4d30-b575-ce5598d4d55e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:56.925002 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30744a05-be6d-4d30-b575-ce5598d4d55e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:56.925433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30744a05-be6d-4d30-b575-ce5598d4d55e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:56.926109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30744a05-be6d-4d30-b575-ce5598d4d55e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:56.926557 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30744a05-be6d-4d30-b575-ce5598d4d55e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:56.927004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30744a05-be6d-4d30-b575-ce5598d4d55e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:56.955052 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-30744a05-be6d-4d30-b575-ce5598d4d55e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042479 Aug 24 12:40:56.955576 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 657/1315] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:56 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:57.329425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-811f9da6-a5ef-4478-be45-6909f3c31271 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:57.331702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-811f9da6-a5ef-4478-be45-6909f3c31271 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:57.338068 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-811f9da6-a5ef-4478-be45-6909f3c31271 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:57.338544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-811f9da6-a5ef-4478-be45-6909f3c31271 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:57.339019 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-811f9da6-a5ef-4478-be45-6909f3c31271 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:57.339702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-811f9da6-a5ef-4478-be45-6909f3c31271 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:57.340151 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-811f9da6-a5ef-4478-be45-6909f3c31271 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:57.340581 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-811f9da6-a5ef-4478-be45-6909f3c31271 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:57.369015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-811f9da6-a5ef-4478-be45-6909f3c31271 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043625 Aug 24 12:40:57.369605 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 659/1316] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:57 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:57.412748 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6f3c8f34-f2a5-4cfa-b34b-b9928694153f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:57.414905 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6f3c8f34-f2a5-4cfa-b34b-b9928694153f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:57.421207 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6f3c8f34-f2a5-4cfa-b34b-b9928694153f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:57.421691 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6f3c8f34-f2a5-4cfa-b34b-b9928694153f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:57.422132 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6f3c8f34-f2a5-4cfa-b34b-b9928694153f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:57.422856 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6f3c8f34-f2a5-4cfa-b34b-b9928694153f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:57.423308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6f3c8f34-f2a5-4cfa-b34b-b9928694153f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:57.423732 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6f3c8f34-f2a5-4cfa-b34b-b9928694153f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:57.459499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6f3c8f34-f2a5-4cfa-b34b-b9928694153f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050695 Aug 24 12:40:57.460052 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 658/1317] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:57 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:57.967786 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0f179c9e-f5a1-43c4-b78e-815b66c10a0a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:57.969934 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0f179c9e-f5a1-43c4-b78e-815b66c10a0a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:57.975901 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f179c9e-f5a1-43c4-b78e-815b66c10a0a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:57.976370 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f179c9e-f5a1-43c4-b78e-815b66c10a0a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:57.976829 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f179c9e-f5a1-43c4-b78e-815b66c10a0a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:57.977502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f179c9e-f5a1-43c4-b78e-815b66c10a0a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:57.977945 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f179c9e-f5a1-43c4-b78e-815b66c10a0a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:57.978362 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f179c9e-f5a1-43c4-b78e-815b66c10a0a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:58.007502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0f179c9e-f5a1-43c4-b78e-815b66c10a0a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043711 Aug 24 12:40:58.008033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 660/1318] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:57 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:58.381186 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d9c7507a-03a7-4551-9cf1-e8e688156cc5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:58.383359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d9c7507a-03a7-4551-9cf1-e8e688156cc5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:58.390324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d9c7507a-03a7-4551-9cf1-e8e688156cc5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:58.390841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d9c7507a-03a7-4551-9cf1-e8e688156cc5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:58.391274 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d9c7507a-03a7-4551-9cf1-e8e688156cc5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:58.391953 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d9c7507a-03a7-4551-9cf1-e8e688156cc5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:58.392402 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d9c7507a-03a7-4551-9cf1-e8e688156cc5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:58.392821 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d9c7507a-03a7-4551-9cf1-e8e688156cc5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:58.421571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d9c7507a-03a7-4551-9cf1-e8e688156cc5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044339 Aug 24 12:40:58.422316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 659/1319] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:58 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:58.471808 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-610454b0-cbec-420d-b7bf-a7f9ecb5035f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:58.474550 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-610454b0-cbec-420d-b7bf-a7f9ecb5035f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:58.480869 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-610454b0-cbec-420d-b7bf-a7f9ecb5035f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:58.481342 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-610454b0-cbec-420d-b7bf-a7f9ecb5035f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:58.481774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-610454b0-cbec-420d-b7bf-a7f9ecb5035f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:58.482458 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-610454b0-cbec-420d-b7bf-a7f9ecb5035f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:58.482937 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-610454b0-cbec-420d-b7bf-a7f9ecb5035f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:58.483360 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-610454b0-cbec-420d-b7bf-a7f9ecb5035f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:58.511385 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-610454b0-cbec-420d-b7bf-a7f9ecb5035f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043614 Aug 24 12:40:58.511938 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 661/1320] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:58 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:40:59.020134 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-55415a57-9551-4bb1-abc8-bc83b923d5b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:59.022339 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-55415a57-9551-4bb1-abc8-bc83b923d5b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:59.028349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55415a57-9551-4bb1-abc8-bc83b923d5b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:59.028823 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55415a57-9551-4bb1-abc8-bc83b923d5b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:59.029253 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55415a57-9551-4bb1-abc8-bc83b923d5b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:59.029927 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55415a57-9551-4bb1-abc8-bc83b923d5b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:59.030376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55415a57-9551-4bb1-abc8-bc83b923d5b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:59.030850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55415a57-9551-4bb1-abc8-bc83b923d5b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:59.058670 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-55415a57-9551-4bb1-abc8-bc83b923d5b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043012 Aug 24 12:40:59.059205 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 660/1321] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:59 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:59.434227 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-635f2b95-fe4e-4077-ab86-06a83904d818 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:59.436386 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-635f2b95-fe4e-4077-ab86-06a83904d818 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:59.438360 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=88 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:59.443593 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-635f2b95-fe4e-4077-ab86-06a83904d818 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:59.444067 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-635f2b95-fe4e-4077-ab86-06a83904d818 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:59.444498 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-635f2b95-fe4e-4077-ab86-06a83904d818 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:59.445180 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-635f2b95-fe4e-4077-ab86-06a83904d818 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:59.445629 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-635f2b95-fe4e-4077-ab86-06a83904d818 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:59.446048 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-635f2b95-fe4e-4077-ab86-06a83904d818 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:59.475595 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-635f2b95-fe4e-4077-ab86-06a83904d818 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045337 Aug 24 12:40:59.476219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 662/1322] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:59 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:59.524239 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-57cfb36e-b184-4a8f-bfe5-67a0ab8084e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:59.526489 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-57cfb36e-b184-4a8f-bfe5-67a0ab8084e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:59.528754 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=88 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:59.533479 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57cfb36e-b184-4a8f-bfe5-67a0ab8084e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:59.533967 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57cfb36e-b184-4a8f-bfe5-67a0ab8084e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:59.534409 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57cfb36e-b184-4a8f-bfe5-67a0ab8084e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:59.535733 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57cfb36e-b184-4a8f-bfe5-67a0ab8084e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:59.536193 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57cfb36e-b184-4a8f-bfe5-67a0ab8084e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:59.536627 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57cfb36e-b184-4a8f-bfe5-67a0ab8084e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:59.565299 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-57cfb36e-b184-4a8f-bfe5-67a0ab8084e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044957 Aug 24 12:40:59.565772 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 661/1323] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:59 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:00.070718 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7b903ba8-c6c8-4570-bde5-65e17502bb82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:00.072845 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7b903ba8-c6c8-4570-bde5-65e17502bb82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:00.079153 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7b903ba8-c6c8-4570-bde5-65e17502bb82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:00.079634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7b903ba8-c6c8-4570-bde5-65e17502bb82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:00.080069 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7b903ba8-c6c8-4570-bde5-65e17502bb82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:00.080754 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7b903ba8-c6c8-4570-bde5-65e17502bb82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:00.081201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7b903ba8-c6c8-4570-bde5-65e17502bb82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:00.082136 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7b903ba8-c6c8-4570-bde5-65e17502bb82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:00.110339 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7b903ba8-c6c8-4570-bde5-65e17502bb82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043645 Aug 24 12:41:00.110908 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 663/1324] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:00 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:00.488002 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1b454707-88b1-4c2d-8b84-7dfdcb1812dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:00.490426 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1b454707-88b1-4c2d-8b84-7dfdcb1812dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:00.496305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b454707-88b1-4c2d-8b84-7dfdcb1812dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:00.496778 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b454707-88b1-4c2d-8b84-7dfdcb1812dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:00.497209 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b454707-88b1-4c2d-8b84-7dfdcb1812dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:00.497889 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b454707-88b1-4c2d-8b84-7dfdcb1812dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:00.498338 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b454707-88b1-4c2d-8b84-7dfdcb1812dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:00.498784 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b454707-88b1-4c2d-8b84-7dfdcb1812dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:00.527076 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1b454707-88b1-4c2d-8b84-7dfdcb1812dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043166 Aug 24 12:41:00.527641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 662/1325] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:00 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:00.577985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a7576e7e-461f-41d0-84fd-c63a4e3c05a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:00.580124 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a7576e7e-461f-41d0-84fd-c63a4e3c05a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:00.586524 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a7576e7e-461f-41d0-84fd-c63a4e3c05a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:00.587038 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a7576e7e-461f-41d0-84fd-c63a4e3c05a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:00.587471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a7576e7e-461f-41d0-84fd-c63a4e3c05a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:00.588188 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a7576e7e-461f-41d0-84fd-c63a4e3c05a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:00.588631 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a7576e7e-461f-41d0-84fd-c63a4e3c05a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:00.589050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a7576e7e-461f-41d0-84fd-c63a4e3c05a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:00.616964 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a7576e7e-461f-41d0-84fd-c63a4e3c05a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042922 Aug 24 12:41:00.617438 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 664/1326] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:00 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:01.123066 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d3b896a3-7888-4aa5-823e-170756dc172e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:01.125198 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d3b896a3-7888-4aa5-823e-170756dc172e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:01.131947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3b896a3-7888-4aa5-823e-170756dc172e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:01.132421 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3b896a3-7888-4aa5-823e-170756dc172e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:01.132853 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3b896a3-7888-4aa5-823e-170756dc172e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:01.133530 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3b896a3-7888-4aa5-823e-170756dc172e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:01.133979 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3b896a3-7888-4aa5-823e-170756dc172e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:01.134397 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3b896a3-7888-4aa5-823e-170756dc172e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:01.163013 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d3b896a3-7888-4aa5-823e-170756dc172e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043911 Aug 24 12:41:01.163545 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 663/1327] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:01 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:01.539234 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d9b04f6b-fda3-4f2b-860a-f95915c89356 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:01.541344 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d9b04f6b-fda3-4f2b-860a-f95915c89356 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:01.547293 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d9b04f6b-fda3-4f2b-860a-f95915c89356 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:01.547763 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d9b04f6b-fda3-4f2b-860a-f95915c89356 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:01.552804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d9b04f6b-fda3-4f2b-860a-f95915c89356 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:01.552804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d9b04f6b-fda3-4f2b-860a-f95915c89356 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:01.552804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d9b04f6b-fda3-4f2b-860a-f95915c89356 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:01.552804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d9b04f6b-fda3-4f2b-860a-f95915c89356 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:01.577913 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d9b04f6b-fda3-4f2b-860a-f95915c89356 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043226 Aug 24 12:41:01.578453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 665/1328] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:01 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:01.628142 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ad39fa14-b64e-46ff-a0a8-a01eab2c5ecc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:01.630266 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ad39fa14-b64e-46ff-a0a8-a01eab2c5ecc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:01.636060 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad39fa14-b64e-46ff-a0a8-a01eab2c5ecc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:01.636534 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad39fa14-b64e-46ff-a0a8-a01eab2c5ecc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:01.636987 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad39fa14-b64e-46ff-a0a8-a01eab2c5ecc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:01.637667 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad39fa14-b64e-46ff-a0a8-a01eab2c5ecc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:01.638117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad39fa14-b64e-46ff-a0a8-a01eab2c5ecc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:01.638543 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad39fa14-b64e-46ff-a0a8-a01eab2c5ecc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:01.667764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ad39fa14-b64e-46ff-a0a8-a01eab2c5ecc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043455 Aug 24 12:41:01.668271 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 664/1329] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:01 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:02.174741 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8ce71f1c-deea-433f-ae61-ff934c79824f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:02.176873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8ce71f1c-deea-433f-ae61-ff934c79824f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:02.182764 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ce71f1c-deea-433f-ae61-ff934c79824f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:02.183245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ce71f1c-deea-433f-ae61-ff934c79824f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:02.183677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ce71f1c-deea-433f-ae61-ff934c79824f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:02.184356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ce71f1c-deea-433f-ae61-ff934c79824f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:02.184803 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ce71f1c-deea-433f-ae61-ff934c79824f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:02.185230 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ce71f1c-deea-433f-ae61-ff934c79824f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:02.214708 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8ce71f1c-deea-433f-ae61-ff934c79824f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043971 Aug 24 12:41:02.215243 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 666/1330] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:02 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:02.590504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-14bdaf60-164b-44f1-b10b-c68da87a6078 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:02.592728 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-14bdaf60-164b-44f1-b10b-c68da87a6078 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:02.599819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14bdaf60-164b-44f1-b10b-c68da87a6078 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:02.600294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14bdaf60-164b-44f1-b10b-c68da87a6078 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:02.600733 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14bdaf60-164b-44f1-b10b-c68da87a6078 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:02.601407 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14bdaf60-164b-44f1-b10b-c68da87a6078 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:02.601858 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14bdaf60-164b-44f1-b10b-c68da87a6078 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:02.602274 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14bdaf60-164b-44f1-b10b-c68da87a6078 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:02.631959 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-14bdaf60-164b-44f1-b10b-c68da87a6078 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045484 Aug 24 12:41:02.632616 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 665/1331] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:02 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:02.680918 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9dac94cf-738d-48b7-84c0-09fc8dd34362 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:02.683001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9dac94cf-738d-48b7-84c0-09fc8dd34362 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:02.689398 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9dac94cf-738d-48b7-84c0-09fc8dd34362 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:02.691180 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9dac94cf-738d-48b7-84c0-09fc8dd34362 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:02.691180 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9dac94cf-738d-48b7-84c0-09fc8dd34362 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:02.691180 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9dac94cf-738d-48b7-84c0-09fc8dd34362 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:02.691579 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9dac94cf-738d-48b7-84c0-09fc8dd34362 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:02.691999 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9dac94cf-738d-48b7-84c0-09fc8dd34362 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:02.720562 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9dac94cf-738d-48b7-84c0-09fc8dd34362 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043800 Aug 24 12:41:02.721105 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 667/1332] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:02 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:03.227842 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d8e667cf-7dcf-423f-9f37-bbfa57392896 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:03.230027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d8e667cf-7dcf-423f-9f37-bbfa57392896 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:03.235916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d8e667cf-7dcf-423f-9f37-bbfa57392896 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:03.236392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d8e667cf-7dcf-423f-9f37-bbfa57392896 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:03.236826 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d8e667cf-7dcf-423f-9f37-bbfa57392896 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:03.237506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d8e667cf-7dcf-423f-9f37-bbfa57392896 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:03.237957 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d8e667cf-7dcf-423f-9f37-bbfa57392896 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:03.238378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d8e667cf-7dcf-423f-9f37-bbfa57392896 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:03.251922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:03.266878 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d8e667cf-7dcf-423f-9f37-bbfa57392896 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043688 Aug 24 12:41:03.267414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 666/1333] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:03 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:03.643821 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e1197065-0ec9-46ad-9c2e-6559b984a3d1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:03.646523 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e1197065-0ec9-46ad-9c2e-6559b984a3d1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:03.652379 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1197065-0ec9-46ad-9c2e-6559b984a3d1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:03.652846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1197065-0ec9-46ad-9c2e-6559b984a3d1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:03.653272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1197065-0ec9-46ad-9c2e-6559b984a3d1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:03.653947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1197065-0ec9-46ad-9c2e-6559b984a3d1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:03.654388 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1197065-0ec9-46ad-9c2e-6559b984a3d1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:03.654855 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1197065-0ec9-46ad-9c2e-6559b984a3d1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:03.682186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e1197065-0ec9-46ad-9c2e-6559b984a3d1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042263 Aug 24 12:41:03.682810 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 668/1334] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:03 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:03.733216 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-13e07149-64b7-42a9-8791-47c695296609 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:03.735417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-13e07149-64b7-42a9-8791-47c695296609 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:03.743136 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13e07149-64b7-42a9-8791-47c695296609 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:03.743608 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13e07149-64b7-42a9-8791-47c695296609 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:03.744035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13e07149-64b7-42a9-8791-47c695296609 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:03.744709 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13e07149-64b7-42a9-8791-47c695296609 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:03.745157 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13e07149-64b7-42a9-8791-47c695296609 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:03.745573 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13e07149-64b7-42a9-8791-47c695296609 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:03.774705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-13e07149-64b7-42a9-8791-47c695296609 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045291 Aug 24 12:41:03.775190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 667/1335] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:03 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:04.279841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fa630e95-35d0-49dc-b4d3-9a937a3a7d55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:04.281994 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fa630e95-35d0-49dc-b4d3-9a937a3a7d55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:04.288889 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa630e95-35d0-49dc-b4d3-9a937a3a7d55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:04.291528 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa630e95-35d0-49dc-b4d3-9a937a3a7d55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:04.291528 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa630e95-35d0-49dc-b4d3-9a937a3a7d55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:04.291528 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa630e95-35d0-49dc-b4d3-9a937a3a7d55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:04.291528 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa630e95-35d0-49dc-b4d3-9a937a3a7d55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:04.291917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa630e95-35d0-49dc-b4d3-9a937a3a7d55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:04.295083 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:04.320550 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fa630e95-35d0-49dc-b4d3-9a937a3a7d55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044884 Aug 24 12:41:04.321102 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 669/1336] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:04 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:04.693279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-39314109-4261-46bf-a1bf-a4ed360d23f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:04.695568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-39314109-4261-46bf-a1bf-a4ed360d23f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:04.701430 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-39314109-4261-46bf-a1bf-a4ed360d23f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:04.701912 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-39314109-4261-46bf-a1bf-a4ed360d23f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:04.702369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-39314109-4261-46bf-a1bf-a4ed360d23f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:04.703087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-39314109-4261-46bf-a1bf-a4ed360d23f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:04.703540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-39314109-4261-46bf-a1bf-a4ed360d23f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:04.703962 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-39314109-4261-46bf-a1bf-a4ed360d23f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:04.733712 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-39314109-4261-46bf-a1bf-a4ed360d23f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044337 Aug 24 12:41:04.734322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 668/1337] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:04 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:04.786676 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ee09fd02-7f3d-40cb-9f01-6321df43bd39 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:04.788783 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ee09fd02-7f3d-40cb-9f01-6321df43bd39 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:04.795267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee09fd02-7f3d-40cb-9f01-6321df43bd39 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:04.795737 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee09fd02-7f3d-40cb-9f01-6321df43bd39 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:04.796165 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee09fd02-7f3d-40cb-9f01-6321df43bd39 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:04.796870 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee09fd02-7f3d-40cb-9f01-6321df43bd39 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:04.797311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee09fd02-7f3d-40cb-9f01-6321df43bd39 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:04.797724 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee09fd02-7f3d-40cb-9f01-6321df43bd39 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:04.826300 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ee09fd02-7f3d-40cb-9f01-6321df43bd39 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044098 Aug 24 12:41:04.826824 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 670/1338] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:04 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:05.332888 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-95288030-1868-4c9a-941b-79d9657c7354 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:05.335082 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-95288030-1868-4c9a-941b-79d9657c7354 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:05.341374 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95288030-1868-4c9a-941b-79d9657c7354 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:05.341856 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95288030-1868-4c9a-941b-79d9657c7354 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:05.342286 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95288030-1868-4c9a-941b-79d9657c7354 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:05.342997 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95288030-1868-4c9a-941b-79d9657c7354 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:05.343453 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95288030-1868-4c9a-941b-79d9657c7354 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:05.343869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95288030-1868-4c9a-941b-79d9657c7354 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:05.373026 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-95288030-1868-4c9a-941b-79d9657c7354 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044172 Aug 24 12:41:05.373606 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 669/1339] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:05 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:05.745967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cd1fa4f7-72a9-40e6-8c73-dddbe4caa5e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:05.748146 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cd1fa4f7-72a9-40e6-8c73-dddbe4caa5e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:05.754476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd1fa4f7-72a9-40e6-8c73-dddbe4caa5e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:05.754987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd1fa4f7-72a9-40e6-8c73-dddbe4caa5e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:05.755422 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd1fa4f7-72a9-40e6-8c73-dddbe4caa5e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:05.756100 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd1fa4f7-72a9-40e6-8c73-dddbe4caa5e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:05.756550 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd1fa4f7-72a9-40e6-8c73-dddbe4caa5e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:05.756969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd1fa4f7-72a9-40e6-8c73-dddbe4caa5e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:05.785036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cd1fa4f7-72a9-40e6-8c73-dddbe4caa5e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042575 Aug 24 12:41:05.785563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 671/1340] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:05 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:05.838454 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2585fd5f-618d-41b0-bf5b-9c54d42f2101 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:05.840626 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2585fd5f-618d-41b0-bf5b-9c54d42f2101 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:05.846432 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2585fd5f-618d-41b0-bf5b-9c54d42f2101 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:05.847435 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2585fd5f-618d-41b0-bf5b-9c54d42f2101 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:05.847883 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2585fd5f-618d-41b0-bf5b-9c54d42f2101 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:05.848558 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2585fd5f-618d-41b0-bf5b-9c54d42f2101 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:05.849008 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2585fd5f-618d-41b0-bf5b-9c54d42f2101 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:05.849427 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2585fd5f-618d-41b0-bf5b-9c54d42f2101 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:05.878473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2585fd5f-618d-41b0-bf5b-9c54d42f2101 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043895 Aug 24 12:41:05.878984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 670/1341] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:05 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:06.385422 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6c9c7d0a-4928-46b3-a817-0a55e4a512a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:06.387576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6c9c7d0a-4928-46b3-a817-0a55e4a512a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:06.393466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c9c7d0a-4928-46b3-a817-0a55e4a512a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:06.394527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c9c7d0a-4928-46b3-a817-0a55e4a512a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:06.394993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c9c7d0a-4928-46b3-a817-0a55e4a512a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:06.395677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c9c7d0a-4928-46b3-a817-0a55e4a512a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:06.396132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c9c7d0a-4928-46b3-a817-0a55e4a512a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:06.396557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c9c7d0a-4928-46b3-a817-0a55e4a512a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:06.425210 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6c9c7d0a-4928-46b3-a817-0a55e4a512a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043728 Aug 24 12:41:06.425767 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 672/1342] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:06 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:06.797240 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-94d832df-ebc6-45a7-a7a6-db3cadb32fb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:06.799408 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-94d832df-ebc6-45a7-a7a6-db3cadb32fb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:06.805826 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94d832df-ebc6-45a7-a7a6-db3cadb32fb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:06.806300 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94d832df-ebc6-45a7-a7a6-db3cadb32fb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:06.806759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94d832df-ebc6-45a7-a7a6-db3cadb32fb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:06.807442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94d832df-ebc6-45a7-a7a6-db3cadb32fb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:06.807889 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94d832df-ebc6-45a7-a7a6-db3cadb32fb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:06.808308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94d832df-ebc6-45a7-a7a6-db3cadb32fb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:06.836230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-94d832df-ebc6-45a7-a7a6-db3cadb32fb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043116 Aug 24 12:41:06.836762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 671/1343] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:06 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:06.890867 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9eb68ae6-d324-4bed-b462-fbf222b51b32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:06.893051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9eb68ae6-d324-4bed-b462-fbf222b51b32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:06.900251 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9eb68ae6-d324-4bed-b462-fbf222b51b32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:06.900727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9eb68ae6-d324-4bed-b462-fbf222b51b32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:06.901164 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9eb68ae6-d324-4bed-b462-fbf222b51b32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:06.901871 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9eb68ae6-d324-4bed-b462-fbf222b51b32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:06.902292 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9eb68ae6-d324-4bed-b462-fbf222b51b32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:06.902733 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9eb68ae6-d324-4bed-b462-fbf222b51b32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:06.931286 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9eb68ae6-d324-4bed-b462-fbf222b51b32 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044423 Aug 24 12:41:06.931748 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 673/1344] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:06 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:07.437410 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-042f6fbb-a7ed-4636-abe9-3b3aaa54b355 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:07.439893 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-042f6fbb-a7ed-4636-abe9-3b3aaa54b355 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:07.445750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-042f6fbb-a7ed-4636-abe9-3b3aaa54b355 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:07.446229 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-042f6fbb-a7ed-4636-abe9-3b3aaa54b355 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:07.446688 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-042f6fbb-a7ed-4636-abe9-3b3aaa54b355 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:07.447371 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-042f6fbb-a7ed-4636-abe9-3b3aaa54b355 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:07.447819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-042f6fbb-a7ed-4636-abe9-3b3aaa54b355 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:07.448237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-042f6fbb-a7ed-4636-abe9-3b3aaa54b355 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:07.476914 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-042f6fbb-a7ed-4636-abe9-3b3aaa54b355 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043505 Aug 24 12:41:07.477444 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 672/1345] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:07 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:07.848411 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-dda78076-84f6-4cb3-ad17-60e98f7af620 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:07.850565 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-dda78076-84f6-4cb3-ad17-60e98f7af620 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:07.856427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dda78076-84f6-4cb3-ad17-60e98f7af620 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:07.856903 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dda78076-84f6-4cb3-ad17-60e98f7af620 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:07.857336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dda78076-84f6-4cb3-ad17-60e98f7af620 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:07.858013 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dda78076-84f6-4cb3-ad17-60e98f7af620 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:07.858462 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dda78076-84f6-4cb3-ad17-60e98f7af620 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:07.858907 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dda78076-84f6-4cb3-ad17-60e98f7af620 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:07.886988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-dda78076-84f6-4cb3-ad17-60e98f7af620 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042505 Aug 24 12:41:07.887513 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 674/1346] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:07 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:07.943864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-58e59c60-8f44-4f7d-9023-aba14a306641 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:07.945984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-58e59c60-8f44-4f7d-9023-aba14a306641 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:07.952234 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58e59c60-8f44-4f7d-9023-aba14a306641 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:07.952708 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58e59c60-8f44-4f7d-9023-aba14a306641 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:07.953141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58e59c60-8f44-4f7d-9023-aba14a306641 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:07.953820 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58e59c60-8f44-4f7d-9023-aba14a306641 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:07.954265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58e59c60-8f44-4f7d-9023-aba14a306641 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:07.954705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58e59c60-8f44-4f7d-9023-aba14a306641 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:07.982743 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-58e59c60-8f44-4f7d-9023-aba14a306641 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043346 Aug 24 12:41:07.983272 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 673/1347] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:07 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:08.488130 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ca81b19d-4750-41d9-a93e-68905cdff3a1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:08.490512 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ca81b19d-4750-41d9-a93e-68905cdff3a1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:08.497856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca81b19d-4750-41d9-a93e-68905cdff3a1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:08.498338 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca81b19d-4750-41d9-a93e-68905cdff3a1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:08.498811 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca81b19d-4750-41d9-a93e-68905cdff3a1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:08.499498 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca81b19d-4750-41d9-a93e-68905cdff3a1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:08.499952 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca81b19d-4750-41d9-a93e-68905cdff3a1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:08.500374 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca81b19d-4750-41d9-a93e-68905cdff3a1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:08.529262 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ca81b19d-4750-41d9-a93e-68905cdff3a1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045062 Aug 24 12:41:08.529809 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 675/1348] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:08 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:08.899604 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7a6f42fc-02cf-4c07-aa3d-118bb9efb9cf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:08.901774 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7a6f42fc-02cf-4c07-aa3d-118bb9efb9cf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:08.907644 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a6f42fc-02cf-4c07-aa3d-118bb9efb9cf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:08.908121 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a6f42fc-02cf-4c07-aa3d-118bb9efb9cf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:08.908556 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a6f42fc-02cf-4c07-aa3d-118bb9efb9cf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:08.909237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a6f42fc-02cf-4c07-aa3d-118bb9efb9cf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:08.909859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a6f42fc-02cf-4c07-aa3d-118bb9efb9cf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:08.910286 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a6f42fc-02cf-4c07-aa3d-118bb9efb9cf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:08.937686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7a6f42fc-02cf-4c07-aa3d-118bb9efb9cf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042015 Aug 24 12:41:08.938233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 674/1349] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:08 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:08.994731 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-20dc34f0-06bb-4c8a-8fef-f55717501cca tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:08.996868 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-20dc34f0-06bb-4c8a-8fef-f55717501cca tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:09.002639 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20dc34f0-06bb-4c8a-8fef-f55717501cca tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:09.003805 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20dc34f0-06bb-4c8a-8fef-f55717501cca tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:09.004236 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20dc34f0-06bb-4c8a-8fef-f55717501cca tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:09.004909 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20dc34f0-06bb-4c8a-8fef-f55717501cca tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:09.005349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20dc34f0-06bb-4c8a-8fef-f55717501cca tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:09.005766 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20dc34f0-06bb-4c8a-8fef-f55717501cca tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:09.033357 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-20dc34f0-06bb-4c8a-8fef-f55717501cca tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042553 Aug 24 12:41:09.033885 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 676/1350] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:08 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:09.541569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3b069b9b-eeee-4ec0-9131-c5136a6acd2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:09.543733 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3b069b9b-eeee-4ec0-9131-c5136a6acd2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:09.550721 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b069b9b-eeee-4ec0-9131-c5136a6acd2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:09.551209 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b069b9b-eeee-4ec0-9131-c5136a6acd2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:09.551646 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b069b9b-eeee-4ec0-9131-c5136a6acd2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:09.552326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b069b9b-eeee-4ec0-9131-c5136a6acd2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:09.552781 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b069b9b-eeee-4ec0-9131-c5136a6acd2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:09.553208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b069b9b-eeee-4ec0-9131-c5136a6acd2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:09.582669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3b069b9b-eeee-4ec0-9131-c5136a6acd2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044922 Aug 24 12:41:09.583309 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 675/1351] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:09 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:09.949313 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e8264ade-bfc4-4e58-bba9-c4acdf51d11d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:09.951446 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e8264ade-bfc4-4e58-bba9-c4acdf51d11d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:09.958467 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e8264ade-bfc4-4e58-bba9-c4acdf51d11d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:09.958974 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e8264ade-bfc4-4e58-bba9-c4acdf51d11d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:09.959404 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e8264ade-bfc4-4e58-bba9-c4acdf51d11d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:09.960084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e8264ade-bfc4-4e58-bba9-c4acdf51d11d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:09.960534 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e8264ade-bfc4-4e58-bba9-c4acdf51d11d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:09.960959 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e8264ade-bfc4-4e58-bba9-c4acdf51d11d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:09.989412 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e8264ade-bfc4-4e58-bba9-c4acdf51d11d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043769 Aug 24 12:41:09.989949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 677/1352] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:09 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:10.045343 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c6d9caa0-4e6c-48e5-ac8c-e99bf4324dcb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:10.047481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c6d9caa0-4e6c-48e5-ac8c-e99bf4324dcb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:10.053298 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6d9caa0-4e6c-48e5-ac8c-e99bf4324dcb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:10.053777 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6d9caa0-4e6c-48e5-ac8c-e99bf4324dcb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:10.054209 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6d9caa0-4e6c-48e5-ac8c-e99bf4324dcb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:10.054909 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6d9caa0-4e6c-48e5-ac8c-e99bf4324dcb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:10.055361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6d9caa0-4e6c-48e5-ac8c-e99bf4324dcb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:10.055784 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6d9caa0-4e6c-48e5-ac8c-e99bf4324dcb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:10.084587 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c6d9caa0-4e6c-48e5-ac8c-e99bf4324dcb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043122 Aug 24 12:41:10.085043 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 676/1353] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:10 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:10.595245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6b838dd2-0f60-4d20-a575-159532299bf2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:10.597400 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6b838dd2-0f60-4d20-a575-159532299bf2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:10.603376 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6b838dd2-0f60-4d20-a575-159532299bf2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:10.603857 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6b838dd2-0f60-4d20-a575-159532299bf2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:10.604294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6b838dd2-0f60-4d20-a575-159532299bf2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:10.604980 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6b838dd2-0f60-4d20-a575-159532299bf2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:10.605431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6b838dd2-0f60-4d20-a575-159532299bf2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:10.605855 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6b838dd2-0f60-4d20-a575-159532299bf2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:10.635589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6b838dd2-0f60-4d20-a575-159532299bf2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044365 Aug 24 12:41:10.636119 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 678/1354] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:10 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:11.001324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-44a34919-588a-46c0-8273-861b2fee646d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:11.003495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-44a34919-588a-46c0-8273-861b2fee646d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:11.009898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-44a34919-588a-46c0-8273-861b2fee646d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:11.010381 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-44a34919-588a-46c0-8273-861b2fee646d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:11.010856 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-44a34919-588a-46c0-8273-861b2fee646d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:11.011540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-44a34919-588a-46c0-8273-861b2fee646d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:11.011993 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-44a34919-588a-46c0-8273-861b2fee646d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:11.012416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-44a34919-588a-46c0-8273-861b2fee646d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:11.041203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-44a34919-588a-46c0-8273-861b2fee646d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043705 Aug 24 12:41:11.041745 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 677/1355] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:10 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:11.096791 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c4cb2175-44c2-4bc9-9a6c-572b0d559d56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:11.099462 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c4cb2175-44c2-4bc9-9a6c-572b0d559d56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:11.105728 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4cb2175-44c2-4bc9-9a6c-572b0d559d56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:11.106200 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4cb2175-44c2-4bc9-9a6c-572b0d559d56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:11.106631 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4cb2175-44c2-4bc9-9a6c-572b0d559d56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:11.107337 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4cb2175-44c2-4bc9-9a6c-572b0d559d56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:11.107786 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4cb2175-44c2-4bc9-9a6c-572b0d559d56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:11.108213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4cb2175-44c2-4bc9-9a6c-572b0d559d56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:11.137121 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c4cb2175-44c2-4bc9-9a6c-572b0d559d56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044398 Aug 24 12:41:11.137660 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 679/1356] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:11 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:11.648067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bd300380-03c7-41ae-bb34-de23d666e829 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:11.650196 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bd300380-03c7-41ae-bb34-de23d666e829 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:11.656050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd300380-03c7-41ae-bb34-de23d666e829 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:11.656529 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd300380-03c7-41ae-bb34-de23d666e829 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:11.656965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd300380-03c7-41ae-bb34-de23d666e829 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:11.657638 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd300380-03c7-41ae-bb34-de23d666e829 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:11.658088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd300380-03c7-41ae-bb34-de23d666e829 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:11.658507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd300380-03c7-41ae-bb34-de23d666e829 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:11.690824 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bd300380-03c7-41ae-bb34-de23d666e829 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043797 Aug 24 12:41:11.690824 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 678/1357] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:11 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:12.052294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-883bd932-b37d-4959-9c90-437eae443316 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:12.054416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-883bd932-b37d-4959-9c90-437eae443316 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:12.060270 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-883bd932-b37d-4959-9c90-437eae443316 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:12.060749 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-883bd932-b37d-4959-9c90-437eae443316 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:12.061181 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-883bd932-b37d-4959-9c90-437eae443316 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:12.061896 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-883bd932-b37d-4959-9c90-437eae443316 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:12.062348 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-883bd932-b37d-4959-9c90-437eae443316 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:12.062793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-883bd932-b37d-4959-9c90-437eae443316 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:12.091250 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-883bd932-b37d-4959-9c90-437eae443316 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042874 Aug 24 12:41:12.091783 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 680/1358] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:12 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:12.149698 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-caa26edb-8de3-486a-8af0-7bdabf611fe9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:12.151874 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-caa26edb-8de3-486a-8af0-7bdabf611fe9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:12.158067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-caa26edb-8de3-486a-8af0-7bdabf611fe9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:12.158545 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-caa26edb-8de3-486a-8af0-7bdabf611fe9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:12.159005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-caa26edb-8de3-486a-8af0-7bdabf611fe9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:12.159678 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-caa26edb-8de3-486a-8af0-7bdabf611fe9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:12.160248 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-caa26edb-8de3-486a-8af0-7bdabf611fe9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:12.161160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-caa26edb-8de3-486a-8af0-7bdabf611fe9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:12.189387 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-caa26edb-8de3-486a-8af0-7bdabf611fe9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043607 Aug 24 12:41:12.190143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 679/1359] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:12 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:12.699463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2f6a2131-c475-48f8-92ed-62f4aff8e5e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:12.701870 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2f6a2131-c475-48f8-92ed-62f4aff8e5e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:12.708670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f6a2131-c475-48f8-92ed-62f4aff8e5e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:12.709173 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f6a2131-c475-48f8-92ed-62f4aff8e5e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:12.709602 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f6a2131-c475-48f8-92ed-62f4aff8e5e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:12.710276 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f6a2131-c475-48f8-92ed-62f4aff8e5e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:12.710748 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f6a2131-c475-48f8-92ed-62f4aff8e5e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:12.711159 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f6a2131-c475-48f8-92ed-62f4aff8e5e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:12.739865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2f6a2131-c475-48f8-92ed-62f4aff8e5e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044674 Aug 24 12:41:12.740400 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 681/1360] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:12 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:13.103802 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-02a6f3be-d5e5-494b-b8d4-f96c1d747b96 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:13.106009 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-02a6f3be-d5e5-494b-b8d4-f96c1d747b96 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:13.112048 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-02a6f3be-d5e5-494b-b8d4-f96c1d747b96 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:13.112529 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-02a6f3be-d5e5-494b-b8d4-f96c1d747b96 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:13.112964 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-02a6f3be-d5e5-494b-b8d4-f96c1d747b96 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:13.114571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-02a6f3be-d5e5-494b-b8d4-f96c1d747b96 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:13.115060 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-02a6f3be-d5e5-494b-b8d4-f96c1d747b96 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:13.115484 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-02a6f3be-d5e5-494b-b8d4-f96c1d747b96 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:13.143428 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-02a6f3be-d5e5-494b-b8d4-f96c1d747b96 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043592 Aug 24 12:41:13.143965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 680/1361] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:13 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:41:13.201923 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ef0d2e38-78c8-46b4-aa94-f4f3a43f502e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:13.204205 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ef0d2e38-78c8-46b4-aa94-f4f3a43f502e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:13.210587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef0d2e38-78c8-46b4-aa94-f4f3a43f502e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:13.211095 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef0d2e38-78c8-46b4-aa94-f4f3a43f502e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:13.211521 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef0d2e38-78c8-46b4-aa94-f4f3a43f502e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:13.212200 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef0d2e38-78c8-46b4-aa94-f4f3a43f502e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:13.212638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef0d2e38-78c8-46b4-aa94-f4f3a43f502e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:13.213054 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef0d2e38-78c8-46b4-aa94-f4f3a43f502e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:13.242505 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ef0d2e38-78c8-46b4-aa94-f4f3a43f502e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044617 Aug 24 12:41:13.243073 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 682/1362] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:13 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:13.752237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a17872c6-be1a-4bd6-a7af-f37f833847f6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:13.754382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a17872c6-be1a-4bd6-a7af-f37f833847f6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:13.760794 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a17872c6-be1a-4bd6-a7af-f37f833847f6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:13.761276 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a17872c6-be1a-4bd6-a7af-f37f833847f6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:13.761716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a17872c6-be1a-4bd6-a7af-f37f833847f6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:13.762405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a17872c6-be1a-4bd6-a7af-f37f833847f6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:13.762921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a17872c6-be1a-4bd6-a7af-f37f833847f6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:13.763351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a17872c6-be1a-4bd6-a7af-f37f833847f6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:13.793214 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a17872c6-be1a-4bd6-a7af-f37f833847f6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044962 Aug 24 12:41:13.793762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 681/1363] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:13 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:14.154984 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-443b8871-762d-452c-8e07-1493e61e84d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:14.157113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-443b8871-762d-452c-8e07-1493e61e84d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:14.163433 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-443b8871-762d-452c-8e07-1493e61e84d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:14.163906 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-443b8871-762d-452c-8e07-1493e61e84d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:14.164334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-443b8871-762d-452c-8e07-1493e61e84d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:14.165015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-443b8871-762d-452c-8e07-1493e61e84d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:14.165463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-443b8871-762d-452c-8e07-1493e61e84d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:14.165888 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-443b8871-762d-452c-8e07-1493e61e84d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:14.194547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-443b8871-762d-452c-8e07-1493e61e84d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043543 Aug 24 12:41:14.195116 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 683/1364] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:14 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:14.255623 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-26255093-89fc-4921-af1c-38914645c978 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:14.257928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-26255093-89fc-4921-af1c-38914645c978 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:14.263764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-26255093-89fc-4921-af1c-38914645c978 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:14.274910 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-26255093-89fc-4921-af1c-38914645c978 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:14.274910 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-26255093-89fc-4921-af1c-38914645c978 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:14.274910 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-26255093-89fc-4921-af1c-38914645c978 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:14.274910 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-26255093-89fc-4921-af1c-38914645c978 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:14.275478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-26255093-89fc-4921-af1c-38914645c978 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:14.294581 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-26255093-89fc-4921-af1c-38914645c978 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043617 Aug 24 12:41:14.295147 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 682/1365] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:14 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:14.805927 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-df30c5f5-a6eb-4f22-a938-e7e02aced103 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:14.808086 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-df30c5f5-a6eb-4f22-a938-e7e02aced103 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:14.813856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-df30c5f5-a6eb-4f22-a938-e7e02aced103 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:14.814327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-df30c5f5-a6eb-4f22-a938-e7e02aced103 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:14.814797 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-df30c5f5-a6eb-4f22-a938-e7e02aced103 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:14.815472 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-df30c5f5-a6eb-4f22-a938-e7e02aced103 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:14.815912 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-df30c5f5-a6eb-4f22-a938-e7e02aced103 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:14.816327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-df30c5f5-a6eb-4f22-a938-e7e02aced103 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:14.845594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-df30c5f5-a6eb-4f22-a938-e7e02aced103 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044273 Aug 24 12:41:14.846135 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 684/1366] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:14 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:15.206841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a630efa7-4800-4118-9ffe-40255cdeea77 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:15.209509 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a630efa7-4800-4118-9ffe-40255cdeea77 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:15.216373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a630efa7-4800-4118-9ffe-40255cdeea77 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:15.216890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a630efa7-4800-4118-9ffe-40255cdeea77 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:15.217289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a630efa7-4800-4118-9ffe-40255cdeea77 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:15.217977 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a630efa7-4800-4118-9ffe-40255cdeea77 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:15.218427 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a630efa7-4800-4118-9ffe-40255cdeea77 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:15.218870 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a630efa7-4800-4118-9ffe-40255cdeea77 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:15.221228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:15.249492 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a630efa7-4800-4118-9ffe-40255cdeea77 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046619 Aug 24 12:41:15.254450 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 683/1367] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:15 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:15.307060 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-82eae077-3bce-490a-9ff1-d853c1c0fea2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:15.309171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-82eae077-3bce-490a-9ff1-d853c1c0fea2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:15.315449 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82eae077-3bce-490a-9ff1-d853c1c0fea2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:15.315927 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82eae077-3bce-490a-9ff1-d853c1c0fea2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:15.316361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82eae077-3bce-490a-9ff1-d853c1c0fea2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:15.317548 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82eae077-3bce-490a-9ff1-d853c1c0fea2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:15.317991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82eae077-3bce-490a-9ff1-d853c1c0fea2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:15.318412 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82eae077-3bce-490a-9ff1-d853c1c0fea2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:15.342422 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:15.346955 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-82eae077-3bce-490a-9ff1-d853c1c0fea2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043897 Aug 24 12:41:15.347496 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 685/1368] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:15 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:15.858244 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d7bffcec-e073-49af-99eb-311cac57f0c4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:15.860437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d7bffcec-e073-49af-99eb-311cac57f0c4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:15.867232 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7bffcec-e073-49af-99eb-311cac57f0c4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:15.867716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7bffcec-e073-49af-99eb-311cac57f0c4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:15.868155 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7bffcec-e073-49af-99eb-311cac57f0c4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:15.868842 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7bffcec-e073-49af-99eb-311cac57f0c4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:15.869299 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7bffcec-e073-49af-99eb-311cac57f0c4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:15.869728 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7bffcec-e073-49af-99eb-311cac57f0c4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:15.898554 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d7bffcec-e073-49af-99eb-311cac57f0c4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044233 Aug 24 12:41:15.906340 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 684/1369] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:15 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:16.264524 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-860d17ef-b9aa-436a-864f-0728504c12f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:16.266702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-860d17ef-b9aa-436a-864f-0728504c12f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:16.273794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-860d17ef-b9aa-436a-864f-0728504c12f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:16.274278 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-860d17ef-b9aa-436a-864f-0728504c12f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:16.274736 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-860d17ef-b9aa-436a-864f-0728504c12f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:16.275432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-860d17ef-b9aa-436a-864f-0728504c12f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:16.275882 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-860d17ef-b9aa-436a-864f-0728504c12f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:16.276304 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-860d17ef-b9aa-436a-864f-0728504c12f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:16.305161 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-860d17ef-b9aa-436a-864f-0728504c12f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044526 Aug 24 12:41:16.309660 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 686/1370] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:16 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:16.361284 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-70e27060-e953-452a-aaaa-7ac54033574b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:16.363505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-70e27060-e953-452a-aaaa-7ac54033574b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:16.370019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70e27060-e953-452a-aaaa-7ac54033574b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:16.370501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70e27060-e953-452a-aaaa-7ac54033574b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:16.370974 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70e27060-e953-452a-aaaa-7ac54033574b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:16.371662 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70e27060-e953-452a-aaaa-7ac54033574b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:16.372118 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70e27060-e953-452a-aaaa-7ac54033574b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:16.372545 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70e27060-e953-452a-aaaa-7ac54033574b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:16.401473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-70e27060-e953-452a-aaaa-7ac54033574b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044112 Aug 24 12:41:16.402008 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 685/1371] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:16 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:16.910734 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-616c5e40-130a-401f-9b43-eb38d48762bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:16.912973 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-616c5e40-130a-401f-9b43-eb38d48762bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:16.918872 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-616c5e40-130a-401f-9b43-eb38d48762bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:16.919355 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-616c5e40-130a-401f-9b43-eb38d48762bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:16.919789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-616c5e40-130a-401f-9b43-eb38d48762bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:16.920467 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-616c5e40-130a-401f-9b43-eb38d48762bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:16.920916 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-616c5e40-130a-401f-9b43-eb38d48762bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:16.921336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-616c5e40-130a-401f-9b43-eb38d48762bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:16.949736 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-616c5e40-130a-401f-9b43-eb38d48762bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043015 Aug 24 12:41:16.950272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 687/1372] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:16 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:17.317424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fc80a350-756f-4438-a8c2-b85126ddf141 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:17.319605 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fc80a350-756f-4438-a8c2-b85126ddf141 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:17.325631 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc80a350-756f-4438-a8c2-b85126ddf141 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:17.326119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc80a350-756f-4438-a8c2-b85126ddf141 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:17.326562 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc80a350-756f-4438-a8c2-b85126ddf141 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:17.327304 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc80a350-756f-4438-a8c2-b85126ddf141 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:17.327748 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc80a350-756f-4438-a8c2-b85126ddf141 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:17.328175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc80a350-756f-4438-a8c2-b85126ddf141 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:17.357971 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fc80a350-756f-4438-a8c2-b85126ddf141 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044515 Aug 24 12:41:17.358851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 686/1373] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:17 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:17.413386 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c4cf486d-d554-4703-a517-942c466c9cfa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:17.415599 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c4cf486d-d554-4703-a517-942c466c9cfa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:17.421882 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4cf486d-d554-4703-a517-942c466c9cfa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:17.422364 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4cf486d-d554-4703-a517-942c466c9cfa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:17.422838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4cf486d-d554-4703-a517-942c466c9cfa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:17.423536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4cf486d-d554-4703-a517-942c466c9cfa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:17.423988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4cf486d-d554-4703-a517-942c466c9cfa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:17.424410 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4cf486d-d554-4703-a517-942c466c9cfa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:17.454112 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c4cf486d-d554-4703-a517-942c466c9cfa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044688 Aug 24 12:41:17.454676 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 688/1374] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:17 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:17.964553 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e432f1dd-c948-459b-b306-1010473f69e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:17.966696 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e432f1dd-c948-459b-b306-1010473f69e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:17.973118 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e432f1dd-c948-459b-b306-1010473f69e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:17.973599 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e432f1dd-c948-459b-b306-1010473f69e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:17.974032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e432f1dd-c948-459b-b306-1010473f69e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:17.974753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e432f1dd-c948-459b-b306-1010473f69e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:17.975205 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e432f1dd-c948-459b-b306-1010473f69e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:17.975629 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e432f1dd-c948-459b-b306-1010473f69e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:18.005428 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e432f1dd-c948-459b-b306-1010473f69e5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044781 Aug 24 12:41:18.005972 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 687/1375] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:17 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:18.377597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ddf4cc1a-8556-4601-a864-5bdc86bbb78d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:18.379760 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ddf4cc1a-8556-4601-a864-5bdc86bbb78d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:18.386976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ddf4cc1a-8556-4601-a864-5bdc86bbb78d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:18.394447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ddf4cc1a-8556-4601-a864-5bdc86bbb78d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:18.394447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ddf4cc1a-8556-4601-a864-5bdc86bbb78d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:18.394447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ddf4cc1a-8556-4601-a864-5bdc86bbb78d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:18.394447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ddf4cc1a-8556-4601-a864-5bdc86bbb78d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:18.394924 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ddf4cc1a-8556-4601-a864-5bdc86bbb78d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:18.418519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ddf4cc1a-8556-4601-a864-5bdc86bbb78d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045026 Aug 24 12:41:18.423035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 689/1376] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:18 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:18.466286 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2a934e0c-726e-4dee-a80b-1076786716d3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:18.468458 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2a934e0c-726e-4dee-a80b-1076786716d3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:18.474860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a934e0c-726e-4dee-a80b-1076786716d3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:18.475338 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a934e0c-726e-4dee-a80b-1076786716d3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:18.475773 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a934e0c-726e-4dee-a80b-1076786716d3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:18.476452 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a934e0c-726e-4dee-a80b-1076786716d3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:18.476904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a934e0c-726e-4dee-a80b-1076786716d3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:18.477325 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a934e0c-726e-4dee-a80b-1076786716d3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:18.506103 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2a934e0c-726e-4dee-a80b-1076786716d3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043747 Aug 24 12:41:18.506628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 688/1377] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:18 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:19.017508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2865cb12-b77f-481e-ad9d-a970d679b813 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:19.020196 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2865cb12-b77f-481e-ad9d-a970d679b813 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:19.026590 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2865cb12-b77f-481e-ad9d-a970d679b813 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:19.027132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2865cb12-b77f-481e-ad9d-a970d679b813 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:19.027575 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2865cb12-b77f-481e-ad9d-a970d679b813 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:19.028268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2865cb12-b77f-481e-ad9d-a970d679b813 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:19.028724 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2865cb12-b77f-481e-ad9d-a970d679b813 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:19.029152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2865cb12-b77f-481e-ad9d-a970d679b813 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:19.058489 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2865cb12-b77f-481e-ad9d-a970d679b813 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044968 Aug 24 12:41:19.059089 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 690/1378] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:19 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:19.431564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a2a563cf-6f5f-45c7-9a33-4f6a14cd37e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:19.434217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a2a563cf-6f5f-45c7-9a33-4f6a14cd37e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:19.440961 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a2a563cf-6f5f-45c7-9a33-4f6a14cd37e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:19.444548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a2a563cf-6f5f-45c7-9a33-4f6a14cd37e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:19.444548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a2a563cf-6f5f-45c7-9a33-4f6a14cd37e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:19.444548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a2a563cf-6f5f-45c7-9a33-4f6a14cd37e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:19.444548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a2a563cf-6f5f-45c7-9a33-4f6a14cd37e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:19.445447 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a2a563cf-6f5f-45c7-9a33-4f6a14cd37e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:19.472970 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a2a563cf-6f5f-45c7-9a33-4f6a14cd37e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045726 Aug 24 12:41:19.477443 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 689/1379] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:19 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:19.517894 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6e28778d-45ea-49ca-ba31-6f517c5cf610 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:19.520071 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6e28778d-45ea-49ca-ba31-6f517c5cf610 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:19.525928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e28778d-45ea-49ca-ba31-6f517c5cf610 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:19.526404 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e28778d-45ea-49ca-ba31-6f517c5cf610 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:19.526880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e28778d-45ea-49ca-ba31-6f517c5cf610 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:19.527562 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e28778d-45ea-49ca-ba31-6f517c5cf610 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:19.528009 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e28778d-45ea-49ca-ba31-6f517c5cf610 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:19.528429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e28778d-45ea-49ca-ba31-6f517c5cf610 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:19.556805 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6e28778d-45ea-49ca-ba31-6f517c5cf610 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042897 Aug 24 12:41:19.557331 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 691/1380] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:19 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:20.071267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-34e532cf-c7be-4b4d-9798-71481b43ea6d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:20.073350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-34e532cf-c7be-4b4d-9798-71481b43ea6d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:20.079192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-34e532cf-c7be-4b4d-9798-71481b43ea6d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:20.079665 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-34e532cf-c7be-4b4d-9798-71481b43ea6d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:20.080264 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-34e532cf-c7be-4b4d-9798-71481b43ea6d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:20.080947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-34e532cf-c7be-4b4d-9798-71481b43ea6d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:20.081401 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-34e532cf-c7be-4b4d-9798-71481b43ea6d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:20.081824 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-34e532cf-c7be-4b4d-9798-71481b43ea6d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:20.110365 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-34e532cf-c7be-4b4d-9798-71481b43ea6d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043078 Aug 24 12:41:20.110939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 690/1381] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:20 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:20.485119 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d99d12da-8d73-4092-a8a8-24682260b0e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:20.487385 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d99d12da-8d73-4092-a8a8-24682260b0e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:20.494060 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d99d12da-8d73-4092-a8a8-24682260b0e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:20.494537 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d99d12da-8d73-4092-a8a8-24682260b0e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:20.495004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d99d12da-8d73-4092-a8a8-24682260b0e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:20.495690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d99d12da-8d73-4092-a8a8-24682260b0e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:20.496134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d99d12da-8d73-4092-a8a8-24682260b0e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:20.496550 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d99d12da-8d73-4092-a8a8-24682260b0e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:20.525020 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d99d12da-8d73-4092-a8a8-24682260b0e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043922 Aug 24 12:41:20.525596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 692/1382] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:20 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:20.569501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-14b8ae9e-d193-4997-a053-86992825c421 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:20.571706 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-14b8ae9e-d193-4997-a053-86992825c421 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:20.577925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14b8ae9e-d193-4997-a053-86992825c421 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:20.578407 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14b8ae9e-d193-4997-a053-86992825c421 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:20.578880 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14b8ae9e-d193-4997-a053-86992825c421 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:20.579564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14b8ae9e-d193-4997-a053-86992825c421 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:20.580018 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14b8ae9e-d193-4997-a053-86992825c421 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:20.580443 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14b8ae9e-d193-4997-a053-86992825c421 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:20.608913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-14b8ae9e-d193-4997-a053-86992825c421 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043959 Aug 24 12:41:20.609458 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 691/1383] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:20 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:21.123468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bc7759ca-9991-475c-81cc-f4ec88c3ec55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:21.125646 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-bc7759ca-9991-475c-81cc-f4ec88c3ec55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:21.132242 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bc7759ca-9991-475c-81cc-f4ec88c3ec55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:21.132720 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bc7759ca-9991-475c-81cc-f4ec88c3ec55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:21.133155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bc7759ca-9991-475c-81cc-f4ec88c3ec55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:21.133835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bc7759ca-9991-475c-81cc-f4ec88c3ec55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:21.134285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bc7759ca-9991-475c-81cc-f4ec88c3ec55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:21.134731 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bc7759ca-9991-475c-81cc-f4ec88c3ec55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:21.164381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bc7759ca-9991-475c-81cc-f4ec88c3ec55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044933 Aug 24 12:41:21.164920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 693/1384] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:21 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:21.537694 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-505f65b5-fd87-4cd8-976b-18cb08f82920 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:21.539907 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-505f65b5-fd87-4cd8-976b-18cb08f82920 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:21.546324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-505f65b5-fd87-4cd8-976b-18cb08f82920 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:21.546324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-505f65b5-fd87-4cd8-976b-18cb08f82920 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:21.546927 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-505f65b5-fd87-4cd8-976b-18cb08f82920 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:21.554182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-505f65b5-fd87-4cd8-976b-18cb08f82920 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:21.554182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-505f65b5-fd87-4cd8-976b-18cb08f82920 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:21.554182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-505f65b5-fd87-4cd8-976b-18cb08f82920 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:21.578503 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-505f65b5-fd87-4cd8-976b-18cb08f82920 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045279 Aug 24 12:41:21.583178 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 692/1385] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:21 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:21.621049 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-79489158-b97f-46b0-a8d3-f4aa754f2660 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:21.623194 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-79489158-b97f-46b0-a8d3-f4aa754f2660 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:21.629495 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-79489158-b97f-46b0-a8d3-f4aa754f2660 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:21.629964 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-79489158-b97f-46b0-a8d3-f4aa754f2660 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:21.630396 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-79489158-b97f-46b0-a8d3-f4aa754f2660 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:21.631108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-79489158-b97f-46b0-a8d3-f4aa754f2660 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:21.631589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-79489158-b97f-46b0-a8d3-f4aa754f2660 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:21.632014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-79489158-b97f-46b0-a8d3-f4aa754f2660 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:21.660023 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-79489158-b97f-46b0-a8d3-f4aa754f2660 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042873 Aug 24 12:41:21.661108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 694/1386] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:21 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:22.176714 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-66f4e5b8-a8dc-42fb-a4d8-ee6a8a39a734 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:22.178860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-66f4e5b8-a8dc-42fb-a4d8-ee6a8a39a734 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:22.184735 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-66f4e5b8-a8dc-42fb-a4d8-ee6a8a39a734 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:22.185217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-66f4e5b8-a8dc-42fb-a4d8-ee6a8a39a734 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:22.185657 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-66f4e5b8-a8dc-42fb-a4d8-ee6a8a39a734 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:22.186341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-66f4e5b8-a8dc-42fb-a4d8-ee6a8a39a734 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:22.186823 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-66f4e5b8-a8dc-42fb-a4d8-ee6a8a39a734 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:22.187250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-66f4e5b8-a8dc-42fb-a4d8-ee6a8a39a734 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:22.216478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-66f4e5b8-a8dc-42fb-a4d8-ee6a8a39a734 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043859 Aug 24 12:41:22.217011 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 693/1387] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:22 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:22.590924 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c308d40e-f262-4533-84a1-f6b4d38c89e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:22.593383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c308d40e-f262-4533-84a1-f6b4d38c89e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:22.600227 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c308d40e-f262-4533-84a1-f6b4d38c89e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:22.600705 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c308d40e-f262-4533-84a1-f6b4d38c89e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:22.601138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c308d40e-f262-4533-84a1-f6b4d38c89e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:22.601821 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c308d40e-f262-4533-84a1-f6b4d38c89e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:22.602267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c308d40e-f262-4533-84a1-f6b4d38c89e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:22.602704 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c308d40e-f262-4533-84a1-f6b4d38c89e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:22.633020 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c308d40e-f262-4533-84a1-f6b4d38c89e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046279 Aug 24 12:41:22.634243 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 695/1388] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:22 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:22.674031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-03f78c93-92f8-4c57-a4e2-58a1516998ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:22.677066 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-03f78c93-92f8-4c57-a4e2-58a1516998ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:22.683267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03f78c93-92f8-4c57-a4e2-58a1516998ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:22.683755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03f78c93-92f8-4c57-a4e2-58a1516998ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:22.684251 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03f78c93-92f8-4c57-a4e2-58a1516998ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:22.684964 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03f78c93-92f8-4c57-a4e2-58a1516998ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:22.685419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03f78c93-92f8-4c57-a4e2-58a1516998ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:22.685843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03f78c93-92f8-4c57-a4e2-58a1516998ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:22.715687 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-03f78c93-92f8-4c57-a4e2-58a1516998ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046301 Aug 24 12:41:22.716237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 694/1389] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:22 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:41:23.229146 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2762340c-a849-4b3b-b6d4-cf2a38e010e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:23.231310 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2762340c-a849-4b3b-b6d4-cf2a38e010e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:23.237218 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2762340c-a849-4b3b-b6d4-cf2a38e010e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:23.237701 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2762340c-a849-4b3b-b6d4-cf2a38e010e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:23.238140 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2762340c-a849-4b3b-b6d4-cf2a38e010e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:23.239223 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2762340c-a849-4b3b-b6d4-cf2a38e010e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:23.239683 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2762340c-a849-4b3b-b6d4-cf2a38e010e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:23.240111 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2762340c-a849-4b3b-b6d4-cf2a38e010e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:23.268013 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2762340c-a849-4b3b-b6d4-cf2a38e010e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042823 Aug 24 12:41:23.268553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 696/1390] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:23 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:23.650563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f999cd2f-fcff-4594-afc2-71ac867573a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:23.652737 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f999cd2f-fcff-4594-afc2-71ac867573a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:23.658701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f999cd2f-fcff-4594-afc2-71ac867573a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:23.659194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f999cd2f-fcff-4594-afc2-71ac867573a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:23.659636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f999cd2f-fcff-4594-afc2-71ac867573a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:23.660837 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f999cd2f-fcff-4594-afc2-71ac867573a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:23.661296 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f999cd2f-fcff-4594-afc2-71ac867573a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:23.661726 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f999cd2f-fcff-4594-afc2-71ac867573a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:23.691247 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f999cd2f-fcff-4594-afc2-71ac867573a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044701 Aug 24 12:41:23.694855 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 695/1391] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:23 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:23.728988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-474e11fd-1aba-4f1f-babd-ecbf653cd74b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:23.731484 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-474e11fd-1aba-4f1f-babd-ecbf653cd74b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:23.740146 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-474e11fd-1aba-4f1f-babd-ecbf653cd74b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:23.740725 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-474e11fd-1aba-4f1f-babd-ecbf653cd74b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:23.741119 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-474e11fd-1aba-4f1f-babd-ecbf653cd74b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:23.741823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-474e11fd-1aba-4f1f-babd-ecbf653cd74b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:23.742455 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-474e11fd-1aba-4f1f-babd-ecbf653cd74b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:23.742916 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-474e11fd-1aba-4f1f-babd-ecbf653cd74b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:23.771908 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-474e11fd-1aba-4f1f-babd-ecbf653cd74b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047191 Aug 24 12:41:23.772460 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 697/1392] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:23 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:24.280864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b8a4cb11-5573-4c8e-a61a-b4c4f640c6c6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:24.283126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b8a4cb11-5573-4c8e-a61a-b4c4f640c6c6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:24.289702 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b8a4cb11-5573-4c8e-a61a-b4c4f640c6c6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:24.290187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b8a4cb11-5573-4c8e-a61a-b4c4f640c6c6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:24.290623 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b8a4cb11-5573-4c8e-a61a-b4c4f640c6c6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:24.291334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b8a4cb11-5573-4c8e-a61a-b4c4f640c6c6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:24.291788 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b8a4cb11-5573-4c8e-a61a-b4c4f640c6c6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:24.292243 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b8a4cb11-5573-4c8e-a61a-b4c4f640c6c6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:24.321499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b8a4cb11-5573-4c8e-a61a-b4c4f640c6c6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044611 Aug 24 12:41:24.322051 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 696/1393] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:24 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:24.703462 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-23251e6b-67db-4971-b7d0-19f54653ae19 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:24.705634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-23251e6b-67db-4971-b7d0-19f54653ae19 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:24.712095 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-23251e6b-67db-4971-b7d0-19f54653ae19 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:24.712566 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-23251e6b-67db-4971-b7d0-19f54653ae19 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:24.712995 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-23251e6b-67db-4971-b7d0-19f54653ae19 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:24.713668 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-23251e6b-67db-4971-b7d0-19f54653ae19 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:24.714111 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-23251e6b-67db-4971-b7d0-19f54653ae19 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:24.714616 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-23251e6b-67db-4971-b7d0-19f54653ae19 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:24.759422 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-23251e6b-67db-4971-b7d0-19f54653ae19 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059926 Aug 24 12:41:24.767406 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 698/1394] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:24 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:24.784303 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d679d27d-e1dd-4d13-84eb-0aeb97336b6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:24.787061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d679d27d-e1dd-4d13-84eb-0aeb97336b6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:24.793372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d679d27d-e1dd-4d13-84eb-0aeb97336b6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:24.793851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d679d27d-e1dd-4d13-84eb-0aeb97336b6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:24.794265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d679d27d-e1dd-4d13-84eb-0aeb97336b6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:24.794985 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d679d27d-e1dd-4d13-84eb-0aeb97336b6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:24.795437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d679d27d-e1dd-4d13-84eb-0aeb97336b6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:24.795853 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d679d27d-e1dd-4d13-84eb-0aeb97336b6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:24.824579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d679d27d-e1dd-4d13-84eb-0aeb97336b6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044211 Aug 24 12:41:24.825123 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 697/1395] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:24 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:25.333563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f61d8ea4-c76c-40ee-98bd-fc09c1d1141e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:25.335731 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f61d8ea4-c76c-40ee-98bd-fc09c1d1141e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:25.341571 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f61d8ea4-c76c-40ee-98bd-fc09c1d1141e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:25.342044 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f61d8ea4-c76c-40ee-98bd-fc09c1d1141e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:25.342478 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f61d8ea4-c76c-40ee-98bd-fc09c1d1141e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:25.343188 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f61d8ea4-c76c-40ee-98bd-fc09c1d1141e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:25.343642 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f61d8ea4-c76c-40ee-98bd-fc09c1d1141e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:25.344059 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f61d8ea4-c76c-40ee-98bd-fc09c1d1141e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:25.373497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f61d8ea4-c76c-40ee-98bd-fc09c1d1141e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043943 Aug 24 12:41:25.374028 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 699/1396] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:25 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:25.771728 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b78e416e-e52e-46a3-8c51-3464ee11ba4f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:25.773883 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b78e416e-e52e-46a3-8c51-3464ee11ba4f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:25.779787 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b78e416e-e52e-46a3-8c51-3464ee11ba4f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:25.780265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b78e416e-e52e-46a3-8c51-3464ee11ba4f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:25.780699 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b78e416e-e52e-46a3-8c51-3464ee11ba4f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:25.781381 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b78e416e-e52e-46a3-8c51-3464ee11ba4f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:25.781836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b78e416e-e52e-46a3-8c51-3464ee11ba4f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:25.782258 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b78e416e-e52e-46a3-8c51-3464ee11ba4f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:25.811049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b78e416e-e52e-46a3-8c51-3464ee11ba4f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043859 Aug 24 12:41:25.811631 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 698/1397] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:25 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:25.837247 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-54568398-db03-40d0-8059-8e0deab06328 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:25.839401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-54568398-db03-40d0-8059-8e0deab06328 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:25.846853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-54568398-db03-40d0-8059-8e0deab06328 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:25.847337 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-54568398-db03-40d0-8059-8e0deab06328 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:25.847771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-54568398-db03-40d0-8059-8e0deab06328 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:25.848463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-54568398-db03-40d0-8059-8e0deab06328 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:25.848909 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-54568398-db03-40d0-8059-8e0deab06328 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:25.849332 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-54568398-db03-40d0-8059-8e0deab06328 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:25.878544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-54568398-db03-40d0-8059-8e0deab06328 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045846 Aug 24 12:41:25.879118 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 700/1398] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:25 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:26.385641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a615819b-6f06-4993-9694-46ec212eff18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:26.387838 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a615819b-6f06-4993-9694-46ec212eff18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:26.393700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a615819b-6f06-4993-9694-46ec212eff18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:26.394172 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a615819b-6f06-4993-9694-46ec212eff18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:26.394604 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a615819b-6f06-4993-9694-46ec212eff18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:26.395804 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a615819b-6f06-4993-9694-46ec212eff18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:26.396253 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a615819b-6f06-4993-9694-46ec212eff18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:26.396675 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a615819b-6f06-4993-9694-46ec212eff18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:26.421174 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:26.425835 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a615819b-6f06-4993-9694-46ec212eff18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044225 Aug 24 12:41:26.426393 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 699/1399] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:26 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:26.823279 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9500a315-cbf7-43b9-ac9d-911e79a57550 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:26.825415 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9500a315-cbf7-43b9-ac9d-911e79a57550 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:26.831366 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9500a315-cbf7-43b9-ac9d-911e79a57550 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:26.831840 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9500a315-cbf7-43b9-ac9d-911e79a57550 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:26.832267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9500a315-cbf7-43b9-ac9d-911e79a57550 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:26.832942 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9500a315-cbf7-43b9-ac9d-911e79a57550 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:26.833386 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9500a315-cbf7-43b9-ac9d-911e79a57550 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:26.833802 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9500a315-cbf7-43b9-ac9d-911e79a57550 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:26.862844 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9500a315-cbf7-43b9-ac9d-911e79a57550 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043425 Aug 24 12:41:26.863406 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 701/1400] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:26 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:26.891447 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-019746e0-8b42-4dda-8f59-35812a517185 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:26.893464 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-019746e0-8b42-4dda-8f59-35812a517185 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:26.901157 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-019746e0-8b42-4dda-8f59-35812a517185 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:26.901643 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-019746e0-8b42-4dda-8f59-35812a517185 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:26.902074 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-019746e0-8b42-4dda-8f59-35812a517185 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:26.902784 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-019746e0-8b42-4dda-8f59-35812a517185 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:26.903234 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-019746e0-8b42-4dda-8f59-35812a517185 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:26.903651 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-019746e0-8b42-4dda-8f59-35812a517185 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:26.932952 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-019746e0-8b42-4dda-8f59-35812a517185 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045638 Aug 24 12:41:26.933484 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 700/1401] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:26 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:27.446895 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-493b5851-dd39-4e26-aa20-0fa1a78fec76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:27.449012 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-493b5851-dd39-4e26-aa20-0fa1a78fec76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:27.454934 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-493b5851-dd39-4e26-aa20-0fa1a78fec76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:27.455414 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-493b5851-dd39-4e26-aa20-0fa1a78fec76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:27.455850 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-493b5851-dd39-4e26-aa20-0fa1a78fec76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:27.456533 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-493b5851-dd39-4e26-aa20-0fa1a78fec76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:27.456982 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-493b5851-dd39-4e26-aa20-0fa1a78fec76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:27.457407 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-493b5851-dd39-4e26-aa20-0fa1a78fec76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:27.474419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:27.486554 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-493b5851-dd39-4e26-aa20-0fa1a78fec76 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044190 Aug 24 12:41:27.487122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 702/1402] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:27 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:27.875923 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2b1ded78-0650-47d8-b976-77be332dc52c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:27.878112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2b1ded78-0650-47d8-b976-77be332dc52c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:27.884569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2b1ded78-0650-47d8-b976-77be332dc52c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:27.885046 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2b1ded78-0650-47d8-b976-77be332dc52c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:27.885483 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2b1ded78-0650-47d8-b976-77be332dc52c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:27.886166 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2b1ded78-0650-47d8-b976-77be332dc52c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:27.886623 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2b1ded78-0650-47d8-b976-77be332dc52c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:27.887076 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2b1ded78-0650-47d8-b976-77be332dc52c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:27.914856 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2b1ded78-0650-47d8-b976-77be332dc52c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042841 Aug 24 12:41:27.915402 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 701/1403] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:27 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:27.944761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-58b21c31-b0f4-4611-890a-a578bb2bb7d6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:27.946911 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-58b21c31-b0f4-4611-890a-a578bb2bb7d6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:27.954057 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-58b21c31-b0f4-4611-890a-a578bb2bb7d6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:27.954555 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-58b21c31-b0f4-4611-890a-a578bb2bb7d6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:27.955395 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-58b21c31-b0f4-4611-890a-a578bb2bb7d6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:27.956102 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-58b21c31-b0f4-4611-890a-a578bb2bb7d6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:27.956558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-58b21c31-b0f4-4611-890a-a578bb2bb7d6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:27.956983 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-58b21c31-b0f4-4611-890a-a578bb2bb7d6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:27.986036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-58b21c31-b0f4-4611-890a-a578bb2bb7d6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045662 Aug 24 12:41:27.986577 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 703/1404] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:27 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:28.499148 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ded0962f-cee6-488e-806e-42bb21e13734 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:28.501293 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ded0962f-cee6-488e-806e-42bb21e13734 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:28.507270 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ded0962f-cee6-488e-806e-42bb21e13734 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:28.507801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ded0962f-cee6-488e-806e-42bb21e13734 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:28.508236 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ded0962f-cee6-488e-806e-42bb21e13734 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:28.508922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ded0962f-cee6-488e-806e-42bb21e13734 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:28.509385 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ded0962f-cee6-488e-806e-42bb21e13734 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:28.509810 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ded0962f-cee6-488e-806e-42bb21e13734 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:28.539340 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ded0962f-cee6-488e-806e-42bb21e13734 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044270 Aug 24 12:41:28.539887 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 702/1405] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:28 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:28.927144 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-20f2f758-411c-43f8-9f26-56a32a62ec5e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:28.929289 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-20f2f758-411c-43f8-9f26-56a32a62ec5e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:28.935469 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20f2f758-411c-43f8-9f26-56a32a62ec5e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:28.935941 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20f2f758-411c-43f8-9f26-56a32a62ec5e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:28.936369 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20f2f758-411c-43f8-9f26-56a32a62ec5e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:28.937047 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20f2f758-411c-43f8-9f26-56a32a62ec5e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:28.937485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20f2f758-411c-43f8-9f26-56a32a62ec5e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:28.937902 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20f2f758-411c-43f8-9f26-56a32a62ec5e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:28.967568 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-20f2f758-411c-43f8-9f26-56a32a62ec5e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044374 Aug 24 12:41:28.968179 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 704/1406] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:28 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:28.998951 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ea746357-e726-4d21-acdc-d6fdf6c30dca tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:29.001121 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ea746357-e726-4d21-acdc-d6fdf6c30dca tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:29.007925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea746357-e726-4d21-acdc-d6fdf6c30dca tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:29.008427 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea746357-e726-4d21-acdc-d6fdf6c30dca tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:29.008859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea746357-e726-4d21-acdc-d6fdf6c30dca tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:29.009546 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea746357-e726-4d21-acdc-d6fdf6c30dca tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:29.009995 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea746357-e726-4d21-acdc-d6fdf6c30dca tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:29.010449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea746357-e726-4d21-acdc-d6fdf6c30dca tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:29.042407 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ea746357-e726-4d21-acdc-d6fdf6c30dca tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047530 Aug 24 12:41:29.042984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 703/1407] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:28 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:29.552057 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6d65d79b-2ac0-410d-80c9-37cf6da72df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:29.554222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6d65d79b-2ac0-410d-80c9-37cf6da72df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:29.556116 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=86 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:29.560797 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d65d79b-2ac0-410d-80c9-37cf6da72df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:29.561278 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d65d79b-2ac0-410d-80c9-37cf6da72df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:29.565794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d65d79b-2ac0-410d-80c9-37cf6da72df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:29.565794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d65d79b-2ac0-410d-80c9-37cf6da72df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:29.565794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d65d79b-2ac0-410d-80c9-37cf6da72df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:29.565794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d65d79b-2ac0-410d-80c9-37cf6da72df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:29.591677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6d65d79b-2ac0-410d-80c9-37cf6da72df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044206 Aug 24 12:41:29.592210 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 705/1408] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:29 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:29.979879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2e3848f6-2d5c-4904-862c-bf4c1682ea58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:29.982038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2e3848f6-2d5c-4904-862c-bf4c1682ea58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:29.983897 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=86 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:29.988576 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2e3848f6-2d5c-4904-862c-bf4c1682ea58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:29.989570 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2e3848f6-2d5c-4904-862c-bf4c1682ea58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:29.990002 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2e3848f6-2d5c-4904-862c-bf4c1682ea58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:29.990703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2e3848f6-2d5c-4904-862c-bf4c1682ea58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:29.991162 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2e3848f6-2d5c-4904-862c-bf4c1682ea58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:29.991584 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2e3848f6-2d5c-4904-862c-bf4c1682ea58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:30.020449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2e3848f6-2d5c-4904-862c-bf4c1682ea58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044608 Aug 24 12:41:30.021011 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 704/1409] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:29 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:30.055309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8e0b6c1a-e88e-4d79-afcc-b4850780c2bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:30.057486 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8e0b6c1a-e88e-4d79-afcc-b4850780c2bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:30.063661 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8e0b6c1a-e88e-4d79-afcc-b4850780c2bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:30.064139 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8e0b6c1a-e88e-4d79-afcc-b4850780c2bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:30.064567 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8e0b6c1a-e88e-4d79-afcc-b4850780c2bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:30.065248 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8e0b6c1a-e88e-4d79-afcc-b4850780c2bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:30.065690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8e0b6c1a-e88e-4d79-afcc-b4850780c2bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:30.066109 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8e0b6c1a-e88e-4d79-afcc-b4850780c2bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:30.095496 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8e0b6c1a-e88e-4d79-afcc-b4850780c2bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044614 Aug 24 12:41:30.096028 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 706/1410] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:30 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:30.604735 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5a93c5e7-610a-41f6-95c4-fdae6858810f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:30.606899 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5a93c5e7-610a-41f6-95c4-fdae6858810f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:30.612874 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5a93c5e7-610a-41f6-95c4-fdae6858810f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:30.613359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5a93c5e7-610a-41f6-95c4-fdae6858810f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:30.614408 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5a93c5e7-610a-41f6-95c4-fdae6858810f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:30.615130 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5a93c5e7-610a-41f6-95c4-fdae6858810f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:30.615596 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5a93c5e7-610a-41f6-95c4-fdae6858810f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:30.616027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5a93c5e7-610a-41f6-95c4-fdae6858810f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:30.644161 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5a93c5e7-610a-41f6-95c4-fdae6858810f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043771 Aug 24 12:41:30.644695 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 705/1411] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:30 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:31.031901 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4c432d18-96df-4c1d-8c8a-0eca568d1249 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:31.034016 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4c432d18-96df-4c1d-8c8a-0eca568d1249 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:31.040018 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4c432d18-96df-4c1d-8c8a-0eca568d1249 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:31.040488 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4c432d18-96df-4c1d-8c8a-0eca568d1249 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:31.040919 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4c432d18-96df-4c1d-8c8a-0eca568d1249 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:31.041609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4c432d18-96df-4c1d-8c8a-0eca568d1249 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:31.042033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4c432d18-96df-4c1d-8c8a-0eca568d1249 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:31.042448 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4c432d18-96df-4c1d-8c8a-0eca568d1249 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:31.070869 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4c432d18-96df-4c1d-8c8a-0eca568d1249 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042952 Aug 24 12:41:31.071467 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 707/1412] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:31 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:31.107700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-981b1535-0284-4604-9683-50a0b761b703 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:31.109869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-981b1535-0284-4604-9683-50a0b761b703 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:31.116433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-981b1535-0284-4604-9683-50a0b761b703 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:31.116992 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-981b1535-0284-4604-9683-50a0b761b703 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:31.117438 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-981b1535-0284-4604-9683-50a0b761b703 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:31.118135 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-981b1535-0284-4604-9683-50a0b761b703 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:31.118593 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-981b1535-0284-4604-9683-50a0b761b703 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:31.119044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-981b1535-0284-4604-9683-50a0b761b703 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:31.152043 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-981b1535-0284-4604-9683-50a0b761b703 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048415 Aug 24 12:41:31.152593 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 706/1413] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:31 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:31.656756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-70e1be99-9bde-4dfb-8b6f-0280b45df8d9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:31.658910 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-70e1be99-9bde-4dfb-8b6f-0280b45df8d9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:31.665332 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70e1be99-9bde-4dfb-8b6f-0280b45df8d9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:31.665809 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70e1be99-9bde-4dfb-8b6f-0280b45df8d9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:31.666241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70e1be99-9bde-4dfb-8b6f-0280b45df8d9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:31.666951 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70e1be99-9bde-4dfb-8b6f-0280b45df8d9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:31.667398 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70e1be99-9bde-4dfb-8b6f-0280b45df8d9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:31.667817 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70e1be99-9bde-4dfb-8b6f-0280b45df8d9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:31.695949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-70e1be99-9bde-4dfb-8b6f-0280b45df8d9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043081 Aug 24 12:41:31.696414 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 708/1414] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:31 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:32.083648 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ab75eec7-3b23-4159-b576-cbf4b3393bfd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:32.085784 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ab75eec7-3b23-4159-b576-cbf4b3393bfd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:32.091688 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab75eec7-3b23-4159-b576-cbf4b3393bfd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:32.092170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab75eec7-3b23-4159-b576-cbf4b3393bfd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:32.092605 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab75eec7-3b23-4159-b576-cbf4b3393bfd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:32.093288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab75eec7-3b23-4159-b576-cbf4b3393bfd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:32.093743 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab75eec7-3b23-4159-b576-cbf4b3393bfd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:32.094167 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab75eec7-3b23-4159-b576-cbf4b3393bfd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:32.122958 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ab75eec7-3b23-4159-b576-cbf4b3393bfd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043913 Aug 24 12:41:32.123563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 707/1415] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:32 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:32.164134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9f0682e0-a660-4064-9cb3-ac2969a979b8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:32.166288 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9f0682e0-a660-4064-9cb3-ac2969a979b8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:32.172562 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f0682e0-a660-4064-9cb3-ac2969a979b8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:32.173042 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f0682e0-a660-4064-9cb3-ac2969a979b8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:32.173479 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f0682e0-a660-4064-9cb3-ac2969a979b8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:32.174164 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f0682e0-a660-4064-9cb3-ac2969a979b8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:32.174614 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f0682e0-a660-4064-9cb3-ac2969a979b8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:32.175289 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f0682e0-a660-4064-9cb3-ac2969a979b8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:32.205519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9f0682e0-a660-4064-9cb3-ac2969a979b8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045311 Aug 24 12:41:32.206132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 709/1416] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:32 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:32.708962 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9955c26f-7075-437e-824e-102a9f5f2b36 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:32.711074 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9955c26f-7075-437e-824e-102a9f5f2b36 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:32.716953 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9955c26f-7075-437e-824e-102a9f5f2b36 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:32.717431 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9955c26f-7075-437e-824e-102a9f5f2b36 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:32.717857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9955c26f-7075-437e-824e-102a9f5f2b36 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:32.718537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9955c26f-7075-437e-824e-102a9f5f2b36 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:32.719015 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9955c26f-7075-437e-824e-102a9f5f2b36 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:32.724608 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9955c26f-7075-437e-824e-102a9f5f2b36 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:32.748438 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9955c26f-7075-437e-824e-102a9f5f2b36 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044207 Aug 24 12:41:32.753312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 708/1417] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:32 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:33.136377 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-57a304f1-0b67-4549-aa23-0c7e8d0e995b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:33.138484 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-57a304f1-0b67-4549-aa23-0c7e8d0e995b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:33.144309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-57a304f1-0b67-4549-aa23-0c7e8d0e995b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:33.144777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-57a304f1-0b67-4549-aa23-0c7e8d0e995b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:33.145204 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-57a304f1-0b67-4549-aa23-0c7e8d0e995b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:33.145873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-57a304f1-0b67-4549-aa23-0c7e8d0e995b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:33.146317 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-57a304f1-0b67-4549-aa23-0c7e8d0e995b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:33.146762 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-57a304f1-0b67-4549-aa23-0c7e8d0e995b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:33.174771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-57a304f1-0b67-4549-aa23-0c7e8d0e995b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042295 Aug 24 12:41:33.175393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 710/1418] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:33 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:33.217209 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f7c502e3-d238-432a-a15e-8f7793d7a832 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:33.219479 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f7c502e3-d238-432a-a15e-8f7793d7a832 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:33.225998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7c502e3-d238-432a-a15e-8f7793d7a832 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:33.226481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7c502e3-d238-432a-a15e-8f7793d7a832 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:33.226946 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7c502e3-d238-432a-a15e-8f7793d7a832 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:33.227637 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7c502e3-d238-432a-a15e-8f7793d7a832 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:33.228088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7c502e3-d238-432a-a15e-8f7793d7a832 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:33.228511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7c502e3-d238-432a-a15e-8f7793d7a832 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:33.258445 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f7c502e3-d238-432a-a15e-8f7793d7a832 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045150 Aug 24 12:41:33.259182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 709/1419] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:33 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:33.760741 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-de1f9a88-5f23-4381-b5ee-9e3a5596cd5c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:33.762891 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-de1f9a88-5f23-4381-b5ee-9e3a5596cd5c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:33.768772 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de1f9a88-5f23-4381-b5ee-9e3a5596cd5c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:33.769249 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de1f9a88-5f23-4381-b5ee-9e3a5596cd5c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:33.769691 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de1f9a88-5f23-4381-b5ee-9e3a5596cd5c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:33.770895 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de1f9a88-5f23-4381-b5ee-9e3a5596cd5c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:33.771347 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de1f9a88-5f23-4381-b5ee-9e3a5596cd5c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:33.771770 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de1f9a88-5f23-4381-b5ee-9e3a5596cd5c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:33.800424 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-de1f9a88-5f23-4381-b5ee-9e3a5596cd5c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043665 Aug 24 12:41:33.800958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 711/1420] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:33 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:34.187443 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fef30676-f249-4717-9dd3-c0a349c190d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:34.189494 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fef30676-f249-4717-9dd3-c0a349c190d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:34.196070 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fef30676-f249-4717-9dd3-c0a349c190d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:34.196542 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fef30676-f249-4717-9dd3-c0a349c190d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:34.196969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fef30676-f249-4717-9dd3-c0a349c190d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:34.197642 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fef30676-f249-4717-9dd3-c0a349c190d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:34.198090 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fef30676-f249-4717-9dd3-c0a349c190d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:34.198537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fef30676-f249-4717-9dd3-c0a349c190d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:34.226769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fef30676-f249-4717-9dd3-c0a349c190d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043272 Aug 24 12:41:34.227408 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 710/1421] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:34 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:34.271929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-146f1b02-d40b-485c-90b3-a6c55f8c8f0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:34.273592 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-146f1b02-d40b-485c-90b3-a6c55f8c8f0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:34.281034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-146f1b02-d40b-485c-90b3-a6c55f8c8f0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:34.281612 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-146f1b02-d40b-485c-90b3-a6c55f8c8f0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:34.281969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-146f1b02-d40b-485c-90b3-a6c55f8c8f0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:34.282688 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-146f1b02-d40b-485c-90b3-a6c55f8c8f0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:34.283151 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-146f1b02-d40b-485c-90b3-a6c55f8c8f0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:34.283578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-146f1b02-d40b-485c-90b3-a6c55f8c8f0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:34.322156 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-146f1b02-d40b-485c-90b3-a6c55f8c8f0d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055493 Aug 24 12:41:34.323348 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 712/1422] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:34 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:34.812467 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fa1bd33c-f3f1-428a-8c49-a5f846e6cd3d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:34.814621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fa1bd33c-f3f1-428a-8c49-a5f846e6cd3d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:34.820622 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa1bd33c-f3f1-428a-8c49-a5f846e6cd3d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:34.821101 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa1bd33c-f3f1-428a-8c49-a5f846e6cd3d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:34.821538 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa1bd33c-f3f1-428a-8c49-a5f846e6cd3d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:34.822225 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa1bd33c-f3f1-428a-8c49-a5f846e6cd3d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:34.822707 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa1bd33c-f3f1-428a-8c49-a5f846e6cd3d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:34.823136 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa1bd33c-f3f1-428a-8c49-a5f846e6cd3d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:34.851937 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fa1bd33c-f3f1-428a-8c49-a5f846e6cd3d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043417 Aug 24 12:41:34.852480 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 711/1423] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:34 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:35.239385 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-79754220-c3dc-4e46-a15f-df501559e2bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:35.241494 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-79754220-c3dc-4e46-a15f-df501559e2bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:35.247346 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-79754220-c3dc-4e46-a15f-df501559e2bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:35.247817 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-79754220-c3dc-4e46-a15f-df501559e2bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:35.248283 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-79754220-c3dc-4e46-a15f-df501559e2bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:35.248960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-79754220-c3dc-4e46-a15f-df501559e2bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:35.249400 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-79754220-c3dc-4e46-a15f-df501559e2bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:35.249836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-79754220-c3dc-4e46-a15f-df501559e2bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:35.277869 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-79754220-c3dc-4e46-a15f-df501559e2bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042826 Aug 24 12:41:35.278450 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 713/1424] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:35 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:35.334049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7469fd55-f9f4-4d70-8d42-23e92d1d4431 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:35.336252 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7469fd55-f9f4-4d70-8d42-23e92d1d4431 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:35.342773 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7469fd55-f9f4-4d70-8d42-23e92d1d4431 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:35.343140 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7469fd55-f9f4-4d70-8d42-23e92d1d4431 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:35.343579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7469fd55-f9f4-4d70-8d42-23e92d1d4431 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:35.344267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7469fd55-f9f4-4d70-8d42-23e92d1d4431 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:35.344723 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7469fd55-f9f4-4d70-8d42-23e92d1d4431 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:35.345145 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7469fd55-f9f4-4d70-8d42-23e92d1d4431 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:35.381029 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7469fd55-f9f4-4d70-8d42-23e92d1d4431 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051517 Aug 24 12:41:35.381572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 712/1425] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:35 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:35.864744 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8b1b0b82-85ed-4ab4-b4b6-8b50a6b8eff5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:35.866905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8b1b0b82-85ed-4ab4-b4b6-8b50a6b8eff5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:35.873205 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b1b0b82-85ed-4ab4-b4b6-8b50a6b8eff5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:35.873679 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b1b0b82-85ed-4ab4-b4b6-8b50a6b8eff5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:35.874110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b1b0b82-85ed-4ab4-b4b6-8b50a6b8eff5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:35.874811 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b1b0b82-85ed-4ab4-b4b6-8b50a6b8eff5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:35.875258 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b1b0b82-85ed-4ab4-b4b6-8b50a6b8eff5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:35.875677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b1b0b82-85ed-4ab4-b4b6-8b50a6b8eff5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:35.905697 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8b1b0b82-85ed-4ab4-b4b6-8b50a6b8eff5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045634 Aug 24 12:41:35.906228 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 714/1426] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:35 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:36.290503 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b85ac1d0-ab44-4d0c-9d38-8a43b6310d49 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:36.292659 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b85ac1d0-ab44-4d0c-9d38-8a43b6310d49 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:36.298549 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b85ac1d0-ab44-4d0c-9d38-8a43b6310d49 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:36.299058 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b85ac1d0-ab44-4d0c-9d38-8a43b6310d49 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:36.299499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b85ac1d0-ab44-4d0c-9d38-8a43b6310d49 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:36.300184 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b85ac1d0-ab44-4d0c-9d38-8a43b6310d49 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:36.300639 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b85ac1d0-ab44-4d0c-9d38-8a43b6310d49 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:36.301066 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b85ac1d0-ab44-4d0c-9d38-8a43b6310d49 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:36.329700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b85ac1d0-ab44-4d0c-9d38-8a43b6310d49 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043564 Aug 24 12:41:36.330240 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 713/1427] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:36 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:36.393266 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-60283dba-8d1f-44b9-9fcf-5c59ff3d33a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:36.395430 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-60283dba-8d1f-44b9-9fcf-5c59ff3d33a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:36.401187 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-60283dba-8d1f-44b9-9fcf-5c59ff3d33a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:36.401663 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-60283dba-8d1f-44b9-9fcf-5c59ff3d33a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:36.402098 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-60283dba-8d1f-44b9-9fcf-5c59ff3d33a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:36.402827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-60283dba-8d1f-44b9-9fcf-5c59ff3d33a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:36.403260 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-60283dba-8d1f-44b9-9fcf-5c59ff3d33a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:36.403685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-60283dba-8d1f-44b9-9fcf-5c59ff3d33a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:36.434233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-60283dba-8d1f-44b9-9fcf-5c59ff3d33a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045001 Aug 24 12:41:36.434847 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 715/1428] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:36 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:36.918095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-40031bba-7aa9-4b89-bd1f-b1fa6fbab7f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:36.920282 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-40031bba-7aa9-4b89-bd1f-b1fa6fbab7f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:36.926331 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40031bba-7aa9-4b89-bd1f-b1fa6fbab7f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:36.926851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40031bba-7aa9-4b89-bd1f-b1fa6fbab7f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:36.927340 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40031bba-7aa9-4b89-bd1f-b1fa6fbab7f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:36.928030 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40031bba-7aa9-4b89-bd1f-b1fa6fbab7f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:36.928483 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40031bba-7aa9-4b89-bd1f-b1fa6fbab7f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:36.928907 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40031bba-7aa9-4b89-bd1f-b1fa6fbab7f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:36.956901 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-40031bba-7aa9-4b89-bd1f-b1fa6fbab7f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042839 Aug 24 12:41:36.957442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 714/1429] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:36 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:37.341463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-250dbdab-3893-4a57-a96d-21da00f49ad0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:37.343649 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-250dbdab-3893-4a57-a96d-21da00f49ad0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:37.349989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-250dbdab-3893-4a57-a96d-21da00f49ad0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:37.350467 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-250dbdab-3893-4a57-a96d-21da00f49ad0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:37.350940 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-250dbdab-3893-4a57-a96d-21da00f49ad0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:37.351750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-250dbdab-3893-4a57-a96d-21da00f49ad0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:37.352193 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-250dbdab-3893-4a57-a96d-21da00f49ad0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:37.352614 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-250dbdab-3893-4a57-a96d-21da00f49ad0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:37.381898 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-250dbdab-3893-4a57-a96d-21da00f49ad0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044304 Aug 24 12:41:37.382446 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 716/1430] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:37 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:37.446813 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-89a8ccfc-fe62-4cc0-b521-8205dcc71bad tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:37.448957 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-89a8ccfc-fe62-4cc0-b521-8205dcc71bad tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:37.454792 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-89a8ccfc-fe62-4cc0-b521-8205dcc71bad tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:37.455279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-89a8ccfc-fe62-4cc0-b521-8205dcc71bad tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:37.455709 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-89a8ccfc-fe62-4cc0-b521-8205dcc71bad tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:37.456393 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-89a8ccfc-fe62-4cc0-b521-8205dcc71bad tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:37.456844 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-89a8ccfc-fe62-4cc0-b521-8205dcc71bad tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:37.457263 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-89a8ccfc-fe62-4cc0-b521-8205dcc71bad tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:37.486703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-89a8ccfc-fe62-4cc0-b521-8205dcc71bad tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044448 Aug 24 12:41:37.487235 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 715/1431] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:37 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:37.968727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8f87c2db-c367-4d0b-8793-8c5b6db9d35f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:37.970882 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8f87c2db-c367-4d0b-8793-8c5b6db9d35f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:37.977331 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f87c2db-c367-4d0b-8793-8c5b6db9d35f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:37.977817 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f87c2db-c367-4d0b-8793-8c5b6db9d35f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:37.978241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f87c2db-c367-4d0b-8793-8c5b6db9d35f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:37.978947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f87c2db-c367-4d0b-8793-8c5b6db9d35f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:37.979420 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f87c2db-c367-4d0b-8793-8c5b6db9d35f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:37.979841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f87c2db-c367-4d0b-8793-8c5b6db9d35f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:38.008476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8f87c2db-c367-4d0b-8793-8c5b6db9d35f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043740 Aug 24 12:41:38.009002 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 717/1432] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:37 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:38.393414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-41e88f8a-d102-485c-8718-56d7cfc26ac1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:38.396047 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-41e88f8a-d102-485c-8718-56d7cfc26ac1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:38.402321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-41e88f8a-d102-485c-8718-56d7cfc26ac1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:38.402900 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-41e88f8a-d102-485c-8718-56d7cfc26ac1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:38.403336 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-41e88f8a-d102-485c-8718-56d7cfc26ac1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:38.404013 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-41e88f8a-d102-485c-8718-56d7cfc26ac1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:38.404464 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-41e88f8a-d102-485c-8718-56d7cfc26ac1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:38.404882 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-41e88f8a-d102-485c-8718-56d7cfc26ac1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:38.419350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:38.434541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-41e88f8a-d102-485c-8718-56d7cfc26ac1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045082 Aug 24 12:41:38.435111 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 716/1433] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:38 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:38.498969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-afb04a6e-8043-448f-adc5-c3486a954601 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:38.501123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-afb04a6e-8043-448f-adc5-c3486a954601 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:38.508051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-afb04a6e-8043-448f-adc5-c3486a954601 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:38.508523 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-afb04a6e-8043-448f-adc5-c3486a954601 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:38.508960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-afb04a6e-8043-448f-adc5-c3486a954601 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:38.509904 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-afb04a6e-8043-448f-adc5-c3486a954601 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:38.510086 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-afb04a6e-8043-448f-adc5-c3486a954601 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:38.510508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-afb04a6e-8043-448f-adc5-c3486a954601 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:38.539948 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-afb04a6e-8043-448f-adc5-c3486a954601 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044953 Aug 24 12:41:38.540503 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 718/1434] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:38 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:39.020936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e26fbc1e-24e8-4235-8391-857be2ac24be tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:39.023110 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e26fbc1e-24e8-4235-8391-857be2ac24be tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:39.029154 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e26fbc1e-24e8-4235-8391-857be2ac24be tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:39.029632 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e26fbc1e-24e8-4235-8391-857be2ac24be tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:39.030065 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e26fbc1e-24e8-4235-8391-857be2ac24be tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:39.030777 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e26fbc1e-24e8-4235-8391-857be2ac24be tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:39.031228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e26fbc1e-24e8-4235-8391-857be2ac24be tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:39.031648 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e26fbc1e-24e8-4235-8391-857be2ac24be tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:39.060065 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e26fbc1e-24e8-4235-8391-857be2ac24be tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043485 Aug 24 12:41:39.060597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 717/1435] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:39 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:39.452519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c15f2887-f94a-4556-87c7-70f9f656779f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:39.454702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c15f2887-f94a-4556-87c7-70f9f656779f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:39.460576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c15f2887-f94a-4556-87c7-70f9f656779f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:39.461044 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c15f2887-f94a-4556-87c7-70f9f656779f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:39.461471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c15f2887-f94a-4556-87c7-70f9f656779f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:39.462141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c15f2887-f94a-4556-87c7-70f9f656779f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:39.462580 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c15f2887-f94a-4556-87c7-70f9f656779f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:39.463021 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c15f2887-f94a-4556-87c7-70f9f656779f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:39.466463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:39.492990 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c15f2887-f94a-4556-87c7-70f9f656779f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044555 Aug 24 12:41:39.493525 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 719/1436] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:39 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:39.551966 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-09fd71fe-7b9e-41e0-94bd-8293ef813efd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:39.555033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-09fd71fe-7b9e-41e0-94bd-8293ef813efd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:39.561304 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09fd71fe-7b9e-41e0-94bd-8293ef813efd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:39.561787 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09fd71fe-7b9e-41e0-94bd-8293ef813efd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:39.562250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09fd71fe-7b9e-41e0-94bd-8293ef813efd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:39.562965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09fd71fe-7b9e-41e0-94bd-8293ef813efd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:39.563422 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09fd71fe-7b9e-41e0-94bd-8293ef813efd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:39.563843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09fd71fe-7b9e-41e0-94bd-8293ef813efd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:39.593442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-09fd71fe-7b9e-41e0-94bd-8293ef813efd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045308 Aug 24 12:41:39.594003 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 718/1437] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:39 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:40.072706 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2c622bd6-7001-4506-bdf5-6c29485b8925 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:40.074988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2c622bd6-7001-4506-bdf5-6c29485b8925 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:40.081411 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c622bd6-7001-4506-bdf5-6c29485b8925 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:40.081885 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c622bd6-7001-4506-bdf5-6c29485b8925 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:40.082320 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c622bd6-7001-4506-bdf5-6c29485b8925 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:40.083037 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c622bd6-7001-4506-bdf5-6c29485b8925 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:40.083485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c622bd6-7001-4506-bdf5-6c29485b8925 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:40.083911 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c622bd6-7001-4506-bdf5-6c29485b8925 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:40.112518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2c622bd6-7001-4506-bdf5-6c29485b8925 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044624 Aug 24 12:41:40.113060 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 720/1438] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:40 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:40.505360 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0fba9e4c-a57d-4726-ad05-d683cc7b9f27 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:40.508211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0fba9e4c-a57d-4726-ad05-d683cc7b9f27 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:40.514097 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fba9e4c-a57d-4726-ad05-d683cc7b9f27 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:40.514574 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fba9e4c-a57d-4726-ad05-d683cc7b9f27 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:40.515039 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fba9e4c-a57d-4726-ad05-d683cc7b9f27 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:40.515723 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fba9e4c-a57d-4726-ad05-d683cc7b9f27 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:40.516178 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fba9e4c-a57d-4726-ad05-d683cc7b9f27 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:40.516603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fba9e4c-a57d-4726-ad05-d683cc7b9f27 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:40.543980 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0fba9e4c-a57d-4726-ad05-d683cc7b9f27 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042607 Aug 24 12:41:40.544513 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 719/1439] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:40 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:40.605396 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d0d5dab3-00da-4ce0-b4b5-2b9e40f5dc12 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:40.607657 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d0d5dab3-00da-4ce0-b4b5-2b9e40f5dc12 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:40.613399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0d5dab3-00da-4ce0-b4b5-2b9e40f5dc12 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:40.614138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0d5dab3-00da-4ce0-b4b5-2b9e40f5dc12 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:40.614571 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0d5dab3-00da-4ce0-b4b5-2b9e40f5dc12 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:40.615789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0d5dab3-00da-4ce0-b4b5-2b9e40f5dc12 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:40.616236 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0d5dab3-00da-4ce0-b4b5-2b9e40f5dc12 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:40.616658 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0d5dab3-00da-4ce0-b4b5-2b9e40f5dc12 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:40.646008 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d0d5dab3-00da-4ce0-b4b5-2b9e40f5dc12 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044486 Aug 24 12:41:40.647817 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 721/1440] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:40 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:41.124972 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f6769b5d-1000-4c40-8f3a-bf9c7236baf0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:41.127130 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f6769b5d-1000-4c40-8f3a-bf9c7236baf0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:41.133464 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6769b5d-1000-4c40-8f3a-bf9c7236baf0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:41.133945 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6769b5d-1000-4c40-8f3a-bf9c7236baf0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:41.134385 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6769b5d-1000-4c40-8f3a-bf9c7236baf0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:41.135091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6769b5d-1000-4c40-8f3a-bf9c7236baf0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:41.135578 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6769b5d-1000-4c40-8f3a-bf9c7236baf0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:41.136001 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6769b5d-1000-4c40-8f3a-bf9c7236baf0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:41.164937 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f6769b5d-1000-4c40-8f3a-bf9c7236baf0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043931 Aug 24 12:41:41.165468 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 720/1441] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:41 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:41.556298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1c35db1a-2ed2-468a-ab5f-7685433dc34a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:41.558614 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1c35db1a-2ed2-468a-ab5f-7685433dc34a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:41.565087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c35db1a-2ed2-468a-ab5f-7685433dc34a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:41.573458 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c35db1a-2ed2-468a-ab5f-7685433dc34a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:41.573458 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c35db1a-2ed2-468a-ab5f-7685433dc34a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:41.573458 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c35db1a-2ed2-468a-ab5f-7685433dc34a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:41.573458 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c35db1a-2ed2-468a-ab5f-7685433dc34a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:41.573857 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c35db1a-2ed2-468a-ab5f-7685433dc34a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:41.596717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1c35db1a-2ed2-468a-ab5f-7685433dc34a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044348 Aug 24 12:41:41.597260 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 722/1442] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:41 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:41.657233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dddb451a-2e42-4bf1-918b-74a9b21b7c2e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:41.659748 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dddb451a-2e42-4bf1-918b-74a9b21b7c2e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:41.665906 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dddb451a-2e42-4bf1-918b-74a9b21b7c2e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:41.666397 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dddb451a-2e42-4bf1-918b-74a9b21b7c2e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:41.666877 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dddb451a-2e42-4bf1-918b-74a9b21b7c2e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:41.673714 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dddb451a-2e42-4bf1-918b-74a9b21b7c2e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:41.673714 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dddb451a-2e42-4bf1-918b-74a9b21b7c2e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:41.673714 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dddb451a-2e42-4bf1-918b-74a9b21b7c2e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:41.710817 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dddb451a-2e42-4bf1-918b-74a9b21b7c2e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056831 Aug 24 12:41:41.711395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 721/1443] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:41 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:42.176963 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-708895f6-821a-47e0-9fda-43ecb395ddf4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:42.179663 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-708895f6-821a-47e0-9fda-43ecb395ddf4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:42.185551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-708895f6-821a-47e0-9fda-43ecb395ddf4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:42.186028 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-708895f6-821a-47e0-9fda-43ecb395ddf4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:42.186466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-708895f6-821a-47e0-9fda-43ecb395ddf4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:42.187181 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-708895f6-821a-47e0-9fda-43ecb395ddf4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:42.187634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-708895f6-821a-47e0-9fda-43ecb395ddf4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:42.188060 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-708895f6-821a-47e0-9fda-43ecb395ddf4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:42.217012 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-708895f6-821a-47e0-9fda-43ecb395ddf4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043996 Aug 24 12:41:42.217556 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 723/1444] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:42 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:42.609118 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5e14a074-44f5-49f4-b790-01eedf94afa7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:42.611289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5e14a074-44f5-49f4-b790-01eedf94afa7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:42.617831 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e14a074-44f5-49f4-b790-01eedf94afa7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:42.625552 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e14a074-44f5-49f4-b790-01eedf94afa7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:42.625552 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e14a074-44f5-49f4-b790-01eedf94afa7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:42.625552 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e14a074-44f5-49f4-b790-01eedf94afa7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:42.625552 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e14a074-44f5-49f4-b790-01eedf94afa7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:42.625917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e14a074-44f5-49f4-b790-01eedf94afa7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:42.649478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5e14a074-44f5-49f4-b790-01eedf94afa7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044364 Aug 24 12:41:42.654330 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 722/1445] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:42 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:42.723319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d68c7bb3-2d31-41d8-bf56-845532ad06af tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:42.728810 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d68c7bb3-2d31-41d8-bf56-845532ad06af tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:42.732636 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d68c7bb3-2d31-41d8-bf56-845532ad06af tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:42.733116 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d68c7bb3-2d31-41d8-bf56-845532ad06af tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:42.733548 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d68c7bb3-2d31-41d8-bf56-845532ad06af tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:42.734321 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d68c7bb3-2d31-41d8-bf56-845532ad06af tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:42.734793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d68c7bb3-2d31-41d8-bf56-845532ad06af tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:42.735219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d68c7bb3-2d31-41d8-bf56-845532ad06af tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:42.766441 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d68c7bb3-2d31-41d8-bf56-845532ad06af tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047197 Aug 24 12:41:42.767063 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 724/1446] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:42 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:43.229173 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9a64e4bd-120e-4770-b8af-dc02c4b8588b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:43.231350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9a64e4bd-120e-4770-b8af-dc02c4b8588b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:43.237214 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a64e4bd-120e-4770-b8af-dc02c4b8588b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:43.237684 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a64e4bd-120e-4770-b8af-dc02c4b8588b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:43.238116 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a64e4bd-120e-4770-b8af-dc02c4b8588b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:43.239085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a64e4bd-120e-4770-b8af-dc02c4b8588b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:43.239543 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a64e4bd-120e-4770-b8af-dc02c4b8588b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:43.239962 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a64e4bd-120e-4770-b8af-dc02c4b8588b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:43.268478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9a64e4bd-120e-4770-b8af-dc02c4b8588b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043266 Aug 24 12:41:43.269011 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 723/1447] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:43 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:43.661815 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e3042358-c936-4e16-be6b-b3ccfb410799 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:43.664503 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e3042358-c936-4e16-be6b-b3ccfb410799 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:43.670388 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e3042358-c936-4e16-be6b-b3ccfb410799 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:43.670895 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e3042358-c936-4e16-be6b-b3ccfb410799 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:43.671329 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e3042358-c936-4e16-be6b-b3ccfb410799 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:43.672007 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e3042358-c936-4e16-be6b-b3ccfb410799 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:43.672452 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e3042358-c936-4e16-be6b-b3ccfb410799 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:43.672897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e3042358-c936-4e16-be6b-b3ccfb410799 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:43.701328 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e3042358-c936-4e16-be6b-b3ccfb410799 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043452 Aug 24 12:41:43.701870 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 725/1448] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:43 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:43.777669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-edb0c84f-4af9-40a9-97cf-3ca77226f87c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:43.780038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-edb0c84f-4af9-40a9-97cf-3ca77226f87c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:43.786354 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edb0c84f-4af9-40a9-97cf-3ca77226f87c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:43.786878 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edb0c84f-4af9-40a9-97cf-3ca77226f87c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:43.787319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edb0c84f-4af9-40a9-97cf-3ca77226f87c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:43.788018 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edb0c84f-4af9-40a9-97cf-3ca77226f87c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:43.788473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edb0c84f-4af9-40a9-97cf-3ca77226f87c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:43.789456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edb0c84f-4af9-40a9-97cf-3ca77226f87c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:43.820383 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-edb0c84f-4af9-40a9-97cf-3ca77226f87c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045638 Aug 24 12:41:43.821186 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 724/1449] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:43 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:44.280995 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-dac7aff9-4c3a-4283-8cdd-761491d974a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:44.283193 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-dac7aff9-4c3a-4283-8cdd-761491d974a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:44.289594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dac7aff9-4c3a-4283-8cdd-761491d974a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:44.290078 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dac7aff9-4c3a-4283-8cdd-761491d974a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:44.290518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dac7aff9-4c3a-4283-8cdd-761491d974a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:44.291232 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dac7aff9-4c3a-4283-8cdd-761491d974a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:44.291684 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dac7aff9-4c3a-4283-8cdd-761491d974a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:44.292113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dac7aff9-4c3a-4283-8cdd-761491d974a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:44.322312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-dac7aff9-4c3a-4283-8cdd-761491d974a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045325 Aug 24 12:41:44.322894 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 726/1450] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:44 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:41:44.713499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3d3c9659-e400-4fe0-b9d1-6eea8dbb76b9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:44.715641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3d3c9659-e400-4fe0-b9d1-6eea8dbb76b9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:44.722111 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d3c9659-e400-4fe0-b9d1-6eea8dbb76b9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:44.722585 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d3c9659-e400-4fe0-b9d1-6eea8dbb76b9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:44.723043 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d3c9659-e400-4fe0-b9d1-6eea8dbb76b9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:44.723734 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d3c9659-e400-4fe0-b9d1-6eea8dbb76b9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:44.724183 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d3c9659-e400-4fe0-b9d1-6eea8dbb76b9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:44.724603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d3c9659-e400-4fe0-b9d1-6eea8dbb76b9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:44.754230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3d3c9659-e400-4fe0-b9d1-6eea8dbb76b9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044806 Aug 24 12:41:44.754792 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 725/1451] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:44 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:44.832307 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-eb555241-442e-4b22-90d4-ba2c8b3d3afa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:44.834422 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-eb555241-442e-4b22-90d4-ba2c8b3d3afa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:44.840682 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb555241-442e-4b22-90d4-ba2c8b3d3afa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:44.841432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb555241-442e-4b22-90d4-ba2c8b3d3afa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:44.841678 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb555241-442e-4b22-90d4-ba2c8b3d3afa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:44.842332 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb555241-442e-4b22-90d4-ba2c8b3d3afa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:44.842813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb555241-442e-4b22-90d4-ba2c8b3d3afa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:44.843383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb555241-442e-4b22-90d4-ba2c8b3d3afa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:44.873273 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-eb555241-442e-4b22-90d4-ba2c8b3d3afa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044731 Aug 24 12:41:44.873957 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 727/1452] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:44 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:45.334621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-67f0d4bc-4fd0-4af7-9223-9204fb78b0a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:45.337415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-67f0d4bc-4fd0-4af7-9223-9204fb78b0a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:45.343734 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67f0d4bc-4fd0-4af7-9223-9204fb78b0a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:45.344242 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67f0d4bc-4fd0-4af7-9223-9204fb78b0a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:45.344676 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67f0d4bc-4fd0-4af7-9223-9204fb78b0a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:45.345354 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67f0d4bc-4fd0-4af7-9223-9204fb78b0a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:45.345808 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67f0d4bc-4fd0-4af7-9223-9204fb78b0a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:45.346228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67f0d4bc-4fd0-4af7-9223-9204fb78b0a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:45.374280 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-67f0d4bc-4fd0-4af7-9223-9204fb78b0a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043663 Aug 24 12:41:45.374832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 726/1453] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:45 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:45.766857 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-549e73a6-bd7a-4217-b8b0-d92ab61da62b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:45.769008 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-549e73a6-bd7a-4217-b8b0-d92ab61da62b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:45.775486 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-549e73a6-bd7a-4217-b8b0-d92ab61da62b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:45.775964 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-549e73a6-bd7a-4217-b8b0-d92ab61da62b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:45.776402 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-549e73a6-bd7a-4217-b8b0-d92ab61da62b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:45.777084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-549e73a6-bd7a-4217-b8b0-d92ab61da62b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:45.777536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-549e73a6-bd7a-4217-b8b0-d92ab61da62b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:45.777960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-549e73a6-bd7a-4217-b8b0-d92ab61da62b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:45.806834 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-549e73a6-bd7a-4217-b8b0-d92ab61da62b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044082 Aug 24 12:41:45.807388 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 728/1454] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:45 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:45.885798 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a579d8ca-7aab-4c19-ab62-f1a59aa70855 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:45.888175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a579d8ca-7aab-4c19-ab62-f1a59aa70855 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:45.893985 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a579d8ca-7aab-4c19-ab62-f1a59aa70855 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:45.894475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a579d8ca-7aab-4c19-ab62-f1a59aa70855 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:45.894945 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a579d8ca-7aab-4c19-ab62-f1a59aa70855 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:45.895655 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a579d8ca-7aab-4c19-ab62-f1a59aa70855 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:45.896108 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a579d8ca-7aab-4c19-ab62-f1a59aa70855 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:45.896784 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a579d8ca-7aab-4c19-ab62-f1a59aa70855 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:45.934049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a579d8ca-7aab-4c19-ab62-f1a59aa70855 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052403 Aug 24 12:41:45.934785 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 727/1455] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:45 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:46.387303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-485d1a18-6841-4bab-bbe4-f324d06fc308 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:46.389477 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-485d1a18-6841-4bab-bbe4-f324d06fc308 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:46.395402 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-485d1a18-6841-4bab-bbe4-f324d06fc308 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:46.395881 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-485d1a18-6841-4bab-bbe4-f324d06fc308 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:46.396321 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-485d1a18-6841-4bab-bbe4-f324d06fc308 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:46.397007 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-485d1a18-6841-4bab-bbe4-f324d06fc308 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:46.397453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-485d1a18-6841-4bab-bbe4-f324d06fc308 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:46.397878 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-485d1a18-6841-4bab-bbe4-f324d06fc308 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:46.428893 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-485d1a18-6841-4bab-bbe4-f324d06fc308 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045936 Aug 24 12:41:46.429186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 729/1456] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:46 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:46.820031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f6f01ee5-86e1-4d98-976f-c37a040aa624 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:46.822192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f6f01ee5-86e1-4d98-976f-c37a040aa624 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:46.828573 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6f01ee5-86e1-4d98-976f-c37a040aa624 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:46.829050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6f01ee5-86e1-4d98-976f-c37a040aa624 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:46.829489 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6f01ee5-86e1-4d98-976f-c37a040aa624 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:46.830174 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6f01ee5-86e1-4d98-976f-c37a040aa624 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:46.830625 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6f01ee5-86e1-4d98-976f-c37a040aa624 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:46.831072 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6f01ee5-86e1-4d98-976f-c37a040aa624 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:46.860739 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f6f01ee5-86e1-4d98-976f-c37a040aa624 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044603 Aug 24 12:41:46.861293 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 728/1457] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:46 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:46.945339 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ac39d631-3b18-4fdf-849b-173fddaaf760 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:46.947552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ac39d631-3b18-4fdf-849b-173fddaaf760 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:46.954428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ac39d631-3b18-4fdf-849b-173fddaaf760 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:46.954428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ac39d631-3b18-4fdf-849b-173fddaaf760 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:46.954712 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ac39d631-3b18-4fdf-849b-173fddaaf760 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:46.955400 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ac39d631-3b18-4fdf-849b-173fddaaf760 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:46.955841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ac39d631-3b18-4fdf-849b-173fddaaf760 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:46.956258 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ac39d631-3b18-4fdf-849b-173fddaaf760 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:46.986111 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ac39d631-3b18-4fdf-849b-173fddaaf760 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044710 Aug 24 12:41:46.991326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 730/1458] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:46 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:47.441164 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d6d57040-413a-4a2c-aa38-890d45f1324b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:47.443375 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d6d57040-413a-4a2c-aa38-890d45f1324b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:47.449279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d6d57040-413a-4a2c-aa38-890d45f1324b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:47.449759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d6d57040-413a-4a2c-aa38-890d45f1324b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:47.450195 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d6d57040-413a-4a2c-aa38-890d45f1324b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:47.450926 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d6d57040-413a-4a2c-aa38-890d45f1324b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:47.451383 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d6d57040-413a-4a2c-aa38-890d45f1324b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:47.451810 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d6d57040-413a-4a2c-aa38-890d45f1324b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:47.480264 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d6d57040-413a-4a2c-aa38-890d45f1324b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043015 Aug 24 12:41:47.480729 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 729/1459] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:47 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:47.872315 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ad1aebd5-2b06-4627-b984-8faf836a1e8d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:47.874472 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ad1aebd5-2b06-4627-b984-8faf836a1e8d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:47.880435 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ad1aebd5-2b06-4627-b984-8faf836a1e8d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:47.880928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ad1aebd5-2b06-4627-b984-8faf836a1e8d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:47.881342 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ad1aebd5-2b06-4627-b984-8faf836a1e8d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:47.882022 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ad1aebd5-2b06-4627-b984-8faf836a1e8d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:47.882470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ad1aebd5-2b06-4627-b984-8faf836a1e8d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:47.882933 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ad1aebd5-2b06-4627-b984-8faf836a1e8d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:47.910939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ad1aebd5-2b06-4627-b984-8faf836a1e8d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042562 Aug 24 12:41:47.911477 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 731/1460] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:47 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:47.999255 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1c3e175d-e236-449c-8f59-4e5fef17af5f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:48.001389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1c3e175d-e236-449c-8f59-4e5fef17af5f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:48.007830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1c3e175d-e236-449c-8f59-4e5fef17af5f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:48.008319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1c3e175d-e236-449c-8f59-4e5fef17af5f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:48.008758 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1c3e175d-e236-449c-8f59-4e5fef17af5f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:48.009555 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1c3e175d-e236-449c-8f59-4e5fef17af5f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:48.010559 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1c3e175d-e236-449c-8f59-4e5fef17af5f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:48.011012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1c3e175d-e236-449c-8f59-4e5fef17af5f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:48.040952 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1c3e175d-e236-449c-8f59-4e5fef17af5f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045799 Aug 24 12:41:48.041703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 730/1461] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:47 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:48.492812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cf3149af-f208-4d05-9a1f-46b7947ca4a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:48.495617 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cf3149af-f208-4d05-9a1f-46b7947ca4a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:48.501913 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf3149af-f208-4d05-9a1f-46b7947ca4a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:48.502386 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf3149af-f208-4d05-9a1f-46b7947ca4a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:48.502859 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf3149af-f208-4d05-9a1f-46b7947ca4a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:48.503542 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf3149af-f208-4d05-9a1f-46b7947ca4a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:48.503987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf3149af-f208-4d05-9a1f-46b7947ca4a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:48.504502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf3149af-f208-4d05-9a1f-46b7947ca4a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:48.534861 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cf3149af-f208-4d05-9a1f-46b7947ca4a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046316 Aug 24 12:41:48.535419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 732/1462] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:48 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:48.923872 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-884e5852-19e6-4115-86b8-577b6fd8e4fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:48.925985 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-884e5852-19e6-4115-86b8-577b6fd8e4fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:48.932561 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-884e5852-19e6-4115-86b8-577b6fd8e4fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:48.933043 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-884e5852-19e6-4115-86b8-577b6fd8e4fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:48.933474 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-884e5852-19e6-4115-86b8-577b6fd8e4fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:48.934199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-884e5852-19e6-4115-86b8-577b6fd8e4fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:48.934645 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-884e5852-19e6-4115-86b8-577b6fd8e4fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:48.935085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-884e5852-19e6-4115-86b8-577b6fd8e4fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:48.962371 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-884e5852-19e6-4115-86b8-577b6fd8e4fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042597 Aug 24 12:41:48.963052 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 731/1463] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:48 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:49.052403 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0b5af38b-bb04-4bfc-b24f-f926effa7646 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:49.054530 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0b5af38b-bb04-4bfc-b24f-f926effa7646 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:49.061106 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0b5af38b-bb04-4bfc-b24f-f926effa7646 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:49.061591 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0b5af38b-bb04-4bfc-b24f-f926effa7646 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:49.062029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0b5af38b-bb04-4bfc-b24f-f926effa7646 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:49.062762 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0b5af38b-bb04-4bfc-b24f-f926effa7646 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:49.063217 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0b5af38b-bb04-4bfc-b24f-f926effa7646 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:49.063641 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0b5af38b-bb04-4bfc-b24f-f926effa7646 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:49.096051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0b5af38b-bb04-4bfc-b24f-f926effa7646 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047530 Aug 24 12:41:49.096873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 733/1464] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:49 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:49.546667 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6dbc35a9-79da-487f-9eec-235c7cfc6a2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:49.548821 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6dbc35a9-79da-487f-9eec-235c7cfc6a2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:49.555121 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6dbc35a9-79da-487f-9eec-235c7cfc6a2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:49.555620 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6dbc35a9-79da-487f-9eec-235c7cfc6a2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:49.556053 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6dbc35a9-79da-487f-9eec-235c7cfc6a2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:49.556733 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6dbc35a9-79da-487f-9eec-235c7cfc6a2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:49.557689 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6dbc35a9-79da-487f-9eec-235c7cfc6a2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:49.558110 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6dbc35a9-79da-487f-9eec-235c7cfc6a2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:49.586407 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6dbc35a9-79da-487f-9eec-235c7cfc6a2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043714 Aug 24 12:41:49.586957 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 732/1465] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:49 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:49.975707 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-34b269c9-459f-46b3-b44f-2d20ec28e697 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:49.977883 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-34b269c9-459f-46b3-b44f-2d20ec28e697 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:49.984812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-34b269c9-459f-46b3-b44f-2d20ec28e697 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:49.985288 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-34b269c9-459f-46b3-b44f-2d20ec28e697 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:49.985712 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-34b269c9-459f-46b3-b44f-2d20ec28e697 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:49.986385 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-34b269c9-459f-46b3-b44f-2d20ec28e697 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:49.986857 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-34b269c9-459f-46b3-b44f-2d20ec28e697 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:49.987275 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-34b269c9-459f-46b3-b44f-2d20ec28e697 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:50.015535 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-34b269c9-459f-46b3-b44f-2d20ec28e697 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043781 Aug 24 12:41:50.016076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 734/1466] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:49 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:50.109987 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ec9d7f78-3084-4fe8-8975-199b7ba925b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:50.111560 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ec9d7f78-3084-4fe8-8975-199b7ba925b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:50.117867 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec9d7f78-3084-4fe8-8975-199b7ba925b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:50.118350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec9d7f78-3084-4fe8-8975-199b7ba925b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:50.118831 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec9d7f78-3084-4fe8-8975-199b7ba925b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:50.119524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec9d7f78-3084-4fe8-8975-199b7ba925b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:50.119976 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec9d7f78-3084-4fe8-8975-199b7ba925b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:50.120400 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec9d7f78-3084-4fe8-8975-199b7ba925b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:50.124107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:50.150067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ec9d7f78-3084-4fe8-8975-199b7ba925b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045347 Aug 24 12:41:50.150698 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 733/1467] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:50 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:50.597709 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-583ceb3d-dd60-4676-a781-0a46cecaa4b2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:50.599894 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-583ceb3d-dd60-4676-a781-0a46cecaa4b2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:50.605779 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-583ceb3d-dd60-4676-a781-0a46cecaa4b2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:50.606260 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-583ceb3d-dd60-4676-a781-0a46cecaa4b2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:50.606720 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-583ceb3d-dd60-4676-a781-0a46cecaa4b2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:50.607428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-583ceb3d-dd60-4676-a781-0a46cecaa4b2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:50.607880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-583ceb3d-dd60-4676-a781-0a46cecaa4b2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:50.608301 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-583ceb3d-dd60-4676-a781-0a46cecaa4b2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:50.632226 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:50.636866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-583ceb3d-dd60-4676-a781-0a46cecaa4b2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043172 Aug 24 12:41:50.637905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 735/1468] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:50 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:51.028501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-59111793-4da5-43b6-9310-1144ba03c37c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:51.030722 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-59111793-4da5-43b6-9310-1144ba03c37c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:51.037248 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59111793-4da5-43b6-9310-1144ba03c37c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:51.037727 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59111793-4da5-43b6-9310-1144ba03c37c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:51.038165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59111793-4da5-43b6-9310-1144ba03c37c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:51.038887 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59111793-4da5-43b6-9310-1144ba03c37c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:51.039344 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59111793-4da5-43b6-9310-1144ba03c37c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:51.039767 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59111793-4da5-43b6-9310-1144ba03c37c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:51.069198 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-59111793-4da5-43b6-9310-1144ba03c37c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045039 Aug 24 12:41:51.069671 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 734/1469] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:51 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:51.162615 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-10df0743-e440-478c-96a6-24a5c491a069 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:51.164771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-10df0743-e440-478c-96a6-24a5c491a069 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:51.171771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-10df0743-e440-478c-96a6-24a5c491a069 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:51.180785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-10df0743-e440-478c-96a6-24a5c491a069 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:51.180785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-10df0743-e440-478c-96a6-24a5c491a069 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:51.180785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-10df0743-e440-478c-96a6-24a5c491a069 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:51.180785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-10df0743-e440-478c-96a6-24a5c491a069 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:51.181502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-10df0743-e440-478c-96a6-24a5c491a069 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:51.204206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-10df0743-e440-478c-96a6-24a5c491a069 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045826 Aug 24 12:41:51.204767 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 736/1470] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:51 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:51.650241 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8d81e1e4-abf0-4d7a-979f-09c7a2c9987c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:51.652761 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8d81e1e4-abf0-4d7a-979f-09c7a2c9987c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:51.659570 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d81e1e4-abf0-4d7a-979f-09c7a2c9987c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:51.660060 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d81e1e4-abf0-4d7a-979f-09c7a2c9987c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:51.660502 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d81e1e4-abf0-4d7a-979f-09c7a2c9987c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:51.661192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d81e1e4-abf0-4d7a-979f-09c7a2c9987c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:51.661653 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d81e1e4-abf0-4d7a-979f-09c7a2c9987c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:51.662081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d81e1e4-abf0-4d7a-979f-09c7a2c9987c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:51.690827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8d81e1e4-abf0-4d7a-979f-09c7a2c9987c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045009 Aug 24 12:41:51.691308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 735/1471] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:51 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:52.081787 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6136df9d-d46a-466e-99d6-a2c9e90d04b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:52.083977 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6136df9d-d46a-466e-99d6-a2c9e90d04b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:52.089979 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6136df9d-d46a-466e-99d6-a2c9e90d04b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:52.091132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6136df9d-d46a-466e-99d6-a2c9e90d04b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:52.091571 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6136df9d-d46a-466e-99d6-a2c9e90d04b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:52.092258 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6136df9d-d46a-466e-99d6-a2c9e90d04b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:52.092753 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6136df9d-d46a-466e-99d6-a2c9e90d04b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:52.093208 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6136df9d-d46a-466e-99d6-a2c9e90d04b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:52.121440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6136df9d-d46a-466e-99d6-a2c9e90d04b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043643 Aug 24 12:41:52.121988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 737/1472] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:52 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:52.216637 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c4cde7ba-c527-41ac-bf05-9961d6964417 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:52.218814 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c4cde7ba-c527-41ac-bf05-9961d6964417 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:52.225077 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c4cde7ba-c527-41ac-bf05-9961d6964417 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:52.225559 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c4cde7ba-c527-41ac-bf05-9961d6964417 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:52.225996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c4cde7ba-c527-41ac-bf05-9961d6964417 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:52.226777 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c4cde7ba-c527-41ac-bf05-9961d6964417 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:52.227245 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c4cde7ba-c527-41ac-bf05-9961d6964417 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:52.227723 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c4cde7ba-c527-41ac-bf05-9961d6964417 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:52.258197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c4cde7ba-c527-41ac-bf05-9961d6964417 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045544 Aug 24 12:41:52.263311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 736/1473] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:52 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:52.702676 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-663dd49a-fc55-4834-87df-089751ec9144 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:52.704752 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-663dd49a-fc55-4834-87df-089751ec9144 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:52.711383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-663dd49a-fc55-4834-87df-089751ec9144 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:52.711866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-663dd49a-fc55-4834-87df-089751ec9144 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:52.712306 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-663dd49a-fc55-4834-87df-089751ec9144 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:52.712999 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-663dd49a-fc55-4834-87df-089751ec9144 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:52.713455 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-663dd49a-fc55-4834-87df-089751ec9144 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:52.713884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-663dd49a-fc55-4834-87df-089751ec9144 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:52.744592 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-663dd49a-fc55-4834-87df-089751ec9144 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046003 Aug 24 12:41:52.745138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 738/1474] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:52 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:53.134192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0a3ac8d6-3db6-480d-9c95-a0d85aa581fd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:53.136436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0a3ac8d6-3db6-480d-9c95-a0d85aa581fd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:53.142986 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a3ac8d6-3db6-480d-9c95-a0d85aa581fd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:53.143470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a3ac8d6-3db6-480d-9c95-a0d85aa581fd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:53.143908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a3ac8d6-3db6-480d-9c95-a0d85aa581fd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:53.144595 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a3ac8d6-3db6-480d-9c95-a0d85aa581fd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:53.145050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a3ac8d6-3db6-480d-9c95-a0d85aa581fd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:53.145475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a3ac8d6-3db6-480d-9c95-a0d85aa581fd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:53.174521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0a3ac8d6-3db6-480d-9c95-a0d85aa581fd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044801 Aug 24 12:41:53.175241 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 737/1475] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:53 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:53.271214 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c27c0020-34fc-4e68-a37d-558155182c0b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:53.273531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c27c0020-34fc-4e68-a37d-558155182c0b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:53.279532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c27c0020-34fc-4e68-a37d-558155182c0b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:53.280015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c27c0020-34fc-4e68-a37d-558155182c0b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:53.281054 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c27c0020-34fc-4e68-a37d-558155182c0b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:53.281739 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c27c0020-34fc-4e68-a37d-558155182c0b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:53.282191 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c27c0020-34fc-4e68-a37d-558155182c0b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:53.282614 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c27c0020-34fc-4e68-a37d-558155182c0b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:53.311981 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c27c0020-34fc-4e68-a37d-558155182c0b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044181 Aug 24 12:41:53.312623 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 739/1476] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:53 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:53.757420 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-daa0ec65-0cef-478b-ae96-e029ac03493f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:53.759574 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-daa0ec65-0cef-478b-ae96-e029ac03493f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:53.766060 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-daa0ec65-0cef-478b-ae96-e029ac03493f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:53.766540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-daa0ec65-0cef-478b-ae96-e029ac03493f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:53.767003 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-daa0ec65-0cef-478b-ae96-e029ac03493f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:53.767685 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-daa0ec65-0cef-478b-ae96-e029ac03493f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:53.768134 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-daa0ec65-0cef-478b-ae96-e029ac03493f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:53.768556 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-daa0ec65-0cef-478b-ae96-e029ac03493f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:53.796542 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-daa0ec65-0cef-478b-ae96-e029ac03493f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043122 Aug 24 12:41:53.797592 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 738/1477] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:53 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:54.186188 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-80e0194f-bc0c-43c1-9509-e377f988bec4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:54.188329 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-80e0194f-bc0c-43c1-9509-e377f988bec4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:54.194697 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80e0194f-bc0c-43c1-9509-e377f988bec4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:54.195168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80e0194f-bc0c-43c1-9509-e377f988bec4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:54.195603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80e0194f-bc0c-43c1-9509-e377f988bec4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:54.196286 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80e0194f-bc0c-43c1-9509-e377f988bec4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:54.196735 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80e0194f-bc0c-43c1-9509-e377f988bec4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:54.197157 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80e0194f-bc0c-43c1-9509-e377f988bec4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:54.225253 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-80e0194f-bc0c-43c1-9509-e377f988bec4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043026 Aug 24 12:41:54.225789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 740/1478] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:54 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:54.328190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3949b982-afe2-4cc5-b86f-7eb915b091fe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:54.328190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3949b982-afe2-4cc5-b86f-7eb915b091fe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:54.331951 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3949b982-afe2-4cc5-b86f-7eb915b091fe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:54.332426 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3949b982-afe2-4cc5-b86f-7eb915b091fe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:54.332858 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3949b982-afe2-4cc5-b86f-7eb915b091fe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:54.333533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3949b982-afe2-4cc5-b86f-7eb915b091fe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:54.334032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3949b982-afe2-4cc5-b86f-7eb915b091fe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:54.334455 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3949b982-afe2-4cc5-b86f-7eb915b091fe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:54.363750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3949b982-afe2-4cc5-b86f-7eb915b091fe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044284 Aug 24 12:41:54.364752 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 739/1479] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:54 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:54.809164 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-23f24884-391a-4948-846a-9cd87864493a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:54.811349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-23f24884-391a-4948-846a-9cd87864493a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:54.817732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-23f24884-391a-4948-846a-9cd87864493a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:54.818212 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-23f24884-391a-4948-846a-9cd87864493a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:54.818667 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-23f24884-391a-4948-846a-9cd87864493a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:54.819353 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-23f24884-391a-4948-846a-9cd87864493a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:54.819804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-23f24884-391a-4948-846a-9cd87864493a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:54.820228 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-23f24884-391a-4948-846a-9cd87864493a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:54.848914 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-23f24884-391a-4948-846a-9cd87864493a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043684 Aug 24 12:41:54.849452 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 741/1480] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:54 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:55.237519 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-224220ef-25b9-44e2-b544-d2e2b063d7bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:55.239978 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-224220ef-25b9-44e2-b544-d2e2b063d7bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:55.246363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-224220ef-25b9-44e2-b544-d2e2b063d7bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:55.246873 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-224220ef-25b9-44e2-b544-d2e2b063d7bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:55.247308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-224220ef-25b9-44e2-b544-d2e2b063d7bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:55.247982 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-224220ef-25b9-44e2-b544-d2e2b063d7bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:55.248429 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-224220ef-25b9-44e2-b544-d2e2b063d7bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:55.248848 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-224220ef-25b9-44e2-b544-d2e2b063d7bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:55.277596 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-224220ef-25b9-44e2-b544-d2e2b063d7bf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044163 Aug 24 12:41:55.278141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 740/1481] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:55 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:55.376317 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f6f45207-ac94-47ea-a165-19c2fab1296c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:55.378504 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f6f45207-ac94-47ea-a165-19c2fab1296c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:55.384851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f6f45207-ac94-47ea-a165-19c2fab1296c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:55.385336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f6f45207-ac94-47ea-a165-19c2fab1296c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:55.385768 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f6f45207-ac94-47ea-a165-19c2fab1296c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:55.386454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f6f45207-ac94-47ea-a165-19c2fab1296c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:55.386942 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f6f45207-ac94-47ea-a165-19c2fab1296c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:55.387367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f6f45207-ac94-47ea-a165-19c2fab1296c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:55.417170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f6f45207-ac94-47ea-a165-19c2fab1296c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044798 Aug 24 12:41:55.417928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 742/1482] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:55 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:55.861005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f3867fae-1b5a-43ea-9672-646a1c60256e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:55.863148 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f3867fae-1b5a-43ea-9672-646a1c60256e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:55.869239 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3867fae-1b5a-43ea-9672-646a1c60256e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:55.869711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3867fae-1b5a-43ea-9672-646a1c60256e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:55.870141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3867fae-1b5a-43ea-9672-646a1c60256e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:55.870847 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3867fae-1b5a-43ea-9672-646a1c60256e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:55.871301 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3867fae-1b5a-43ea-9672-646a1c60256e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:55.871722 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3867fae-1b5a-43ea-9672-646a1c60256e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:55.900170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f3867fae-1b5a-43ea-9672-646a1c60256e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043154 Aug 24 12:41:55.907013 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 741/1483] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:55 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:56.289783 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e375900f-33a4-4d52-a406-3586935cff91 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:56.291932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e375900f-33a4-4d52-a406-3586935cff91 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:56.297920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e375900f-33a4-4d52-a406-3586935cff91 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:56.298425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e375900f-33a4-4d52-a406-3586935cff91 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:56.298888 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e375900f-33a4-4d52-a406-3586935cff91 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:56.299574 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e375900f-33a4-4d52-a406-3586935cff91 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:56.300029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e375900f-33a4-4d52-a406-3586935cff91 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:56.300450 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e375900f-33a4-4d52-a406-3586935cff91 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:56.328818 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e375900f-33a4-4d52-a406-3586935cff91 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042974 Aug 24 12:41:56.329374 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 743/1484] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:56 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:56.429848 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6f351510-223a-4560-91b1-72bfe0a513f5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:56.432055 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6f351510-223a-4560-91b1-72bfe0a513f5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:56.438352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6f351510-223a-4560-91b1-72bfe0a513f5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:56.438876 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6f351510-223a-4560-91b1-72bfe0a513f5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:56.439321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6f351510-223a-4560-91b1-72bfe0a513f5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:56.440008 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6f351510-223a-4560-91b1-72bfe0a513f5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:56.440463 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6f351510-223a-4560-91b1-72bfe0a513f5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:56.441398 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6f351510-223a-4560-91b1-72bfe0a513f5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:56.470238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6f351510-223a-4560-91b1-72bfe0a513f5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044420 Aug 24 12:41:56.470811 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 742/1485] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:56 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:56.917324 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bff5d134-e8e9-4be3-b0a6-0b2b4fccd32c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:56.919456 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-bff5d134-e8e9-4be3-b0a6-0b2b4fccd32c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:56.925698 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bff5d134-e8e9-4be3-b0a6-0b2b4fccd32c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:56.926802 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bff5d134-e8e9-4be3-b0a6-0b2b4fccd32c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:56.927255 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bff5d134-e8e9-4be3-b0a6-0b2b4fccd32c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:56.927931 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bff5d134-e8e9-4be3-b0a6-0b2b4fccd32c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:56.928373 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bff5d134-e8e9-4be3-b0a6-0b2b4fccd32c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:56.928789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bff5d134-e8e9-4be3-b0a6-0b2b4fccd32c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:56.956189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bff5d134-e8e9-4be3-b0a6-0b2b4fccd32c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042886 Aug 24 12:41:56.956715 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 744/1486] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:56 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:57.341421 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fba1e84d-15ba-4f8b-be1a-55f9bcdc813c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:57.343585 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fba1e84d-15ba-4f8b-be1a-55f9bcdc813c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:57.350142 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fba1e84d-15ba-4f8b-be1a-55f9bcdc813c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:57.350622 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fba1e84d-15ba-4f8b-be1a-55f9bcdc813c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:57.351083 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fba1e84d-15ba-4f8b-be1a-55f9bcdc813c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:57.351769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fba1e84d-15ba-4f8b-be1a-55f9bcdc813c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:57.352224 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fba1e84d-15ba-4f8b-be1a-55f9bcdc813c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:57.352648 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fba1e84d-15ba-4f8b-be1a-55f9bcdc813c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:57.380334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fba1e84d-15ba-4f8b-be1a-55f9bcdc813c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042860 Aug 24 12:41:57.380873 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 743/1487] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:57 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:57.481607 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8b6d9e63-ab3a-4423-87f3-977df57a38cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:57.483744 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8b6d9e63-ab3a-4423-87f3-977df57a38cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:57.490303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b6d9e63-ab3a-4423-87f3-977df57a38cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:57.490806 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b6d9e63-ab3a-4423-87f3-977df57a38cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:57.491238 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b6d9e63-ab3a-4423-87f3-977df57a38cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:57.491915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b6d9e63-ab3a-4423-87f3-977df57a38cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:57.492357 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b6d9e63-ab3a-4423-87f3-977df57a38cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:57.492772 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b6d9e63-ab3a-4423-87f3-977df57a38cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:57.521030 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8b6d9e63-ab3a-4423-87f3-977df57a38cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043364 Aug 24 12:41:57.521561 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 745/1488] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:57 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:41:57.968331 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b9095e22-4c28-4260-91db-4f5bd0308f39 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:57.970470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b9095e22-4c28-4260-91db-4f5bd0308f39 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:57.976797 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b9095e22-4c28-4260-91db-4f5bd0308f39 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:57.977276 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b9095e22-4c28-4260-91db-4f5bd0308f39 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:57.977712 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b9095e22-4c28-4260-91db-4f5bd0308f39 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:57.978397 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b9095e22-4c28-4260-91db-4f5bd0308f39 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:57.978893 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b9095e22-4c28-4260-91db-4f5bd0308f39 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:57.979319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b9095e22-4c28-4260-91db-4f5bd0308f39 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:58.007938 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b9095e22-4c28-4260-91db-4f5bd0308f39 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043569 Aug 24 12:41:58.008471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 744/1489] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:57 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:58.392371 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a1884095-cea4-42b4-94eb-ad9d36108842 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:58.394488 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a1884095-cea4-42b4-94eb-ad9d36108842 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:58.400885 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1884095-cea4-42b4-94eb-ad9d36108842 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:58.401367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1884095-cea4-42b4-94eb-ad9d36108842 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:58.401802 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1884095-cea4-42b4-94eb-ad9d36108842 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:58.402487 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1884095-cea4-42b4-94eb-ad9d36108842 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:58.402962 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1884095-cea4-42b4-94eb-ad9d36108842 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:58.403386 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1884095-cea4-42b4-94eb-ad9d36108842 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:58.432905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a1884095-cea4-42b4-94eb-ad9d36108842 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044432 Aug 24 12:41:58.433458 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 746/1490] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:58 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:58.533269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-47c793cc-c320-4673-9baf-1f9ce7fa66b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:58.536008 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-47c793cc-c320-4673-9baf-1f9ce7fa66b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:58.541881 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-47c793cc-c320-4673-9baf-1f9ce7fa66b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:58.542355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-47c793cc-c320-4673-9baf-1f9ce7fa66b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:58.542825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-47c793cc-c320-4673-9baf-1f9ce7fa66b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:58.543507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-47c793cc-c320-4673-9baf-1f9ce7fa66b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:58.543959 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-47c793cc-c320-4673-9baf-1f9ce7fa66b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:58.544377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-47c793cc-c320-4673-9baf-1f9ce7fa66b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:58.572899 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-47c793cc-c320-4673-9baf-1f9ce7fa66b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043627 Aug 24 12:41:58.573431 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 745/1491] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:58 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:41:59.019274 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7590908d-48e1-43a6-b1c3-b0ec7bfea9fe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:59.021431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7590908d-48e1-43a6-b1c3-b0ec7bfea9fe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:59.027357 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7590908d-48e1-43a6-b1c3-b0ec7bfea9fe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:59.027835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7590908d-48e1-43a6-b1c3-b0ec7bfea9fe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:59.028267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7590908d-48e1-43a6-b1c3-b0ec7bfea9fe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:59.028945 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7590908d-48e1-43a6-b1c3-b0ec7bfea9fe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:59.029396 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7590908d-48e1-43a6-b1c3-b0ec7bfea9fe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:59.029813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7590908d-48e1-43a6-b1c3-b0ec7bfea9fe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:59.057936 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7590908d-48e1-43a6-b1c3-b0ec7bfea9fe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042638 Aug 24 12:41:59.058470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 747/1492] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:59 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:59.445894 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-cbc0c065-d4c3-444e-ad38-2e916c3f681b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:59.448278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-cbc0c065-d4c3-444e-ad38-2e916c3f681b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:59.455557 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cbc0c065-d4c3-444e-ad38-2e916c3f681b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:59.460636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cbc0c065-d4c3-444e-ad38-2e916c3f681b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:59.460636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cbc0c065-d4c3-444e-ad38-2e916c3f681b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:59.460636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cbc0c065-d4c3-444e-ad38-2e916c3f681b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:59.460636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cbc0c065-d4c3-444e-ad38-2e916c3f681b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:59.461011 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cbc0c065-d4c3-444e-ad38-2e916c3f681b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:59.486563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-cbc0c065-d4c3-444e-ad38-2e916c3f681b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045318 Aug 24 12:41:59.487179 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 746/1493] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:41:59 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:59.585731 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-88c5a8a9-ad40-49c1-96ee-d9cc8977b392 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:59.587817 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-88c5a8a9-ad40-49c1-96ee-d9cc8977b392 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:59.590082 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=86 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:59.594721 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88c5a8a9-ad40-49c1-96ee-d9cc8977b392 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:59.595199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88c5a8a9-ad40-49c1-96ee-d9cc8977b392 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:59.595633 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88c5a8a9-ad40-49c1-96ee-d9cc8977b392 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:59.596311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88c5a8a9-ad40-49c1-96ee-d9cc8977b392 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:59.596759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88c5a8a9-ad40-49c1-96ee-d9cc8977b392 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:59.597179 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88c5a8a9-ad40-49c1-96ee-d9cc8977b392 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:59.626909 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-88c5a8a9-ad40-49c1-96ee-d9cc8977b392 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045807 Aug 24 12:41:59.627445 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 748/1494] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:41:59 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:00.071431 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-91a9c862-81b6-4f3d-b2cb-5fc9b4ddc02c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:00.073564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-91a9c862-81b6-4f3d-b2cb-5fc9b4ddc02c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:00.079448 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-91a9c862-81b6-4f3d-b2cb-5fc9b4ddc02c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:00.079928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-91a9c862-81b6-4f3d-b2cb-5fc9b4ddc02c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:00.080362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-91a9c862-81b6-4f3d-b2cb-5fc9b4ddc02c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:00.081048 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-91a9c862-81b6-4f3d-b2cb-5fc9b4ddc02c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:00.081529 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-91a9c862-81b6-4f3d-b2cb-5fc9b4ddc02c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:00.082600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-91a9c862-81b6-4f3d-b2cb-5fc9b4ddc02c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:00.113684 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-91a9c862-81b6-4f3d-b2cb-5fc9b4ddc02c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047484 Aug 24 12:42:00.114423 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 747/1495] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:00 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:00.499252 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-996aa930-6d2b-4222-aced-2fb9081574f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:00.501356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-996aa930-6d2b-4222-aced-2fb9081574f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:00.507341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-996aa930-6d2b-4222-aced-2fb9081574f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:00.507815 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-996aa930-6d2b-4222-aced-2fb9081574f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:00.508245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-996aa930-6d2b-4222-aced-2fb9081574f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:00.508918 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-996aa930-6d2b-4222-aced-2fb9081574f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:00.509358 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-996aa930-6d2b-4222-aced-2fb9081574f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:00.509773 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-996aa930-6d2b-4222-aced-2fb9081574f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:00.539266 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-996aa930-6d2b-4222-aced-2fb9081574f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043958 Aug 24 12:42:00.539805 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 749/1496] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:00 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:00.639826 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-59180c6c-80d6-4860-b561-39861237da7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:00.641929 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-59180c6c-80d6-4860-b561-39861237da7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:00.644175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=88 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:00.649221 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59180c6c-80d6-4860-b561-39861237da7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:00.649696 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59180c6c-80d6-4860-b561-39861237da7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:00.650128 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59180c6c-80d6-4860-b561-39861237da7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:00.650837 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59180c6c-80d6-4860-b561-39861237da7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:00.651285 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59180c6c-80d6-4860-b561-39861237da7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:00.651702 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59180c6c-80d6-4860-b561-39861237da7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:00.684291 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-59180c6c-80d6-4860-b561-39861237da7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048261 Aug 24 12:42:00.684757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 748/1497] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:00 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:01.125961 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-80b5912a-580c-41d3-80a5-3bca93ce8f3c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:01.128128 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-80b5912a-580c-41d3-80a5-3bca93ce8f3c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:01.135056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80b5912a-580c-41d3-80a5-3bca93ce8f3c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:01.135532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80b5912a-580c-41d3-80a5-3bca93ce8f3c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:01.135970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80b5912a-580c-41d3-80a5-3bca93ce8f3c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:01.136647 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80b5912a-580c-41d3-80a5-3bca93ce8f3c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:01.137094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80b5912a-580c-41d3-80a5-3bca93ce8f3c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:01.137521 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80b5912a-580c-41d3-80a5-3bca93ce8f3c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:01.165614 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-80b5912a-580c-41d3-80a5-3bca93ce8f3c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043601 Aug 24 12:42:01.166155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 750/1498] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:01 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:01.552237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-83ef520b-9982-4548-ad81-91fac6226339 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:01.554412 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-83ef520b-9982-4548-ad81-91fac6226339 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:01.560504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83ef520b-9982-4548-ad81-91fac6226339 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:01.560992 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83ef520b-9982-4548-ad81-91fac6226339 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:01.561430 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83ef520b-9982-4548-ad81-91fac6226339 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:01.562122 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83ef520b-9982-4548-ad81-91fac6226339 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:01.562607 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83ef520b-9982-4548-ad81-91fac6226339 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:01.563118 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83ef520b-9982-4548-ad81-91fac6226339 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:01.586937 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:01.591531 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-83ef520b-9982-4548-ad81-91fac6226339 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043973 Aug 24 12:42:01.592138 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 749/1499] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:01 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:01.697047 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e7d46f8b-4c63-4baf-af0d-1ad5f135e289 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:01.699132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e7d46f8b-4c63-4baf-af0d-1ad5f135e289 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:01.705022 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7d46f8b-4c63-4baf-af0d-1ad5f135e289 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:01.705526 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7d46f8b-4c63-4baf-af0d-1ad5f135e289 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:01.705961 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7d46f8b-4c63-4baf-af0d-1ad5f135e289 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:01.706640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7d46f8b-4c63-4baf-af0d-1ad5f135e289 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:01.707140 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7d46f8b-4c63-4baf-af0d-1ad5f135e289 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:01.707562 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7d46f8b-4c63-4baf-af0d-1ad5f135e289 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:01.736562 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e7d46f8b-4c63-4baf-af0d-1ad5f135e289 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043554 Aug 24 12:42:01.737104 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 751/1500] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:01 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:02.177884 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-27604818-b357-401c-8f2a-48cf29eea1e6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:02.180136 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-27604818-b357-401c-8f2a-48cf29eea1e6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:02.186864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-27604818-b357-401c-8f2a-48cf29eea1e6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:02.187362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-27604818-b357-401c-8f2a-48cf29eea1e6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:02.188020 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-27604818-b357-401c-8f2a-48cf29eea1e6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:02.188487 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-27604818-b357-401c-8f2a-48cf29eea1e6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:02.188948 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-27604818-b357-401c-8f2a-48cf29eea1e6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:02.189378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-27604818-b357-401c-8f2a-48cf29eea1e6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:02.218856 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-27604818-b357-401c-8f2a-48cf29eea1e6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044968 Aug 24 12:42:02.219410 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 750/1501] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:02 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:02.603796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6fb0ca3f-17e4-4c4f-90c2-7c83654a7f15 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:02.605921 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6fb0ca3f-17e4-4c4f-90c2-7c83654a7f15 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:02.612341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6fb0ca3f-17e4-4c4f-90c2-7c83654a7f15 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:02.612818 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6fb0ca3f-17e4-4c4f-90c2-7c83654a7f15 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:02.613768 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6fb0ca3f-17e4-4c4f-90c2-7c83654a7f15 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:02.614720 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6fb0ca3f-17e4-4c4f-90c2-7c83654a7f15 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:02.615172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6fb0ca3f-17e4-4c4f-90c2-7c83654a7f15 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:02.615592 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6fb0ca3f-17e4-4c4f-90c2-7c83654a7f15 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:02.632595 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:02.644816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6fb0ca3f-17e4-4c4f-90c2-7c83654a7f15 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045020 Aug 24 12:42:02.645370 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 752/1502] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:02 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:02.749487 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b62ec9b7-336d-45f7-b9a7-a215fea475ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:02.751653 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b62ec9b7-336d-45f7-b9a7-a215fea475ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:02.758369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b62ec9b7-336d-45f7-b9a7-a215fea475ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:02.758896 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b62ec9b7-336d-45f7-b9a7-a215fea475ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:02.761973 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b62ec9b7-336d-45f7-b9a7-a215fea475ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:02.761973 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b62ec9b7-336d-45f7-b9a7-a215fea475ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:02.761973 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b62ec9b7-336d-45f7-b9a7-a215fea475ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:02.761973 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b62ec9b7-336d-45f7-b9a7-a215fea475ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:02.790493 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b62ec9b7-336d-45f7-b9a7-a215fea475ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044971 Aug 24 12:42:02.791173 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 751/1503] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:02 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:03.230925 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cc3b50f5-b0d3-4afc-bf01-5e666534cb67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:03.232949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cc3b50f5-b0d3-4afc-bf01-5e666534cb67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:03.239783 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc3b50f5-b0d3-4afc-bf01-5e666534cb67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:03.240252 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc3b50f5-b0d3-4afc-bf01-5e666534cb67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:03.240686 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc3b50f5-b0d3-4afc-bf01-5e666534cb67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:03.241362 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc3b50f5-b0d3-4afc-bf01-5e666534cb67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:03.241810 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc3b50f5-b0d3-4afc-bf01-5e666534cb67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:03.242229 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc3b50f5-b0d3-4afc-bf01-5e666534cb67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:03.270640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cc3b50f5-b0d3-4afc-bf01-5e666534cb67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044239 Aug 24 12:42:03.271194 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 753/1504] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:03 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:03.656957 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-25e306b4-5ff4-4025-89ac-b6a6e25421f3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:03.659112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-25e306b4-5ff4-4025-89ac-b6a6e25421f3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:03.665996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-25e306b4-5ff4-4025-89ac-b6a6e25421f3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:03.666481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-25e306b4-5ff4-4025-89ac-b6a6e25421f3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:03.666953 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-25e306b4-5ff4-4025-89ac-b6a6e25421f3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:03.667644 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-25e306b4-5ff4-4025-89ac-b6a6e25421f3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:03.668100 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-25e306b4-5ff4-4025-89ac-b6a6e25421f3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:03.668518 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-25e306b4-5ff4-4025-89ac-b6a6e25421f3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:03.696822 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-25e306b4-5ff4-4025-89ac-b6a6e25421f3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043933 Aug 24 12:42:03.697359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 752/1505] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:03 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:03.807090 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9bb9b7f0-1368-40a4-bc26-a994e85568ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:03.809199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9bb9b7f0-1368-40a4-bc26-a994e85568ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:03.815429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bb9b7f0-1368-40a4-bc26-a994e85568ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:03.815901 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bb9b7f0-1368-40a4-bc26-a994e85568ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:03.816893 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bb9b7f0-1368-40a4-bc26-a994e85568ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:03.817568 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bb9b7f0-1368-40a4-bc26-a994e85568ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:03.818016 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bb9b7f0-1368-40a4-bc26-a994e85568ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:03.818432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bb9b7f0-1368-40a4-bc26-a994e85568ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:03.847765 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9bb9b7f0-1368-40a4-bc26-a994e85568ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044698 Aug 24 12:42:03.848302 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 754/1506] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:03 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:04.282363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e7e6ca2f-a8d5-48c4-b401-caadf61fd91a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:04.284558 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e7e6ca2f-a8d5-48c4-b401-caadf61fd91a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:04.290496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e7e6ca2f-a8d5-48c4-b401-caadf61fd91a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:04.291012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e7e6ca2f-a8d5-48c4-b401-caadf61fd91a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:04.291452 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e7e6ca2f-a8d5-48c4-b401-caadf61fd91a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:04.292143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e7e6ca2f-a8d5-48c4-b401-caadf61fd91a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:04.292600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e7e6ca2f-a8d5-48c4-b401-caadf61fd91a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:04.293029 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e7e6ca2f-a8d5-48c4-b401-caadf61fd91a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:04.322614 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e7e6ca2f-a8d5-48c4-b401-caadf61fd91a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044158 Aug 24 12:42:04.323309 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 753/1507] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:04 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:04.709158 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-82558ddb-7af5-4d99-a7ad-220afff3c692 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:04.711376 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-82558ddb-7af5-4d99-a7ad-220afff3c692 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:04.717263 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82558ddb-7af5-4d99-a7ad-220afff3c692 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:04.717768 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82558ddb-7af5-4d99-a7ad-220afff3c692 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:04.718200 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82558ddb-7af5-4d99-a7ad-220afff3c692 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:04.718904 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82558ddb-7af5-4d99-a7ad-220afff3c692 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:04.719356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82558ddb-7af5-4d99-a7ad-220afff3c692 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:04.719777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82558ddb-7af5-4d99-a7ad-220afff3c692 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:04.748934 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-82558ddb-7af5-4d99-a7ad-220afff3c692 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043779 Aug 24 12:42:04.749459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 755/1508] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:04 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:04.860363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8135434f-d345-45a5-be17-c67661012b87 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:04.862439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8135434f-d345-45a5-be17-c67661012b87 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:04.869038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8135434f-d345-45a5-be17-c67661012b87 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:04.869509 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8135434f-d345-45a5-be17-c67661012b87 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:04.869939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8135434f-d345-45a5-be17-c67661012b87 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:04.870613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8135434f-d345-45a5-be17-c67661012b87 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:04.871086 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8135434f-d345-45a5-be17-c67661012b87 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:04.871502 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8135434f-d345-45a5-be17-c67661012b87 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:04.899974 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8135434f-d345-45a5-be17-c67661012b87 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043728 Aug 24 12:42:04.900501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 754/1509] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:04 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:05.335433 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5f7de3c7-c271-4b03-b8a2-a5df0b456be9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:05.337551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5f7de3c7-c271-4b03-b8a2-a5df0b456be9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:05.344001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5f7de3c7-c271-4b03-b8a2-a5df0b456be9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:05.344478 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5f7de3c7-c271-4b03-b8a2-a5df0b456be9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:05.344911 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5f7de3c7-c271-4b03-b8a2-a5df0b456be9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:05.345595 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5f7de3c7-c271-4b03-b8a2-a5df0b456be9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:05.346043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5f7de3c7-c271-4b03-b8a2-a5df0b456be9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:05.346464 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5f7de3c7-c271-4b03-b8a2-a5df0b456be9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:05.374585 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5f7de3c7-c271-4b03-b8a2-a5df0b456be9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043718 Aug 24 12:42:05.375149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 756/1510] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:05 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:05.761059 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-db0c7be4-eba0-45d4-990d-ed8e32ee0c8a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:05.763222 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-db0c7be4-eba0-45d4-990d-ed8e32ee0c8a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:05.769187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db0c7be4-eba0-45d4-990d-ed8e32ee0c8a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:05.770152 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db0c7be4-eba0-45d4-990d-ed8e32ee0c8a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:05.770581 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db0c7be4-eba0-45d4-990d-ed8e32ee0c8a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:05.771282 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db0c7be4-eba0-45d4-990d-ed8e32ee0c8a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:05.771730 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db0c7be4-eba0-45d4-990d-ed8e32ee0c8a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:05.772149 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db0c7be4-eba0-45d4-990d-ed8e32ee0c8a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:05.800145 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-db0c7be4-eba0-45d4-990d-ed8e32ee0c8a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043055 Aug 24 12:42:05.800700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 755/1511] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:05 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:05.912973 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c409dcef-4325-4d14-9fd9-b5485204f00f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:05.915146 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c409dcef-4325-4d14-9fd9-b5485204f00f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:05.921023 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c409dcef-4325-4d14-9fd9-b5485204f00f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:05.921507 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c409dcef-4325-4d14-9fd9-b5485204f00f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:05.921941 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c409dcef-4325-4d14-9fd9-b5485204f00f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:05.922685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c409dcef-4325-4d14-9fd9-b5485204f00f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:05.923133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c409dcef-4325-4d14-9fd9-b5485204f00f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:05.923553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c409dcef-4325-4d14-9fd9-b5485204f00f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:05.953335 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c409dcef-4325-4d14-9fd9-b5485204f00f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045040 Aug 24 12:42:05.953879 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 757/1512] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:05 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:06.387272 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0a92939a-ff1a-4ba2-8358-bfbf604aaf7a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:06.389456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0a92939a-ff1a-4ba2-8358-bfbf604aaf7a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:06.395784 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a92939a-ff1a-4ba2-8358-bfbf604aaf7a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:06.396267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a92939a-ff1a-4ba2-8358-bfbf604aaf7a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:06.396710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a92939a-ff1a-4ba2-8358-bfbf604aaf7a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:06.397403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a92939a-ff1a-4ba2-8358-bfbf604aaf7a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:06.397861 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a92939a-ff1a-4ba2-8358-bfbf604aaf7a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:06.398288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a92939a-ff1a-4ba2-8358-bfbf604aaf7a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:06.428348 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0a92939a-ff1a-4ba2-8358-bfbf604aaf7a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044934 Aug 24 12:42:06.429363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 756/1513] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:06 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:06.813683 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9b7c844c-62e9-4ee8-bf35-1077553f0ec5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:06.815777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9b7c844c-62e9-4ee8-bf35-1077553f0ec5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:06.822183 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b7c844c-62e9-4ee8-bf35-1077553f0ec5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:06.822666 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b7c844c-62e9-4ee8-bf35-1077553f0ec5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:06.823123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b7c844c-62e9-4ee8-bf35-1077553f0ec5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:06.823804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b7c844c-62e9-4ee8-bf35-1077553f0ec5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:06.824252 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b7c844c-62e9-4ee8-bf35-1077553f0ec5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:06.824672 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b7c844c-62e9-4ee8-bf35-1077553f0ec5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:06.852927 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9b7c844c-62e9-4ee8-bf35-1077553f0ec5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043234 Aug 24 12:42:06.853464 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 758/1514] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:06 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:06.965413 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5a03efd8-683e-49c1-9f3e-682948df4243 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:06.967613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5a03efd8-683e-49c1-9f3e-682948df4243 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:06.973978 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5a03efd8-683e-49c1-9f3e-682948df4243 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:06.974460 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5a03efd8-683e-49c1-9f3e-682948df4243 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:06.974921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5a03efd8-683e-49c1-9f3e-682948df4243 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:06.975608 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5a03efd8-683e-49c1-9f3e-682948df4243 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:06.976059 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5a03efd8-683e-49c1-9f3e-682948df4243 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:06.976482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5a03efd8-683e-49c1-9f3e-682948df4243 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:07.005807 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5a03efd8-683e-49c1-9f3e-682948df4243 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044327 Aug 24 12:42:07.006351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 757/1515] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:06 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:07.440531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ade7a3bf-c715-4303-ad41-65e75636b0ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:07.443233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ade7a3bf-c715-4303-ad41-65e75636b0ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:07.449138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ade7a3bf-c715-4303-ad41-65e75636b0ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:07.449636 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ade7a3bf-c715-4303-ad41-65e75636b0ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:07.450051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ade7a3bf-c715-4303-ad41-65e75636b0ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:07.450767 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ade7a3bf-c715-4303-ad41-65e75636b0ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:07.451222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ade7a3bf-c715-4303-ad41-65e75636b0ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:07.451646 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ade7a3bf-c715-4303-ad41-65e75636b0ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:07.480078 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ade7a3bf-c715-4303-ad41-65e75636b0ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043627 Aug 24 12:42:07.480609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 759/1516] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:07 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:07.865754 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f2d41ce1-4375-4688-87cb-f9c792254bd9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:07.868239 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f2d41ce1-4375-4688-87cb-f9c792254bd9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:07.875200 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2d41ce1-4375-4688-87cb-f9c792254bd9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:07.875681 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2d41ce1-4375-4688-87cb-f9c792254bd9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:07.876116 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2d41ce1-4375-4688-87cb-f9c792254bd9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:07.876813 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2d41ce1-4375-4688-87cb-f9c792254bd9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:07.877266 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2d41ce1-4375-4688-87cb-f9c792254bd9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:07.877688 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2d41ce1-4375-4688-87cb-f9c792254bd9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:07.905818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f2d41ce1-4375-4688-87cb-f9c792254bd9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044742 Aug 24 12:42:07.906344 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 758/1517] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:07 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:08.017939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-86ba6789-73c3-42c4-9e30-efecb78be2ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:08.020303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-86ba6789-73c3-42c4-9e30-efecb78be2ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:08.026607 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86ba6789-73c3-42c4-9e30-efecb78be2ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:08.027116 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86ba6789-73c3-42c4-9e30-efecb78be2ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:08.027553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86ba6789-73c3-42c4-9e30-efecb78be2ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:08.028239 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86ba6789-73c3-42c4-9e30-efecb78be2ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:08.028689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86ba6789-73c3-42c4-9e30-efecb78be2ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:08.029109 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86ba6789-73c3-42c4-9e30-efecb78be2ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:08.057464 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-86ba6789-73c3-42c4-9e30-efecb78be2ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043967 Aug 24 12:42:08.058012 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 760/1518] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:08 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:08.492926 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-44969a45-a7f0-45b4-a125-297159e9fa54 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:08.495143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-44969a45-a7f0-45b4-a125-297159e9fa54 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:08.505416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-44969a45-a7f0-45b4-a125-297159e9fa54 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:08.506263 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-44969a45-a7f0-45b4-a125-297159e9fa54 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:08.507060 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-44969a45-a7f0-45b4-a125-297159e9fa54 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:08.508329 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-44969a45-a7f0-45b4-a125-297159e9fa54 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:08.508628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-44969a45-a7f0-45b4-a125-297159e9fa54 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:08.509057 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-44969a45-a7f0-45b4-a125-297159e9fa54 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:08.538948 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-44969a45-a7f0-45b4-a125-297159e9fa54 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050638 Aug 24 12:42:08.539494 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 759/1519] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:08 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:08.917971 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8f1d67b9-0c9f-459f-9834-c5ff8486d3e9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:08.920096 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8f1d67b9-0c9f-459f-9834-c5ff8486d3e9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:08.925897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f1d67b9-0c9f-459f-9834-c5ff8486d3e9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:08.927025 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f1d67b9-0c9f-459f-9834-c5ff8486d3e9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:08.927456 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f1d67b9-0c9f-459f-9834-c5ff8486d3e9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:08.928130 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f1d67b9-0c9f-459f-9834-c5ff8486d3e9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:08.928574 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f1d67b9-0c9f-459f-9834-c5ff8486d3e9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:08.928990 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f1d67b9-0c9f-459f-9834-c5ff8486d3e9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:08.957493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8f1d67b9-0c9f-459f-9834-c5ff8486d3e9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043485 Aug 24 12:42:08.958033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 761/1520] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:08 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:09.069496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4e8d3616-f27b-45ec-b9e6-fe45ffe1d15c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:09.071658 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4e8d3616-f27b-45ec-b9e6-fe45ffe1d15c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:09.077935 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e8d3616-f27b-45ec-b9e6-fe45ffe1d15c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:09.078418 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e8d3616-f27b-45ec-b9e6-fe45ffe1d15c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:09.078895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e8d3616-f27b-45ec-b9e6-fe45ffe1d15c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:09.079588 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e8d3616-f27b-45ec-b9e6-fe45ffe1d15c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:09.080042 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e8d3616-f27b-45ec-b9e6-fe45ffe1d15c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:09.080467 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e8d3616-f27b-45ec-b9e6-fe45ffe1d15c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:09.108776 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4e8d3616-f27b-45ec-b9e6-fe45ffe1d15c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043327 Aug 24 12:42:09.109313 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 760/1521] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:09 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:09.551146 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ecb115fb-d8b0-45fc-b26a-62fa1f23e632 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:09.553267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ecb115fb-d8b0-45fc-b26a-62fa1f23e632 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:09.559546 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ecb115fb-d8b0-45fc-b26a-62fa1f23e632 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:09.560024 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ecb115fb-d8b0-45fc-b26a-62fa1f23e632 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:09.560458 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ecb115fb-d8b0-45fc-b26a-62fa1f23e632 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:09.561137 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ecb115fb-d8b0-45fc-b26a-62fa1f23e632 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:09.561587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ecb115fb-d8b0-45fc-b26a-62fa1f23e632 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:09.562010 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ecb115fb-d8b0-45fc-b26a-62fa1f23e632 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:09.590474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ecb115fb-d8b0-45fc-b26a-62fa1f23e632 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043299 Aug 24 12:42:09.591070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 762/1522] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:09 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:09.969641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4eaccc01-4f88-42cc-8ea7-aefa5c6e09d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:09.971825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4eaccc01-4f88-42cc-8ea7-aefa5c6e09d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:09.977753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4eaccc01-4f88-42cc-8ea7-aefa5c6e09d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:09.978228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4eaccc01-4f88-42cc-8ea7-aefa5c6e09d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:09.978678 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4eaccc01-4f88-42cc-8ea7-aefa5c6e09d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:09.979360 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4eaccc01-4f88-42cc-8ea7-aefa5c6e09d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:09.979815 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4eaccc01-4f88-42cc-8ea7-aefa5c6e09d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:09.980233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4eaccc01-4f88-42cc-8ea7-aefa5c6e09d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:10.008422 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4eaccc01-4f88-42cc-8ea7-aefa5c6e09d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042774 Aug 24 12:42:10.008950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 761/1523] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:09 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:10.121107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-09f4bfab-1a19-4842-98a2-970cfba0d104 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:10.123324 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-09f4bfab-1a19-4842-98a2-970cfba0d104 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:10.129865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-09f4bfab-1a19-4842-98a2-970cfba0d104 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:10.130344 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-09f4bfab-1a19-4842-98a2-970cfba0d104 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:10.130820 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-09f4bfab-1a19-4842-98a2-970cfba0d104 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:10.131510 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-09f4bfab-1a19-4842-98a2-970cfba0d104 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:10.132077 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-09f4bfab-1a19-4842-98a2-970cfba0d104 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:10.132509 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-09f4bfab-1a19-4842-98a2-970cfba0d104 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:10.160752 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-09f4bfab-1a19-4842-98a2-970cfba0d104 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043686 Aug 24 12:42:10.161285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 763/1524] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:10 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:10.602619 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-66dcd07e-cbd2-4f58-a928-09bf82d71c62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:10.604770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-66dcd07e-cbd2-4f58-a928-09bf82d71c62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:10.611122 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-66dcd07e-cbd2-4f58-a928-09bf82d71c62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:10.611605 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-66dcd07e-cbd2-4f58-a928-09bf82d71c62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:10.612045 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-66dcd07e-cbd2-4f58-a928-09bf82d71c62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:10.612733 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-66dcd07e-cbd2-4f58-a928-09bf82d71c62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:10.613189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-66dcd07e-cbd2-4f58-a928-09bf82d71c62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:10.613616 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-66dcd07e-cbd2-4f58-a928-09bf82d71c62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:10.642204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-66dcd07e-cbd2-4f58-a928-09bf82d71c62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043657 Aug 24 12:42:10.642764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 762/1525] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:10 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:11.021093 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c210ab0e-480d-47c7-8882-3a3f51309144 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:11.023248 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c210ab0e-480d-47c7-8882-3a3f51309144 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:11.029808 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c210ab0e-480d-47c7-8882-3a3f51309144 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:11.030290 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c210ab0e-480d-47c7-8882-3a3f51309144 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:11.030755 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c210ab0e-480d-47c7-8882-3a3f51309144 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:11.031479 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c210ab0e-480d-47c7-8882-3a3f51309144 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:11.031930 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c210ab0e-480d-47c7-8882-3a3f51309144 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:11.032356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c210ab0e-480d-47c7-8882-3a3f51309144 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:11.061123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c210ab0e-480d-47c7-8882-3a3f51309144 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044487 Aug 24 12:42:11.061661 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 764/1526] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:11 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:11.173463 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-785be263-2194-4207-85dc-0b97a58be483 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:11.175607 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-785be263-2194-4207-85dc-0b97a58be483 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:11.181514 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-785be263-2194-4207-85dc-0b97a58be483 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:11.181989 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-785be263-2194-4207-85dc-0b97a58be483 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:11.182419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-785be263-2194-4207-85dc-0b97a58be483 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:11.183126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-785be263-2194-4207-85dc-0b97a58be483 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:11.183575 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-785be263-2194-4207-85dc-0b97a58be483 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:11.183991 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-785be263-2194-4207-85dc-0b97a58be483 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:11.213923 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-785be263-2194-4207-85dc-0b97a58be483 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044568 Aug 24 12:42:11.214467 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 763/1527] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:11 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:11.655226 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-30114b27-4104-454f-8e88-6d574cbcfa70 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:11.657274 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-30114b27-4104-454f-8e88-6d574cbcfa70 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:11.663201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-30114b27-4104-454f-8e88-6d574cbcfa70 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:11.663680 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-30114b27-4104-454f-8e88-6d574cbcfa70 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:11.664119 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-30114b27-4104-454f-8e88-6d574cbcfa70 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:11.664808 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-30114b27-4104-454f-8e88-6d574cbcfa70 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:11.665262 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-30114b27-4104-454f-8e88-6d574cbcfa70 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:11.665689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-30114b27-4104-454f-8e88-6d574cbcfa70 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:11.694727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-30114b27-4104-454f-8e88-6d574cbcfa70 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043706 Aug 24 12:42:11.695269 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 765/1528] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:11 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:12.073052 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-70a6db3a-7c55-4558-8fdd-4da124e61a53 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:12.075209 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-70a6db3a-7c55-4558-8fdd-4da124e61a53 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:12.081513 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70a6db3a-7c55-4558-8fdd-4da124e61a53 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:12.081996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70a6db3a-7c55-4558-8fdd-4da124e61a53 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:12.082430 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70a6db3a-7c55-4558-8fdd-4da124e61a53 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:12.083146 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70a6db3a-7c55-4558-8fdd-4da124e61a53 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:12.083600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70a6db3a-7c55-4558-8fdd-4da124e61a53 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:12.084025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70a6db3a-7c55-4558-8fdd-4da124e61a53 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:12.112073 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-70a6db3a-7c55-4558-8fdd-4da124e61a53 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043010 Aug 24 12:42:12.112609 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 764/1529] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:12 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:12.225963 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2055567f-98b5-467e-a431-09bd745b909c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:12.228190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2055567f-98b5-467e-a431-09bd745b909c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:12.234474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2055567f-98b5-467e-a431-09bd745b909c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:12.234986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2055567f-98b5-467e-a431-09bd745b909c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:12.235425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2055567f-98b5-467e-a431-09bd745b909c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:12.236110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2055567f-98b5-467e-a431-09bd745b909c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:12.236562 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2055567f-98b5-467e-a431-09bd745b909c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:12.236986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2055567f-98b5-467e-a431-09bd745b909c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:12.265950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2055567f-98b5-467e-a431-09bd745b909c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044444 Aug 24 12:42:12.266492 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 766/1530] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:12 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:12.706228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-87564ada-3758-4878-a157-ff1b1e8151e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:12.709180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-87564ada-3758-4878-a157-ff1b1e8151e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:12.715107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-87564ada-3758-4878-a157-ff1b1e8151e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:12.715593 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-87564ada-3758-4878-a157-ff1b1e8151e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:12.716028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-87564ada-3758-4878-a157-ff1b1e8151e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:12.716725 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-87564ada-3758-4878-a157-ff1b1e8151e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:12.717182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-87564ada-3758-4878-a157-ff1b1e8151e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:12.717609 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-87564ada-3758-4878-a157-ff1b1e8151e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:12.746334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-87564ada-3758-4878-a157-ff1b1e8151e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044092 Aug 24 12:42:12.746904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 765/1531] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:12 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:13.125199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-84474515-5392-4d14-8d66-6585d804c243 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:13.127364 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-84474515-5392-4d14-8d66-6585d804c243 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:13.133889 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-84474515-5392-4d14-8d66-6585d804c243 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:13.134364 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-84474515-5392-4d14-8d66-6585d804c243 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:13.134844 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-84474515-5392-4d14-8d66-6585d804c243 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:13.135525 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-84474515-5392-4d14-8d66-6585d804c243 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:13.135975 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-84474515-5392-4d14-8d66-6585d804c243 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:13.136426 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-84474515-5392-4d14-8d66-6585d804c243 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:13.163884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-84474515-5392-4d14-8d66-6585d804c243 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042693 Aug 24 12:42:13.164428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 767/1532] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:13 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:13.278536 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5a2b26d5-cade-42a9-9899-1b49924e6380 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:13.280705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5a2b26d5-cade-42a9-9899-1b49924e6380 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:13.287095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5a2b26d5-cade-42a9-9899-1b49924e6380 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:13.288596 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5a2b26d5-cade-42a9-9899-1b49924e6380 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:13.289052 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5a2b26d5-cade-42a9-9899-1b49924e6380 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:13.289742 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5a2b26d5-cade-42a9-9899-1b49924e6380 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:13.290198 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5a2b26d5-cade-42a9-9899-1b49924e6380 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:13.290623 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5a2b26d5-cade-42a9-9899-1b49924e6380 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:13.304409 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:13.320105 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5a2b26d5-cade-42a9-9899-1b49924e6380 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045496 Aug 24 12:42:13.320655 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 766/1533] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:13 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:13.759219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-108c5dca-bf6c-43aa-a935-c0eda7423e89 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:13.761334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-108c5dca-bf6c-43aa-a935-c0eda7423e89 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:13.767770 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-108c5dca-bf6c-43aa-a935-c0eda7423e89 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:13.768253 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-108c5dca-bf6c-43aa-a935-c0eda7423e89 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:13.768685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-108c5dca-bf6c-43aa-a935-c0eda7423e89 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:13.769370 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-108c5dca-bf6c-43aa-a935-c0eda7423e89 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:13.769817 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-108c5dca-bf6c-43aa-a935-c0eda7423e89 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:13.770241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-108c5dca-bf6c-43aa-a935-c0eda7423e89 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:13.798747 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-108c5dca-bf6c-43aa-a935-c0eda7423e89 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044018 Aug 24 12:42:13.799302 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 768/1534] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:13 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:14.181095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-11658d3f-83bd-4e74-8a9d-5af37c773b47 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:14.181095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-11658d3f-83bd-4e74-8a9d-5af37c773b47 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:14.185078 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11658d3f-83bd-4e74-8a9d-5af37c773b47 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:14.185561 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11658d3f-83bd-4e74-8a9d-5af37c773b47 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:14.186001 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11658d3f-83bd-4e74-8a9d-5af37c773b47 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:14.186714 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11658d3f-83bd-4e74-8a9d-5af37c773b47 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:14.187196 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11658d3f-83bd-4e74-8a9d-5af37c773b47 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:14.187621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11658d3f-83bd-4e74-8a9d-5af37c773b47 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:14.221871 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-11658d3f-83bd-4e74-8a9d-5af37c773b47 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049765 Aug 24 12:42:14.222417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 767/1535] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:14 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:14.332828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-642bd69b-cd62-455d-9ce7-bc8ca46fb081 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:14.335134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-642bd69b-cd62-455d-9ce7-bc8ca46fb081 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:14.340937 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-642bd69b-cd62-455d-9ce7-bc8ca46fb081 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:14.341408 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-642bd69b-cd62-455d-9ce7-bc8ca46fb081 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:14.341838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-642bd69b-cd62-455d-9ce7-bc8ca46fb081 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:14.342511 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-642bd69b-cd62-455d-9ce7-bc8ca46fb081 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:14.342986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-642bd69b-cd62-455d-9ce7-bc8ca46fb081 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:14.343402 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-642bd69b-cd62-455d-9ce7-bc8ca46fb081 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:14.346950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:14.373220 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-642bd69b-cd62-455d-9ce7-bc8ca46fb081 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044515 Aug 24 12:42:14.373883 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 769/1536] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:14 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:14.810997 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-061558f2-40aa-435f-a8b6-631549b78b26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:14.813167 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-061558f2-40aa-435f-a8b6-631549b78b26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:14.819783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-061558f2-40aa-435f-a8b6-631549b78b26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:14.820276 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-061558f2-40aa-435f-a8b6-631549b78b26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:14.820722 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-061558f2-40aa-435f-a8b6-631549b78b26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:14.821434 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-061558f2-40aa-435f-a8b6-631549b78b26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:14.821889 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-061558f2-40aa-435f-a8b6-631549b78b26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:14.822316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-061558f2-40aa-435f-a8b6-631549b78b26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:14.851694 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-061558f2-40aa-435f-a8b6-631549b78b26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044776 Aug 24 12:42:14.852241 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 768/1537] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:14 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:15.233825 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-65fe56be-d63c-4560-9a64-d4878648b6a6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:15.236117 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-65fe56be-d63c-4560-9a64-d4878648b6a6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:15.243384 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-65fe56be-d63c-4560-9a64-d4878648b6a6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:15.243863 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-65fe56be-d63c-4560-9a64-d4878648b6a6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:15.244294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-65fe56be-d63c-4560-9a64-d4878648b6a6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:15.244975 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-65fe56be-d63c-4560-9a64-d4878648b6a6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:15.245426 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-65fe56be-d63c-4560-9a64-d4878648b6a6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:15.245847 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-65fe56be-d63c-4560-9a64-d4878648b6a6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:15.275024 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-65fe56be-d63c-4560-9a64-d4878648b6a6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045111 Aug 24 12:42:15.275566 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 770/1538] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:15 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:15.385936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2a9533d7-8adc-42e6-b7bf-62340e57523d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:15.388077 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2a9533d7-8adc-42e6-b7bf-62340e57523d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:15.393945 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a9533d7-8adc-42e6-b7bf-62340e57523d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:15.394425 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a9533d7-8adc-42e6-b7bf-62340e57523d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:15.394892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a9533d7-8adc-42e6-b7bf-62340e57523d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:15.396171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a9533d7-8adc-42e6-b7bf-62340e57523d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:15.396617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a9533d7-8adc-42e6-b7bf-62340e57523d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:15.397036 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a9533d7-8adc-42e6-b7bf-62340e57523d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:15.425110 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2a9533d7-8adc-42e6-b7bf-62340e57523d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043124 Aug 24 12:42:15.425652 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 769/1539] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:15 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:15.552130 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ce95fc13-8c17-4f37-b8e1-40658e7d55d0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:15.552677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ce95fc13-8c17-4f37-b8e1-40658e7d55d0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:15.558359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce95fc13-8c17-4f37-b8e1-40658e7d55d0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:15.565570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce95fc13-8c17-4f37-b8e1-40658e7d55d0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:15.565570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce95fc13-8c17-4f37-b8e1-40658e7d55d0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:15.565570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce95fc13-8c17-4f37-b8e1-40658e7d55d0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:15.565570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce95fc13-8c17-4f37-b8e1-40658e7d55d0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:15.566213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce95fc13-8c17-4f37-b8e1-40658e7d55d0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:15.598893 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3229bf15-72bd-458d-9b1a-786f4eac7ebc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:15.601024 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3229bf15-72bd-458d-9b1a-786f4eac7ebc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:15.607107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3229bf15-72bd-458d-9b1a-786f4eac7ebc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:15.607590 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3229bf15-72bd-458d-9b1a-786f4eac7ebc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:15.608024 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3229bf15-72bd-458d-9b1a-786f4eac7ebc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:15.608697 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3229bf15-72bd-458d-9b1a-786f4eac7ebc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:15.609149 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3229bf15-72bd-458d-9b1a-786f4eac7ebc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:15.609662 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3229bf15-72bd-458d-9b1a-786f4eac7ebc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:15.639214 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3229bf15-72bd-458d-9b1a-786f4eac7ebc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044406 Aug 24 12:42:15.639758 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 770/1540] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:15 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:15.704193 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.objects.instance [None req-ce95fc13-8c17-4f37-b8e1-40658e7d55d0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lazy-loading 'services' on Instance uuid b9fbb4c1-a035-462e-b287-be4131984b09 {{(pid=121171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:42:15.864557 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-494eb316-a6a9-4bb0-8397-a4402bb1c90b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:15.866787 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-494eb316-a6a9-4bb0-8397-a4402bb1c90b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:15.873271 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-494eb316-a6a9-4bb0-8397-a4402bb1c90b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:15.873753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-494eb316-a6a9-4bb0-8397-a4402bb1c90b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:15.874192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-494eb316-a6a9-4bb0-8397-a4402bb1c90b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:15.874971 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-494eb316-a6a9-4bb0-8397-a4402bb1c90b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:15.875428 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-494eb316-a6a9-4bb0-8397-a4402bb1c90b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:15.875857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-494eb316-a6a9-4bb0-8397-a4402bb1c90b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:15.905919 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ce95fc13-8c17-4f37-b8e1-40658e7d55d0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09/os-volume_attachments/993d2a0c-8e3d-4e96-946f-a191346775b9" status: 202 len: 0 microversion: 2.1 time: 0.357565 Aug 24 12:42:15.906751 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 771/1541] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 24 12:42:15 2022] DELETE /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09/os-volume_attachments/993d2a0c-8e3d-4e96-946f-a191346775b9 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:42:15.907578 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-494eb316-a6a9-4bb0-8397-a4402bb1c90b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047693 Aug 24 12:42:15.908131 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 771/1542] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:15 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:42:16.287680 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-04eba4f7-7f6e-4ee6-bf13-f65549640e14 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:16.290000 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-04eba4f7-7f6e-4ee6-bf13-f65549640e14 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:16.296089 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04eba4f7-7f6e-4ee6-bf13-f65549640e14 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:16.296563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04eba4f7-7f6e-4ee6-bf13-f65549640e14 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:16.296989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04eba4f7-7f6e-4ee6-bf13-f65549640e14 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:16.297661 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04eba4f7-7f6e-4ee6-bf13-f65549640e14 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:16.298103 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04eba4f7-7f6e-4ee6-bf13-f65549640e14 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:16.298517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04eba4f7-7f6e-4ee6-bf13-f65549640e14 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:16.327242 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-04eba4f7-7f6e-4ee6-bf13-f65549640e14 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044714 Aug 24 12:42:16.327707 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 772/1543] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:16 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:16.436637 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1baa1613-a34d-4bcc-bd0f-4135e1b9ac48 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:16.438770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1baa1613-a34d-4bcc-bd0f-4135e1b9ac48 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:16.444746 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1baa1613-a34d-4bcc-bd0f-4135e1b9ac48 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:16.445250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1baa1613-a34d-4bcc-bd0f-4135e1b9ac48 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:16.445742 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1baa1613-a34d-4bcc-bd0f-4135e1b9ac48 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:16.446480 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1baa1613-a34d-4bcc-bd0f-4135e1b9ac48 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:16.447002 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1baa1613-a34d-4bcc-bd0f-4135e1b9ac48 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:16.447553 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1baa1613-a34d-4bcc-bd0f-4135e1b9ac48 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:16.477079 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1baa1613-a34d-4bcc-bd0f-4135e1b9ac48 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044485 Aug 24 12:42:16.477612 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 772/1544] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:16 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:16.651984 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8d6a06e2-5179-425a-a466-c90c47bd5308 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:16.654070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8d6a06e2-5179-425a-a466-c90c47bd5308 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:16.660386 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8d6a06e2-5179-425a-a466-c90c47bd5308 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:16.661496 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8d6a06e2-5179-425a-a466-c90c47bd5308 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:16.661936 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8d6a06e2-5179-425a-a466-c90c47bd5308 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:16.662623 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8d6a06e2-5179-425a-a466-c90c47bd5308 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:16.663102 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8d6a06e2-5179-425a-a466-c90c47bd5308 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:16.663529 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8d6a06e2-5179-425a-a466-c90c47bd5308 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:16.691181 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8d6a06e2-5179-425a-a466-c90c47bd5308 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043250 Aug 24 12:42:16.691711 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 773/1545] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:16 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:16.919274 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8c3e03b7-2178-4f41-a0e1-21fa76f0cb2a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:16.921356 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8c3e03b7-2178-4f41-a0e1-21fa76f0cb2a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:16.927592 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8c3e03b7-2178-4f41-a0e1-21fa76f0cb2a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:16.928075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8c3e03b7-2178-4f41-a0e1-21fa76f0cb2a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:16.928508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8c3e03b7-2178-4f41-a0e1-21fa76f0cb2a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:16.929187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8c3e03b7-2178-4f41-a0e1-21fa76f0cb2a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:16.929743 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8c3e03b7-2178-4f41-a0e1-21fa76f0cb2a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:16.930170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8c3e03b7-2178-4f41-a0e1-21fa76f0cb2a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:16.958868 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8c3e03b7-2178-4f41-a0e1-21fa76f0cb2a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043585 Aug 24 12:42:16.959393 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 773/1546] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:16 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:17.339317 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7af9c805-9c0a-465a-8bdf-23d62be21ed1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:17.341530 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7af9c805-9c0a-465a-8bdf-23d62be21ed1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:17.347401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7af9c805-9c0a-465a-8bdf-23d62be21ed1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:17.347878 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7af9c805-9c0a-465a-8bdf-23d62be21ed1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:17.348313 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7af9c805-9c0a-465a-8bdf-23d62be21ed1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:17.348995 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7af9c805-9c0a-465a-8bdf-23d62be21ed1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:17.349439 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7af9c805-9c0a-465a-8bdf-23d62be21ed1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:17.349859 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7af9c805-9c0a-465a-8bdf-23d62be21ed1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:17.378167 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7af9c805-9c0a-465a-8bdf-23d62be21ed1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042813 Aug 24 12:42:17.378718 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 774/1547] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:17 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:17.490182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1e626a95-0524-4669-9243-fe27da8e1111 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:17.492377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1e626a95-0524-4669-9243-fe27da8e1111 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:17.498273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e626a95-0524-4669-9243-fe27da8e1111 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:17.498776 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e626a95-0524-4669-9243-fe27da8e1111 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:17.499209 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e626a95-0524-4669-9243-fe27da8e1111 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:17.499891 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e626a95-0524-4669-9243-fe27da8e1111 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:17.500339 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e626a95-0524-4669-9243-fe27da8e1111 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:17.500754 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e626a95-0524-4669-9243-fe27da8e1111 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:17.529756 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1e626a95-0524-4669-9243-fe27da8e1111 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044438 Aug 24 12:42:17.530288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 774/1548] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:17 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:17.703292 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e1b2fb17-f91c-45ff-a95e-9f58a6c0784c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:17.705328 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e1b2fb17-f91c-45ff-a95e-9f58a6c0784c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:17.711543 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1b2fb17-f91c-45ff-a95e-9f58a6c0784c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:17.712014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1b2fb17-f91c-45ff-a95e-9f58a6c0784c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:17.712442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1b2fb17-f91c-45ff-a95e-9f58a6c0784c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:17.713119 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1b2fb17-f91c-45ff-a95e-9f58a6c0784c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:17.713563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1b2fb17-f91c-45ff-a95e-9f58a6c0784c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:17.713981 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1b2fb17-f91c-45ff-a95e-9f58a6c0784c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:17.742527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e1b2fb17-f91c-45ff-a95e-9f58a6c0784c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043295 Aug 24 12:42:17.743198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 775/1549] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:17 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:17.971119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0c8c04c2-124a-4fea-b5f7-137b00a4009b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:17.973198 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0c8c04c2-124a-4fea-b5f7-137b00a4009b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:17.980047 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0c8c04c2-124a-4fea-b5f7-137b00a4009b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:17.980526 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0c8c04c2-124a-4fea-b5f7-137b00a4009b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:17.980960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0c8c04c2-124a-4fea-b5f7-137b00a4009b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:17.981644 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0c8c04c2-124a-4fea-b5f7-137b00a4009b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:17.982251 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0c8c04c2-124a-4fea-b5f7-137b00a4009b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:17.982930 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0c8c04c2-124a-4fea-b5f7-137b00a4009b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:18.019854 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0c8c04c2-124a-4fea-b5f7-137b00a4009b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052963 Aug 24 12:42:18.020388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 775/1550] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:17 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:18.390978 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ab0177f3-16aa-4ab3-9f49-835fee89a57d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:18.393168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ab0177f3-16aa-4ab3-9f49-835fee89a57d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:18.399529 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab0177f3-16aa-4ab3-9f49-835fee89a57d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:18.400006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab0177f3-16aa-4ab3-9f49-835fee89a57d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:18.400440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab0177f3-16aa-4ab3-9f49-835fee89a57d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:18.401125 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab0177f3-16aa-4ab3-9f49-835fee89a57d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:18.401570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab0177f3-16aa-4ab3-9f49-835fee89a57d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:18.401995 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab0177f3-16aa-4ab3-9f49-835fee89a57d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:18.431070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ab0177f3-16aa-4ab3-9f49-835fee89a57d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044056 Aug 24 12:42:18.431622 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 776/1551] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:18 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:18.541921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c776a9e0-99e4-48c4-b89b-d503c2447c31 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:18.544286 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c776a9e0-99e4-48c4-b89b-d503c2447c31 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:18.550208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c776a9e0-99e4-48c4-b89b-d503c2447c31 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:18.550722 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c776a9e0-99e4-48c4-b89b-d503c2447c31 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:18.551160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c776a9e0-99e4-48c4-b89b-d503c2447c31 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:18.551848 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c776a9e0-99e4-48c4-b89b-d503c2447c31 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:18.552302 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c776a9e0-99e4-48c4-b89b-d503c2447c31 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:18.552726 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c776a9e0-99e4-48c4-b89b-d503c2447c31 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:18.580416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c776a9e0-99e4-48c4-b89b-d503c2447c31 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042593 Aug 24 12:42:18.580968 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 776/1552] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:18 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:18.755151 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2a85b733-f785-4111-909a-92ffc03ecb42 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:18.757323 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2a85b733-f785-4111-909a-92ffc03ecb42 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:18.763670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a85b733-f785-4111-909a-92ffc03ecb42 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:18.764145 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a85b733-f785-4111-909a-92ffc03ecb42 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:18.764583 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a85b733-f785-4111-909a-92ffc03ecb42 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:18.765268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a85b733-f785-4111-909a-92ffc03ecb42 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:18.765717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a85b733-f785-4111-909a-92ffc03ecb42 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:18.766138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a85b733-f785-4111-909a-92ffc03ecb42 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:18.794681 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2a85b733-f785-4111-909a-92ffc03ecb42 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043466 Aug 24 12:42:18.795222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 777/1553] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:18 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:19.031931 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9ebef0cc-d34a-4252-86d2-f9cc41eeb313 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:19.034002 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9ebef0cc-d34a-4252-86d2-f9cc41eeb313 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:19.040961 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ebef0cc-d34a-4252-86d2-f9cc41eeb313 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:19.041446 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ebef0cc-d34a-4252-86d2-f9cc41eeb313 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:19.041919 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ebef0cc-d34a-4252-86d2-f9cc41eeb313 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:19.042578 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ebef0cc-d34a-4252-86d2-f9cc41eeb313 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:19.043064 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ebef0cc-d34a-4252-86d2-f9cc41eeb313 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:19.043494 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ebef0cc-d34a-4252-86d2-f9cc41eeb313 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:19.071404 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9ebef0cc-d34a-4252-86d2-f9cc41eeb313 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043570 Aug 24 12:42:19.071939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 777/1554] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:19 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:19.442710 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4be702a4-88ea-4e5e-9914-ebfe9c4efd9a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:19.444865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4be702a4-88ea-4e5e-9914-ebfe9c4efd9a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:19.450777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4be702a4-88ea-4e5e-9914-ebfe9c4efd9a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:19.451261 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4be702a4-88ea-4e5e-9914-ebfe9c4efd9a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:19.451701 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4be702a4-88ea-4e5e-9914-ebfe9c4efd9a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:19.452384 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4be702a4-88ea-4e5e-9914-ebfe9c4efd9a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:19.452840 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4be702a4-88ea-4e5e-9914-ebfe9c4efd9a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:19.453262 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4be702a4-88ea-4e5e-9914-ebfe9c4efd9a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:19.482258 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4be702a4-88ea-4e5e-9914-ebfe9c4efd9a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043553 Aug 24 12:42:19.482824 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 778/1555] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:19 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:19.592690 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7f1aaf4c-7e45-4d71-8e59-8977a3e582f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:19.594864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7f1aaf4c-7e45-4d71-8e59-8977a3e582f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:19.601147 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7f1aaf4c-7e45-4d71-8e59-8977a3e582f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:19.601619 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7f1aaf4c-7e45-4d71-8e59-8977a3e582f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:19.602067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7f1aaf4c-7e45-4d71-8e59-8977a3e582f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:19.602775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7f1aaf4c-7e45-4d71-8e59-8977a3e582f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:19.603225 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7f1aaf4c-7e45-4d71-8e59-8977a3e582f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:19.603644 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7f1aaf4c-7e45-4d71-8e59-8977a3e582f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:19.633103 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7f1aaf4c-7e45-4d71-8e59-8977a3e582f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044363 Aug 24 12:42:19.633639 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 778/1556] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:19 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:19.806713 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-daba863c-a941-430b-88fc-a461ca8ff155 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:19.808852 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-daba863c-a941-430b-88fc-a461ca8ff155 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:19.815195 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-daba863c-a941-430b-88fc-a461ca8ff155 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:19.815682 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-daba863c-a941-430b-88fc-a461ca8ff155 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:19.816120 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-daba863c-a941-430b-88fc-a461ca8ff155 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:19.816810 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-daba863c-a941-430b-88fc-a461ca8ff155 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:19.817264 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-daba863c-a941-430b-88fc-a461ca8ff155 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:19.817696 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-daba863c-a941-430b-88fc-a461ca8ff155 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:19.846482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-daba863c-a941-430b-88fc-a461ca8ff155 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043767 Aug 24 12:42:19.847066 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 779/1557] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:19 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:20.083771 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fc792b75-b26a-47e9-a7dd-794c5736027e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:20.085865 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fc792b75-b26a-47e9-a7dd-794c5736027e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:20.092349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc792b75-b26a-47e9-a7dd-794c5736027e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:20.092855 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc792b75-b26a-47e9-a7dd-794c5736027e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:20.093289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc792b75-b26a-47e9-a7dd-794c5736027e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:20.093972 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc792b75-b26a-47e9-a7dd-794c5736027e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:20.094425 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc792b75-b26a-47e9-a7dd-794c5736027e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:20.094876 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc792b75-b26a-47e9-a7dd-794c5736027e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:20.123433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fc792b75-b26a-47e9-a7dd-794c5736027e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043663 Aug 24 12:42:20.123966 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 779/1558] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:20 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:20.495554 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b379d66f-aaf9-44a2-8b28-6d144cff6913 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:20.497752 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b379d66f-aaf9-44a2-8b28-6d144cff6913 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:20.503831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b379d66f-aaf9-44a2-8b28-6d144cff6913 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:20.504318 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b379d66f-aaf9-44a2-8b28-6d144cff6913 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:20.504750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b379d66f-aaf9-44a2-8b28-6d144cff6913 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:20.505434 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b379d66f-aaf9-44a2-8b28-6d144cff6913 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:20.505979 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b379d66f-aaf9-44a2-8b28-6d144cff6913 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:20.506402 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b379d66f-aaf9-44a2-8b28-6d144cff6913 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:20.534713 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b379d66f-aaf9-44a2-8b28-6d144cff6913 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043286 Aug 24 12:42:20.535248 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 780/1559] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:20 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:20.645462 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-75a0940c-d379-4ece-9238-0601dc5e4e22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:20.647631 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-75a0940c-d379-4ece-9238-0601dc5e4e22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:20.653503 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75a0940c-d379-4ece-9238-0601dc5e4e22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:20.653980 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75a0940c-d379-4ece-9238-0601dc5e4e22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:20.654412 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75a0940c-d379-4ece-9238-0601dc5e4e22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:20.655117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75a0940c-d379-4ece-9238-0601dc5e4e22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:20.655565 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75a0940c-d379-4ece-9238-0601dc5e4e22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:20.655983 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75a0940c-d379-4ece-9238-0601dc5e4e22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:20.684249 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-75a0940c-d379-4ece-9238-0601dc5e4e22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042817 Aug 24 12:42:20.684712 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 780/1560] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:20 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:20.858442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-18265482-251f-4589-bdab-2321a909c022 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:20.860570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-18265482-251f-4589-bdab-2321a909c022 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:20.867753 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18265482-251f-4589-bdab-2321a909c022 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:20.868230 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18265482-251f-4589-bdab-2321a909c022 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:20.868661 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18265482-251f-4589-bdab-2321a909c022 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:20.869336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18265482-251f-4589-bdab-2321a909c022 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:20.869780 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18265482-251f-4589-bdab-2321a909c022 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:20.870198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18265482-251f-4589-bdab-2321a909c022 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:20.898450 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-18265482-251f-4589-bdab-2321a909c022 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043926 Aug 24 12:42:20.898999 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 781/1561] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:20 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:42:21.135696 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ef5baad2-f209-4736-a786-f8dfb1225506 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:21.137901 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ef5baad2-f209-4736-a786-f8dfb1225506 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:21.144360 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef5baad2-f209-4736-a786-f8dfb1225506 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:21.144844 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef5baad2-f209-4736-a786-f8dfb1225506 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:21.145280 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef5baad2-f209-4736-a786-f8dfb1225506 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:21.145972 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef5baad2-f209-4736-a786-f8dfb1225506 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:21.146453 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef5baad2-f209-4736-a786-f8dfb1225506 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:21.146879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef5baad2-f209-4736-a786-f8dfb1225506 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:21.175871 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ef5baad2-f209-4736-a786-f8dfb1225506 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044111 Aug 24 12:42:21.176421 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 781/1562] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:21 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:21.547483 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3093a614-1012-447f-b8ef-fe5c4fa70004 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:21.549603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3093a614-1012-447f-b8ef-fe5c4fa70004 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:21.555710 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3093a614-1012-447f-b8ef-fe5c4fa70004 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:21.558823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3093a614-1012-447f-b8ef-fe5c4fa70004 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:21.558823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3093a614-1012-447f-b8ef-fe5c4fa70004 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:21.558823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3093a614-1012-447f-b8ef-fe5c4fa70004 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:21.558823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3093a614-1012-447f-b8ef-fe5c4fa70004 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:21.559270 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3093a614-1012-447f-b8ef-fe5c4fa70004 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:21.586536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3093a614-1012-447f-b8ef-fe5c4fa70004 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043012 Aug 24 12:42:21.587104 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 782/1563] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:21 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:21.697358 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6e6ec369-ccae-4699-982a-061559110f01 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:21.699451 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6e6ec369-ccae-4699-982a-061559110f01 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:21.705292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e6ec369-ccae-4699-982a-061559110f01 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:21.705773 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e6ec369-ccae-4699-982a-061559110f01 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:21.706205 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e6ec369-ccae-4699-982a-061559110f01 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:21.706917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e6ec369-ccae-4699-982a-061559110f01 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:21.707373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e6ec369-ccae-4699-982a-061559110f01 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:21.707798 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e6ec369-ccae-4699-982a-061559110f01 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:21.736516 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6e6ec369-ccae-4699-982a-061559110f01 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043795 Aug 24 12:42:21.737253 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 782/1564] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:21 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:21.910524 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6c0ba2c1-906a-427b-a2e5-d4a122460d0d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:21.912826 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6c0ba2c1-906a-427b-a2e5-d4a122460d0d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:21.919122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c0ba2c1-906a-427b-a2e5-d4a122460d0d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:21.919603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c0ba2c1-906a-427b-a2e5-d4a122460d0d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:21.920036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c0ba2c1-906a-427b-a2e5-d4a122460d0d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:21.920720 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c0ba2c1-906a-427b-a2e5-d4a122460d0d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:21.921172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c0ba2c1-906a-427b-a2e5-d4a122460d0d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:21.921594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c0ba2c1-906a-427b-a2e5-d4a122460d0d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:21.950111 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6c0ba2c1-906a-427b-a2e5-d4a122460d0d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043513 Aug 24 12:42:21.950581 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 783/1565] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:21 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:22.188413 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-96990e11-92fb-4483-93de-80d1916d51d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:22.190568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-96990e11-92fb-4483-93de-80d1916d51d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:22.197059 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96990e11-92fb-4483-93de-80d1916d51d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:22.197544 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96990e11-92fb-4483-93de-80d1916d51d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:22.197990 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96990e11-92fb-4483-93de-80d1916d51d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:22.205031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96990e11-92fb-4483-93de-80d1916d51d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:22.205031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96990e11-92fb-4483-93de-80d1916d51d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:22.205031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96990e11-92fb-4483-93de-80d1916d51d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:22.205031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:22.230389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-96990e11-92fb-4483-93de-80d1916d51d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045974 Aug 24 12:42:22.230974 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 783/1566] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:22 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:22.597839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fe22dd6e-c889-4b30-b377-87b5aa29b8ec tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:22.599966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fe22dd6e-c889-4b30-b377-87b5aa29b8ec tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:22.605822 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fe22dd6e-c889-4b30-b377-87b5aa29b8ec tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:22.606295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fe22dd6e-c889-4b30-b377-87b5aa29b8ec tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:22.606774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fe22dd6e-c889-4b30-b377-87b5aa29b8ec tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:22.607436 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fe22dd6e-c889-4b30-b377-87b5aa29b8ec tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:22.607880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fe22dd6e-c889-4b30-b377-87b5aa29b8ec tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:22.608296 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fe22dd6e-c889-4b30-b377-87b5aa29b8ec tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:22.636900 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fe22dd6e-c889-4b30-b377-87b5aa29b8ec tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043006 Aug 24 12:42:22.637432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 784/1567] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:22 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:22.749721 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2f6b106c-c66d-487d-958b-a7f297f3305f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:22.751943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2f6b106c-c66d-487d-958b-a7f297f3305f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:22.758609 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f6b106c-c66d-487d-958b-a7f297f3305f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:22.759136 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f6b106c-c66d-487d-958b-a7f297f3305f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:22.759574 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f6b106c-c66d-487d-958b-a7f297f3305f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:22.760261 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f6b106c-c66d-487d-958b-a7f297f3305f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:22.760897 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f6b106c-c66d-487d-958b-a7f297f3305f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:22.761273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f6b106c-c66d-487d-958b-a7f297f3305f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:22.789760 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2f6b106c-c66d-487d-958b-a7f297f3305f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044652 Aug 24 12:42:22.790406 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 784/1568] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:22 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:22.962099 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-dc734452-8947-493e-85cb-7c57ac523bb4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:22.964265 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-dc734452-8947-493e-85cb-7c57ac523bb4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:22.970430 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dc734452-8947-493e-85cb-7c57ac523bb4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:22.970935 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dc734452-8947-493e-85cb-7c57ac523bb4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:22.971366 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dc734452-8947-493e-85cb-7c57ac523bb4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:22.972041 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dc734452-8947-493e-85cb-7c57ac523bb4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:22.972484 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dc734452-8947-493e-85cb-7c57ac523bb4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:22.972902 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dc734452-8947-493e-85cb-7c57ac523bb4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:22.976582 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:23.001570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-dc734452-8947-493e-85cb-7c57ac523bb4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043390 Aug 24 12:42:23.002112 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 785/1569] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:22 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:23.243881 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a0360aea-0fda-4172-8e65-2d6bf94b5e8c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:23.246011 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a0360aea-0fda-4172-8e65-2d6bf94b5e8c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:23.252304 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0360aea-0fda-4172-8e65-2d6bf94b5e8c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:23.252788 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0360aea-0fda-4172-8e65-2d6bf94b5e8c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:23.253226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0360aea-0fda-4172-8e65-2d6bf94b5e8c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:23.253914 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0360aea-0fda-4172-8e65-2d6bf94b5e8c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:23.254370 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0360aea-0fda-4172-8e65-2d6bf94b5e8c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:23.254824 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0360aea-0fda-4172-8e65-2d6bf94b5e8c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:23.282750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a0360aea-0fda-4172-8e65-2d6bf94b5e8c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043711 Aug 24 12:42:23.283292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 785/1570] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:23 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:23.649405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d82c7735-74b1-4e73-b9e9-3efa683a6dc1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:23.652177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d82c7735-74b1-4e73-b9e9-3efa683a6dc1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:23.659501 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d82c7735-74b1-4e73-b9e9-3efa683a6dc1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:23.664853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d82c7735-74b1-4e73-b9e9-3efa683a6dc1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:23.664853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d82c7735-74b1-4e73-b9e9-3efa683a6dc1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:23.664853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d82c7735-74b1-4e73-b9e9-3efa683a6dc1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:23.664853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d82c7735-74b1-4e73-b9e9-3efa683a6dc1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:23.665396 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d82c7735-74b1-4e73-b9e9-3efa683a6dc1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:23.692098 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d82c7735-74b1-4e73-b9e9-3efa683a6dc1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046880 Aug 24 12:42:23.692645 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 786/1571] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:23 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:23.801495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d3041e49-fa7d-448a-8dbc-95dae748d0ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:23.804172 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d3041e49-fa7d-448a-8dbc-95dae748d0ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:23.809976 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3041e49-fa7d-448a-8dbc-95dae748d0ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:23.810452 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3041e49-fa7d-448a-8dbc-95dae748d0ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:23.810917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3041e49-fa7d-448a-8dbc-95dae748d0ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:23.811597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3041e49-fa7d-448a-8dbc-95dae748d0ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:23.812049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3041e49-fa7d-448a-8dbc-95dae748d0ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:23.812468 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3041e49-fa7d-448a-8dbc-95dae748d0ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:23.841473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d3041e49-fa7d-448a-8dbc-95dae748d0ff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044046 Aug 24 12:42:23.841998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 786/1572] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:23 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:24.013819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-df69eb69-b5c0-46e7-be40-181ac7177b55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:24.016038 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-df69eb69-b5c0-46e7-be40-181ac7177b55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:24.022438 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-df69eb69-b5c0-46e7-be40-181ac7177b55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:24.025311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-df69eb69-b5c0-46e7-be40-181ac7177b55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:24.025311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-df69eb69-b5c0-46e7-be40-181ac7177b55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:24.025311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-df69eb69-b5c0-46e7-be40-181ac7177b55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:24.025311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-df69eb69-b5c0-46e7-be40-181ac7177b55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:24.025877 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-df69eb69-b5c0-46e7-be40-181ac7177b55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:24.054079 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-df69eb69-b5c0-46e7-be40-181ac7177b55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044588 Aug 24 12:42:24.054681 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 787/1573] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:24 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:24.295482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-022eb63a-f09c-40a3-85c3-2255c43dbf85 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:24.297559 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-022eb63a-f09c-40a3-85c3-2255c43dbf85 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:24.303838 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-022eb63a-f09c-40a3-85c3-2255c43dbf85 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:24.304322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-022eb63a-f09c-40a3-85c3-2255c43dbf85 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:24.304755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-022eb63a-f09c-40a3-85c3-2255c43dbf85 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:24.305670 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-022eb63a-f09c-40a3-85c3-2255c43dbf85 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:24.306124 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-022eb63a-f09c-40a3-85c3-2255c43dbf85 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:24.306548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-022eb63a-f09c-40a3-85c3-2255c43dbf85 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:24.336195 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-022eb63a-f09c-40a3-85c3-2255c43dbf85 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044649 Aug 24 12:42:24.336745 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 787/1574] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:24 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:24.704094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2b327a12-c446-48d2-82a7-228b907ef248 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:24.706452 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2b327a12-c446-48d2-82a7-228b907ef248 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:24.713002 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b327a12-c446-48d2-82a7-228b907ef248 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:24.713476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b327a12-c446-48d2-82a7-228b907ef248 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:24.713970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b327a12-c446-48d2-82a7-228b907ef248 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:24.714643 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b327a12-c446-48d2-82a7-228b907ef248 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:24.715112 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b327a12-c446-48d2-82a7-228b907ef248 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:24.715530 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b327a12-c446-48d2-82a7-228b907ef248 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:24.743735 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2b327a12-c446-48d2-82a7-228b907ef248 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043714 Aug 24 12:42:24.744280 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 788/1575] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:24 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:24.854046 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-faf5a1c9-7227-47ec-ba06-e71b7cfb9b87 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:24.856232 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-faf5a1c9-7227-47ec-ba06-e71b7cfb9b87 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:24.862136 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-faf5a1c9-7227-47ec-ba06-e71b7cfb9b87 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:24.862615 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-faf5a1c9-7227-47ec-ba06-e71b7cfb9b87 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:24.863085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-faf5a1c9-7227-47ec-ba06-e71b7cfb9b87 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:24.864034 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-faf5a1c9-7227-47ec-ba06-e71b7cfb9b87 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:24.864491 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-faf5a1c9-7227-47ec-ba06-e71b7cfb9b87 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:24.864914 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-faf5a1c9-7227-47ec-ba06-e71b7cfb9b87 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:24.893498 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-faf5a1c9-7227-47ec-ba06-e71b7cfb9b87 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043718 Aug 24 12:42:24.894036 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 788/1576] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:24 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:25.065368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-024d2feb-ecec-4a79-9913-22a5e7fbc626 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:25.067530 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-024d2feb-ecec-4a79-9913-22a5e7fbc626 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:25.074476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-024d2feb-ecec-4a79-9913-22a5e7fbc626 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:25.074991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-024d2feb-ecec-4a79-9913-22a5e7fbc626 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:25.075429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-024d2feb-ecec-4a79-9913-22a5e7fbc626 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:25.076116 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-024d2feb-ecec-4a79-9913-22a5e7fbc626 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:25.076567 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-024d2feb-ecec-4a79-9913-22a5e7fbc626 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:25.076991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-024d2feb-ecec-4a79-9913-22a5e7fbc626 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:25.104893 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-024d2feb-ecec-4a79-9913-22a5e7fbc626 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043501 Aug 24 12:42:25.105428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 789/1577] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:25 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:25.348549 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-026a7b82-bca9-4ec1-9948-6480dc2ae5b2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:25.350920 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-026a7b82-bca9-4ec1-9948-6480dc2ae5b2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:25.357254 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-026a7b82-bca9-4ec1-9948-6480dc2ae5b2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:25.357735 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-026a7b82-bca9-4ec1-9948-6480dc2ae5b2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:25.358171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-026a7b82-bca9-4ec1-9948-6480dc2ae5b2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:25.358890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-026a7b82-bca9-4ec1-9948-6480dc2ae5b2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:25.359347 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-026a7b82-bca9-4ec1-9948-6480dc2ae5b2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:25.359792 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-026a7b82-bca9-4ec1-9948-6480dc2ae5b2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:25.389086 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-026a7b82-bca9-4ec1-9948-6480dc2ae5b2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044665 Aug 24 12:42:25.389623 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 789/1578] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:25 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:25.755849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d8015b2e-eb2e-4dd5-b62e-f7bcfd194adc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:25.758035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d8015b2e-eb2e-4dd5-b62e-f7bcfd194adc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:25.763894 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8015b2e-eb2e-4dd5-b62e-f7bcfd194adc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:25.764370 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8015b2e-eb2e-4dd5-b62e-f7bcfd194adc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:25.764803 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8015b2e-eb2e-4dd5-b62e-f7bcfd194adc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:25.765483 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8015b2e-eb2e-4dd5-b62e-f7bcfd194adc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:25.765928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8015b2e-eb2e-4dd5-b62e-f7bcfd194adc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:25.766350 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8015b2e-eb2e-4dd5-b62e-f7bcfd194adc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:25.795133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d8015b2e-eb2e-4dd5-b62e-f7bcfd194adc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043131 Aug 24 12:42:25.795675 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 790/1579] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:25 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:25.915659 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9650a917-3449-4ca8-a996-d89455ddb335 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:25.915659 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9650a917-3449-4ca8-a996-d89455ddb335 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:25.915659 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9650a917-3449-4ca8-a996-d89455ddb335 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:25.915659 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9650a917-3449-4ca8-a996-d89455ddb335 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:25.916150 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9650a917-3449-4ca8-a996-d89455ddb335 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:25.916150 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9650a917-3449-4ca8-a996-d89455ddb335 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:25.916461 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9650a917-3449-4ca8-a996-d89455ddb335 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:25.916877 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9650a917-3449-4ca8-a996-d89455ddb335 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:25.945906 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9650a917-3449-4ca8-a996-d89455ddb335 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044436 Aug 24 12:42:25.946465 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 790/1580] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:25 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:26.116984 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c31d1327-9989-47e3-b2d6-9741e70aa940 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:26.119182 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c31d1327-9989-47e3-b2d6-9741e70aa940 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:26.125471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c31d1327-9989-47e3-b2d6-9741e70aa940 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:26.125951 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c31d1327-9989-47e3-b2d6-9741e70aa940 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:26.126384 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c31d1327-9989-47e3-b2d6-9741e70aa940 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:26.127099 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c31d1327-9989-47e3-b2d6-9741e70aa940 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:26.127550 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c31d1327-9989-47e3-b2d6-9741e70aa940 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:26.127971 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c31d1327-9989-47e3-b2d6-9741e70aa940 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:26.157030 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c31d1327-9989-47e3-b2d6-9741e70aa940 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044252 Aug 24 12:42:26.157565 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 791/1581] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:26 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:26.401308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e7234119-9bdb-43ff-b787-f3d9faa05a11 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:26.403509 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e7234119-9bdb-43ff-b787-f3d9faa05a11 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:26.409835 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e7234119-9bdb-43ff-b787-f3d9faa05a11 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:26.410319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e7234119-9bdb-43ff-b787-f3d9faa05a11 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:26.410792 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e7234119-9bdb-43ff-b787-f3d9faa05a11 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:26.411481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e7234119-9bdb-43ff-b787-f3d9faa05a11 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:26.411937 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e7234119-9bdb-43ff-b787-f3d9faa05a11 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:26.412366 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e7234119-9bdb-43ff-b787-f3d9faa05a11 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:26.441605 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e7234119-9bdb-43ff-b787-f3d9faa05a11 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044215 Aug 24 12:42:26.442153 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 791/1582] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:26 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:26.807972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-beb9cd88-c040-40f0-b6f9-8731f819540b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:26.810102 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-beb9cd88-c040-40f0-b6f9-8731f819540b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:26.816455 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-beb9cd88-c040-40f0-b6f9-8731f819540b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:26.816932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-beb9cd88-c040-40f0-b6f9-8731f819540b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:26.817359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-beb9cd88-c040-40f0-b6f9-8731f819540b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:26.818759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-beb9cd88-c040-40f0-b6f9-8731f819540b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:26.819213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-beb9cd88-c040-40f0-b6f9-8731f819540b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:26.819635 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-beb9cd88-c040-40f0-b6f9-8731f819540b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:26.847264 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-beb9cd88-c040-40f0-b6f9-8731f819540b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043239 Aug 24 12:42:26.847804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 792/1583] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:26 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:26.958735 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-89a2e6a2-23a1-48e2-aa5d-2a83c49d8111 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:26.960859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-89a2e6a2-23a1-48e2-aa5d-2a83c49d8111 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:26.966754 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-89a2e6a2-23a1-48e2-aa5d-2a83c49d8111 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:26.967235 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-89a2e6a2-23a1-48e2-aa5d-2a83c49d8111 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:26.967668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-89a2e6a2-23a1-48e2-aa5d-2a83c49d8111 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:26.968352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-89a2e6a2-23a1-48e2-aa5d-2a83c49d8111 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:26.968806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-89a2e6a2-23a1-48e2-aa5d-2a83c49d8111 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:26.969231 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-89a2e6a2-23a1-48e2-aa5d-2a83c49d8111 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:26.998593 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-89a2e6a2-23a1-48e2-aa5d-2a83c49d8111 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044788 Aug 24 12:42:26.999165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 792/1584] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:26 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:27.169169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-262e39f2-c09a-49c3-9fc5-076278f90b34 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:27.171266 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-262e39f2-c09a-49c3-9fc5-076278f90b34 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:27.178130 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-262e39f2-c09a-49c3-9fc5-076278f90b34 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:27.178603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-262e39f2-c09a-49c3-9fc5-076278f90b34 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:27.179053 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-262e39f2-c09a-49c3-9fc5-076278f90b34 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:27.179732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-262e39f2-c09a-49c3-9fc5-076278f90b34 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:27.180173 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-262e39f2-c09a-49c3-9fc5-076278f90b34 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:27.180589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-262e39f2-c09a-49c3-9fc5-076278f90b34 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:27.208802 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-262e39f2-c09a-49c3-9fc5-076278f90b34 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043586 Aug 24 12:42:27.209338 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 793/1585] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:27 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:27.454226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-126a63b7-2729-4c5d-989d-a5a43facbb29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:27.456475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-126a63b7-2729-4c5d-989d-a5a43facbb29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:27.463373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-126a63b7-2729-4c5d-989d-a5a43facbb29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:27.463861 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-126a63b7-2729-4c5d-989d-a5a43facbb29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:27.464305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-126a63b7-2729-4c5d-989d-a5a43facbb29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:27.464998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-126a63b7-2729-4c5d-989d-a5a43facbb29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:27.465457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-126a63b7-2729-4c5d-989d-a5a43facbb29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:27.465890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-126a63b7-2729-4c5d-989d-a5a43facbb29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:27.494872 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-126a63b7-2729-4c5d-989d-a5a43facbb29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044590 Aug 24 12:42:27.495411 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 793/1586] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:27 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:27.859408 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-795de7d5-a882-4bf5-afb0-8a0c3f66fb5d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:27.861520 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-795de7d5-a882-4bf5-afb0-8a0c3f66fb5d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:27.868275 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-795de7d5-a882-4bf5-afb0-8a0c3f66fb5d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:27.868741 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-795de7d5-a882-4bf5-afb0-8a0c3f66fb5d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:27.869167 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-795de7d5-a882-4bf5-afb0-8a0c3f66fb5d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:27.869840 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-795de7d5-a882-4bf5-afb0-8a0c3f66fb5d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:27.870285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-795de7d5-a882-4bf5-afb0-8a0c3f66fb5d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:27.870718 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-795de7d5-a882-4bf5-afb0-8a0c3f66fb5d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:27.897964 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-795de7d5-a882-4bf5-afb0-8a0c3f66fb5d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042508 Aug 24 12:42:27.898488 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 794/1587] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:27 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:28.010492 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ea012173-a7c5-4acc-b822-ddf929711c75 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:28.012671 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ea012173-a7c5-4acc-b822-ddf929711c75 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:28.018615 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea012173-a7c5-4acc-b822-ddf929711c75 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:28.019127 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea012173-a7c5-4acc-b822-ddf929711c75 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:28.019570 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea012173-a7c5-4acc-b822-ddf929711c75 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:28.020260 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea012173-a7c5-4acc-b822-ddf929711c75 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:28.020718 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea012173-a7c5-4acc-b822-ddf929711c75 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:28.021653 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea012173-a7c5-4acc-b822-ddf929711c75 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:28.050320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ea012173-a7c5-4acc-b822-ddf929711c75 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043815 Aug 24 12:42:28.050892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 794/1588] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:28 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:28.220856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9124cd20-47b2-4260-a3f5-da14151acb23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:28.222917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9124cd20-47b2-4260-a3f5-da14151acb23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:28.229926 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9124cd20-47b2-4260-a3f5-da14151acb23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:28.230406 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9124cd20-47b2-4260-a3f5-da14151acb23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:28.230875 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9124cd20-47b2-4260-a3f5-da14151acb23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:28.231552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9124cd20-47b2-4260-a3f5-da14151acb23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:28.231997 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9124cd20-47b2-4260-a3f5-da14151acb23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:28.232411 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9124cd20-47b2-4260-a3f5-da14151acb23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:28.260411 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9124cd20-47b2-4260-a3f5-da14151acb23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043552 Aug 24 12:42:28.260943 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 795/1589] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:28 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:28.507033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-97f59a58-604d-48b6-a828-f7370d853b86 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:28.509193 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-97f59a58-604d-48b6-a828-f7370d853b86 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:28.515575 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97f59a58-604d-48b6-a828-f7370d853b86 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:28.516058 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97f59a58-604d-48b6-a828-f7370d853b86 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:28.516487 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97f59a58-604d-48b6-a828-f7370d853b86 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:28.517167 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97f59a58-604d-48b6-a828-f7370d853b86 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:28.517643 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97f59a58-604d-48b6-a828-f7370d853b86 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:28.518064 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97f59a58-604d-48b6-a828-f7370d853b86 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:28.546187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-97f59a58-604d-48b6-a828-f7370d853b86 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043751 Aug 24 12:42:28.546729 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 795/1590] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:28 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:28.909727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bde1d4f1-514b-4713-aeee-f6f5c4957f90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:28.912447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-bde1d4f1-514b-4713-aeee-f6f5c4957f90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:28.918312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bde1d4f1-514b-4713-aeee-f6f5c4957f90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:28.918835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bde1d4f1-514b-4713-aeee-f6f5c4957f90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:28.919269 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bde1d4f1-514b-4713-aeee-f6f5c4957f90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:28.919952 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bde1d4f1-514b-4713-aeee-f6f5c4957f90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:28.920404 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bde1d4f1-514b-4713-aeee-f6f5c4957f90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:28.920835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bde1d4f1-514b-4713-aeee-f6f5c4957f90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:28.949159 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bde1d4f1-514b-4713-aeee-f6f5c4957f90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043493 Aug 24 12:42:28.949691 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 796/1591] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:28 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:29.062245 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-164c7295-7878-488e-9d33-37225c11a5b9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:29.064424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-164c7295-7878-488e-9d33-37225c11a5b9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:29.070270 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-164c7295-7878-488e-9d33-37225c11a5b9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:29.070778 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-164c7295-7878-488e-9d33-37225c11a5b9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:29.071215 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-164c7295-7878-488e-9d33-37225c11a5b9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:29.071905 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-164c7295-7878-488e-9d33-37225c11a5b9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:29.072353 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-164c7295-7878-488e-9d33-37225c11a5b9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:29.072773 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-164c7295-7878-488e-9d33-37225c11a5b9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:29.101649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-164c7295-7878-488e-9d33-37225c11a5b9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043412 Aug 24 12:42:29.102179 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 796/1592] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:29 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:29.272250 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2a2c176c-175e-4909-8809-3e0c9f9b8483 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:29.274396 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2a2c176c-175e-4909-8809-3e0c9f9b8483 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:29.280683 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a2c176c-175e-4909-8809-3e0c9f9b8483 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:29.281156 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a2c176c-175e-4909-8809-3e0c9f9b8483 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:29.281899 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a2c176c-175e-4909-8809-3e0c9f9b8483 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:29.282922 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a2c176c-175e-4909-8809-3e0c9f9b8483 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:29.283378 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a2c176c-175e-4909-8809-3e0c9f9b8483 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:29.283795 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a2c176c-175e-4909-8809-3e0c9f9b8483 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:29.312009 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2a2c176c-175e-4909-8809-3e0c9f9b8483 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044316 Aug 24 12:42:29.312539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 797/1593] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:29 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:42:29.559405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-51b05105-4a65-4224-b2b0-b10b76cf37c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:29.561498 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-51b05105-4a65-4224-b2b0-b10b76cf37c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:29.568503 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51b05105-4a65-4224-b2b0-b10b76cf37c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:29.568988 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51b05105-4a65-4224-b2b0-b10b76cf37c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:29.569495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51b05105-4a65-4224-b2b0-b10b76cf37c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:29.570182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51b05105-4a65-4224-b2b0-b10b76cf37c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:29.570638 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51b05105-4a65-4224-b2b0-b10b76cf37c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:29.571084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51b05105-4a65-4224-b2b0-b10b76cf37c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:29.605011 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-51b05105-4a65-4224-b2b0-b10b76cf37c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049560 Aug 24 12:42:29.605566 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 797/1594] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:29 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:29.961303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9ea52848-f101-4617-8af3-47606fdb8d16 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:29.963471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9ea52848-f101-4617-8af3-47606fdb8d16 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:29.965294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:29.969830 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9ea52848-f101-4617-8af3-47606fdb8d16 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:29.970427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9ea52848-f101-4617-8af3-47606fdb8d16 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:29.970883 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9ea52848-f101-4617-8af3-47606fdb8d16 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:29.971558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9ea52848-f101-4617-8af3-47606fdb8d16 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:29.972003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9ea52848-f101-4617-8af3-47606fdb8d16 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:29.972417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9ea52848-f101-4617-8af3-47606fdb8d16 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:30.001904 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9ea52848-f101-4617-8af3-47606fdb8d16 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044525 Aug 24 12:42:30.002441 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 798/1595] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:29 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:30.114384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-86eb7be5-d3f3-4e16-ac9d-aae45f0eafb0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:30.117104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-86eb7be5-d3f3-4e16-ac9d-aae45f0eafb0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:30.118976 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:30.123533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86eb7be5-d3f3-4e16-ac9d-aae45f0eafb0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:30.124008 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86eb7be5-d3f3-4e16-ac9d-aae45f0eafb0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:30.128190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86eb7be5-d3f3-4e16-ac9d-aae45f0eafb0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:30.128190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86eb7be5-d3f3-4e16-ac9d-aae45f0eafb0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:30.128190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86eb7be5-d3f3-4e16-ac9d-aae45f0eafb0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:30.128190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86eb7be5-d3f3-4e16-ac9d-aae45f0eafb0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:30.154828 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-86eb7be5-d3f3-4e16-ac9d-aae45f0eafb0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044850 Aug 24 12:42:30.155361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 798/1596] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:30 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:30.324916 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c0115a08-d4bd-41cb-aef8-0aa2ec448f9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:30.327044 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c0115a08-d4bd-41cb-aef8-0aa2ec448f9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:30.333835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0115a08-d4bd-41cb-aef8-0aa2ec448f9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:30.334312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0115a08-d4bd-41cb-aef8-0aa2ec448f9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:30.334785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0115a08-d4bd-41cb-aef8-0aa2ec448f9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:30.335439 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0115a08-d4bd-41cb-aef8-0aa2ec448f9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:30.335881 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0115a08-d4bd-41cb-aef8-0aa2ec448f9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:30.336294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0115a08-d4bd-41cb-aef8-0aa2ec448f9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:30.365274 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c0115a08-d4bd-41cb-aef8-0aa2ec448f9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044603 Aug 24 12:42:30.365734 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 799/1597] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:30 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:30.617693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9fc29abf-d962-4cec-9cca-596144d44456 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:30.619813 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9fc29abf-d962-4cec-9cca-596144d44456 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:30.626130 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9fc29abf-d962-4cec-9cca-596144d44456 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:30.626612 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9fc29abf-d962-4cec-9cca-596144d44456 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:30.627080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9fc29abf-d962-4cec-9cca-596144d44456 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:30.627773 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9fc29abf-d962-4cec-9cca-596144d44456 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:30.628230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9fc29abf-d962-4cec-9cca-596144d44456 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:30.628660 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9fc29abf-d962-4cec-9cca-596144d44456 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:30.653468 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:30.658069 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9fc29abf-d962-4cec-9cca-596144d44456 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044721 Aug 24 12:42:30.658614 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 799/1598] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:30 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:31.013484 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-01c6f296-188d-473b-a36b-35d071585f94 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:31.015658 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-01c6f296-188d-473b-a36b-35d071585f94 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:31.022087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01c6f296-188d-473b-a36b-35d071585f94 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:31.022557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01c6f296-188d-473b-a36b-35d071585f94 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:31.023009 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01c6f296-188d-473b-a36b-35d071585f94 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:31.023682 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01c6f296-188d-473b-a36b-35d071585f94 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:31.024125 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01c6f296-188d-473b-a36b-35d071585f94 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:31.024541 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01c6f296-188d-473b-a36b-35d071585f94 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:31.053346 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-01c6f296-188d-473b-a36b-35d071585f94 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043845 Aug 24 12:42:31.053878 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 800/1599] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:31 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:31.167691 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8dfc3ce4-9350-4c99-8182-62876c8588c5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:31.169783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8dfc3ce4-9350-4c99-8182-62876c8588c5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:31.176014 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8dfc3ce4-9350-4c99-8182-62876c8588c5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:31.176485 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8dfc3ce4-9350-4c99-8182-62876c8588c5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:31.176913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8dfc3ce4-9350-4c99-8182-62876c8588c5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:31.177582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8dfc3ce4-9350-4c99-8182-62876c8588c5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:31.178032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8dfc3ce4-9350-4c99-8182-62876c8588c5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:31.178449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8dfc3ce4-9350-4c99-8182-62876c8588c5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:31.206269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8dfc3ce4-9350-4c99-8182-62876c8588c5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042613 Aug 24 12:42:31.206830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 800/1600] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:31 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:31.376345 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-49770bf3-99ff-4b2c-9792-545699d74208 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:31.378372 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-49770bf3-99ff-4b2c-9792-545699d74208 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:31.385264 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-49770bf3-99ff-4b2c-9792-545699d74208 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:31.385742 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-49770bf3-99ff-4b2c-9792-545699d74208 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:31.386179 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-49770bf3-99ff-4b2c-9792-545699d74208 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:31.386896 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-49770bf3-99ff-4b2c-9792-545699d74208 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:31.387347 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-49770bf3-99ff-4b2c-9792-545699d74208 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:31.387769 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-49770bf3-99ff-4b2c-9792-545699d74208 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:31.412102 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:31.417190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-49770bf3-99ff-4b2c-9792-545699d74208 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044853 Aug 24 12:42:31.417752 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 801/1601] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:31 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:31.669738 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8dce8ed5-864e-4088-854e-72b10ea9c0a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:31.671858 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8dce8ed5-864e-4088-854e-72b10ea9c0a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:31.678111 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8dce8ed5-864e-4088-854e-72b10ea9c0a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:31.678588 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8dce8ed5-864e-4088-854e-72b10ea9c0a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:31.679049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8dce8ed5-864e-4088-854e-72b10ea9c0a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:31.679727 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8dce8ed5-864e-4088-854e-72b10ea9c0a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:31.680182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8dce8ed5-864e-4088-854e-72b10ea9c0a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:31.680597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8dce8ed5-864e-4088-854e-72b10ea9c0a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:31.709600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8dce8ed5-864e-4088-854e-72b10ea9c0a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043976 Aug 24 12:42:31.710132 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 801/1602] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:31 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:32.065641 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a78076d6-f44c-422e-957a-07bbda0318f5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:32.068455 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a78076d6-f44c-422e-957a-07bbda0318f5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:32.074931 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a78076d6-f44c-422e-957a-07bbda0318f5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:32.075415 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a78076d6-f44c-422e-957a-07bbda0318f5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:32.075853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a78076d6-f44c-422e-957a-07bbda0318f5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:32.076541 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a78076d6-f44c-422e-957a-07bbda0318f5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:32.076994 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a78076d6-f44c-422e-957a-07bbda0318f5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:32.077421 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a78076d6-f44c-422e-957a-07bbda0318f5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:32.106516 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a78076d6-f44c-422e-957a-07bbda0318f5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044777 Aug 24 12:42:32.107285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 802/1603] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:32 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:32.218252 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c0af0267-7b0a-4b8a-a52c-6db43bdddb73 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:32.220397 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c0af0267-7b0a-4b8a-a52c-6db43bdddb73 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:32.226855 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c0af0267-7b0a-4b8a-a52c-6db43bdddb73 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:32.227332 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c0af0267-7b0a-4b8a-a52c-6db43bdddb73 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:32.227763 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c0af0267-7b0a-4b8a-a52c-6db43bdddb73 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:32.228444 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c0af0267-7b0a-4b8a-a52c-6db43bdddb73 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:32.228891 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c0af0267-7b0a-4b8a-a52c-6db43bdddb73 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:32.229308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c0af0267-7b0a-4b8a-a52c-6db43bdddb73 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:32.258284 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c0af0267-7b0a-4b8a-a52c-6db43bdddb73 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043980 Aug 24 12:42:32.258844 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 802/1604] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:32 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:32.430060 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5b815e1b-7d69-4918-9636-f3976b80ef73 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:32.432220 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5b815e1b-7d69-4918-9636-f3976b80ef73 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:32.438757 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5b815e1b-7d69-4918-9636-f3976b80ef73 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:32.439248 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5b815e1b-7d69-4918-9636-f3976b80ef73 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:32.439685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5b815e1b-7d69-4918-9636-f3976b80ef73 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:32.440420 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5b815e1b-7d69-4918-9636-f3976b80ef73 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:32.440874 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5b815e1b-7d69-4918-9636-f3976b80ef73 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:32.441303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5b815e1b-7d69-4918-9636-f3976b80ef73 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:32.469374 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5b815e1b-7d69-4918-9636-f3976b80ef73 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044046 Aug 24 12:42:32.469921 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 803/1605] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:32 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:32.720868 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-eb58bf71-6cb7-4e05-8506-62e5c9916454 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:32.722982 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-eb58bf71-6cb7-4e05-8506-62e5c9916454 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:32.729939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eb58bf71-6cb7-4e05-8506-62e5c9916454 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:32.730423 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eb58bf71-6cb7-4e05-8506-62e5c9916454 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:32.730899 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eb58bf71-6cb7-4e05-8506-62e5c9916454 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:32.731586 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eb58bf71-6cb7-4e05-8506-62e5c9916454 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:32.732041 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eb58bf71-6cb7-4e05-8506-62e5c9916454 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:32.732466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eb58bf71-6cb7-4e05-8506-62e5c9916454 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:32.761032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-eb58bf71-6cb7-4e05-8506-62e5c9916454 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044158 Aug 24 12:42:32.761583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 803/1606] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:32 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:33.119080 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-53403712-b236-4712-8bf7-a777493fe728 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:33.121224 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-53403712-b236-4712-8bf7-a777493fe728 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:33.127091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-53403712-b236-4712-8bf7-a777493fe728 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:33.127572 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-53403712-b236-4712-8bf7-a777493fe728 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:33.128015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-53403712-b236-4712-8bf7-a777493fe728 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:33.128698 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-53403712-b236-4712-8bf7-a777493fe728 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:33.129150 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-53403712-b236-4712-8bf7-a777493fe728 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:33.129604 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-53403712-b236-4712-8bf7-a777493fe728 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:33.158443 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-53403712-b236-4712-8bf7-a777493fe728 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043260 Aug 24 12:42:33.159001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 804/1607] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:33 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:33.270523 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8b772140-38d8-41c2-93fe-bbfd1726daeb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:33.272672 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8b772140-38d8-41c2-93fe-bbfd1726daeb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:33.278569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b772140-38d8-41c2-93fe-bbfd1726daeb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:33.279081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b772140-38d8-41c2-93fe-bbfd1726daeb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:33.279520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b772140-38d8-41c2-93fe-bbfd1726daeb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:33.280205 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b772140-38d8-41c2-93fe-bbfd1726daeb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:33.280656 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b772140-38d8-41c2-93fe-bbfd1726daeb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:33.281077 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b772140-38d8-41c2-93fe-bbfd1726daeb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:33.309923 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8b772140-38d8-41c2-93fe-bbfd1726daeb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043357 Aug 24 12:42:33.310462 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 804/1608] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:33 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:33.481407 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c3d7553d-34df-42ba-8b21-3ea4b843308f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:33.483565 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c3d7553d-34df-42ba-8b21-3ea4b843308f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:33.490168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c3d7553d-34df-42ba-8b21-3ea4b843308f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:33.490670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c3d7553d-34df-42ba-8b21-3ea4b843308f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:33.491121 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c3d7553d-34df-42ba-8b21-3ea4b843308f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:33.491809 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c3d7553d-34df-42ba-8b21-3ea4b843308f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:33.492268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c3d7553d-34df-42ba-8b21-3ea4b843308f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:33.493201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c3d7553d-34df-42ba-8b21-3ea4b843308f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:33.521794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c3d7553d-34df-42ba-8b21-3ea4b843308f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044362 Aug 24 12:42:33.522332 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 805/1609] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:33 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:33.772824 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-41ba5c1f-280e-41f5-b086-960a29bc1080 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:33.775604 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-41ba5c1f-280e-41f5-b086-960a29bc1080 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:33.781848 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-41ba5c1f-280e-41f5-b086-960a29bc1080 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:33.782336 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-41ba5c1f-280e-41f5-b086-960a29bc1080 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:33.782816 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-41ba5c1f-280e-41f5-b086-960a29bc1080 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:33.783516 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-41ba5c1f-280e-41f5-b086-960a29bc1080 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:33.783977 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-41ba5c1f-280e-41f5-b086-960a29bc1080 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:33.784405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-41ba5c1f-280e-41f5-b086-960a29bc1080 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:33.813042 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-41ba5c1f-280e-41f5-b086-960a29bc1080 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044205 Aug 24 12:42:33.813584 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 805/1610] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:33 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:34.170237 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f5bc80e4-cc13-4d21-ba73-39c5257e23be tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:34.172315 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f5bc80e4-cc13-4d21-ba73-39c5257e23be tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:34.178241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5bc80e4-cc13-4d21-ba73-39c5257e23be tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:34.178749 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5bc80e4-cc13-4d21-ba73-39c5257e23be tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:34.179190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5bc80e4-cc13-4d21-ba73-39c5257e23be tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:34.179863 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5bc80e4-cc13-4d21-ba73-39c5257e23be tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:34.180814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5bc80e4-cc13-4d21-ba73-39c5257e23be tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:34.181233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5bc80e4-cc13-4d21-ba73-39c5257e23be tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:34.209814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f5bc80e4-cc13-4d21-ba73-39c5257e23be tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043565 Aug 24 12:42:34.210355 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 806/1611] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:34 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:42:34.321505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5984a5d1-d7df-41dc-804f-2c37089e380e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:34.323829 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5984a5d1-d7df-41dc-804f-2c37089e380e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:34.332247 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5984a5d1-d7df-41dc-804f-2c37089e380e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:34.332247 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5984a5d1-d7df-41dc-804f-2c37089e380e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:34.332247 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5984a5d1-d7df-41dc-804f-2c37089e380e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:34.332247 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5984a5d1-d7df-41dc-804f-2c37089e380e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:34.332637 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5984a5d1-d7df-41dc-804f-2c37089e380e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:34.332637 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5984a5d1-d7df-41dc-804f-2c37089e380e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:34.360442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5984a5d1-d7df-41dc-804f-2c37089e380e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042933 Aug 24 12:42:34.360973 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 806/1612] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:34 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:34.533892 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e75b9af9-c4db-4263-a6cf-7e77572b8bba tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:34.536036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e75b9af9-c4db-4263-a6cf-7e77572b8bba tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:34.542969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e75b9af9-c4db-4263-a6cf-7e77572b8bba tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:34.543449 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e75b9af9-c4db-4263-a6cf-7e77572b8bba tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:34.543879 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e75b9af9-c4db-4263-a6cf-7e77572b8bba tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:34.544560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e75b9af9-c4db-4263-a6cf-7e77572b8bba tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:34.545006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e75b9af9-c4db-4263-a6cf-7e77572b8bba tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:34.545425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e75b9af9-c4db-4263-a6cf-7e77572b8bba tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:34.573734 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e75b9af9-c4db-4263-a6cf-7e77572b8bba tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043793 Aug 24 12:42:34.574270 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 807/1613] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:34 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:34.825025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-52234e9e-61f9-4a9c-bc77-f409fef3850e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:34.827265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-52234e9e-61f9-4a9c-bc77-f409fef3850e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:34.833606 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52234e9e-61f9-4a9c-bc77-f409fef3850e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:34.834090 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52234e9e-61f9-4a9c-bc77-f409fef3850e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:34.834530 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52234e9e-61f9-4a9c-bc77-f409fef3850e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:34.835244 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52234e9e-61f9-4a9c-bc77-f409fef3850e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:34.835704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52234e9e-61f9-4a9c-bc77-f409fef3850e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:34.836132 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52234e9e-61f9-4a9c-bc77-f409fef3850e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:34.865667 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-52234e9e-61f9-4a9c-bc77-f409fef3850e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044596 Aug 24 12:42:34.866225 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 807/1614] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:34 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:35.222087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cfa11764-ceaa-4571-b701-ce3940357108 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:35.224212 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cfa11764-ceaa-4571-b701-ce3940357108 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:35.230094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfa11764-ceaa-4571-b701-ce3940357108 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:35.230591 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfa11764-ceaa-4571-b701-ce3940357108 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:35.231039 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfa11764-ceaa-4571-b701-ce3940357108 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:35.231722 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfa11764-ceaa-4571-b701-ce3940357108 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:35.232170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfa11764-ceaa-4571-b701-ce3940357108 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:35.232594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfa11764-ceaa-4571-b701-ce3940357108 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:35.261337 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cfa11764-ceaa-4571-b701-ce3940357108 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043869 Aug 24 12:42:35.261868 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 808/1615] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:35 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:35.372631 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d4b5b0ca-02a0-4118-9de1-1b4667433ad3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:35.374811 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d4b5b0ca-02a0-4118-9de1-1b4667433ad3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:35.380744 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4b5b0ca-02a0-4118-9de1-1b4667433ad3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:35.381222 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4b5b0ca-02a0-4118-9de1-1b4667433ad3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:35.381661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4b5b0ca-02a0-4118-9de1-1b4667433ad3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:35.382346 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4b5b0ca-02a0-4118-9de1-1b4667433ad3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:35.382832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4b5b0ca-02a0-4118-9de1-1b4667433ad3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:35.383260 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4b5b0ca-02a0-4118-9de1-1b4667433ad3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:35.412168 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d4b5b0ca-02a0-4118-9de1-1b4667433ad3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043495 Aug 24 12:42:35.412711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 808/1616] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:35 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:35.585990 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-788346fe-a127-4428-987c-2ce2d4313879 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:35.588188 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-788346fe-a127-4428-987c-2ce2d4313879 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:35.594489 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-788346fe-a127-4428-987c-2ce2d4313879 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:35.594997 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-788346fe-a127-4428-987c-2ce2d4313879 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:35.595430 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-788346fe-a127-4428-987c-2ce2d4313879 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:35.596112 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-788346fe-a127-4428-987c-2ce2d4313879 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:35.596563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-788346fe-a127-4428-987c-2ce2d4313879 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:35.596984 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-788346fe-a127-4428-987c-2ce2d4313879 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:35.626311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-788346fe-a127-4428-987c-2ce2d4313879 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044209 Aug 24 12:42:35.626880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 809/1617] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:35 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:35.877882 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d2fa2388-c6dc-4489-8db6-dbebd98c9777 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:35.880023 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d2fa2388-c6dc-4489-8db6-dbebd98c9777 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:35.886274 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d2fa2388-c6dc-4489-8db6-dbebd98c9777 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:35.886790 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d2fa2388-c6dc-4489-8db6-dbebd98c9777 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:35.887223 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d2fa2388-c6dc-4489-8db6-dbebd98c9777 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:35.887902 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d2fa2388-c6dc-4489-8db6-dbebd98c9777 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:35.888352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d2fa2388-c6dc-4489-8db6-dbebd98c9777 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:35.888773 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d2fa2388-c6dc-4489-8db6-dbebd98c9777 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:35.917544 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d2fa2388-c6dc-4489-8db6-dbebd98c9777 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043579 Aug 24 12:42:35.918077 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 809/1618] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:35 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:36.273318 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0ba56129-1760-49a6-9502-d56e84b7e979 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:36.276001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0ba56129-1760-49a6-9502-d56e84b7e979 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:36.281830 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ba56129-1760-49a6-9502-d56e84b7e979 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:36.282299 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ba56129-1760-49a6-9502-d56e84b7e979 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:36.282761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ba56129-1760-49a6-9502-d56e84b7e979 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:36.283433 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ba56129-1760-49a6-9502-d56e84b7e979 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:36.283906 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ba56129-1760-49a6-9502-d56e84b7e979 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:36.284327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ba56129-1760-49a6-9502-d56e84b7e979 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:36.312942 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0ba56129-1760-49a6-9502-d56e84b7e979 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043458 Aug 24 12:42:36.313489 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 810/1619] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:36 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:36.424531 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dd994989-f0f8-4efb-8493-350fd45d29ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:36.426745 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dd994989-f0f8-4efb-8493-350fd45d29ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:36.432654 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dd994989-f0f8-4efb-8493-350fd45d29ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:36.433141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dd994989-f0f8-4efb-8493-350fd45d29ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:36.433580 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dd994989-f0f8-4efb-8493-350fd45d29ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:36.434271 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dd994989-f0f8-4efb-8493-350fd45d29ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:36.434757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dd994989-f0f8-4efb-8493-350fd45d29ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:36.435184 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dd994989-f0f8-4efb-8493-350fd45d29ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:36.464525 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dd994989-f0f8-4efb-8493-350fd45d29ae tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044129 Aug 24 12:42:36.465019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 810/1620] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:36 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:36.638207 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-dbeb4efa-3673-415f-b504-327aa7cea51e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:36.640430 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-dbeb4efa-3673-415f-b504-327aa7cea51e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:36.646882 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dbeb4efa-3673-415f-b504-327aa7cea51e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:36.647363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dbeb4efa-3673-415f-b504-327aa7cea51e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:36.647804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dbeb4efa-3673-415f-b504-327aa7cea51e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:36.648491 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dbeb4efa-3673-415f-b504-327aa7cea51e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:36.648947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dbeb4efa-3673-415f-b504-327aa7cea51e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:36.649374 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dbeb4efa-3673-415f-b504-327aa7cea51e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:36.677846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-dbeb4efa-3673-415f-b504-327aa7cea51e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043569 Aug 24 12:42:36.678376 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 811/1621] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:36 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:36.929607 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2690ad34-b131-416e-98ef-632d499da47e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:36.931777 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2690ad34-b131-416e-98ef-632d499da47e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:36.937657 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2690ad34-b131-416e-98ef-632d499da47e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:36.938145 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2690ad34-b131-416e-98ef-632d499da47e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:36.938585 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2690ad34-b131-416e-98ef-632d499da47e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:36.939302 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2690ad34-b131-416e-98ef-632d499da47e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:36.939763 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2690ad34-b131-416e-98ef-632d499da47e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:36.940194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2690ad34-b131-416e-98ef-632d499da47e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:36.968755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2690ad34-b131-416e-98ef-632d499da47e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043059 Aug 24 12:42:36.969291 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 811/1622] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:36 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:37.325664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-195281a2-ba6d-4019-82f7-d44be29993a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:37.327962 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-195281a2-ba6d-4019-82f7-d44be29993a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:37.333901 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-195281a2-ba6d-4019-82f7-d44be29993a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:37.334370 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-195281a2-ba6d-4019-82f7-d44be29993a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:37.334829 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-195281a2-ba6d-4019-82f7-d44be29993a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:37.335512 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-195281a2-ba6d-4019-82f7-d44be29993a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:37.335982 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-195281a2-ba6d-4019-82f7-d44be29993a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:37.336400 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-195281a2-ba6d-4019-82f7-d44be29993a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:37.365011 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-195281a2-ba6d-4019-82f7-d44be29993a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043859 Aug 24 12:42:37.365547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 812/1623] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:37 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:37.476963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0b548bc9-fceb-438f-a691-49606c6ffd69 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:37.479138 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0b548bc9-fceb-438f-a691-49606c6ffd69 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:37.485450 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b548bc9-fceb-438f-a691-49606c6ffd69 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:37.485927 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b548bc9-fceb-438f-a691-49606c6ffd69 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:37.486362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b548bc9-fceb-438f-a691-49606c6ffd69 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:37.487083 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b548bc9-fceb-438f-a691-49606c6ffd69 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:37.487542 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b548bc9-fceb-438f-a691-49606c6ffd69 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:37.487963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b548bc9-fceb-438f-a691-49606c6ffd69 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:37.516770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0b548bc9-fceb-438f-a691-49606c6ffd69 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043838 Aug 24 12:42:37.517304 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 812/1624] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:37 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:37.690727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e0fe2e31-c16b-4e08-8da7-609587d4efc8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:37.692787 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e0fe2e31-c16b-4e08-8da7-609587d4efc8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:37.699286 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0fe2e31-c16b-4e08-8da7-609587d4efc8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:37.700441 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0fe2e31-c16b-4e08-8da7-609587d4efc8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:37.700883 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0fe2e31-c16b-4e08-8da7-609587d4efc8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:37.701576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0fe2e31-c16b-4e08-8da7-609587d4efc8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:37.702028 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0fe2e31-c16b-4e08-8da7-609587d4efc8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:37.702452 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0fe2e31-c16b-4e08-8da7-609587d4efc8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:37.731589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e0fe2e31-c16b-4e08-8da7-609587d4efc8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044931 Aug 24 12:42:37.732143 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 813/1625] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:37 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:37.981661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7316407e-0bcf-4baf-b34a-bbbe8905feca tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:37.983838 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7316407e-0bcf-4baf-b34a-bbbe8905feca tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:37.989955 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7316407e-0bcf-4baf-b34a-bbbe8905feca tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:37.990437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7316407e-0bcf-4baf-b34a-bbbe8905feca tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:37.990921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7316407e-0bcf-4baf-b34a-bbbe8905feca tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:37.991604 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7316407e-0bcf-4baf-b34a-bbbe8905feca tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:37.992061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7316407e-0bcf-4baf-b34a-bbbe8905feca tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:37.992487 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7316407e-0bcf-4baf-b34a-bbbe8905feca tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:38.022083 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7316407e-0bcf-4baf-b34a-bbbe8905feca tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045134 Aug 24 12:42:38.022856 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 813/1626] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:37 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:38.377162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-278d7c74-cf85-4736-9b2d-e817e2f59bbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:38.379388 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-278d7c74-cf85-4736-9b2d-e817e2f59bbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:38.385275 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-278d7c74-cf85-4736-9b2d-e817e2f59bbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:38.385754 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-278d7c74-cf85-4736-9b2d-e817e2f59bbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:38.386186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-278d7c74-cf85-4736-9b2d-e817e2f59bbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:38.386898 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-278d7c74-cf85-4736-9b2d-e817e2f59bbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:38.387346 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-278d7c74-cf85-4736-9b2d-e817e2f59bbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:38.387768 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-278d7c74-cf85-4736-9b2d-e817e2f59bbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:38.415929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-278d7c74-cf85-4736-9b2d-e817e2f59bbe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042686 Aug 24 12:42:38.417072 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 814/1627] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:38 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:38.530031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-af141127-9a5e-4c57-92b5-bd9aedc64569 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:38.532185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-af141127-9a5e-4c57-92b5-bd9aedc64569 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:38.538545 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af141127-9a5e-4c57-92b5-bd9aedc64569 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:38.539058 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af141127-9a5e-4c57-92b5-bd9aedc64569 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:38.539494 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af141127-9a5e-4c57-92b5-bd9aedc64569 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:38.540175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af141127-9a5e-4c57-92b5-bd9aedc64569 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:38.540630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af141127-9a5e-4c57-92b5-bd9aedc64569 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:38.541056 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af141127-9a5e-4c57-92b5-bd9aedc64569 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:38.569457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-af141127-9a5e-4c57-92b5-bd9aedc64569 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044019 Aug 24 12:42:38.569996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 814/1628] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:38 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:38.743861 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fd12fcd9-cef0-4f47-ba2d-290537b9c7d7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:38.746011 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fd12fcd9-cef0-4f47-ba2d-290537b9c7d7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:38.752236 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd12fcd9-cef0-4f47-ba2d-290537b9c7d7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:38.752714 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd12fcd9-cef0-4f47-ba2d-290537b9c7d7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:38.753144 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd12fcd9-cef0-4f47-ba2d-290537b9c7d7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:38.753819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd12fcd9-cef0-4f47-ba2d-290537b9c7d7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:38.754264 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd12fcd9-cef0-4f47-ba2d-290537b9c7d7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:38.754697 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd12fcd9-cef0-4f47-ba2d-290537b9c7d7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:38.783384 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fd12fcd9-cef0-4f47-ba2d-290537b9c7d7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043465 Aug 24 12:42:38.783907 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 815/1629] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:38 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:39.033699 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c6e93fb4-b4d6-44d7-ad88-eeaf7d107f2a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:39.035808 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c6e93fb4-b4d6-44d7-ad88-eeaf7d107f2a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:39.041834 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6e93fb4-b4d6-44d7-ad88-eeaf7d107f2a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:39.042317 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6e93fb4-b4d6-44d7-ad88-eeaf7d107f2a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:39.042794 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6e93fb4-b4d6-44d7-ad88-eeaf7d107f2a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:39.043481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6e93fb4-b4d6-44d7-ad88-eeaf7d107f2a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:39.043930 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6e93fb4-b4d6-44d7-ad88-eeaf7d107f2a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:39.044352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6e93fb4-b4d6-44d7-ad88-eeaf7d107f2a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:39.072020 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c6e93fb4-b4d6-44d7-ad88-eeaf7d107f2a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042510 Aug 24 12:42:39.073066 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 815/1630] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:39 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:39.428051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9f88f492-aa26-4cd5-8952-d946f8bb8741 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:39.430179 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9f88f492-aa26-4cd5-8952-d946f8bb8741 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:39.436577 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f88f492-aa26-4cd5-8952-d946f8bb8741 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:39.437056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f88f492-aa26-4cd5-8952-d946f8bb8741 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:39.437491 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f88f492-aa26-4cd5-8952-d946f8bb8741 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:39.438169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f88f492-aa26-4cd5-8952-d946f8bb8741 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:39.438617 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f88f492-aa26-4cd5-8952-d946f8bb8741 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:39.439067 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f88f492-aa26-4cd5-8952-d946f8bb8741 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:39.467114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9f88f492-aa26-4cd5-8952-d946f8bb8741 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043025 Aug 24 12:42:39.467653 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 816/1631] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:39 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:39.581728 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b3f5d837-1065-42e2-971f-cbd239dc5b8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:39.583797 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b3f5d837-1065-42e2-971f-cbd239dc5b8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:39.590095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3f5d837-1065-42e2-971f-cbd239dc5b8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:39.590572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3f5d837-1065-42e2-971f-cbd239dc5b8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:39.591036 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3f5d837-1065-42e2-971f-cbd239dc5b8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:39.591711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3f5d837-1065-42e2-971f-cbd239dc5b8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:39.592160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3f5d837-1065-42e2-971f-cbd239dc5b8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:39.592582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3f5d837-1065-42e2-971f-cbd239dc5b8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:39.606086 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:39.621976 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b3f5d837-1065-42e2-971f-cbd239dc5b8c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044279 Aug 24 12:42:39.622505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 816/1632] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:39 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:39.796265 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5068ebb7-f092-4231-8c8d-f88bf456e1a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:39.798382 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5068ebb7-f092-4231-8c8d-f88bf456e1a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:39.804637 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5068ebb7-f092-4231-8c8d-f88bf456e1a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:39.805107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5068ebb7-f092-4231-8c8d-f88bf456e1a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:39.805537 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5068ebb7-f092-4231-8c8d-f88bf456e1a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:39.806244 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5068ebb7-f092-4231-8c8d-f88bf456e1a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:39.807369 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5068ebb7-f092-4231-8c8d-f88bf456e1a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:39.807849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5068ebb7-f092-4231-8c8d-f88bf456e1a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:39.835613 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5068ebb7-f092-4231-8c8d-f88bf456e1a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043339 Aug 24 12:42:39.836076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 817/1633] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:39 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:40.084612 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6ec67219-5bde-42bb-b34c-8dbde17dda84 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:40.086814 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6ec67219-5bde-42bb-b34c-8dbde17dda84 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:40.093658 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6ec67219-5bde-42bb-b34c-8dbde17dda84 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:40.094155 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6ec67219-5bde-42bb-b34c-8dbde17dda84 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:40.094597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6ec67219-5bde-42bb-b34c-8dbde17dda84 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:40.095305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6ec67219-5bde-42bb-b34c-8dbde17dda84 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:40.095761 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6ec67219-5bde-42bb-b34c-8dbde17dda84 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:40.096184 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6ec67219-5bde-42bb-b34c-8dbde17dda84 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:40.124904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6ec67219-5bde-42bb-b34c-8dbde17dda84 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044255 Aug 24 12:42:40.125445 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 817/1634] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:40 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:40.478420 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-88f532f5-48e3-4113-af96-ba11190c664c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:40.480597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-88f532f5-48e3-4113-af96-ba11190c664c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:40.486413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88f532f5-48e3-4113-af96-ba11190c664c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:40.486920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88f532f5-48e3-4113-af96-ba11190c664c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:40.487413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88f532f5-48e3-4113-af96-ba11190c664c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:40.488159 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88f532f5-48e3-4113-af96-ba11190c664c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:40.488638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88f532f5-48e3-4113-af96-ba11190c664c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:40.489325 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88f532f5-48e3-4113-af96-ba11190c664c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:40.505262 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:40.517482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-88f532f5-48e3-4113-af96-ba11190c664c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043048 Aug 24 12:42:40.518183 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 818/1635] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:40 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:40.634084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-58d58817-24e9-424d-866a-551b6eec66f8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:40.636228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-58d58817-24e9-424d-866a-551b6eec66f8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:40.642448 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58d58817-24e9-424d-866a-551b6eec66f8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:40.642956 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58d58817-24e9-424d-866a-551b6eec66f8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:40.643415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58d58817-24e9-424d-866a-551b6eec66f8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:40.644100 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58d58817-24e9-424d-866a-551b6eec66f8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:40.644545 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58d58817-24e9-424d-866a-551b6eec66f8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:40.644965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58d58817-24e9-424d-866a-551b6eec66f8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:40.673792 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-58d58817-24e9-424d-866a-551b6eec66f8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043685 Aug 24 12:42:40.674311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 818/1636] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:40 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:40.847995 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-222409d5-830a-486b-a5fc-2a5007be58fd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:40.850106 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-222409d5-830a-486b-a5fc-2a5007be58fd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:40.857170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-222409d5-830a-486b-a5fc-2a5007be58fd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:40.857647 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-222409d5-830a-486b-a5fc-2a5007be58fd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:40.858084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-222409d5-830a-486b-a5fc-2a5007be58fd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:40.858794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-222409d5-830a-486b-a5fc-2a5007be58fd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:40.859248 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-222409d5-830a-486b-a5fc-2a5007be58fd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:40.859669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-222409d5-830a-486b-a5fc-2a5007be58fd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:40.887727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-222409d5-830a-486b-a5fc-2a5007be58fd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043972 Aug 24 12:42:40.888263 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 819/1637] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:40 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:41.137804 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-50f1c495-a1b5-4b23-bed6-66ae5afb4744 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:41.139928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-50f1c495-a1b5-4b23-bed6-66ae5afb4744 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:41.145740 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50f1c495-a1b5-4b23-bed6-66ae5afb4744 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:41.146224 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50f1c495-a1b5-4b23-bed6-66ae5afb4744 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:41.146682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50f1c495-a1b5-4b23-bed6-66ae5afb4744 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:41.147372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50f1c495-a1b5-4b23-bed6-66ae5afb4744 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:41.147830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50f1c495-a1b5-4b23-bed6-66ae5afb4744 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:41.148253 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50f1c495-a1b5-4b23-bed6-66ae5afb4744 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:41.176655 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-50f1c495-a1b5-4b23-bed6-66ae5afb4744 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043402 Aug 24 12:42:41.177227 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 819/1638] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:41 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:41.529419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-eb901e35-f2ce-4220-8e4a-31103a2acecd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:41.531675 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-eb901e35-f2ce-4220-8e4a-31103a2acecd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:41.537497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb901e35-f2ce-4220-8e4a-31103a2acecd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:41.537974 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb901e35-f2ce-4220-8e4a-31103a2acecd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:41.538472 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb901e35-f2ce-4220-8e4a-31103a2acecd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:41.539177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb901e35-f2ce-4220-8e4a-31103a2acecd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:41.539624 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb901e35-f2ce-4220-8e4a-31103a2acecd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:41.540044 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb901e35-f2ce-4220-8e4a-31103a2acecd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:41.569006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-eb901e35-f2ce-4220-8e4a-31103a2acecd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043565 Aug 24 12:42:41.569545 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 820/1639] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:41 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:41.692138 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2d08f9c4-61cd-4301-abb7-e5d8e26415bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:41.694277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2d08f9c4-61cd-4301-abb7-e5d8e26415bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:41.700689 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2d08f9c4-61cd-4301-abb7-e5d8e26415bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:41.701174 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2d08f9c4-61cd-4301-abb7-e5d8e26415bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:41.701613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2d08f9c4-61cd-4301-abb7-e5d8e26415bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:41.702304 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2d08f9c4-61cd-4301-abb7-e5d8e26415bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:41.702783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2d08f9c4-61cd-4301-abb7-e5d8e26415bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:41.703208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2d08f9c4-61cd-4301-abb7-e5d8e26415bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:41.733262 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2d08f9c4-61cd-4301-abb7-e5d8e26415bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051040 Aug 24 12:42:41.733816 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 820/1640] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:41 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:41.899926 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e4ec1ecf-d6b1-4360-9953-3c4709b9b668 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:41.902679 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e4ec1ecf-d6b1-4360-9953-3c4709b9b668 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:41.908960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4ec1ecf-d6b1-4360-9953-3c4709b9b668 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:41.909432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4ec1ecf-d6b1-4360-9953-3c4709b9b668 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:41.909859 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4ec1ecf-d6b1-4360-9953-3c4709b9b668 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:41.910534 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4ec1ecf-d6b1-4360-9953-3c4709b9b668 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:41.911008 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4ec1ecf-d6b1-4360-9953-3c4709b9b668 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:41.911424 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4ec1ecf-d6b1-4360-9953-3c4709b9b668 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:41.939034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e4ec1ecf-d6b1-4360-9953-3c4709b9b668 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043105 Aug 24 12:42:41.939566 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 821/1641] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:41 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:42.188934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6887fba9-137d-4d63-b7b0-42e8b3b807d6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:42.191120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6887fba9-137d-4d63-b7b0-42e8b3b807d6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:42.197019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6887fba9-137d-4d63-b7b0-42e8b3b807d6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:42.197509 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6887fba9-137d-4d63-b7b0-42e8b3b807d6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:42.198583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6887fba9-137d-4d63-b7b0-42e8b3b807d6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:42.199302 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6887fba9-137d-4d63-b7b0-42e8b3b807d6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:42.199762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6887fba9-137d-4d63-b7b0-42e8b3b807d6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:42.200187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6887fba9-137d-4d63-b7b0-42e8b3b807d6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:42.228125 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6887fba9-137d-4d63-b7b0-42e8b3b807d6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043151 Aug 24 12:42:42.228668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 821/1642] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:42 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:42.581431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1616a3b7-0f12-4ed7-b503-ed15e77cfa82 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:42.583552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1616a3b7-0f12-4ed7-b503-ed15e77cfa82 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:42.590002 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1616a3b7-0f12-4ed7-b503-ed15e77cfa82 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:42.590470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1616a3b7-0f12-4ed7-b503-ed15e77cfa82 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:42.590927 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1616a3b7-0f12-4ed7-b503-ed15e77cfa82 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:42.591594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1616a3b7-0f12-4ed7-b503-ed15e77cfa82 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:42.592037 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1616a3b7-0f12-4ed7-b503-ed15e77cfa82 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:42.592450 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1616a3b7-0f12-4ed7-b503-ed15e77cfa82 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:42.621019 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1616a3b7-0f12-4ed7-b503-ed15e77cfa82 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043536 Aug 24 12:42:42.621557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 822/1643] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:42 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:42.745206 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f984be6f-a858-4ff6-972a-ad34504eb5d2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:42.747508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f984be6f-a858-4ff6-972a-ad34504eb5d2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:42.753774 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f984be6f-a858-4ff6-972a-ad34504eb5d2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:42.754250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f984be6f-a858-4ff6-972a-ad34504eb5d2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:42.754706 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f984be6f-a858-4ff6-972a-ad34504eb5d2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:42.755384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f984be6f-a858-4ff6-972a-ad34504eb5d2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:42.755871 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f984be6f-a858-4ff6-972a-ad34504eb5d2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:42.756252 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f984be6f-a858-4ff6-972a-ad34504eb5d2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:42.786274 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f984be6f-a858-4ff6-972a-ad34504eb5d2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045138 Aug 24 12:42:42.786844 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 822/1644] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:42 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:42.951042 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-00420411-c611-456f-87ce-c13158b74894 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:42.953126 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-00420411-c611-456f-87ce-c13158b74894 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:42.959440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00420411-c611-456f-87ce-c13158b74894 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:42.959907 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00420411-c611-456f-87ce-c13158b74894 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:42.960332 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00420411-c611-456f-87ce-c13158b74894 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:42.961003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00420411-c611-456f-87ce-c13158b74894 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:42.961448 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00420411-c611-456f-87ce-c13158b74894 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:42.961863 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00420411-c611-456f-87ce-c13158b74894 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:42.991282 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-00420411-c611-456f-87ce-c13158b74894 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044450 Aug 24 12:42:42.991831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 823/1645] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:42 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:43.240772 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e391b6e8-5ec6-4e43-ac95-2346597e1e9c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:43.242952 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e391b6e8-5ec6-4e43-ac95-2346597e1e9c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:43.249452 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e391b6e8-5ec6-4e43-ac95-2346597e1e9c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:43.249932 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e391b6e8-5ec6-4e43-ac95-2346597e1e9c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:43.250363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e391b6e8-5ec6-4e43-ac95-2346597e1e9c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:43.251072 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e391b6e8-5ec6-4e43-ac95-2346597e1e9c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:43.251524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e391b6e8-5ec6-4e43-ac95-2346597e1e9c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:43.251942 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e391b6e8-5ec6-4e43-ac95-2346597e1e9c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:43.280933 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e391b6e8-5ec6-4e43-ac95-2346597e1e9c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044436 Aug 24 12:42:43.281470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 823/1646] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:43 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:43.632874 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6b1f0d37-8c31-458b-a3a2-18a8c0b7f3b0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:43.635138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6b1f0d37-8c31-458b-a3a2-18a8c0b7f3b0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:43.641595 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6b1f0d37-8c31-458b-a3a2-18a8c0b7f3b0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:43.642072 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6b1f0d37-8c31-458b-a3a2-18a8c0b7f3b0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:43.642507 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6b1f0d37-8c31-458b-a3a2-18a8c0b7f3b0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:43.643219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6b1f0d37-8c31-458b-a3a2-18a8c0b7f3b0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:43.643667 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6b1f0d37-8c31-458b-a3a2-18a8c0b7f3b0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:43.644087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6b1f0d37-8c31-458b-a3a2-18a8c0b7f3b0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:43.671690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6b1f0d37-8c31-458b-a3a2-18a8c0b7f3b0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042882 Aug 24 12:42:43.672221 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 824/1647] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:43 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:43.798420 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-00bf0c4f-05be-4cff-95c2-29c3e3b91199 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:43.800567 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-00bf0c4f-05be-4cff-95c2-29c3e3b91199 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:43.806868 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-00bf0c4f-05be-4cff-95c2-29c3e3b91199 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:43.807885 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-00bf0c4f-05be-4cff-95c2-29c3e3b91199 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:43.808323 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-00bf0c4f-05be-4cff-95c2-29c3e3b91199 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:43.809004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-00bf0c4f-05be-4cff-95c2-29c3e3b91199 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:43.809459 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-00bf0c4f-05be-4cff-95c2-29c3e3b91199 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:43.810000 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-00bf0c4f-05be-4cff-95c2-29c3e3b91199 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:43.838374 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-00bf0c4f-05be-4cff-95c2-29c3e3b91199 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043900 Aug 24 12:42:43.838924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 824/1648] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:43 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:44.003460 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-eb80a780-0eb7-4d90-97d0-594185874cf6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:44.005574 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-eb80a780-0eb7-4d90-97d0-594185874cf6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:44.011908 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb80a780-0eb7-4d90-97d0-594185874cf6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:44.012385 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb80a780-0eb7-4d90-97d0-594185874cf6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:44.012820 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb80a780-0eb7-4d90-97d0-594185874cf6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:44.013501 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb80a780-0eb7-4d90-97d0-594185874cf6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:44.013947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb80a780-0eb7-4d90-97d0-594185874cf6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:44.014367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb80a780-0eb7-4d90-97d0-594185874cf6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:44.042846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-eb80a780-0eb7-4d90-97d0-594185874cf6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043437 Aug 24 12:42:44.043378 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 825/1649] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:43 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:44.293508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-63acf6cc-51df-4069-ab81-13c566b6ffe7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:44.295576 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-63acf6cc-51df-4069-ab81-13c566b6ffe7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:44.301395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63acf6cc-51df-4069-ab81-13c566b6ffe7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:44.301880 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63acf6cc-51df-4069-ab81-13c566b6ffe7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:44.302312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63acf6cc-51df-4069-ab81-13c566b6ffe7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:44.303022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63acf6cc-51df-4069-ab81-13c566b6ffe7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:44.303473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63acf6cc-51df-4069-ab81-13c566b6ffe7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:44.303894 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63acf6cc-51df-4069-ab81-13c566b6ffe7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:44.333551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-63acf6cc-51df-4069-ab81-13c566b6ffe7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044428 Aug 24 12:42:44.334110 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 825/1650] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:44 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:44.683553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-55905b6c-d964-40e2-9f1b-fa76d7301c52 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:44.685666 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-55905b6c-d964-40e2-9f1b-fa76d7301c52 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:44.691671 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-55905b6c-d964-40e2-9f1b-fa76d7301c52 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:44.692172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-55905b6c-d964-40e2-9f1b-fa76d7301c52 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:44.692582 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-55905b6c-d964-40e2-9f1b-fa76d7301c52 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:44.695794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-55905b6c-d964-40e2-9f1b-fa76d7301c52 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:44.695794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-55905b6c-d964-40e2-9f1b-fa76d7301c52 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:44.695794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-55905b6c-d964-40e2-9f1b-fa76d7301c52 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:44.722780 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-55905b6c-d964-40e2-9f1b-fa76d7301c52 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043183 Aug 24 12:42:44.723326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 826/1651] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:44 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:44.849842 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4402dcfa-cf62-4971-b6ce-bfa8c7e81df4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:44.851999 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4402dcfa-cf62-4971-b6ce-bfa8c7e81df4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:44.858054 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4402dcfa-cf62-4971-b6ce-bfa8c7e81df4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:44.858569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4402dcfa-cf62-4971-b6ce-bfa8c7e81df4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:44.859031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4402dcfa-cf62-4971-b6ce-bfa8c7e81df4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:44.859714 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4402dcfa-cf62-4971-b6ce-bfa8c7e81df4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:44.860168 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4402dcfa-cf62-4971-b6ce-bfa8c7e81df4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:44.860593 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4402dcfa-cf62-4971-b6ce-bfa8c7e81df4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:44.889571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4402dcfa-cf62-4971-b6ce-bfa8c7e81df4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043752 Aug 24 12:42:44.890109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 826/1652] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:44 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:45.054974 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-35d3e82c-f88e-49b4-b5a5-537939fca769 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:45.057104 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-35d3e82c-f88e-49b4-b5a5-537939fca769 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:45.063483 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-35d3e82c-f88e-49b4-b5a5-537939fca769 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:45.063964 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-35d3e82c-f88e-49b4-b5a5-537939fca769 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:45.064395 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-35d3e82c-f88e-49b4-b5a5-537939fca769 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:45.065081 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-35d3e82c-f88e-49b4-b5a5-537939fca769 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:45.065529 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-35d3e82c-f88e-49b4-b5a5-537939fca769 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:45.065950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-35d3e82c-f88e-49b4-b5a5-537939fca769 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:45.095193 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-35d3e82c-f88e-49b4-b5a5-537939fca769 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044231 Aug 24 12:42:45.095727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 827/1653] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:45 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:45.345443 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-83986d3b-0de8-4b46-990d-446bb09affcc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:45.347540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-83986d3b-0de8-4b46-990d-446bb09affcc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:45.353388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83986d3b-0de8-4b46-990d-446bb09affcc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:45.353866 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83986d3b-0de8-4b46-990d-446bb09affcc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:45.354354 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83986d3b-0de8-4b46-990d-446bb09affcc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:45.355058 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83986d3b-0de8-4b46-990d-446bb09affcc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:45.355513 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83986d3b-0de8-4b46-990d-446bb09affcc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:45.355935 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83986d3b-0de8-4b46-990d-446bb09affcc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:45.384463 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-83986d3b-0de8-4b46-990d-446bb09affcc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043045 Aug 24 12:42:45.384998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 827/1654] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:45 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:45.735757 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4cc8f520-d4a9-43fc-847e-bc7bcaee9420 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:45.737894 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4cc8f520-d4a9-43fc-847e-bc7bcaee9420 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:45.744154 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4cc8f520-d4a9-43fc-847e-bc7bcaee9420 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:45.744633 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4cc8f520-d4a9-43fc-847e-bc7bcaee9420 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:45.745751 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4cc8f520-d4a9-43fc-847e-bc7bcaee9420 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:45.746439 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4cc8f520-d4a9-43fc-847e-bc7bcaee9420 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:45.746922 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4cc8f520-d4a9-43fc-847e-bc7bcaee9420 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:45.747349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4cc8f520-d4a9-43fc-847e-bc7bcaee9420 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:45.774989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4cc8f520-d4a9-43fc-847e-bc7bcaee9420 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043283 Aug 24 12:42:45.775531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 828/1655] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:45 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:45.902367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1433cc7b-2917-4ee1-ad32-6d13af172d6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:45.904539 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1433cc7b-2917-4ee1-ad32-6d13af172d6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:45.910957 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1433cc7b-2917-4ee1-ad32-6d13af172d6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:45.911463 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1433cc7b-2917-4ee1-ad32-6d13af172d6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:45.911857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1433cc7b-2917-4ee1-ad32-6d13af172d6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:45.912544 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1433cc7b-2917-4ee1-ad32-6d13af172d6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:45.912998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1433cc7b-2917-4ee1-ad32-6d13af172d6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:45.913422 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1433cc7b-2917-4ee1-ad32-6d13af172d6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:45.943157 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1433cc7b-2917-4ee1-ad32-6d13af172d6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045346 Aug 24 12:42:45.943719 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 828/1656] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:45 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:46.108224 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e75b515d-e1f5-4d05-97c8-95a6075d2a2a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:46.110274 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e75b515d-e1f5-4d05-97c8-95a6075d2a2a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:46.116397 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e75b515d-e1f5-4d05-97c8-95a6075d2a2a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:46.116868 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e75b515d-e1f5-4d05-97c8-95a6075d2a2a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:46.117298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e75b515d-e1f5-4d05-97c8-95a6075d2a2a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:46.117974 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e75b515d-e1f5-4d05-97c8-95a6075d2a2a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:46.118419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e75b515d-e1f5-4d05-97c8-95a6075d2a2a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:46.118865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e75b515d-e1f5-4d05-97c8-95a6075d2a2a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:46.146576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e75b515d-e1f5-4d05-97c8-95a6075d2a2a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043028 Aug 24 12:42:46.147134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 829/1657] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:46 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:46.397374 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1e000823-a5d9-49ae-bf12-8a92e5612788 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:46.399472 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1e000823-a5d9-49ae-bf12-8a92e5612788 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:46.405981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e000823-a5d9-49ae-bf12-8a92e5612788 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:46.406467 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e000823-a5d9-49ae-bf12-8a92e5612788 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:46.407017 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e000823-a5d9-49ae-bf12-8a92e5612788 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:46.407706 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e000823-a5d9-49ae-bf12-8a92e5612788 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:46.408161 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e000823-a5d9-49ae-bf12-8a92e5612788 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:46.408586 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e000823-a5d9-49ae-bf12-8a92e5612788 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:46.437855 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1e000823-a5d9-49ae-bf12-8a92e5612788 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044484 Aug 24 12:42:46.438408 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 829/1658] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:46 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:46.787489 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-26a10ddd-c9c0-43e4-955a-4cf6fce0dcf3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:46.789665 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-26a10ddd-c9c0-43e4-955a-4cf6fce0dcf3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:46.796059 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26a10ddd-c9c0-43e4-955a-4cf6fce0dcf3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:46.796538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26a10ddd-c9c0-43e4-955a-4cf6fce0dcf3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:46.796969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26a10ddd-c9c0-43e4-955a-4cf6fce0dcf3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:46.797652 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26a10ddd-c9c0-43e4-955a-4cf6fce0dcf3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:46.798105 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26a10ddd-c9c0-43e4-955a-4cf6fce0dcf3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:46.798523 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26a10ddd-c9c0-43e4-955a-4cf6fce0dcf3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:46.827777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-26a10ddd-c9c0-43e4-955a-4cf6fce0dcf3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044278 Aug 24 12:42:46.828323 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 830/1659] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:46 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:46.955570 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-466a892d-77ad-4c2d-9bc2-2201bc0982a4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:46.957711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-466a892d-77ad-4c2d-9bc2-2201bc0982a4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:46.964558 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-466a892d-77ad-4c2d-9bc2-2201bc0982a4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:46.965028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-466a892d-77ad-4c2d-9bc2-2201bc0982a4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:46.965458 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-466a892d-77ad-4c2d-9bc2-2201bc0982a4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:46.966138 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-466a892d-77ad-4c2d-9bc2-2201bc0982a4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:46.966616 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-466a892d-77ad-4c2d-9bc2-2201bc0982a4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:46.967058 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-466a892d-77ad-4c2d-9bc2-2201bc0982a4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:46.996004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-466a892d-77ad-4c2d-9bc2-2201bc0982a4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044383 Aug 24 12:42:46.996543 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 830/1660] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:46 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:47.158940 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fce2d33f-dd61-46c3-80bc-29437a4780b1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:47.161042 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fce2d33f-dd61-46c3-80bc-29437a4780b1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:47.167010 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fce2d33f-dd61-46c3-80bc-29437a4780b1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:47.167499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fce2d33f-dd61-46c3-80bc-29437a4780b1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:47.167936 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fce2d33f-dd61-46c3-80bc-29437a4780b1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:47.168617 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fce2d33f-dd61-46c3-80bc-29437a4780b1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:47.169070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fce2d33f-dd61-46c3-80bc-29437a4780b1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:47.169492 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fce2d33f-dd61-46c3-80bc-29437a4780b1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:47.197628 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fce2d33f-dd61-46c3-80bc-29437a4780b1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042894 Aug 24 12:42:47.198690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 831/1661] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:47 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:47.450571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c13d19a4-5c7a-41ad-9dd2-2c2d85e6d5ba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:47.452777 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c13d19a4-5c7a-41ad-9dd2-2c2d85e6d5ba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:47.458599 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c13d19a4-5c7a-41ad-9dd2-2c2d85e6d5ba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:47.459120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c13d19a4-5c7a-41ad-9dd2-2c2d85e6d5ba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:47.459550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c13d19a4-5c7a-41ad-9dd2-2c2d85e6d5ba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:47.460228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c13d19a4-5c7a-41ad-9dd2-2c2d85e6d5ba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:47.460679 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c13d19a4-5c7a-41ad-9dd2-2c2d85e6d5ba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:47.461101 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c13d19a4-5c7a-41ad-9dd2-2c2d85e6d5ba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:47.489186 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c13d19a4-5c7a-41ad-9dd2-2c2d85e6d5ba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042905 Aug 24 12:42:47.489717 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 831/1662] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:47 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:47.839964 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c3228489-7507-4b6a-9d61-437c2e2d2dc7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:47.842225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c3228489-7507-4b6a-9d61-437c2e2d2dc7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:47.848592 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c3228489-7507-4b6a-9d61-437c2e2d2dc7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:47.849068 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c3228489-7507-4b6a-9d61-437c2e2d2dc7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:47.849502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c3228489-7507-4b6a-9d61-437c2e2d2dc7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:47.850186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c3228489-7507-4b6a-9d61-437c2e2d2dc7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:47.850638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c3228489-7507-4b6a-9d61-437c2e2d2dc7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:47.851085 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c3228489-7507-4b6a-9d61-437c2e2d2dc7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:47.880710 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c3228489-7507-4b6a-9d61-437c2e2d2dc7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044651 Aug 24 12:42:47.881246 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 832/1663] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:47 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:48.008292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ea1af0d1-a4df-4291-a652-b51b9cddfb1c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:48.010431 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ea1af0d1-a4df-4291-a652-b51b9cddfb1c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:48.016735 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea1af0d1-a4df-4291-a652-b51b9cddfb1c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:48.017215 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea1af0d1-a4df-4291-a652-b51b9cddfb1c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:48.017654 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea1af0d1-a4df-4291-a652-b51b9cddfb1c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:48.018336 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea1af0d1-a4df-4291-a652-b51b9cddfb1c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:48.018821 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea1af0d1-a4df-4291-a652-b51b9cddfb1c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:48.019246 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea1af0d1-a4df-4291-a652-b51b9cddfb1c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:48.047552 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ea1af0d1-a4df-4291-a652-b51b9cddfb1c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043261 Aug 24 12:42:48.048111 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 832/1664] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:48 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:48.209538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-71f09041-fe40-4073-9fe1-1e3f2d6173b6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:48.211637 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-71f09041-fe40-4073-9fe1-1e3f2d6173b6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:48.218000 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-71f09041-fe40-4073-9fe1-1e3f2d6173b6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:48.218478 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-71f09041-fe40-4073-9fe1-1e3f2d6173b6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:48.218945 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-71f09041-fe40-4073-9fe1-1e3f2d6173b6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:48.219637 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-71f09041-fe40-4073-9fe1-1e3f2d6173b6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:48.220090 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-71f09041-fe40-4073-9fe1-1e3f2d6173b6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:48.220514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-71f09041-fe40-4073-9fe1-1e3f2d6173b6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:48.249528 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-71f09041-fe40-4073-9fe1-1e3f2d6173b6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044019 Aug 24 12:42:48.250069 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 833/1665] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:48 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:48.501367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3aee5031-7917-4ed5-8561-43781f011d7f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:48.503545 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3aee5031-7917-4ed5-8561-43781f011d7f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:48.509386 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3aee5031-7917-4ed5-8561-43781f011d7f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:48.509868 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3aee5031-7917-4ed5-8561-43781f011d7f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:48.510884 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3aee5031-7917-4ed5-8561-43781f011d7f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:48.511513 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3aee5031-7917-4ed5-8561-43781f011d7f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:48.511970 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3aee5031-7917-4ed5-8561-43781f011d7f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:48.512397 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3aee5031-7917-4ed5-8561-43781f011d7f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:48.514701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:48.542202 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3aee5031-7917-4ed5-8561-43781f011d7f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044817 Aug 24 12:42:48.542759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 833/1666] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:48 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:48.892856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a092858d-2401-4d0a-b312-55707fc2172d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:48.895001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a092858d-2401-4d0a-b312-55707fc2172d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:48.901275 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a092858d-2401-4d0a-b312-55707fc2172d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:48.901748 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a092858d-2401-4d0a-b312-55707fc2172d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:48.902707 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a092858d-2401-4d0a-b312-55707fc2172d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:48.903379 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a092858d-2401-4d0a-b312-55707fc2172d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:48.903856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a092858d-2401-4d0a-b312-55707fc2172d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:48.904268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a092858d-2401-4d0a-b312-55707fc2172d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:48.932501 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a092858d-2401-4d0a-b312-55707fc2172d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043618 Aug 24 12:42:48.933027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 834/1667] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:48 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:49.059761 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2214be96-2b89-4e18-95c5-09fc4d27c216 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:49.061941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2214be96-2b89-4e18-95c5-09fc4d27c216 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:49.068292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2214be96-2b89-4e18-95c5-09fc4d27c216 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:49.068777 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2214be96-2b89-4e18-95c5-09fc4d27c216 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:49.069335 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2214be96-2b89-4e18-95c5-09fc4d27c216 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:49.069970 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2214be96-2b89-4e18-95c5-09fc4d27c216 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:49.070428 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2214be96-2b89-4e18-95c5-09fc4d27c216 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:49.070880 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2214be96-2b89-4e18-95c5-09fc4d27c216 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:49.099837 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2214be96-2b89-4e18-95c5-09fc4d27c216 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044056 Aug 24 12:42:49.100375 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 834/1668] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:49 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:49.261977 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b69bcab1-ce1c-4672-a423-727e907f8d55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:49.264168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b69bcab1-ce1c-4672-a423-727e907f8d55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:49.269949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b69bcab1-ce1c-4672-a423-727e907f8d55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:49.270418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b69bcab1-ce1c-4672-a423-727e907f8d55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:49.270894 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b69bcab1-ce1c-4672-a423-727e907f8d55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:49.271573 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b69bcab1-ce1c-4672-a423-727e907f8d55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:49.272018 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b69bcab1-ce1c-4672-a423-727e907f8d55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:49.272433 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b69bcab1-ce1c-4672-a423-727e907f8d55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:49.276002 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:49.301399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b69bcab1-ce1c-4672-a423-727e907f8d55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043947 Aug 24 12:42:49.301944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 835/1669] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:49 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:49.553592 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c9203f57-e7c0-439e-9465-b36467f8aa0b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:49.555798 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c9203f57-e7c0-439e-9465-b36467f8aa0b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:49.561597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9203f57-e7c0-439e-9465-b36467f8aa0b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:49.562075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9203f57-e7c0-439e-9465-b36467f8aa0b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:49.562515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9203f57-e7c0-439e-9465-b36467f8aa0b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:49.563221 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9203f57-e7c0-439e-9465-b36467f8aa0b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:49.563691 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9203f57-e7c0-439e-9465-b36467f8aa0b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:49.564106 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9203f57-e7c0-439e-9465-b36467f8aa0b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:49.595015 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c9203f57-e7c0-439e-9465-b36467f8aa0b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045320 Aug 24 12:42:49.595562 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 835/1670] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:49 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:49.945237 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fcf18bca-958a-4d5c-97b7-03da8deeea2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:49.947403 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fcf18bca-958a-4d5c-97b7-03da8deeea2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:49.954532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fcf18bca-958a-4d5c-97b7-03da8deeea2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:49.955045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fcf18bca-958a-4d5c-97b7-03da8deeea2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:49.955484 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fcf18bca-958a-4d5c-97b7-03da8deeea2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:49.956169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fcf18bca-958a-4d5c-97b7-03da8deeea2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:49.956623 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fcf18bca-958a-4d5c-97b7-03da8deeea2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:49.957050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fcf18bca-958a-4d5c-97b7-03da8deeea2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:49.985436 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fcf18bca-958a-4d5c-97b7-03da8deeea2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044527 Aug 24 12:42:49.985914 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 836/1671] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:49 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:50.112033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5922ab8f-3ede-41ee-9687-529c1b1c6e31 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:50.114454 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5922ab8f-3ede-41ee-9687-529c1b1c6e31 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:50.120732 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5922ab8f-3ede-41ee-9687-529c1b1c6e31 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:50.121208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5922ab8f-3ede-41ee-9687-529c1b1c6e31 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:50.121640 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5922ab8f-3ede-41ee-9687-529c1b1c6e31 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:50.122321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5922ab8f-3ede-41ee-9687-529c1b1c6e31 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:50.122802 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5922ab8f-3ede-41ee-9687-529c1b1c6e31 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:50.123220 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5922ab8f-3ede-41ee-9687-529c1b1c6e31 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:50.151349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5922ab8f-3ede-41ee-9687-529c1b1c6e31 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043284 Aug 24 12:42:50.152537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 836/1672] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:50 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:50.313657 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6b5c3693-f24d-410f-bf69-0f6173dddb40 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:50.315738 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6b5c3693-f24d-410f-bf69-0f6173dddb40 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:50.321565 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6b5c3693-f24d-410f-bf69-0f6173dddb40 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:50.322045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6b5c3693-f24d-410f-bf69-0f6173dddb40 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:50.322486 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6b5c3693-f24d-410f-bf69-0f6173dddb40 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:50.323230 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6b5c3693-f24d-410f-bf69-0f6173dddb40 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:50.323687 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6b5c3693-f24d-410f-bf69-0f6173dddb40 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:50.324621 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6b5c3693-f24d-410f-bf69-0f6173dddb40 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:50.353401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6b5c3693-f24d-410f-bf69-0f6173dddb40 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043869 Aug 24 12:42:50.353939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 837/1673] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:50 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:50.607694 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-eb6a58a0-4f51-4939-9264-ebef744b00a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:50.609834 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-eb6a58a0-4f51-4939-9264-ebef744b00a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:50.616032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eb6a58a0-4f51-4939-9264-ebef744b00a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:50.616521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eb6a58a0-4f51-4939-9264-ebef744b00a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:50.616958 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eb6a58a0-4f51-4939-9264-ebef744b00a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:50.617643 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eb6a58a0-4f51-4939-9264-ebef744b00a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:50.618099 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eb6a58a0-4f51-4939-9264-ebef744b00a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:50.618525 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eb6a58a0-4f51-4939-9264-ebef744b00a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:50.646340 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-eb6a58a0-4f51-4939-9264-ebef744b00a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043299 Aug 24 12:42:50.646898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 837/1674] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:50 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:50.998164 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c79b9cbc-b0bb-475e-9225-6b4a2ccb193f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:51.000332 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c79b9cbc-b0bb-475e-9225-6b4a2ccb193f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:51.006670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c79b9cbc-b0bb-475e-9225-6b4a2ccb193f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:51.007162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c79b9cbc-b0bb-475e-9225-6b4a2ccb193f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:51.007597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c79b9cbc-b0bb-475e-9225-6b4a2ccb193f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:51.008279 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c79b9cbc-b0bb-475e-9225-6b4a2ccb193f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:51.008747 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c79b9cbc-b0bb-475e-9225-6b4a2ccb193f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:51.009165 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c79b9cbc-b0bb-475e-9225-6b4a2ccb193f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:51.038089 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c79b9cbc-b0bb-475e-9225-6b4a2ccb193f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043862 Aug 24 12:42:51.038628 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 838/1675] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:50 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:51.163427 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5d70d7e3-7307-4e09-a12b-fb3d3a2dd7cd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:51.167185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5d70d7e3-7307-4e09-a12b-fb3d3a2dd7cd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:51.172020 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5d70d7e3-7307-4e09-a12b-fb3d3a2dd7cd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:51.172548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5d70d7e3-7307-4e09-a12b-fb3d3a2dd7cd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:51.172993 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5d70d7e3-7307-4e09-a12b-fb3d3a2dd7cd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:51.173685 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5d70d7e3-7307-4e09-a12b-fb3d3a2dd7cd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:51.174144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5d70d7e3-7307-4e09-a12b-fb3d3a2dd7cd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:51.174571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5d70d7e3-7307-4e09-a12b-fb3d3a2dd7cd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:51.204193 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5d70d7e3-7307-4e09-a12b-fb3d3a2dd7cd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044758 Aug 24 12:42:51.204743 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 838/1676] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:51 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:51.365833 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-823ab8ae-31dd-41f2-8db0-66218bcc8c80 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:51.367957 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-823ab8ae-31dd-41f2-8db0-66218bcc8c80 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:51.374431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-823ab8ae-31dd-41f2-8db0-66218bcc8c80 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:51.374940 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-823ab8ae-31dd-41f2-8db0-66218bcc8c80 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:51.375377 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-823ab8ae-31dd-41f2-8db0-66218bcc8c80 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:51.376064 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-823ab8ae-31dd-41f2-8db0-66218bcc8c80 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:51.376516 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-823ab8ae-31dd-41f2-8db0-66218bcc8c80 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:51.376938 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-823ab8ae-31dd-41f2-8db0-66218bcc8c80 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:51.408065 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-823ab8ae-31dd-41f2-8db0-66218bcc8c80 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046523 Aug 24 12:42:51.408929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 839/1677] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:51 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:51.658445 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a720b6f3-83f9-4b2e-9005-09fc336f3f8f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:51.660537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a720b6f3-83f9-4b2e-9005-09fc336f3f8f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:51.666462 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a720b6f3-83f9-4b2e-9005-09fc336f3f8f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:51.666977 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a720b6f3-83f9-4b2e-9005-09fc336f3f8f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:51.667413 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a720b6f3-83f9-4b2e-9005-09fc336f3f8f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:51.670928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a720b6f3-83f9-4b2e-9005-09fc336f3f8f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:51.671388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a720b6f3-83f9-4b2e-9005-09fc336f3f8f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:51.671812 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a720b6f3-83f9-4b2e-9005-09fc336f3f8f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:51.701086 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a720b6f3-83f9-4b2e-9005-09fc336f3f8f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046640 Aug 24 12:42:51.701636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 839/1678] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:51 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:52.049816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ffbe02db-2799-452a-b75c-6f11b5e4e4fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:52.051977 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ffbe02db-2799-452a-b75c-6f11b5e4e4fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:52.058271 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ffbe02db-2799-452a-b75c-6f11b5e4e4fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:52.058776 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ffbe02db-2799-452a-b75c-6f11b5e4e4fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:52.059205 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ffbe02db-2799-452a-b75c-6f11b5e4e4fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:52.059874 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ffbe02db-2799-452a-b75c-6f11b5e4e4fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:52.060315 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ffbe02db-2799-452a-b75c-6f11b5e4e4fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:52.060733 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ffbe02db-2799-452a-b75c-6f11b5e4e4fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:52.087986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ffbe02db-2799-452a-b75c-6f11b5e4e4fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042058 Aug 24 12:42:52.088517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 840/1679] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:52 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:52.216938 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-408b4704-9146-4291-a09c-83e89fbabc47 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:52.219154 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-408b4704-9146-4291-a09c-83e89fbabc47 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:52.225449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-408b4704-9146-4291-a09c-83e89fbabc47 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:52.225928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-408b4704-9146-4291-a09c-83e89fbabc47 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:52.226363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-408b4704-9146-4291-a09c-83e89fbabc47 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:52.227082 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-408b4704-9146-4291-a09c-83e89fbabc47 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:52.227537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-408b4704-9146-4291-a09c-83e89fbabc47 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:52.227979 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-408b4704-9146-4291-a09c-83e89fbabc47 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:52.255954 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-408b4704-9146-4291-a09c-83e89fbabc47 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043687 Aug 24 12:42:52.256481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 840/1680] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:52 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:52.420550 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e1eac297-a1d6-40e0-90f1-14fa5a2372af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:52.422615 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e1eac297-a1d6-40e0-90f1-14fa5a2372af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:52.428493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1eac297-a1d6-40e0-90f1-14fa5a2372af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:52.428965 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1eac297-a1d6-40e0-90f1-14fa5a2372af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:52.429398 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1eac297-a1d6-40e0-90f1-14fa5a2372af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:52.430077 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1eac297-a1d6-40e0-90f1-14fa5a2372af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:52.430518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1eac297-a1d6-40e0-90f1-14fa5a2372af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:52.430958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1eac297-a1d6-40e0-90f1-14fa5a2372af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:52.459694 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e1eac297-a1d6-40e0-90f1-14fa5a2372af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043067 Aug 24 12:42:52.460248 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 841/1681] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:52 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:52.713625 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d688bb8f-ea85-442b-b6b7-49d637d1c8b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:52.715845 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d688bb8f-ea85-442b-b6b7-49d637d1c8b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:52.721864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d688bb8f-ea85-442b-b6b7-49d637d1c8b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:52.722354 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d688bb8f-ea85-442b-b6b7-49d637d1c8b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:52.722829 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d688bb8f-ea85-442b-b6b7-49d637d1c8b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:52.723519 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d688bb8f-ea85-442b-b6b7-49d637d1c8b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:52.723975 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d688bb8f-ea85-442b-b6b7-49d637d1c8b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:52.724402 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d688bb8f-ea85-442b-b6b7-49d637d1c8b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:52.753301 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d688bb8f-ea85-442b-b6b7-49d637d1c8b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044071 Aug 24 12:42:52.753851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 841/1682] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:52 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:53.100748 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c908e2f0-7eb5-4155-a6d7-b68516395821 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:53.102914 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c908e2f0-7eb5-4155-a6d7-b68516395821 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:53.109717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c908e2f0-7eb5-4155-a6d7-b68516395821 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:53.110194 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c908e2f0-7eb5-4155-a6d7-b68516395821 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:53.110626 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c908e2f0-7eb5-4155-a6d7-b68516395821 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:53.111330 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c908e2f0-7eb5-4155-a6d7-b68516395821 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:53.111779 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c908e2f0-7eb5-4155-a6d7-b68516395821 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:53.112204 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c908e2f0-7eb5-4155-a6d7-b68516395821 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:53.140874 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c908e2f0-7eb5-4155-a6d7-b68516395821 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044105 Aug 24 12:42:53.141417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 842/1683] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:53 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:53.267366 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6e53c33e-4df7-4838-b9e5-5f0a7982ca86 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:53.269520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6e53c33e-4df7-4838-b9e5-5f0a7982ca86 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:53.275955 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e53c33e-4df7-4838-b9e5-5f0a7982ca86 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:53.276434 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e53c33e-4df7-4838-b9e5-5f0a7982ca86 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:53.276873 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e53c33e-4df7-4838-b9e5-5f0a7982ca86 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:53.277607 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e53c33e-4df7-4838-b9e5-5f0a7982ca86 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:53.278066 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e53c33e-4df7-4838-b9e5-5f0a7982ca86 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:53.278490 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e53c33e-4df7-4838-b9e5-5f0a7982ca86 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:53.307586 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6e53c33e-4df7-4838-b9e5-5f0a7982ca86 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044113 Aug 24 12:42:53.308139 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 842/1684] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:53 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:53.471724 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-46a68e62-e3ef-4d22-9e22-2bb95485c805 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:53.473913 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-46a68e62-e3ef-4d22-9e22-2bb95485c805 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:53.479783 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46a68e62-e3ef-4d22-9e22-2bb95485c805 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:53.480829 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46a68e62-e3ef-4d22-9e22-2bb95485c805 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:53.481258 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46a68e62-e3ef-4d22-9e22-2bb95485c805 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:53.481935 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46a68e62-e3ef-4d22-9e22-2bb95485c805 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:53.482377 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46a68e62-e3ef-4d22-9e22-2bb95485c805 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:53.482827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46a68e62-e3ef-4d22-9e22-2bb95485c805 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:53.511212 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-46a68e62-e3ef-4d22-9e22-2bb95485c805 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043423 Aug 24 12:42:53.511791 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 843/1685] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:53 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:53.766048 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f2c16223-1a4d-4579-bc49-fe863171033e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:53.768215 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f2c16223-1a4d-4579-bc49-fe863171033e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:53.774110 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2c16223-1a4d-4579-bc49-fe863171033e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:53.774593 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2c16223-1a4d-4579-bc49-fe863171033e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:53.775060 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2c16223-1a4d-4579-bc49-fe863171033e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:53.775749 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2c16223-1a4d-4579-bc49-fe863171033e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:53.776208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2c16223-1a4d-4579-bc49-fe863171033e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:53.776633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2c16223-1a4d-4579-bc49-fe863171033e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:53.805436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f2c16223-1a4d-4579-bc49-fe863171033e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043930 Aug 24 12:42:53.805973 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 843/1686] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:53 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:54.152081 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f934d2cb-d309-4df8-8e91-b0c444e703e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:54.154257 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f934d2cb-d309-4df8-8e91-b0c444e703e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:54.160536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f934d2cb-d309-4df8-8e91-b0c444e703e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:54.161007 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f934d2cb-d309-4df8-8e91-b0c444e703e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:54.161433 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f934d2cb-d309-4df8-8e91-b0c444e703e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:54.162107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f934d2cb-d309-4df8-8e91-b0c444e703e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:54.162547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f934d2cb-d309-4df8-8e91-b0c444e703e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:54.162991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f934d2cb-d309-4df8-8e91-b0c444e703e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:54.191331 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f934d2cb-d309-4df8-8e91-b0c444e703e2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043166 Aug 24 12:42:54.191855 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 844/1687] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:54 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:54.320495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e3f155cd-2d18-41d8-99b3-4e378304933b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:54.322643 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e3f155cd-2d18-41d8-99b3-4e378304933b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:54.328982 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3f155cd-2d18-41d8-99b3-4e378304933b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:54.329465 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3f155cd-2d18-41d8-99b3-4e378304933b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:54.329903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3f155cd-2d18-41d8-99b3-4e378304933b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:54.330595 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3f155cd-2d18-41d8-99b3-4e378304933b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:54.331079 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3f155cd-2d18-41d8-99b3-4e378304933b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:54.331504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3f155cd-2d18-41d8-99b3-4e378304933b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:54.369888 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e3f155cd-2d18-41d8-99b3-4e378304933b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053376 Aug 24 12:42:54.370450 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 844/1688] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:54 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:54.523621 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7b7973f9-50ed-4c61-b326-a191dacda756 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:54.525772 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7b7973f9-50ed-4c61-b326-a191dacda756 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:54.532271 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7b7973f9-50ed-4c61-b326-a191dacda756 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:54.532750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7b7973f9-50ed-4c61-b326-a191dacda756 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:54.533183 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7b7973f9-50ed-4c61-b326-a191dacda756 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:54.533886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7b7973f9-50ed-4c61-b326-a191dacda756 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:54.534337 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7b7973f9-50ed-4c61-b326-a191dacda756 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:54.534787 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7b7973f9-50ed-4c61-b326-a191dacda756 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:54.562445 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7b7973f9-50ed-4c61-b326-a191dacda756 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042829 Aug 24 12:42:54.563084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 845/1689] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:54 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:54.817528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a6bdc559-c7a7-496c-9056-94cc235c5edd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:54.819793 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a6bdc559-c7a7-496c-9056-94cc235c5edd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:54.826283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6bdc559-c7a7-496c-9056-94cc235c5edd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:54.826785 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6bdc559-c7a7-496c-9056-94cc235c5edd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:54.827226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6bdc559-c7a7-496c-9056-94cc235c5edd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:54.827920 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6bdc559-c7a7-496c-9056-94cc235c5edd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:54.828379 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6bdc559-c7a7-496c-9056-94cc235c5edd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:54.828808 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6bdc559-c7a7-496c-9056-94cc235c5edd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:54.857590 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a6bdc559-c7a7-496c-9056-94cc235c5edd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044006 Aug 24 12:42:54.858142 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 845/1690] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:54 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:55.203986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-191b14f9-a050-45e6-9c05-944bbfe0a547 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:55.206065 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-191b14f9-a050-45e6-9c05-944bbfe0a547 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:55.212547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-191b14f9-a050-45e6-9c05-944bbfe0a547 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:55.213025 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-191b14f9-a050-45e6-9c05-944bbfe0a547 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:55.213459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-191b14f9-a050-45e6-9c05-944bbfe0a547 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:55.214140 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-191b14f9-a050-45e6-9c05-944bbfe0a547 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:55.214586 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-191b14f9-a050-45e6-9c05-944bbfe0a547 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:55.215032 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-191b14f9-a050-45e6-9c05-944bbfe0a547 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:55.243265 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-191b14f9-a050-45e6-9c05-944bbfe0a547 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043342 Aug 24 12:42:55.243800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 846/1691] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:55 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:55.382601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a6919c07-b6dc-43e8-9601-c4e95a3c48da tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:55.384763 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a6919c07-b6dc-43e8-9601-c4e95a3c48da tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:55.391107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6919c07-b6dc-43e8-9601-c4e95a3c48da tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:55.391580 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6919c07-b6dc-43e8-9601-c4e95a3c48da tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:55.392017 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6919c07-b6dc-43e8-9601-c4e95a3c48da tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:55.392691 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6919c07-b6dc-43e8-9601-c4e95a3c48da tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:55.393136 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6919c07-b6dc-43e8-9601-c4e95a3c48da tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:55.393554 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6919c07-b6dc-43e8-9601-c4e95a3c48da tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:55.422636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a6919c07-b6dc-43e8-9601-c4e95a3c48da tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044084 Aug 24 12:42:55.423389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 846/1692] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:55 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:55.575080 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-75ec2108-fded-47b8-bbc1-12dbdd68b2ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:55.577194 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-75ec2108-fded-47b8-bbc1-12dbdd68b2ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:55.583034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-75ec2108-fded-47b8-bbc1-12dbdd68b2ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:55.583505 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-75ec2108-fded-47b8-bbc1-12dbdd68b2ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:55.583937 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-75ec2108-fded-47b8-bbc1-12dbdd68b2ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:55.584616 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-75ec2108-fded-47b8-bbc1-12dbdd68b2ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:55.585064 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-75ec2108-fded-47b8-bbc1-12dbdd68b2ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:55.585485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-75ec2108-fded-47b8-bbc1-12dbdd68b2ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:55.614219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-75ec2108-fded-47b8-bbc1-12dbdd68b2ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043397 Aug 24 12:42:55.614782 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 847/1693] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:55 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:55.870005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8237de8c-a1ae-4820-bc46-ae1e3caf0006 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:55.873674 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8237de8c-a1ae-4820-bc46-ae1e3caf0006 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:55.878617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8237de8c-a1ae-4820-bc46-ae1e3caf0006 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:55.879130 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8237de8c-a1ae-4820-bc46-ae1e3caf0006 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:55.879569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8237de8c-a1ae-4820-bc46-ae1e3caf0006 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:55.880302 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8237de8c-a1ae-4820-bc46-ae1e3caf0006 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:55.880757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8237de8c-a1ae-4820-bc46-ae1e3caf0006 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:55.881185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8237de8c-a1ae-4820-bc46-ae1e3caf0006 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:55.910662 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8237de8c-a1ae-4820-bc46-ae1e3caf0006 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044786 Aug 24 12:42:55.911232 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 847/1694] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:55 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:56.256056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fe69e803-5af0-4f45-94e2-51b229970882 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:56.258189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fe69e803-5af0-4f45-94e2-51b229970882 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:56.260466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:56.265051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fe69e803-5af0-4f45-94e2-51b229970882 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:56.265555 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fe69e803-5af0-4f45-94e2-51b229970882 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:56.265991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fe69e803-5af0-4f45-94e2-51b229970882 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:56.266691 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fe69e803-5af0-4f45-94e2-51b229970882 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:56.267143 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fe69e803-5af0-4f45-94e2-51b229970882 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:56.270515 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fe69e803-5af0-4f45-94e2-51b229970882 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:56.296284 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fe69e803-5af0-4f45-94e2-51b229970882 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044158 Aug 24 12:42:56.296989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 848/1695] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:56 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:56.435063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-be778944-6fc6-4fd1-b8ed-6d46ea3ab145 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:56.437213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-be778944-6fc6-4fd1-b8ed-6d46ea3ab145 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:56.439585 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:56.444204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be778944-6fc6-4fd1-b8ed-6d46ea3ab145 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:56.448520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be778944-6fc6-4fd1-b8ed-6d46ea3ab145 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:56.448520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be778944-6fc6-4fd1-b8ed-6d46ea3ab145 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:56.448520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be778944-6fc6-4fd1-b8ed-6d46ea3ab145 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:56.448520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be778944-6fc6-4fd1-b8ed-6d46ea3ab145 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:56.448908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be778944-6fc6-4fd1-b8ed-6d46ea3ab145 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:56.476476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-be778944-6fc6-4fd1-b8ed-6d46ea3ab145 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045415 Aug 24 12:42:56.477022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 848/1696] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:56 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:56.626512 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e126e1a2-625e-40d8-842b-56f765faea03 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:56.628655 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e126e1a2-625e-40d8-842b-56f765faea03 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:56.634399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e126e1a2-625e-40d8-842b-56f765faea03 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:56.634915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e126e1a2-625e-40d8-842b-56f765faea03 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:56.635353 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e126e1a2-625e-40d8-842b-56f765faea03 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:56.636032 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e126e1a2-625e-40d8-842b-56f765faea03 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:56.636478 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e126e1a2-625e-40d8-842b-56f765faea03 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:56.636897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e126e1a2-625e-40d8-842b-56f765faea03 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:56.665224 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e126e1a2-625e-40d8-842b-56f765faea03 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042903 Aug 24 12:42:56.665757 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 849/1697] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:56 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:56.923203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-22dca6ac-efe3-491a-ae36-10784eff5247 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:56.925419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-22dca6ac-efe3-491a-ae36-10784eff5247 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:56.931325 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-22dca6ac-efe3-491a-ae36-10784eff5247 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:56.931799 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-22dca6ac-efe3-491a-ae36-10784eff5247 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:56.932232 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-22dca6ac-efe3-491a-ae36-10784eff5247 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:56.932911 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-22dca6ac-efe3-491a-ae36-10784eff5247 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:56.933418 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-22dca6ac-efe3-491a-ae36-10784eff5247 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:56.933836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-22dca6ac-efe3-491a-ae36-10784eff5247 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:56.961815 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:56.967018 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-22dca6ac-efe3-491a-ae36-10784eff5247 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048019 Aug 24 12:42:56.967558 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 849/1698] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:56 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:57.308403 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-59816f88-563c-42d9-b6ef-76ed6c7c6c4a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:57.310530 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-59816f88-563c-42d9-b6ef-76ed6c7c6c4a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:57.316963 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59816f88-563c-42d9-b6ef-76ed6c7c6c4a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:57.317436 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59816f88-563c-42d9-b6ef-76ed6c7c6c4a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:57.317868 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59816f88-563c-42d9-b6ef-76ed6c7c6c4a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:57.318550 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59816f88-563c-42d9-b6ef-76ed6c7c6c4a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:57.319089 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59816f88-563c-42d9-b6ef-76ed6c7c6c4a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:57.319511 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59816f88-563c-42d9-b6ef-76ed6c7c6c4a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:57.348396 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-59816f88-563c-42d9-b6ef-76ed6c7c6c4a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044272 Aug 24 12:42:57.348936 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 850/1699] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:57 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:57.489858 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-37be3221-acd3-4650-ae41-6bb39e68ee3f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:57.492026 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-37be3221-acd3-4650-ae41-6bb39e68ee3f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:57.499393 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37be3221-acd3-4650-ae41-6bb39e68ee3f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:57.499866 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37be3221-acd3-4650-ae41-6bb39e68ee3f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:57.500295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37be3221-acd3-4650-ae41-6bb39e68ee3f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:57.500970 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37be3221-acd3-4650-ae41-6bb39e68ee3f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:57.501416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37be3221-acd3-4650-ae41-6bb39e68ee3f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:57.501833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37be3221-acd3-4650-ae41-6bb39e68ee3f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:57.530208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-37be3221-acd3-4650-ae41-6bb39e68ee3f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044684 Aug 24 12:42:57.530802 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 850/1700] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:57 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:57.677876 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2c81b9cb-e16a-4689-a1dd-3a002f1db875 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:57.680038 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2c81b9cb-e16a-4689-a1dd-3a002f1db875 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:57.686386 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c81b9cb-e16a-4689-a1dd-3a002f1db875 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:57.686896 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c81b9cb-e16a-4689-a1dd-3a002f1db875 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:57.687361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c81b9cb-e16a-4689-a1dd-3a002f1db875 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:57.688049 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c81b9cb-e16a-4689-a1dd-3a002f1db875 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:57.688501 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c81b9cb-e16a-4689-a1dd-3a002f1db875 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:57.688924 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c81b9cb-e16a-4689-a1dd-3a002f1db875 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:57.713221 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:57.717798 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2c81b9cb-e16a-4689-a1dd-3a002f1db875 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043954 Aug 24 12:42:57.718338 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 851/1701] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:57 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:57.979498 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4f0bca1f-559d-407b-b122-97c46396f22c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:57.982074 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4f0bca1f-559d-407b-b122-97c46396f22c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:57.987934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4f0bca1f-559d-407b-b122-97c46396f22c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:57.988408 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4f0bca1f-559d-407b-b122-97c46396f22c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:57.989100 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4f0bca1f-559d-407b-b122-97c46396f22c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:57.989778 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4f0bca1f-559d-407b-b122-97c46396f22c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:57.990228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4f0bca1f-559d-407b-b122-97c46396f22c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:57.990674 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4f0bca1f-559d-407b-b122-97c46396f22c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:58.019600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4f0bca1f-559d-407b-b122-97c46396f22c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044054 Aug 24 12:42:58.020147 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 851/1702] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:57 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:58.361608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-96178949-97b7-4133-8308-0fbe26c5b925 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:58.364012 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-96178949-97b7-4133-8308-0fbe26c5b925 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:58.370482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96178949-97b7-4133-8308-0fbe26c5b925 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:58.371065 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96178949-97b7-4133-8308-0fbe26c5b925 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:58.371502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96178949-97b7-4133-8308-0fbe26c5b925 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:58.372188 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96178949-97b7-4133-8308-0fbe26c5b925 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:58.372634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96178949-97b7-4133-8308-0fbe26c5b925 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:58.373053 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96178949-97b7-4133-8308-0fbe26c5b925 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:58.400421 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-96178949-97b7-4133-8308-0fbe26c5b925 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043154 Aug 24 12:42:58.400954 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 852/1703] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:58 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:58.542200 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-13d0f1a3-20c9-43ba-8523-d7474caa8ae1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:58.544942 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-13d0f1a3-20c9-43ba-8523-d7474caa8ae1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:58.551234 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13d0f1a3-20c9-43ba-8523-d7474caa8ae1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:58.551713 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13d0f1a3-20c9-43ba-8523-d7474caa8ae1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:58.552141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13d0f1a3-20c9-43ba-8523-d7474caa8ae1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:58.552819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13d0f1a3-20c9-43ba-8523-d7474caa8ae1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:58.553267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13d0f1a3-20c9-43ba-8523-d7474caa8ae1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:58.553687 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13d0f1a3-20c9-43ba-8523-d7474caa8ae1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:58.581638 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-13d0f1a3-20c9-43ba-8523-d7474caa8ae1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043428 Aug 24 12:42:58.582170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 852/1704] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:58 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:58.729402 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ae7f5631-9912-432d-80ee-717bf6d6bd10 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:58.731649 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ae7f5631-9912-432d-80ee-717bf6d6bd10 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:58.737622 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ae7f5631-9912-432d-80ee-717bf6d6bd10 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:58.738107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ae7f5631-9912-432d-80ee-717bf6d6bd10 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:58.738539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ae7f5631-9912-432d-80ee-717bf6d6bd10 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:58.739512 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ae7f5631-9912-432d-80ee-717bf6d6bd10 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:58.739968 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ae7f5631-9912-432d-80ee-717bf6d6bd10 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:58.740389 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ae7f5631-9912-432d-80ee-717bf6d6bd10 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:58.768887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ae7f5631-9912-432d-80ee-717bf6d6bd10 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043450 Aug 24 12:42:58.769426 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 853/1705] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:58 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:59.031002 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3725b16f-81f2-4bc6-99bf-c7d13239cda6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:59.033178 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3725b16f-81f2-4bc6-99bf-c7d13239cda6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:59.039033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3725b16f-81f2-4bc6-99bf-c7d13239cda6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:59.039541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3725b16f-81f2-4bc6-99bf-c7d13239cda6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:59.039980 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3725b16f-81f2-4bc6-99bf-c7d13239cda6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:59.040667 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3725b16f-81f2-4bc6-99bf-c7d13239cda6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:59.041123 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3725b16f-81f2-4bc6-99bf-c7d13239cda6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:59.041555 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3725b16f-81f2-4bc6-99bf-c7d13239cda6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:59.070522 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3725b16f-81f2-4bc6-99bf-c7d13239cda6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043497 Aug 24 12:42:59.071100 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 853/1706] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:59 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:59.413143 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-dd4125bb-9846-4a5a-ac42-b1d7e31d0e92 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:59.415508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-dd4125bb-9846-4a5a-ac42-b1d7e31d0e92 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:59.422424 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd4125bb-9846-4a5a-ac42-b1d7e31d0e92 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:59.422956 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd4125bb-9846-4a5a-ac42-b1d7e31d0e92 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:59.423435 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd4125bb-9846-4a5a-ac42-b1d7e31d0e92 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:59.424143 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd4125bb-9846-4a5a-ac42-b1d7e31d0e92 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:59.424590 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd4125bb-9846-4a5a-ac42-b1d7e31d0e92 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:59.425010 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd4125bb-9846-4a5a-ac42-b1d7e31d0e92 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:59.453987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-dd4125bb-9846-4a5a-ac42-b1d7e31d0e92 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044843 Aug 24 12:42:59.454521 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 854/1707] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:59 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:59.593834 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2c552ed2-a645-439b-8caa-8dd4f8e1108d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:59.595993 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2c552ed2-a645-439b-8caa-8dd4f8e1108d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:59.602333 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c552ed2-a645-439b-8caa-8dd4f8e1108d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:59.602855 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c552ed2-a645-439b-8caa-8dd4f8e1108d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:59.603292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c552ed2-a645-439b-8caa-8dd4f8e1108d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:59.603975 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c552ed2-a645-439b-8caa-8dd4f8e1108d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:59.604428 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c552ed2-a645-439b-8caa-8dd4f8e1108d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:59.605341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c552ed2-a645-439b-8caa-8dd4f8e1108d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:59.634205 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2c552ed2-a645-439b-8caa-8dd4f8e1108d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044448 Aug 24 12:42:59.634754 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 854/1708] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 24 12:42:59 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:42:59.781507 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6c24c795-208e-4ae3-b735-91f1d52be32e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:59.783705 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6c24c795-208e-4ae3-b735-91f1d52be32e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:59.789744 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c24c795-208e-4ae3-b735-91f1d52be32e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:59.790220 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c24c795-208e-4ae3-b735-91f1d52be32e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:59.790669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c24c795-208e-4ae3-b735-91f1d52be32e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:59.791345 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c24c795-208e-4ae3-b735-91f1d52be32e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:59.791789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c24c795-208e-4ae3-b735-91f1d52be32e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:59.792206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c24c795-208e-4ae3-b735-91f1d52be32e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:59.820519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6c24c795-208e-4ae3-b735-91f1d52be32e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043488 Aug 24 12:42:59.821052 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 855/1709] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:42:59 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:00.083389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-47b6c091-b5a4-447d-b8b3-0cb273e1e2d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:00.085559 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-47b6c091-b5a4-447d-b8b3-0cb273e1e2d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:00.091967 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-47b6c091-b5a4-447d-b8b3-0cb273e1e2d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:00.092452 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-47b6c091-b5a4-447d-b8b3-0cb273e1e2d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:00.092888 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-47b6c091-b5a4-447d-b8b3-0cb273e1e2d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:00.093581 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-47b6c091-b5a4-447d-b8b3-0cb273e1e2d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:00.094068 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-47b6c091-b5a4-447d-b8b3-0cb273e1e2d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:00.094505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-47b6c091-b5a4-447d-b8b3-0cb273e1e2d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:00.123347 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-47b6c091-b5a4-447d-b8b3-0cb273e1e2d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043833 Aug 24 12:43:00.123827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 855/1710] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:00 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:00.466201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fe3bc191-a0fe-48e5-bd90-e4be0e9874ba tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:00.468342 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fe3bc191-a0fe-48e5-bd90-e4be0e9874ba tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:00.474683 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fe3bc191-a0fe-48e5-bd90-e4be0e9874ba tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:00.475164 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fe3bc191-a0fe-48e5-bd90-e4be0e9874ba tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:00.475592 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fe3bc191-a0fe-48e5-bd90-e4be0e9874ba tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:00.476263 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fe3bc191-a0fe-48e5-bd90-e4be0e9874ba tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:00.476706 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fe3bc191-a0fe-48e5-bd90-e4be0e9874ba tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:00.477121 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fe3bc191-a0fe-48e5-bd90-e4be0e9874ba tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:00.505839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fe3bc191-a0fe-48e5-bd90-e4be0e9874ba tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044266 Aug 24 12:43:00.506366 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 856/1711] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:00 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:00.645380 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-19112ee6-ad23-4360-928b-df5c20f994b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:43:00.647613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-19112ee6-ad23-4360-928b-df5c20f994b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:00.653940 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-19112ee6-ad23-4360-928b-df5c20f994b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:00.654422 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-19112ee6-ad23-4360-928b-df5c20f994b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:00.654906 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-19112ee6-ad23-4360-928b-df5c20f994b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:00.655598 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-19112ee6-ad23-4360-928b-df5c20f994b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:00.656050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-19112ee6-ad23-4360-928b-df5c20f994b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:00.656495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-19112ee6-ad23-4360-928b-df5c20f994b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:00.758431 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-19112ee6-ad23-4360-928b-df5c20f994b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "POST /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/action" status: 200 len: 37860 microversion: 2.20 time: 0.116718 Aug 24 12:43:00.759787 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 856/1712] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Aug 24 12:43:00 2022] POST /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3/action => generated 37860 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:43:00.832517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6e325c40-f5eb-451f-92a1-b6dfcabd7d7b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:00.834745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6e325c40-f5eb-451f-92a1-b6dfcabd7d7b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:00.840475 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e325c40-f5eb-451f-92a1-b6dfcabd7d7b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:00.840946 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e325c40-f5eb-451f-92a1-b6dfcabd7d7b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:00.841371 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e325c40-f5eb-451f-92a1-b6dfcabd7d7b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:00.842042 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e325c40-f5eb-451f-92a1-b6dfcabd7d7b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:00.842487 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e325c40-f5eb-451f-92a1-b6dfcabd7d7b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:00.842933 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e325c40-f5eb-451f-92a1-b6dfcabd7d7b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:00.871874 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6e325c40-f5eb-451f-92a1-b6dfcabd7d7b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043276 Aug 24 12:43:00.872407 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 857/1713] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:00 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:01.136115 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b536f0c0-f1e6-4de4-85c2-2f9ddcff117e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:01.138256 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b536f0c0-f1e6-4de4-85c2-2f9ddcff117e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:01.145200 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b536f0c0-f1e6-4de4-85c2-2f9ddcff117e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:01.145694 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b536f0c0-f1e6-4de4-85c2-2f9ddcff117e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:01.146115 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b536f0c0-f1e6-4de4-85c2-2f9ddcff117e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:01.146818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b536f0c0-f1e6-4de4-85c2-2f9ddcff117e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:01.147275 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b536f0c0-f1e6-4de4-85c2-2f9ddcff117e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:01.147696 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b536f0c0-f1e6-4de4-85c2-2f9ddcff117e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:01.178019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b536f0c0-f1e6-4de4-85c2-2f9ddcff117e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046341 Aug 24 12:43:01.178552 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 857/1714] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:01 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:01.517438 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0d606cee-8a55-41bd-9d20-00ae79427b44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:01.519607 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0d606cee-8a55-41bd-9d20-00ae79427b44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:01.525975 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d606cee-8a55-41bd-9d20-00ae79427b44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:01.526449 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d606cee-8a55-41bd-9d20-00ae79427b44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:01.533363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d606cee-8a55-41bd-9d20-00ae79427b44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:01.533363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d606cee-8a55-41bd-9d20-00ae79427b44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:01.533363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d606cee-8a55-41bd-9d20-00ae79427b44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:01.533363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d606cee-8a55-41bd-9d20-00ae79427b44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:01.557315 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0d606cee-8a55-41bd-9d20-00ae79427b44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043840 Aug 24 12:43:01.561849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 858/1715] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:01 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:01.883489 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f13483d4-3412-417a-821c-200f4cddb6c4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:01.885647 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f13483d4-3412-417a-821c-200f4cddb6c4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:01.892577 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f13483d4-3412-417a-821c-200f4cddb6c4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:01.893066 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f13483d4-3412-417a-821c-200f4cddb6c4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:01.893509 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f13483d4-3412-417a-821c-200f4cddb6c4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:01.894204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f13483d4-3412-417a-821c-200f4cddb6c4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:01.894686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f13483d4-3412-417a-821c-200f4cddb6c4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:01.895120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f13483d4-3412-417a-821c-200f4cddb6c4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:01.923967 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f13483d4-3412-417a-821c-200f4cddb6c4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044428 Aug 24 12:43:01.924510 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 858/1716] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:01 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:02.189522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e1b3033e-e767-4ef9-8cbd-04ada357e47b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:02.191597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e1b3033e-e767-4ef9-8cbd-04ada357e47b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:02.197438 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1b3033e-e767-4ef9-8cbd-04ada357e47b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:02.197910 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1b3033e-e767-4ef9-8cbd-04ada357e47b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:02.198342 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1b3033e-e767-4ef9-8cbd-04ada357e47b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:02.199043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1b3033e-e767-4ef9-8cbd-04ada357e47b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:02.199489 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1b3033e-e767-4ef9-8cbd-04ada357e47b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:02.199906 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1b3033e-e767-4ef9-8cbd-04ada357e47b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:02.228296 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e1b3033e-e767-4ef9-8cbd-04ada357e47b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042792 Aug 24 12:43:02.228824 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 859/1717] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:02 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:02.569436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b3dd8087-d0ce-4a6f-8896-34fb91bb443f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:02.571595 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b3dd8087-d0ce-4a6f-8896-34fb91bb443f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:02.578410 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3dd8087-d0ce-4a6f-8896-34fb91bb443f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:02.578936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3dd8087-d0ce-4a6f-8896-34fb91bb443f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:02.579377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3dd8087-d0ce-4a6f-8896-34fb91bb443f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:02.580061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3dd8087-d0ce-4a6f-8896-34fb91bb443f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:02.580517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3dd8087-d0ce-4a6f-8896-34fb91bb443f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:02.580969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3dd8087-d0ce-4a6f-8896-34fb91bb443f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:02.608883 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b3dd8087-d0ce-4a6f-8896-34fb91bb443f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043502 Aug 24 12:43:02.609416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 859/1718] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:02 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:02.936456 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-41ce2099-ef10-43d1-97b9-892e54007980 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:02.938638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-41ce2099-ef10-43d1-97b9-892e54007980 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:02.944940 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41ce2099-ef10-43d1-97b9-892e54007980 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:02.945416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41ce2099-ef10-43d1-97b9-892e54007980 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:02.945844 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41ce2099-ef10-43d1-97b9-892e54007980 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:02.946516 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41ce2099-ef10-43d1-97b9-892e54007980 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:02.946991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41ce2099-ef10-43d1-97b9-892e54007980 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:02.947427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41ce2099-ef10-43d1-97b9-892e54007980 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:02.976499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-41ce2099-ef10-43d1-97b9-892e54007980 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044382 Aug 24 12:43:02.977073 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 860/1719] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:02 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:03.241364 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9eeaee64-a8af-49b7-90d1-1fb13288dfb2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:03.243557 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9eeaee64-a8af-49b7-90d1-1fb13288dfb2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:03.250439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9eeaee64-a8af-49b7-90d1-1fb13288dfb2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:03.250953 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9eeaee64-a8af-49b7-90d1-1fb13288dfb2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:03.251388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9eeaee64-a8af-49b7-90d1-1fb13288dfb2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:03.252070 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9eeaee64-a8af-49b7-90d1-1fb13288dfb2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:03.252518 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9eeaee64-a8af-49b7-90d1-1fb13288dfb2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:03.252951 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9eeaee64-a8af-49b7-90d1-1fb13288dfb2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:03.280791 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9eeaee64-a8af-49b7-90d1-1fb13288dfb2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043606 Aug 24 12:43:03.281327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 860/1720] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:03 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:03.621543 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0f466979-da6b-4cd1-9ee9-db48624cfff0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:03.623690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0f466979-da6b-4cd1-9ee9-db48624cfff0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:03.629555 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f466979-da6b-4cd1-9ee9-db48624cfff0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:03.630033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f466979-da6b-4cd1-9ee9-db48624cfff0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:03.630464 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f466979-da6b-4cd1-9ee9-db48624cfff0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:03.631176 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f466979-da6b-4cd1-9ee9-db48624cfff0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:03.631625 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f466979-da6b-4cd1-9ee9-db48624cfff0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:03.632043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f466979-da6b-4cd1-9ee9-db48624cfff0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:03.660036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0f466979-da6b-4cd1-9ee9-db48624cfff0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042892 Aug 24 12:43:03.660566 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 861/1721] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:03 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:03.988532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3a4b3abf-3180-4dda-8636-0074b08e3f1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:03.990987 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3a4b3abf-3180-4dda-8636-0074b08e3f1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:03.998038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a4b3abf-3180-4dda-8636-0074b08e3f1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:03.998550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a4b3abf-3180-4dda-8636-0074b08e3f1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:03.999022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a4b3abf-3180-4dda-8636-0074b08e3f1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:03.999718 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a4b3abf-3180-4dda-8636-0074b08e3f1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:04.000177 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a4b3abf-3180-4dda-8636-0074b08e3f1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:04.000604 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a4b3abf-3180-4dda-8636-0074b08e3f1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:04.028856 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3a4b3abf-3180-4dda-8636-0074b08e3f1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044275 Aug 24 12:43:04.029402 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 861/1722] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:03 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:04.293152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-98d02c80-f2df-4981-8ccb-9e40a9d13d81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:04.295332 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-98d02c80-f2df-4981-8ccb-9e40a9d13d81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:04.301771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98d02c80-f2df-4981-8ccb-9e40a9d13d81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:04.302249 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98d02c80-f2df-4981-8ccb-9e40a9d13d81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:04.302707 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98d02c80-f2df-4981-8ccb-9e40a9d13d81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:04.303396 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98d02c80-f2df-4981-8ccb-9e40a9d13d81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:04.303850 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98d02c80-f2df-4981-8ccb-9e40a9d13d81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:04.304272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98d02c80-f2df-4981-8ccb-9e40a9d13d81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:04.333301 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-98d02c80-f2df-4981-8ccb-9e40a9d13d81 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044582 Aug 24 12:43:04.333897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 862/1723] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:04 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:04.672074 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-765ce21c-ee4f-4984-9276-cd81dac5c088 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:04.674221 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-765ce21c-ee4f-4984-9276-cd81dac5c088 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:04.680659 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-765ce21c-ee4f-4984-9276-cd81dac5c088 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:04.681149 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-765ce21c-ee4f-4984-9276-cd81dac5c088 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:04.681590 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-765ce21c-ee4f-4984-9276-cd81dac5c088 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:04.682279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-765ce21c-ee4f-4984-9276-cd81dac5c088 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:04.682770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-765ce21c-ee4f-4984-9276-cd81dac5c088 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:04.683205 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-765ce21c-ee4f-4984-9276-cd81dac5c088 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:04.711458 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-765ce21c-ee4f-4984-9276-cd81dac5c088 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043344 Aug 24 12:43:04.712004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 862/1724] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:04 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:05.040843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5af182ef-ebcc-4e6c-ac7c-7da4a67d0a44 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:05.043019 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5af182ef-ebcc-4e6c-ac7c-7da4a67d0a44 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:05.048918 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5af182ef-ebcc-4e6c-ac7c-7da4a67d0a44 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:05.049398 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5af182ef-ebcc-4e6c-ac7c-7da4a67d0a44 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:05.049836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5af182ef-ebcc-4e6c-ac7c-7da4a67d0a44 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:05.050519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5af182ef-ebcc-4e6c-ac7c-7da4a67d0a44 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:05.051006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5af182ef-ebcc-4e6c-ac7c-7da4a67d0a44 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:05.051431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5af182ef-ebcc-4e6c-ac7c-7da4a67d0a44 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:05.080788 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5af182ef-ebcc-4e6c-ac7c-7da4a67d0a44 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043873 Aug 24 12:43:05.081329 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 863/1725] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:05 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:05.345572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c4c9bed2-7a38-47c1-8389-6d7121215672 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:05.347685 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c4c9bed2-7a38-47c1-8389-6d7121215672 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:05.353557 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c4c9bed2-7a38-47c1-8389-6d7121215672 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:05.354071 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c4c9bed2-7a38-47c1-8389-6d7121215672 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:05.354510 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c4c9bed2-7a38-47c1-8389-6d7121215672 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:05.355746 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c4c9bed2-7a38-47c1-8389-6d7121215672 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:05.356201 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c4c9bed2-7a38-47c1-8389-6d7121215672 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:05.356627 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c4c9bed2-7a38-47c1-8389-6d7121215672 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:05.385375 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c4c9bed2-7a38-47c1-8389-6d7121215672 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043893 Aug 24 12:43:05.385924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 863/1726] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:05 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:05.724142 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8907e752-1185-4907-a1b0-18be819637a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:05.726287 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8907e752-1185-4907-a1b0-18be819637a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:05.733569 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8907e752-1185-4907-a1b0-18be819637a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:05.734045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8907e752-1185-4907-a1b0-18be819637a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:05.734472 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8907e752-1185-4907-a1b0-18be819637a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:05.735178 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8907e752-1185-4907-a1b0-18be819637a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:05.735664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8907e752-1185-4907-a1b0-18be819637a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:05.736079 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8907e752-1185-4907-a1b0-18be819637a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:05.764095 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8907e752-1185-4907-a1b0-18be819637a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043873 Aug 24 12:43:05.764627 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 864/1727] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:05 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:06.093362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-df1f4608-241b-42c6-9085-855304f34141 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:06.095579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-df1f4608-241b-42c6-9085-855304f34141 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:06.101779 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df1f4608-241b-42c6-9085-855304f34141 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:06.102256 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df1f4608-241b-42c6-9085-855304f34141 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:06.102709 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df1f4608-241b-42c6-9085-855304f34141 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:06.103389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df1f4608-241b-42c6-9085-855304f34141 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:06.103843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df1f4608-241b-42c6-9085-855304f34141 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:06.104265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df1f4608-241b-42c6-9085-855304f34141 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:06.132343 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-df1f4608-241b-42c6-9085-855304f34141 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043474 Aug 24 12:43:06.132814 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 864/1728] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:06 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:06.397522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0292c6dd-0e56-4f60-81bf-0546132c323a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:06.399858 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0292c6dd-0e56-4f60-81bf-0546132c323a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:06.406302 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0292c6dd-0e56-4f60-81bf-0546132c323a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:06.406821 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0292c6dd-0e56-4f60-81bf-0546132c323a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:06.407257 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0292c6dd-0e56-4f60-81bf-0546132c323a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:06.407945 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0292c6dd-0e56-4f60-81bf-0546132c323a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:06.408399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0292c6dd-0e56-4f60-81bf-0546132c323a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:06.408848 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0292c6dd-0e56-4f60-81bf-0546132c323a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:06.437483 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0292c6dd-0e56-4f60-81bf-0546132c323a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043998 Aug 24 12:43:06.438034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 865/1729] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:06 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:43:06.775645 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2c0332d2-6c23-4ef6-8c37-4f252f8e65d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:06.778318 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2c0332d2-6c23-4ef6-8c37-4f252f8e65d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:06.784283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c0332d2-6c23-4ef6-8c37-4f252f8e65d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:06.784776 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c0332d2-6c23-4ef6-8c37-4f252f8e65d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:06.785197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c0332d2-6c23-4ef6-8c37-4f252f8e65d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:06.785879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c0332d2-6c23-4ef6-8c37-4f252f8e65d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:06.786331 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c0332d2-6c23-4ef6-8c37-4f252f8e65d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:06.786794 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c0332d2-6c23-4ef6-8c37-4f252f8e65d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:06.814739 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2c0332d2-6c23-4ef6-8c37-4f252f8e65d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043034 Aug 24 12:43:06.815279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 865/1730] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:06 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:07.144710 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5fa5dae3-1e51-4d1d-b040-405f8943f57b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:07.146961 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5fa5dae3-1e51-4d1d-b040-405f8943f57b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:07.154295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5fa5dae3-1e51-4d1d-b040-405f8943f57b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:07.154799 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5fa5dae3-1e51-4d1d-b040-405f8943f57b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:07.155238 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5fa5dae3-1e51-4d1d-b040-405f8943f57b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:07.155930 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5fa5dae3-1e51-4d1d-b040-405f8943f57b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:07.156386 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5fa5dae3-1e51-4d1d-b040-405f8943f57b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:07.156812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5fa5dae3-1e51-4d1d-b040-405f8943f57b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:07.186048 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5fa5dae3-1e51-4d1d-b040-405f8943f57b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045306 Aug 24 12:43:07.186871 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 866/1731] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:07 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:07.449765 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5c1aa57e-a378-48af-aa05-0cc9e699e50b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:07.451947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5c1aa57e-a378-48af-aa05-0cc9e699e50b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:07.458548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5c1aa57e-a378-48af-aa05-0cc9e699e50b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:07.459065 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5c1aa57e-a378-48af-aa05-0cc9e699e50b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:07.459498 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5c1aa57e-a378-48af-aa05-0cc9e699e50b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:07.460201 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5c1aa57e-a378-48af-aa05-0cc9e699e50b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:07.460657 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5c1aa57e-a378-48af-aa05-0cc9e699e50b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:07.461080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5c1aa57e-a378-48af-aa05-0cc9e699e50b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:07.487456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:07.494242 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5c1aa57e-a378-48af-aa05-0cc9e699e50b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048423 Aug 24 12:43:07.494951 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 866/1732] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:07 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:07.827403 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-069f8f68-d440-4795-b576-9b0fe0bfc5b2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:07.829608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-069f8f68-d440-4795-b576-9b0fe0bfc5b2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:07.835402 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-069f8f68-d440-4795-b576-9b0fe0bfc5b2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:07.835875 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-069f8f68-d440-4795-b576-9b0fe0bfc5b2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:07.836303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-069f8f68-d440-4795-b576-9b0fe0bfc5b2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:07.836980 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-069f8f68-d440-4795-b576-9b0fe0bfc5b2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:07.837425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-069f8f68-d440-4795-b576-9b0fe0bfc5b2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:07.837840 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-069f8f68-d440-4795-b576-9b0fe0bfc5b2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:07.866896 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-069f8f68-d440-4795-b576-9b0fe0bfc5b2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043892 Aug 24 12:43:07.867644 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 867/1733] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:07 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:08.197448 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-80b0e009-304c-4ff6-a803-9d7a6949f43c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:08.200250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-80b0e009-304c-4ff6-a803-9d7a6949f43c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:08.206381 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-80b0e009-304c-4ff6-a803-9d7a6949f43c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:08.206894 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-80b0e009-304c-4ff6-a803-9d7a6949f43c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:08.207344 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-80b0e009-304c-4ff6-a803-9d7a6949f43c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:08.208029 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-80b0e009-304c-4ff6-a803-9d7a6949f43c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:08.208486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-80b0e009-304c-4ff6-a803-9d7a6949f43c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:08.208913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-80b0e009-304c-4ff6-a803-9d7a6949f43c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:08.237042 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-80b0e009-304c-4ff6-a803-9d7a6949f43c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043652 Aug 24 12:43:08.237585 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 867/1734] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:08 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:08.506806 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2bb35574-08be-4a8f-a8b3-1475519c3fa6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:08.508928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2bb35574-08be-4a8f-a8b3-1475519c3fa6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:08.515209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2bb35574-08be-4a8f-a8b3-1475519c3fa6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:08.515683 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2bb35574-08be-4a8f-a8b3-1475519c3fa6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:08.516114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2bb35574-08be-4a8f-a8b3-1475519c3fa6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:08.516803 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2bb35574-08be-4a8f-a8b3-1475519c3fa6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:08.517231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2bb35574-08be-4a8f-a8b3-1475519c3fa6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:08.517646 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2bb35574-08be-4a8f-a8b3-1475519c3fa6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:08.534004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:08.546573 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2bb35574-08be-4a8f-a8b3-1475519c3fa6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043762 Aug 24 12:43:08.550943 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 868/1735] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:08 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:08.945952 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f18fddb1-e474-4076-8515-210c04b28481 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:08.948396 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f18fddb1-e474-4076-8515-210c04b28481 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:08.954193 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f18fddb1-e474-4076-8515-210c04b28481 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:08.954701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f18fddb1-e474-4076-8515-210c04b28481 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:08.955145 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f18fddb1-e474-4076-8515-210c04b28481 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:08.955858 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f18fddb1-e474-4076-8515-210c04b28481 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:08.956330 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f18fddb1-e474-4076-8515-210c04b28481 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:08.956740 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f18fddb1-e474-4076-8515-210c04b28481 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:08.985519 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f18fddb1-e474-4076-8515-210c04b28481 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110613 Aug 24 12:43:08.986063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 868/1736] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:08 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:09.249354 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1793c392-11da-41b9-ba08-5df27ef2b098 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:09.251756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1793c392-11da-41b9-ba08-5df27ef2b098 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:09.257962 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1793c392-11da-41b9-ba08-5df27ef2b098 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:09.258446 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1793c392-11da-41b9-ba08-5df27ef2b098 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:09.258904 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1793c392-11da-41b9-ba08-5df27ef2b098 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:09.259592 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1793c392-11da-41b9-ba08-5df27ef2b098 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:09.260154 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1793c392-11da-41b9-ba08-5df27ef2b098 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:09.260584 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1793c392-11da-41b9-ba08-5df27ef2b098 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:09.290064 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1793c392-11da-41b9-ba08-5df27ef2b098 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044608 Aug 24 12:43:09.290605 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 869/1737] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:09 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:09.561710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d11bdfff-f6e2-4bfb-b6f0-93fe5d90565f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:09.563908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d11bdfff-f6e2-4bfb-b6f0-93fe5d90565f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:09.569760 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d11bdfff-f6e2-4bfb-b6f0-93fe5d90565f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:09.570243 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d11bdfff-f6e2-4bfb-b6f0-93fe5d90565f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:09.570703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d11bdfff-f6e2-4bfb-b6f0-93fe5d90565f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:09.571393 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d11bdfff-f6e2-4bfb-b6f0-93fe5d90565f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:09.571851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d11bdfff-f6e2-4bfb-b6f0-93fe5d90565f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:09.572280 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d11bdfff-f6e2-4bfb-b6f0-93fe5d90565f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:09.601431 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d11bdfff-f6e2-4bfb-b6f0-93fe5d90565f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044251 Aug 24 12:43:09.601971 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 869/1738] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:09 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:09.998549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5ba9e06a-b264-460c-bc66-177902e839da tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:10.000700 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5ba9e06a-b264-460c-bc66-177902e839da tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:10.006997 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ba9e06a-b264-460c-bc66-177902e839da tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:10.007467 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ba9e06a-b264-460c-bc66-177902e839da tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:10.007896 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ba9e06a-b264-460c-bc66-177902e839da tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:10.008567 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ba9e06a-b264-460c-bc66-177902e839da tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:10.009008 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ba9e06a-b264-460c-bc66-177902e839da tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:10.009422 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ba9e06a-b264-460c-bc66-177902e839da tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:10.036671 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5ba9e06a-b264-460c-bc66-177902e839da tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042766 Aug 24 12:43:10.037200 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 870/1739] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:09 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:10.301482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e25d46ca-a4a8-4691-ba2e-0a84ebefbfd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:10.303693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e25d46ca-a4a8-4691-ba2e-0a84ebefbfd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:10.311394 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e25d46ca-a4a8-4691-ba2e-0a84ebefbfd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:10.311862 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e25d46ca-a4a8-4691-ba2e-0a84ebefbfd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:10.312300 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e25d46ca-a4a8-4691-ba2e-0a84ebefbfd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:10.312990 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e25d46ca-a4a8-4691-ba2e-0a84ebefbfd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:10.313445 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e25d46ca-a4a8-4691-ba2e-0a84ebefbfd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:10.313868 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e25d46ca-a4a8-4691-ba2e-0a84ebefbfd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:10.342572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e25d46ca-a4a8-4691-ba2e-0a84ebefbfd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045091 Aug 24 12:43:10.343144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 870/1740] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:10 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:10.613875 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cfaf1ed5-c645-4cce-923c-9014570b3bb7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:10.616087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cfaf1ed5-c645-4cce-923c-9014570b3bb7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:10.621952 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfaf1ed5-c645-4cce-923c-9014570b3bb7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:10.622434 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfaf1ed5-c645-4cce-923c-9014570b3bb7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:10.622911 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfaf1ed5-c645-4cce-923c-9014570b3bb7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:10.623629 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfaf1ed5-c645-4cce-923c-9014570b3bb7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:10.624083 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfaf1ed5-c645-4cce-923c-9014570b3bb7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:10.624509 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfaf1ed5-c645-4cce-923c-9014570b3bb7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:10.653794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cfaf1ed5-c645-4cce-923c-9014570b3bb7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044106 Aug 24 12:43:10.654338 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 871/1741] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:10 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:11.049389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c898abf0-6dde-429d-88c0-1ac1f24a0943 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:11.051578 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c898abf0-6dde-429d-88c0-1ac1f24a0943 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:11.058030 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c898abf0-6dde-429d-88c0-1ac1f24a0943 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:11.058511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c898abf0-6dde-429d-88c0-1ac1f24a0943 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:11.058983 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c898abf0-6dde-429d-88c0-1ac1f24a0943 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:11.059673 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c898abf0-6dde-429d-88c0-1ac1f24a0943 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:11.060120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c898abf0-6dde-429d-88c0-1ac1f24a0943 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:11.060537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c898abf0-6dde-429d-88c0-1ac1f24a0943 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:11.088205 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c898abf0-6dde-429d-88c0-1ac1f24a0943 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042770 Aug 24 12:43:11.088740 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 871/1742] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:11 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:11.354383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-212f80dc-f64c-43fa-b65c-e322d93bf319 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:11.356580 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-212f80dc-f64c-43fa-b65c-e322d93bf319 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:11.362865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-212f80dc-f64c-43fa-b65c-e322d93bf319 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:11.363421 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-212f80dc-f64c-43fa-b65c-e322d93bf319 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:11.364127 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-212f80dc-f64c-43fa-b65c-e322d93bf319 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:11.364812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-212f80dc-f64c-43fa-b65c-e322d93bf319 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:11.365272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-212f80dc-f64c-43fa-b65c-e322d93bf319 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:11.365699 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-212f80dc-f64c-43fa-b65c-e322d93bf319 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:11.404289 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-212f80dc-f64c-43fa-b65c-e322d93bf319 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053775 Aug 24 12:43:11.404831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 872/1743] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:11 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:11.665608 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a106fce7-943d-41f6-8da1-2bf0e42e536f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:11.667710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a106fce7-943d-41f6-8da1-2bf0e42e536f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:11.674074 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a106fce7-943d-41f6-8da1-2bf0e42e536f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:11.674558 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a106fce7-943d-41f6-8da1-2bf0e42e536f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:11.675028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a106fce7-943d-41f6-8da1-2bf0e42e536f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:11.675844 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a106fce7-943d-41f6-8da1-2bf0e42e536f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:11.676307 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a106fce7-943d-41f6-8da1-2bf0e42e536f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:11.676759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a106fce7-943d-41f6-8da1-2bf0e42e536f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:11.705116 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a106fce7-943d-41f6-8da1-2bf0e42e536f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043662 Aug 24 12:43:11.705650 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 872/1744] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:11 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:12.100942 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b19b8199-9d20-4fc8-879e-41c2b90755af tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:12.103105 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b19b8199-9d20-4fc8-879e-41c2b90755af tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:12.109483 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b19b8199-9d20-4fc8-879e-41c2b90755af tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:12.109963 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b19b8199-9d20-4fc8-879e-41c2b90755af tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:12.110424 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b19b8199-9d20-4fc8-879e-41c2b90755af tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:12.111141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b19b8199-9d20-4fc8-879e-41c2b90755af tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:12.111591 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b19b8199-9d20-4fc8-879e-41c2b90755af tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:12.112016 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b19b8199-9d20-4fc8-879e-41c2b90755af tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:12.140524 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b19b8199-9d20-4fc8-879e-41c2b90755af tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043672 Aug 24 12:43:12.141070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 873/1745] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:12 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:12.416476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ec8ce0b4-e530-40e4-af7a-82765907f82d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:12.426540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ec8ce0b4-e530-40e4-af7a-82765907f82d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:12.426540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec8ce0b4-e530-40e4-af7a-82765907f82d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:12.426540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec8ce0b4-e530-40e4-af7a-82765907f82d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:12.426540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec8ce0b4-e530-40e4-af7a-82765907f82d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:12.426904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec8ce0b4-e530-40e4-af7a-82765907f82d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:12.427462 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec8ce0b4-e530-40e4-af7a-82765907f82d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:12.428003 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec8ce0b4-e530-40e4-af7a-82765907f82d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:12.457004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ec8ce0b4-e530-40e4-af7a-82765907f82d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044542 Aug 24 12:43:12.457547 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 873/1746] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:12 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:12.717574 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0d81974a-27a6-4da8-8f9f-3284566de177 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:12.719796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0d81974a-27a6-4da8-8f9f-3284566de177 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:12.726436 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d81974a-27a6-4da8-8f9f-3284566de177 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:12.726947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d81974a-27a6-4da8-8f9f-3284566de177 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:12.727545 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d81974a-27a6-4da8-8f9f-3284566de177 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:12.728098 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d81974a-27a6-4da8-8f9f-3284566de177 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:12.728551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d81974a-27a6-4da8-8f9f-3284566de177 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:12.729027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d81974a-27a6-4da8-8f9f-3284566de177 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:12.760059 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0d81974a-27a6-4da8-8f9f-3284566de177 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046966 Aug 24 12:43:12.760607 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 874/1747] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:12 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:13.153736 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-57b1f8e6-6d89-4924-b33d-a269e4b60b2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:13.155970 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-57b1f8e6-6d89-4924-b33d-a269e4b60b2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:13.162471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57b1f8e6-6d89-4924-b33d-a269e4b60b2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:13.162993 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57b1f8e6-6d89-4924-b33d-a269e4b60b2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:13.163429 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57b1f8e6-6d89-4924-b33d-a269e4b60b2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:13.164116 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57b1f8e6-6d89-4924-b33d-a269e4b60b2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:13.164570 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57b1f8e6-6d89-4924-b33d-a269e4b60b2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:13.164994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57b1f8e6-6d89-4924-b33d-a269e4b60b2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:13.192964 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-57b1f8e6-6d89-4924-b33d-a269e4b60b2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043702 Aug 24 12:43:13.193509 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 874/1748] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:13 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:13.469833 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0a27e778-7ff9-4b0a-b8b3-b83080f51cf7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:13.472175 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0a27e778-7ff9-4b0a-b8b3-b83080f51cf7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:13.477873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a27e778-7ff9-4b0a-b8b3-b83080f51cf7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:13.478345 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a27e778-7ff9-4b0a-b8b3-b83080f51cf7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:13.478800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a27e778-7ff9-4b0a-b8b3-b83080f51cf7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:13.479490 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a27e778-7ff9-4b0a-b8b3-b83080f51cf7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:13.480525 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a27e778-7ff9-4b0a-b8b3-b83080f51cf7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:13.480942 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a27e778-7ff9-4b0a-b8b3-b83080f51cf7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:13.509122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0a27e778-7ff9-4b0a-b8b3-b83080f51cf7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043538 Aug 24 12:43:13.509650 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 875/1749] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:13 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:13.772197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5f69870a-8f46-4a9d-bb86-79b03c24a18e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:13.774329 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5f69870a-8f46-4a9d-bb86-79b03c24a18e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:13.780862 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f69870a-8f46-4a9d-bb86-79b03c24a18e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:13.781354 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f69870a-8f46-4a9d-bb86-79b03c24a18e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:13.781793 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f69870a-8f46-4a9d-bb86-79b03c24a18e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:13.782551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f69870a-8f46-4a9d-bb86-79b03c24a18e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:13.783038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f69870a-8f46-4a9d-bb86-79b03c24a18e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:13.783465 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f69870a-8f46-4a9d-bb86-79b03c24a18e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:13.811805 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5f69870a-8f46-4a9d-bb86-79b03c24a18e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043603 Aug 24 12:43:13.812457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 875/1750] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:13 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:14.205533 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-84da896e-a885-4088-a1bc-1367cc9d8558 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:14.207705 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-84da896e-a885-4088-a1bc-1367cc9d8558 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:14.214845 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-84da896e-a885-4088-a1bc-1367cc9d8558 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:14.215350 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-84da896e-a885-4088-a1bc-1367cc9d8558 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:14.215779 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-84da896e-a885-4088-a1bc-1367cc9d8558 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:14.216459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-84da896e-a885-4088-a1bc-1367cc9d8558 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:14.216905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-84da896e-a885-4088-a1bc-1367cc9d8558 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:14.217352 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-84da896e-a885-4088-a1bc-1367cc9d8558 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:14.245862 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-84da896e-a885-4088-a1bc-1367cc9d8558 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043854 Aug 24 12:43:14.246401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 876/1751] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:14 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:14.521166 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fc5258de-bf7a-4374-acfb-139db235a4c3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:14.523322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fc5258de-bf7a-4374-acfb-139db235a4c3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:14.529630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc5258de-bf7a-4374-acfb-139db235a4c3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:14.530109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc5258de-bf7a-4374-acfb-139db235a4c3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:14.530538 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc5258de-bf7a-4374-acfb-139db235a4c3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:14.531318 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc5258de-bf7a-4374-acfb-139db235a4c3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:14.531767 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc5258de-bf7a-4374-acfb-139db235a4c3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:14.532185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc5258de-bf7a-4374-acfb-139db235a4c3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:14.562153 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fc5258de-bf7a-4374-acfb-139db235a4c3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044966 Aug 24 12:43:14.562703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 876/1752] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:14 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:14.823922 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-29c05de5-d923-4e33-bab7-6746780247ff tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:14.826085 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-29c05de5-d923-4e33-bab7-6746780247ff tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:14.832017 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-29c05de5-d923-4e33-bab7-6746780247ff tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:14.832496 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-29c05de5-d923-4e33-bab7-6746780247ff tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:14.832931 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-29c05de5-d923-4e33-bab7-6746780247ff tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:14.833609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-29c05de5-d923-4e33-bab7-6746780247ff tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:14.834057 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-29c05de5-d923-4e33-bab7-6746780247ff tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:14.834477 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-29c05de5-d923-4e33-bab7-6746780247ff tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:14.863328 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-29c05de5-d923-4e33-bab7-6746780247ff tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043381 Aug 24 12:43:14.864121 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 877/1753] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:14 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:15.257984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3c0399c7-9967-401d-80e4-d84b3607c4d6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:15.260128 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3c0399c7-9967-401d-80e4-d84b3607c4d6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:15.266489 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c0399c7-9967-401d-80e4-d84b3607c4d6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:15.267000 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c0399c7-9967-401d-80e4-d84b3607c4d6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:15.267436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c0399c7-9967-401d-80e4-d84b3607c4d6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:15.268111 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c0399c7-9967-401d-80e4-d84b3607c4d6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:15.268561 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c0399c7-9967-401d-80e4-d84b3607c4d6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:15.268979 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c0399c7-9967-401d-80e4-d84b3607c4d6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:15.297069 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3c0399c7-9967-401d-80e4-d84b3607c4d6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043051 Aug 24 12:43:15.297603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 877/1754] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:15 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:15.574687 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-56b26a66-98e5-4a12-a8a6-eaf928c23ed3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:15.576866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-56b26a66-98e5-4a12-a8a6-eaf928c23ed3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:15.583140 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-56b26a66-98e5-4a12-a8a6-eaf928c23ed3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:15.583622 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-56b26a66-98e5-4a12-a8a6-eaf928c23ed3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:15.584112 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-56b26a66-98e5-4a12-a8a6-eaf928c23ed3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:15.584822 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-56b26a66-98e5-4a12-a8a6-eaf928c23ed3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:15.585282 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-56b26a66-98e5-4a12-a8a6-eaf928c23ed3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:15.585707 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-56b26a66-98e5-4a12-a8a6-eaf928c23ed3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:15.614492 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-56b26a66-98e5-4a12-a8a6-eaf928c23ed3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044318 Aug 24 12:43:15.615057 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 878/1755] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:15 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:15.876396 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d5d2a504-3788-45c3-8882-020f874b98fd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:15.878584 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d5d2a504-3788-45c3-8882-020f874b98fd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:15.884952 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d5d2a504-3788-45c3-8882-020f874b98fd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:15.885435 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d5d2a504-3788-45c3-8882-020f874b98fd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:15.885894 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d5d2a504-3788-45c3-8882-020f874b98fd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:15.886584 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d5d2a504-3788-45c3-8882-020f874b98fd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:15.887077 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d5d2a504-3788-45c3-8882-020f874b98fd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:15.887512 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d5d2a504-3788-45c3-8882-020f874b98fd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:15.915713 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d5d2a504-3788-45c3-8882-020f874b98fd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043252 Aug 24 12:43:15.916244 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 878/1756] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:15 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:16.309508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3ad615c6-1d2d-4864-b73c-0e9006c537f9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:16.311696 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3ad615c6-1d2d-4864-b73c-0e9006c537f9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:16.317642 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ad615c6-1d2d-4864-b73c-0e9006c537f9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:16.318133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ad615c6-1d2d-4864-b73c-0e9006c537f9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:16.318572 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ad615c6-1d2d-4864-b73c-0e9006c537f9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:16.319286 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ad615c6-1d2d-4864-b73c-0e9006c537f9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:16.319739 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ad615c6-1d2d-4864-b73c-0e9006c537f9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:16.320166 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ad615c6-1d2d-4864-b73c-0e9006c537f9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:16.348474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3ad615c6-1d2d-4864-b73c-0e9006c537f9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043058 Aug 24 12:43:16.349019 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 879/1757] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:16 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:16.626540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4131836d-5bd3-4956-a63f-f2eee1433705 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:16.628721 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4131836d-5bd3-4956-a63f-f2eee1433705 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:16.634527 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4131836d-5bd3-4956-a63f-f2eee1433705 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:16.635038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4131836d-5bd3-4956-a63f-f2eee1433705 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:16.635470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4131836d-5bd3-4956-a63f-f2eee1433705 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:16.636680 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4131836d-5bd3-4956-a63f-f2eee1433705 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:16.637132 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4131836d-5bd3-4956-a63f-f2eee1433705 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:16.637554 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4131836d-5bd3-4956-a63f-f2eee1433705 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:16.666376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4131836d-5bd3-4956-a63f-f2eee1433705 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043735 Aug 24 12:43:16.666939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 879/1758] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:16 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:16.928633 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-068cad92-779a-49d8-9a40-3f4c5fde535d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:16.930775 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-068cad92-779a-49d8-9a40-3f4c5fde535d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:16.937292 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-068cad92-779a-49d8-9a40-3f4c5fde535d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:16.937754 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-068cad92-779a-49d8-9a40-3f4c5fde535d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:16.938195 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-068cad92-779a-49d8-9a40-3f4c5fde535d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:16.938905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-068cad92-779a-49d8-9a40-3f4c5fde535d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:16.939357 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-068cad92-779a-49d8-9a40-3f4c5fde535d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:16.939779 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-068cad92-779a-49d8-9a40-3f4c5fde535d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:16.968363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-068cad92-779a-49d8-9a40-3f4c5fde535d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043842 Aug 24 12:43:16.968897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 880/1759] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:16 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:17.360765 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-be5ae465-ef3b-42d2-8da1-8d00a32189a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:17.362934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-be5ae465-ef3b-42d2-8da1-8d00a32189a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:17.369727 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be5ae465-ef3b-42d2-8da1-8d00a32189a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:17.370206 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be5ae465-ef3b-42d2-8da1-8d00a32189a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:17.370641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be5ae465-ef3b-42d2-8da1-8d00a32189a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:17.371345 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be5ae465-ef3b-42d2-8da1-8d00a32189a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:17.371800 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be5ae465-ef3b-42d2-8da1-8d00a32189a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:17.372222 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be5ae465-ef3b-42d2-8da1-8d00a32189a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:17.400160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-be5ae465-ef3b-42d2-8da1-8d00a32189a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043401 Aug 24 12:43:17.400693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 880/1760] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:17 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:17.677834 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-672e33f9-365e-4902-93e1-079507f5667b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:17.680006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-672e33f9-365e-4902-93e1-079507f5667b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:17.686364 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-672e33f9-365e-4902-93e1-079507f5667b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:17.686884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-672e33f9-365e-4902-93e1-079507f5667b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:17.687317 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-672e33f9-365e-4902-93e1-079507f5667b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:17.688105 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-672e33f9-365e-4902-93e1-079507f5667b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:17.688448 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-672e33f9-365e-4902-93e1-079507f5667b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:17.688872 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-672e33f9-365e-4902-93e1-079507f5667b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:17.718676 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-672e33f9-365e-4902-93e1-079507f5667b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044816 Aug 24 12:43:17.719225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 881/1761] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:17 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:17.980537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dead4a26-d859-4b98-9753-a6197481a438 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:17.982703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dead4a26-d859-4b98-9753-a6197481a438 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:17.988605 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dead4a26-d859-4b98-9753-a6197481a438 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:17.989387 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dead4a26-d859-4b98-9753-a6197481a438 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:17.989877 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dead4a26-d859-4b98-9753-a6197481a438 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:17.990530 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dead4a26-d859-4b98-9753-a6197481a438 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:17.991031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dead4a26-d859-4b98-9753-a6197481a438 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:17.991462 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dead4a26-d859-4b98-9753-a6197481a438 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:18.021898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dead4a26-d859-4b98-9753-a6197481a438 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045379 Aug 24 12:43:18.022461 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 881/1762] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:17 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:43:18.413037 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b667b948-259a-45e4-b349-b925c788563b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:18.415256 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b667b948-259a-45e4-b349-b925c788563b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:18.421580 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b667b948-259a-45e4-b349-b925c788563b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:18.422053 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b667b948-259a-45e4-b349-b925c788563b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:18.422487 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b667b948-259a-45e4-b349-b925c788563b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:18.423195 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b667b948-259a-45e4-b349-b925c788563b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:18.423638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b667b948-259a-45e4-b349-b925c788563b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:18.424058 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b667b948-259a-45e4-b349-b925c788563b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:18.452775 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b667b948-259a-45e4-b349-b925c788563b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043711 Aug 24 12:43:18.453309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 882/1763] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:18 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:18.731607 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-40b7cda7-e176-4917-b506-3707d7b209d2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:18.733773 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-40b7cda7-e176-4917-b506-3707d7b209d2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:18.740264 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40b7cda7-e176-4917-b506-3707d7b209d2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:18.740748 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40b7cda7-e176-4917-b506-3707d7b209d2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:18.741207 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40b7cda7-e176-4917-b506-3707d7b209d2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:18.741851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40b7cda7-e176-4917-b506-3707d7b209d2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:18.742304 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40b7cda7-e176-4917-b506-3707d7b209d2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:18.742751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40b7cda7-e176-4917-b506-3707d7b209d2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:18.771061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-40b7cda7-e176-4917-b506-3707d7b209d2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044342 Aug 24 12:43:18.771601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 882/1764] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:18 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:19.033934 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-792add54-6249-4271-8ca1-d76461ad8e63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:19.036142 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-792add54-6249-4271-8ca1-d76461ad8e63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:19.042370 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-792add54-6249-4271-8ca1-d76461ad8e63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:19.042958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-792add54-6249-4271-8ca1-d76461ad8e63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:19.043393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-792add54-6249-4271-8ca1-d76461ad8e63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:19.044075 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-792add54-6249-4271-8ca1-d76461ad8e63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:19.044525 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-792add54-6249-4271-8ca1-d76461ad8e63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:19.044946 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-792add54-6249-4271-8ca1-d76461ad8e63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:19.073211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-792add54-6249-4271-8ca1-d76461ad8e63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043338 Aug 24 12:43:19.074258 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 883/1765] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:19 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:19.215191 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:43:19.215703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 12:43:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:43:19.465160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9cb3ab87-4b90-44f4-b46f-302501940233 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:19.467330 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9cb3ab87-4b90-44f4-b46f-302501940233 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:19.473312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9cb3ab87-4b90-44f4-b46f-302501940233 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:19.473934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9cb3ab87-4b90-44f4-b46f-302501940233 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:19.474382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9cb3ab87-4b90-44f4-b46f-302501940233 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:19.475099 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9cb3ab87-4b90-44f4-b46f-302501940233 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:19.475554 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9cb3ab87-4b90-44f4-b46f-302501940233 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:19.475979 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9cb3ab87-4b90-44f4-b46f-302501940233 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:19.489716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:19.505218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9cb3ab87-4b90-44f4-b46f-302501940233 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044051 Aug 24 12:43:19.505702 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 883/1766] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:19 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:19.782939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-328b960a-bcfa-4540-835c-9461a181fff4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:19.785072 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-328b960a-bcfa-4540-835c-9461a181fff4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:19.791006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-328b960a-bcfa-4540-835c-9461a181fff4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:19.791491 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-328b960a-bcfa-4540-835c-9461a181fff4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:19.791928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-328b960a-bcfa-4540-835c-9461a181fff4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:19.793165 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-328b960a-bcfa-4540-835c-9461a181fff4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:19.793621 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-328b960a-bcfa-4540-835c-9461a181fff4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:19.794048 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-328b960a-bcfa-4540-835c-9461a181fff4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:19.824403 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-328b960a-bcfa-4540-835c-9461a181fff4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045403 Aug 24 12:43:19.824943 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 884/1767] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:19 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:20.086243 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0007b526-2f73-4a9a-b855-9bc693970c3f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:20.088331 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0007b526-2f73-4a9a-b855-9bc693970c3f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:20.095204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0007b526-2f73-4a9a-b855-9bc693970c3f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:20.095687 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0007b526-2f73-4a9a-b855-9bc693970c3f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:20.096126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0007b526-2f73-4a9a-b855-9bc693970c3f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:20.096810 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0007b526-2f73-4a9a-b855-9bc693970c3f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:20.097265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0007b526-2f73-4a9a-b855-9bc693970c3f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:20.097693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0007b526-2f73-4a9a-b855-9bc693970c3f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:20.126577 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0007b526-2f73-4a9a-b855-9bc693970c3f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044771 Aug 24 12:43:20.127143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 884/1768] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:20 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:20.517858 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3347b4f6-e3a4-4430-ab96-43cd95903e80 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:20.520045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3347b4f6-e3a4-4430-ab96-43cd95903e80 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:20.526331 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3347b4f6-e3a4-4430-ab96-43cd95903e80 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:20.527461 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3347b4f6-e3a4-4430-ab96-43cd95903e80 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:20.527903 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3347b4f6-e3a4-4430-ab96-43cd95903e80 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:20.528587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3347b4f6-e3a4-4430-ab96-43cd95903e80 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:20.529041 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3347b4f6-e3a4-4430-ab96-43cd95903e80 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:20.529478 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3347b4f6-e3a4-4430-ab96-43cd95903e80 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:20.533027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:20.557252 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3347b4f6-e3a4-4430-ab96-43cd95903e80 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043321 Aug 24 12:43:20.557795 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 885/1769] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:20 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:20.836405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4a3948af-47a3-4e9a-a6c3-c7c2b2fdab16 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:20.838601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4a3948af-47a3-4e9a-a6c3-c7c2b2fdab16 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:20.844512 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a3948af-47a3-4e9a-a6c3-c7c2b2fdab16 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:20.844999 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a3948af-47a3-4e9a-a6c3-c7c2b2fdab16 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:20.845436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a3948af-47a3-4e9a-a6c3-c7c2b2fdab16 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:20.846126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a3948af-47a3-4e9a-a6c3-c7c2b2fdab16 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:20.846568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a3948af-47a3-4e9a-a6c3-c7c2b2fdab16 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:20.847019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a3948af-47a3-4e9a-a6c3-c7c2b2fdab16 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:20.876131 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4a3948af-47a3-4e9a-a6c3-c7c2b2fdab16 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043676 Aug 24 12:43:20.876673 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 885/1770] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:20 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:21.139749 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a87e7322-e01d-441a-9d3b-95333bff1a58 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:21.141888 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a87e7322-e01d-441a-9d3b-95333bff1a58 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:21.148227 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a87e7322-e01d-441a-9d3b-95333bff1a58 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:21.148712 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a87e7322-e01d-441a-9d3b-95333bff1a58 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:21.149155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a87e7322-e01d-441a-9d3b-95333bff1a58 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:21.149861 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a87e7322-e01d-441a-9d3b-95333bff1a58 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:21.150360 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a87e7322-e01d-441a-9d3b-95333bff1a58 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:21.150767 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a87e7322-e01d-441a-9d3b-95333bff1a58 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:21.179942 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a87e7322-e01d-441a-9d3b-95333bff1a58 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045276 Aug 24 12:43:21.180489 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 886/1771] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:21 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:21.569370 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bddd577c-c909-4a16-93b1-3e66773f5783 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:21.571653 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bddd577c-c909-4a16-93b1-3e66773f5783 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:21.578418 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bddd577c-c909-4a16-93b1-3e66773f5783 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:21.579165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bddd577c-c909-4a16-93b1-3e66773f5783 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:21.579419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bddd577c-c909-4a16-93b1-3e66773f5783 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:21.580112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bddd577c-c909-4a16-93b1-3e66773f5783 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:21.580572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bddd577c-c909-4a16-93b1-3e66773f5783 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:21.580997 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bddd577c-c909-4a16-93b1-3e66773f5783 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:21.610270 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bddd577c-c909-4a16-93b1-3e66773f5783 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044862 Aug 24 12:43:21.613568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 886/1772] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:21 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:21.888610 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-295af96f-3396-4a22-9522-62e689890a9b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:21.890964 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-295af96f-3396-4a22-9522-62e689890a9b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:21.897211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-295af96f-3396-4a22-9522-62e689890a9b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:21.897895 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-295af96f-3396-4a22-9522-62e689890a9b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:21.898383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-295af96f-3396-4a22-9522-62e689890a9b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:21.899094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-295af96f-3396-4a22-9522-62e689890a9b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:21.899565 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-295af96f-3396-4a22-9522-62e689890a9b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:21.900182 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-295af96f-3396-4a22-9522-62e689890a9b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:21.928980 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-295af96f-3396-4a22-9522-62e689890a9b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044770 Aug 24 12:43:21.929790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 887/1773] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:21 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:22.192872 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a8e099d8-2707-46e6-beb2-182d6a507c4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:22.194998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a8e099d8-2707-46e6-beb2-182d6a507c4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:22.201536 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a8e099d8-2707-46e6-beb2-182d6a507c4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:22.202012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a8e099d8-2707-46e6-beb2-182d6a507c4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:22.202446 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a8e099d8-2707-46e6-beb2-182d6a507c4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:22.203155 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a8e099d8-2707-46e6-beb2-182d6a507c4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:22.203612 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a8e099d8-2707-46e6-beb2-182d6a507c4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:22.204036 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a8e099d8-2707-46e6-beb2-182d6a507c4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:22.236112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a8e099d8-2707-46e6-beb2-182d6a507c4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047297 Aug 24 12:43:22.236649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 887/1774] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:22 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:22.623121 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0dcfc551-a5ab-42f6-ac80-65488785d236 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:22.625607 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0dcfc551-a5ab-42f6-ac80-65488785d236 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:22.631595 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0dcfc551-a5ab-42f6-ac80-65488785d236 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:22.632068 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0dcfc551-a5ab-42f6-ac80-65488785d236 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:22.632493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0dcfc551-a5ab-42f6-ac80-65488785d236 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:22.633168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0dcfc551-a5ab-42f6-ac80-65488785d236 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:22.633610 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0dcfc551-a5ab-42f6-ac80-65488785d236 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:22.634026 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0dcfc551-a5ab-42f6-ac80-65488785d236 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:22.661833 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0dcfc551-a5ab-42f6-ac80-65488785d236 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043577 Aug 24 12:43:22.662368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 888/1775] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:22 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:22.940849 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-83f26d0d-cfec-4826-bb36-be10f7adca6a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:22.942918 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-83f26d0d-cfec-4826-bb36-be10f7adca6a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:22.949155 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83f26d0d-cfec-4826-bb36-be10f7adca6a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:22.949635 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83f26d0d-cfec-4826-bb36-be10f7adca6a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:22.950069 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83f26d0d-cfec-4826-bb36-be10f7adca6a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:22.950776 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83f26d0d-cfec-4826-bb36-be10f7adca6a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:22.951227 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83f26d0d-cfec-4826-bb36-be10f7adca6a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:22.951648 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83f26d0d-cfec-4826-bb36-be10f7adca6a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:22.981853 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-83f26d0d-cfec-4826-bb36-be10f7adca6a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044943 Aug 24 12:43:22.982388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 888/1776] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:22 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:23.007233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:43:23.007709 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 12:43:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:43:23.247855 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ebd49766-c83c-435e-bed8-ccfe62c40f98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:23.249983 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ebd49766-c83c-435e-bed8-ccfe62c40f98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:23.256463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ebd49766-c83c-435e-bed8-ccfe62c40f98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:23.256944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ebd49766-c83c-435e-bed8-ccfe62c40f98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:23.257379 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ebd49766-c83c-435e-bed8-ccfe62c40f98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:23.258072 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ebd49766-c83c-435e-bed8-ccfe62c40f98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:23.258528 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ebd49766-c83c-435e-bed8-ccfe62c40f98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:23.258984 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ebd49766-c83c-435e-bed8-ccfe62c40f98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:23.287943 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ebd49766-c83c-435e-bed8-ccfe62c40f98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043937 Aug 24 12:43:23.288484 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 889/1777] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:23 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:23.674004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d4647371-9a6e-4617-8635-03e38f854fd1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:23.676175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d4647371-9a6e-4617-8635-03e38f854fd1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:23.681993 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4647371-9a6e-4617-8635-03e38f854fd1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:23.682477 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4647371-9a6e-4617-8635-03e38f854fd1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:23.682945 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4647371-9a6e-4617-8635-03e38f854fd1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:23.684144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4647371-9a6e-4617-8635-03e38f854fd1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:23.684598 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4647371-9a6e-4617-8635-03e38f854fd1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:23.685023 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4647371-9a6e-4617-8635-03e38f854fd1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:23.713130 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d4647371-9a6e-4617-8635-03e38f854fd1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043073 Aug 24 12:43:23.713674 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 889/1778] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:23 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:23.993860 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0f2a8be3-e017-45a9-8b9d-909b8a53fed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:23.995933 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0f2a8be3-e017-45a9-8b9d-909b8a53fed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:24.002458 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f2a8be3-e017-45a9-8b9d-909b8a53fed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:24.002969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f2a8be3-e017-45a9-8b9d-909b8a53fed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:24.003440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f2a8be3-e017-45a9-8b9d-909b8a53fed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:24.004318 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f2a8be3-e017-45a9-8b9d-909b8a53fed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:24.004561 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f2a8be3-e017-45a9-8b9d-909b8a53fed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:24.005067 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f2a8be3-e017-45a9-8b9d-909b8a53fed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:24.038817 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0f2a8be3-e017-45a9-8b9d-909b8a53fed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049016 Aug 24 12:43:24.039404 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 890/1779] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:23 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:24.300316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2ec9b0eb-b62a-4b7e-9e85-78c4b8edc8b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:24.302502 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2ec9b0eb-b62a-4b7e-9e85-78c4b8edc8b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:24.309399 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2ec9b0eb-b62a-4b7e-9e85-78c4b8edc8b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:24.309878 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2ec9b0eb-b62a-4b7e-9e85-78c4b8edc8b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:24.310315 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2ec9b0eb-b62a-4b7e-9e85-78c4b8edc8b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:24.311039 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2ec9b0eb-b62a-4b7e-9e85-78c4b8edc8b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:24.311495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2ec9b0eb-b62a-4b7e-9e85-78c4b8edc8b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:24.311922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2ec9b0eb-b62a-4b7e-9e85-78c4b8edc8b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:24.339933 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2ec9b0eb-b62a-4b7e-9e85-78c4b8edc8b9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043685 Aug 24 12:43:24.340466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 890/1780] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:24 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:24.725187 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ff775b40-f701-4204-8f8d-15660587a719 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:24.727482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ff775b40-f701-4204-8f8d-15660587a719 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:24.734422 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ff775b40-f701-4204-8f8d-15660587a719 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:24.734942 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ff775b40-f701-4204-8f8d-15660587a719 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:24.735381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ff775b40-f701-4204-8f8d-15660587a719 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:24.736096 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ff775b40-f701-4204-8f8d-15660587a719 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:24.736548 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ff775b40-f701-4204-8f8d-15660587a719 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:24.736975 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ff775b40-f701-4204-8f8d-15660587a719 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:24.765734 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ff775b40-f701-4204-8f8d-15660587a719 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044479 Aug 24 12:43:24.766276 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 891/1781] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:24 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:25.051385 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5cd01fc4-793f-423c-a371-6fd3a9615628 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:25.053548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5cd01fc4-793f-423c-a371-6fd3a9615628 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:25.059675 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5cd01fc4-793f-423c-a371-6fd3a9615628 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:25.060163 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5cd01fc4-793f-423c-a371-6fd3a9615628 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:25.060603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5cd01fc4-793f-423c-a371-6fd3a9615628 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:25.061299 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5cd01fc4-793f-423c-a371-6fd3a9615628 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:25.061758 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5cd01fc4-793f-423c-a371-6fd3a9615628 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:25.062182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5cd01fc4-793f-423c-a371-6fd3a9615628 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:25.091692 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5cd01fc4-793f-423c-a371-6fd3a9615628 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044271 Aug 24 12:43:25.092222 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 891/1782] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:25 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:25.351745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b8c91585-906e-48a6-92c2-5a30538e2674 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:25.353781 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b8c91585-906e-48a6-92c2-5a30538e2674 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:25.359697 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8c91585-906e-48a6-92c2-5a30538e2674 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:25.360170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8c91585-906e-48a6-92c2-5a30538e2674 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:25.360596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8c91585-906e-48a6-92c2-5a30538e2674 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:25.361271 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8c91585-906e-48a6-92c2-5a30538e2674 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:25.361716 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8c91585-906e-48a6-92c2-5a30538e2674 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:25.362133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8c91585-906e-48a6-92c2-5a30538e2674 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:25.391303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b8c91585-906e-48a6-92c2-5a30538e2674 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043553 Aug 24 12:43:25.391839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 892/1783] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:25 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:25.777734 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c1478758-4bb3-4dcd-813f-b018292c23a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:25.779934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c1478758-4bb3-4dcd-813f-b018292c23a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:25.786203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1478758-4bb3-4dcd-813f-b018292c23a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:25.786708 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1478758-4bb3-4dcd-813f-b018292c23a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:25.787143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1478758-4bb3-4dcd-813f-b018292c23a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:25.787822 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1478758-4bb3-4dcd-813f-b018292c23a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:25.788272 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1478758-4bb3-4dcd-813f-b018292c23a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:25.788689 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1478758-4bb3-4dcd-813f-b018292c23a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:25.817203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c1478758-4bb3-4dcd-813f-b018292c23a3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043383 Aug 24 12:43:25.817727 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 892/1784] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:25 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:26.103389 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ada1fbbb-0ad9-4910-8896-f17a36eb4f4a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:26.106100 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ada1fbbb-0ad9-4910-8896-f17a36eb4f4a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:26.117252 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ada1fbbb-0ad9-4910-8896-f17a36eb4f4a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:26.117252 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ada1fbbb-0ad9-4910-8896-f17a36eb4f4a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:26.117252 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ada1fbbb-0ad9-4910-8896-f17a36eb4f4a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:26.117252 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ada1fbbb-0ad9-4910-8896-f17a36eb4f4a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:26.117577 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ada1fbbb-0ad9-4910-8896-f17a36eb4f4a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:26.117577 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ada1fbbb-0ad9-4910-8896-f17a36eb4f4a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:26.144087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ada1fbbb-0ad9-4910-8896-f17a36eb4f4a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044747 Aug 24 12:43:26.144640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 893/1785] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:26 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:26.403960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ed9e6100-561a-451d-afc7-1dbbe915f3bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:26.406077 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ed9e6100-561a-451d-afc7-1dbbe915f3bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:26.411966 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ed9e6100-561a-451d-afc7-1dbbe915f3bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:26.412447 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ed9e6100-561a-451d-afc7-1dbbe915f3bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:26.412879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ed9e6100-561a-451d-afc7-1dbbe915f3bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:26.413564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ed9e6100-561a-451d-afc7-1dbbe915f3bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:26.414014 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ed9e6100-561a-451d-afc7-1dbbe915f3bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:26.414432 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ed9e6100-561a-451d-afc7-1dbbe915f3bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:26.444136 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ed9e6100-561a-451d-afc7-1dbbe915f3bc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044749 Aug 24 12:43:26.444688 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 893/1786] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:26 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:26.829214 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-59b178b1-35b9-4c1f-9b39-5006b57dd253 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:26.831401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-59b178b1-35b9-4c1f-9b39-5006b57dd253 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:26.833314 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=92 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:26.837996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59b178b1-35b9-4c1f-9b39-5006b57dd253 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:26.838465 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59b178b1-35b9-4c1f-9b39-5006b57dd253 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:26.838924 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59b178b1-35b9-4c1f-9b39-5006b57dd253 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:26.839595 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59b178b1-35b9-4c1f-9b39-5006b57dd253 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:26.840037 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59b178b1-35b9-4c1f-9b39-5006b57dd253 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:26.840454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59b178b1-35b9-4c1f-9b39-5006b57dd253 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:26.869427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-59b178b1-35b9-4c1f-9b39-5006b57dd253 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044018 Aug 24 12:43:26.869974 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 894/1787] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:26 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:27.156216 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-51535d0b-340f-4abb-ab00-55d38de95bcf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:27.158449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-51535d0b-340f-4abb-ab00-55d38de95bcf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:27.160740 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=92 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:27.165474 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51535d0b-340f-4abb-ab00-55d38de95bcf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:27.165963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51535d0b-340f-4abb-ab00-55d38de95bcf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:27.166408 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51535d0b-340f-4abb-ab00-55d38de95bcf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:27.167239 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51535d0b-340f-4abb-ab00-55d38de95bcf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:27.167725 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51535d0b-340f-4abb-ab00-55d38de95bcf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:27.172675 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51535d0b-340f-4abb-ab00-55d38de95bcf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:27.198710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-51535d0b-340f-4abb-ab00-55d38de95bcf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046369 Aug 24 12:43:27.199508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 894/1788] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:27 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:27.456769 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-918fec7a-eaed-4bec-aa21-35afe199aef3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:27.458930 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-918fec7a-eaed-4bec-aa21-35afe199aef3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:27.465921 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-918fec7a-eaed-4bec-aa21-35afe199aef3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:27.466402 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-918fec7a-eaed-4bec-aa21-35afe199aef3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:27.466872 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-918fec7a-eaed-4bec-aa21-35afe199aef3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:27.467560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-918fec7a-eaed-4bec-aa21-35afe199aef3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:27.468015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-918fec7a-eaed-4bec-aa21-35afe199aef3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:27.468442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-918fec7a-eaed-4bec-aa21-35afe199aef3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:27.497558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-918fec7a-eaed-4bec-aa21-35afe199aef3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045092 Aug 24 12:43:27.498096 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 895/1789] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:27 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:27.882631 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-53e86688-0437-4b1c-ab66-198113c1ee78 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:27.884800 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-53e86688-0437-4b1c-ab66-198113c1ee78 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:27.891387 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-53e86688-0437-4b1c-ab66-198113c1ee78 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:27.891873 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-53e86688-0437-4b1c-ab66-198113c1ee78 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:27.892314 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-53e86688-0437-4b1c-ab66-198113c1ee78 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:27.893005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-53e86688-0437-4b1c-ab66-198113c1ee78 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:27.893466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-53e86688-0437-4b1c-ab66-198113c1ee78 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:27.893889 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-53e86688-0437-4b1c-ab66-198113c1ee78 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:27.930433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-53e86688-0437-4b1c-ab66-198113c1ee78 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051757 Aug 24 12:43:27.931017 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 895/1790] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:27 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:28.209965 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-02fa8b29-0547-4ce9-bde4-ad37ef13c766 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:28.212122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-02fa8b29-0547-4ce9-bde4-ad37ef13c766 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:28.217994 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02fa8b29-0547-4ce9-bde4-ad37ef13c766 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:28.218471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02fa8b29-0547-4ce9-bde4-ad37ef13c766 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:28.218937 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02fa8b29-0547-4ce9-bde4-ad37ef13c766 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:28.219619 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02fa8b29-0547-4ce9-bde4-ad37ef13c766 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:28.220067 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02fa8b29-0547-4ce9-bde4-ad37ef13c766 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:28.220487 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02fa8b29-0547-4ce9-bde4-ad37ef13c766 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:28.251285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-02fa8b29-0547-4ce9-bde4-ad37ef13c766 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045066 Aug 24 12:43:28.251869 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 896/1791] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:28 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:28.509353 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8267f23b-0158-41d5-becd-7912e3ee0569 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:28.511629 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8267f23b-0158-41d5-becd-7912e3ee0569 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:28.518506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8267f23b-0158-41d5-becd-7912e3ee0569 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:28.519028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8267f23b-0158-41d5-becd-7912e3ee0569 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:28.519473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8267f23b-0158-41d5-becd-7912e3ee0569 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:28.520170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8267f23b-0158-41d5-becd-7912e3ee0569 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:28.520641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8267f23b-0158-41d5-becd-7912e3ee0569 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:28.521063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8267f23b-0158-41d5-becd-7912e3ee0569 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:28.549725 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8267f23b-0158-41d5-becd-7912e3ee0569 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044266 Aug 24 12:43:28.550281 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 896/1792] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:28 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:28.941937 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-071d6671-be0e-4a04-b412-ba25957c06fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:28.944108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-071d6671-be0e-4a04-b412-ba25957c06fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:28.950458 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-071d6671-be0e-4a04-b412-ba25957c06fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:28.950976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-071d6671-be0e-4a04-b412-ba25957c06fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:28.951413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-071d6671-be0e-4a04-b412-ba25957c06fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:28.952106 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-071d6671-be0e-4a04-b412-ba25957c06fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:28.952558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-071d6671-be0e-4a04-b412-ba25957c06fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:28.952981 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-071d6671-be0e-4a04-b412-ba25957c06fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:28.981624 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-071d6671-be0e-4a04-b412-ba25957c06fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043583 Aug 24 12:43:28.982159 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 897/1793] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:28 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:29.264128 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-80776ba7-d20a-474d-86e5-8ba3ba604309 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:29.266273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-80776ba7-d20a-474d-86e5-8ba3ba604309 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:29.272320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-80776ba7-d20a-474d-86e5-8ba3ba604309 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:29.272802 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-80776ba7-d20a-474d-86e5-8ba3ba604309 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:29.273242 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-80776ba7-d20a-474d-86e5-8ba3ba604309 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:29.273929 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-80776ba7-d20a-474d-86e5-8ba3ba604309 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:29.274386 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-80776ba7-d20a-474d-86e5-8ba3ba604309 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:29.274849 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-80776ba7-d20a-474d-86e5-8ba3ba604309 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:29.304178 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-80776ba7-d20a-474d-86e5-8ba3ba604309 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044641 Aug 24 12:43:29.304737 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 897/1794] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:29 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:29.562455 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6668f435-44b4-485a-9aae-798eec17687c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:29.564549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6668f435-44b4-485a-9aae-798eec17687c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:29.570400 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6668f435-44b4-485a-9aae-798eec17687c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:29.570919 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6668f435-44b4-485a-9aae-798eec17687c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:29.571349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6668f435-44b4-485a-9aae-798eec17687c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:29.572030 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6668f435-44b4-485a-9aae-798eec17687c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:29.572477 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6668f435-44b4-485a-9aae-798eec17687c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:29.572896 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6668f435-44b4-485a-9aae-798eec17687c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:29.600623 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6668f435-44b4-485a-9aae-798eec17687c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042773 Aug 24 12:43:29.601157 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 898/1795] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:29 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:29.994060 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ca845830-6820-4527-abd0-2024c1b64106 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:29.996243 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ca845830-6820-4527-abd0-2024c1b64106 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:30.002186 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ca845830-6820-4527-abd0-2024c1b64106 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:30.002674 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ca845830-6820-4527-abd0-2024c1b64106 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:30.003117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ca845830-6820-4527-abd0-2024c1b64106 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:30.003794 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ca845830-6820-4527-abd0-2024c1b64106 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:30.004241 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ca845830-6820-4527-abd0-2024c1b64106 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:30.004659 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ca845830-6820-4527-abd0-2024c1b64106 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:30.033388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ca845830-6820-4527-abd0-2024c1b64106 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042859 Aug 24 12:43:30.034189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 898/1796] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:29 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:30.316816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8e786ab5-b93e-4b59-a230-7941305b7d51 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:30.318985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8e786ab5-b93e-4b59-a230-7941305b7d51 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:30.325876 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8e786ab5-b93e-4b59-a230-7941305b7d51 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:30.327061 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8e786ab5-b93e-4b59-a230-7941305b7d51 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:30.327061 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8e786ab5-b93e-4b59-a230-7941305b7d51 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:30.327582 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8e786ab5-b93e-4b59-a230-7941305b7d51 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:30.328026 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8e786ab5-b93e-4b59-a230-7941305b7d51 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:30.328442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8e786ab5-b93e-4b59-a230-7941305b7d51 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:30.358419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8e786ab5-b93e-4b59-a230-7941305b7d51 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045496 Aug 24 12:43:30.359006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 899/1797] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:30 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:30.612770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b48090bb-bd04-40ec-b91c-bce855c6b42f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:30.615156 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b48090bb-bd04-40ec-b91c-bce855c6b42f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:30.620943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b48090bb-bd04-40ec-b91c-bce855c6b42f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:30.621972 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b48090bb-bd04-40ec-b91c-bce855c6b42f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:30.622409 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b48090bb-bd04-40ec-b91c-bce855c6b42f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:30.623114 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b48090bb-bd04-40ec-b91c-bce855c6b42f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:30.623570 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b48090bb-bd04-40ec-b91c-bce855c6b42f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:30.623990 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b48090bb-bd04-40ec-b91c-bce855c6b42f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:30.652656 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b48090bb-bd04-40ec-b91c-bce855c6b42f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043940 Aug 24 12:43:30.653192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 899/1798] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:30 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:31.045787 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-84d3afd3-5078-4ba2-a270-b99d6fc86d28 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:31.047938 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-84d3afd3-5078-4ba2-a270-b99d6fc86d28 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:31.053717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-84d3afd3-5078-4ba2-a270-b99d6fc86d28 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:31.054192 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-84d3afd3-5078-4ba2-a270-b99d6fc86d28 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:31.054620 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-84d3afd3-5078-4ba2-a270-b99d6fc86d28 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:31.055325 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-84d3afd3-5078-4ba2-a270-b99d6fc86d28 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:31.055767 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-84d3afd3-5078-4ba2-a270-b99d6fc86d28 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:31.056181 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-84d3afd3-5078-4ba2-a270-b99d6fc86d28 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:31.084090 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-84d3afd3-5078-4ba2-a270-b99d6fc86d28 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042705 Aug 24 12:43:31.084615 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 900/1799] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:31 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:31.370793 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-79032ed1-3d13-4347-a3d4-f8d755247d54 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:31.372942 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-79032ed1-3d13-4347-a3d4-f8d755247d54 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:31.379268 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-79032ed1-3d13-4347-a3d4-f8d755247d54 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:31.379756 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-79032ed1-3d13-4347-a3d4-f8d755247d54 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:31.380194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-79032ed1-3d13-4347-a3d4-f8d755247d54 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:31.380967 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-79032ed1-3d13-4347-a3d4-f8d755247d54 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:31.381425 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-79032ed1-3d13-4347-a3d4-f8d755247d54 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:31.381850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-79032ed1-3d13-4347-a3d4-f8d755247d54 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:31.385343 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:31.411473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-79032ed1-3d13-4347-a3d4-f8d755247d54 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044745 Aug 24 12:43:31.412070 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 900/1800] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:31 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:31.664350 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-efe5ec0e-308c-4aed-b5eb-c7830949d8a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:31.666357 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-efe5ec0e-308c-4aed-b5eb-c7830949d8a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:31.672620 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-efe5ec0e-308c-4aed-b5eb-c7830949d8a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:31.673088 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-efe5ec0e-308c-4aed-b5eb-c7830949d8a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:31.673515 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-efe5ec0e-308c-4aed-b5eb-c7830949d8a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:31.674194 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-efe5ec0e-308c-4aed-b5eb-c7830949d8a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:31.674633 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-efe5ec0e-308c-4aed-b5eb-c7830949d8a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:31.675071 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-efe5ec0e-308c-4aed-b5eb-c7830949d8a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:31.698594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:31.703613 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-efe5ec0e-308c-4aed-b5eb-c7830949d8a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043319 Aug 24 12:43:31.704145 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 901/1801] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:31 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:32.044232 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:43:32.044697 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 12:43:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:43:32.096417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d475289b-4c7c-4086-9672-416ef6f2efa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:32.098575 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d475289b-4c7c-4086-9672-416ef6f2efa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:32.104929 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d475289b-4c7c-4086-9672-416ef6f2efa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:32.105405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d475289b-4c7c-4086-9672-416ef6f2efa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:32.106449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d475289b-4c7c-4086-9672-416ef6f2efa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:32.107155 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d475289b-4c7c-4086-9672-416ef6f2efa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:32.107608 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d475289b-4c7c-4086-9672-416ef6f2efa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:32.108028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d475289b-4c7c-4086-9672-416ef6f2efa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:32.135486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d475289b-4c7c-4086-9672-416ef6f2efa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042906 Aug 24 12:43:32.136016 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 901/1802] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:32 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:32.423455 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-830b73d8-ae1c-440b-a1db-91d97d19fc30 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:32.425502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-830b73d8-ae1c-440b-a1db-91d97d19fc30 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:32.431602 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-830b73d8-ae1c-440b-a1db-91d97d19fc30 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:32.432083 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-830b73d8-ae1c-440b-a1db-91d97d19fc30 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:32.432526 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-830b73d8-ae1c-440b-a1db-91d97d19fc30 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:32.433207 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-830b73d8-ae1c-440b-a1db-91d97d19fc30 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:32.433655 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-830b73d8-ae1c-440b-a1db-91d97d19fc30 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:32.434075 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-830b73d8-ae1c-440b-a1db-91d97d19fc30 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:32.463309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-830b73d8-ae1c-440b-a1db-91d97d19fc30 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044267 Aug 24 12:43:32.463855 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 902/1803] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:32 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:32.520282 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:43:32.520428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 12:43:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:43:32.715903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a184ead3-f636-4350-ad62-5f0c84ac6507 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:32.717972 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a184ead3-f636-4350-ad62-5f0c84ac6507 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:32.724344 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a184ead3-f636-4350-ad62-5f0c84ac6507 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:32.728091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a184ead3-f636-4350-ad62-5f0c84ac6507 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:32.728091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a184ead3-f636-4350-ad62-5f0c84ac6507 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:32.728091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a184ead3-f636-4350-ad62-5f0c84ac6507 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:32.728091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a184ead3-f636-4350-ad62-5f0c84ac6507 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:32.728571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a184ead3-f636-4350-ad62-5f0c84ac6507 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:32.756660 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a184ead3-f636-4350-ad62-5f0c84ac6507 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044803 Aug 24 12:43:32.757212 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 902/1804] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:32 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:33.146775 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0cc20b23-8a35-49ec-86f7-85ca4227e9ad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:33.148943 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0cc20b23-8a35-49ec-86f7-85ca4227e9ad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:33.155878 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0cc20b23-8a35-49ec-86f7-85ca4227e9ad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:33.156353 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0cc20b23-8a35-49ec-86f7-85ca4227e9ad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:33.156788 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0cc20b23-8a35-49ec-86f7-85ca4227e9ad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:33.157471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0cc20b23-8a35-49ec-86f7-85ca4227e9ad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:33.157920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0cc20b23-8a35-49ec-86f7-85ca4227e9ad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:33.158340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0cc20b23-8a35-49ec-86f7-85ca4227e9ad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:33.186466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0cc20b23-8a35-49ec-86f7-85ca4227e9ad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043640 Aug 24 12:43:33.187032 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 903/1805] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:33 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:33.475981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1ec64019-96d1-492d-ba6e-f8ead38021cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:33.478095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1ec64019-96d1-492d-ba6e-f8ead38021cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:33.483963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1ec64019-96d1-492d-ba6e-f8ead38021cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:33.484439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1ec64019-96d1-492d-ba6e-f8ead38021cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:33.484871 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1ec64019-96d1-492d-ba6e-f8ead38021cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:33.485547 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1ec64019-96d1-492d-ba6e-f8ead38021cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:33.485998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1ec64019-96d1-492d-ba6e-f8ead38021cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:33.486417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1ec64019-96d1-492d-ba6e-f8ead38021cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:33.515755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1ec64019-96d1-492d-ba6e-f8ead38021cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043679 Aug 24 12:43:33.516291 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 903/1806] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:33 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:33.769037 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5d4ee22e-ebde-4652-8682-f9ec98ea4883 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:33.771222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5d4ee22e-ebde-4652-8682-f9ec98ea4883 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:33.777052 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d4ee22e-ebde-4652-8682-f9ec98ea4883 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:33.777523 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d4ee22e-ebde-4652-8682-f9ec98ea4883 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:33.777952 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d4ee22e-ebde-4652-8682-f9ec98ea4883 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:33.778628 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d4ee22e-ebde-4652-8682-f9ec98ea4883 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:33.779097 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d4ee22e-ebde-4652-8682-f9ec98ea4883 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:33.779515 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d4ee22e-ebde-4652-8682-f9ec98ea4883 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:33.807995 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5d4ee22e-ebde-4652-8682-f9ec98ea4883 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042920 Aug 24 12:43:33.808568 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 904/1807] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:33 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:34.198515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-627023e3-8adc-4097-888a-820130c429cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:43:34.201311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-627023e3-8adc-4097-888a-820130c429cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:34.207666 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-627023e3-8adc-4097-888a-820130c429cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:34.208147 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-627023e3-8adc-4097-888a-820130c429cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:34.208580 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-627023e3-8adc-4097-888a-820130c429cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:34.209293 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-627023e3-8adc-4097-888a-820130c429cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:34.209745 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-627023e3-8adc-4097-888a-820130c429cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:34.210169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-627023e3-8adc-4097-888a-820130c429cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:34.306176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-627023e3-8adc-4097-888a-820130c429cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "POST /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/action" status: 200 len: 82085 microversion: 2.1 time: 0.111265 Aug 24 12:43:34.306844 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 904/1808] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 12:43:34 2022] POST /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/action => generated 82085 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:43:34.320074 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-61f45337-a5ea-40dc-9152-7592a79d8261 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:34.320656 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-61f45337-a5ea-40dc-9152-7592a79d8261 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:34.327738 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61f45337-a5ea-40dc-9152-7592a79d8261 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:34.328215 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61f45337-a5ea-40dc-9152-7592a79d8261 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:34.328649 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61f45337-a5ea-40dc-9152-7592a79d8261 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:34.329330 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61f45337-a5ea-40dc-9152-7592a79d8261 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:34.329796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61f45337-a5ea-40dc-9152-7592a79d8261 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:34.330201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61f45337-a5ea-40dc-9152-7592a79d8261 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:34.408459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.objects.instance [None req-61f45337-a5ea-40dc-9152-7592a79d8261 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lazy-loading 'services' on Instance uuid 29ce2c0c-40e5-45d1-b2a6-ad30617badb4 {{(pid=121171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:43:34.464702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.wsgi [None req-61f45337-a5ea-40dc-9152-7592a79d8261 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e83ead6-5c97-4b40-9d56-505a6585fb87) Aug 24 12:43:34.469295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-61f45337-a5ea-40dc-9152-7592a79d8261 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Request method failure captured: Aug 24 12:43:34.469295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: request: DELETE /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments/b4c145b7-fcf4-4bf2-8030-ed47b577a2a6 HTTP/1.1 Aug 24 12:43:34.469295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept: application/json Aug 24 12:43:34.469295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept-Encoding: identity Aug 24 12:43:34.469295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Connection: close Aug 24 12:43:34.469295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Length: 0 Aug 24 12:43:34.469295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Type: application/json Aug 24 12:43:34.469295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Host: 10.222.0.45 Aug 24 12:43:34.469295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Openstack-System-Scope: None Aug 24 12:43:34.469295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: User-Agent: python-urllib3/1.26.11 Aug 24 12:43:34.469295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Auth-Token: gAAAAABjBhp-fNb8AfkoaCLRhc1uVUuBZTnAoeqodYgxPDTs-tK-pueC-jr7rNphFGP-taMiUsobeBOPjwJ30j7d5psZ76rdWLVemAHYgEPc3_Ku8AlMohzJhmheA7BB1vE8lz1AJhfB9zWg-KzL6MAhXHFY0owqFioFVjPIMKbQ-JbFug4dsE4 Aug 24 12:43:34.469295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Id: None Aug 24 12:43:34.469295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Name: None Aug 24 12:43:34.469295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Identity-Status: Confirmed Aug 24 12:43:34.469295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Is-Admin-Project: True Aug 24 12:43:34.469295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Id: default Aug 24 12:43:34.469295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Name: Default Aug 24 12:43:34.469295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Id: d3d75e4de32444e2813b11b29553d47a Aug 24 12:43:34.469295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Name: tempest-TestMinimumBasicScenario-453850903 Aug 24 12:43:34.469295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Role: member,reader Aug 24 12:43:34.469295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Roles: member,reader Aug 24 12:43:34.470992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d3d75e4de32444e2813b11b29553d47a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3d75e4de32444e2813b11b29553d47a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d3d75e4de32444e2813b11b29553d47a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3d75e4de32444e2813b11b29553d47a"}]}] Aug 24 12:43:34.470992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant: tempest-TestMinimumBasicScenario-453850903 Aug 24 12:43:34.470992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Id: d3d75e4de32444e2813b11b29553d47a Aug 24 12:43:34.470992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Name: tempest-TestMinimumBasicScenario-453850903 Aug 24 12:43:34.470992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User: tempest-TestMinimumBasicScenario-453850903-project Aug 24 12:43:34.470992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Id: default Aug 24 12:43:34.470992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Name: Default Aug 24 12:43:34.470992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Id: 1eb6acf487864a41ba1628e9093b8773 Aug 24 12:43:34.470992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Name: tempest-TestMinimumBasicScenario-453850903-project Aug 24 12:43:34.470992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: method: > Aug 24 12:43:34.471793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e83ead6-5c97-4b40-9d56-505a6585fb87) Aug 24 12:43:34.471793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: action_args: {'server_id': '29ce2c0c-40e5-45d1-b2a6-ad30617badb4', 'id': 'b4c145b7-fcf4-4bf2-8030-ed47b577a2a6'} Aug 24 12:43:34.471793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:43:34.471793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:43:34.471793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 12:43:34.471793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 12:43:34.471793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:43:34.471793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:43:34.471793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 12:43:34.471793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 12:43:34.471793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 12:43:34.471793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 12:43:34.471793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 12:43:34.471793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 12:43:34.471793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 12:43:34.471793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 12:43:34.471793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:43:34.473171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:43:34.473171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:43:34.473171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:43:34.473171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e83ead6-5c97-4b40-9d56-505a6585fb87) Aug 24 12:43:34.473171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:43:34.473171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:43:34.473171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:43:34.473171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:43:34.473171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 24 12:43:34.473171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 24 12:43:34.473171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 24 12:43:34.473171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 24 12:43:34.473171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 12:43:34.473171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 12:43:34.473171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 12:43:34.473171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 12:43:34.473171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:43:34.473171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:43:34.473171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 12:43:34.474835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 12:43:34.474835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 12:43:34.474835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 12:43:34.474835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 12:43:34.474835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 12:43:34.474835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 12:43:34.474835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 12:43:34.474835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:43:34.474835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:43:34.474835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:43:34.474835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:43:34.474835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e83ead6-5c97-4b40-9d56-505a6585fb87) Aug 24 12:43:34.474835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:43:34.474835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:43:34.474835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:43:34.474835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:43:34.474835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 12:43:34.476152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 12:43:34.476152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 12:43:34.476152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 12:43:34.476152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 12:43:34.476152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 12:43:34.476152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 24 12:43:34.476152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 24 12:43:34.476152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 24 12:43:34.476152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 12:43:34.476152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 24 12:43:34.476152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 24 12:43:34.476152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e83ead6-5c97-4b40-9d56-505a6585fb87) Aug 24 12:43:34.476152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:43:34.476152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:43:34.476152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:43:34.476152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:43:34.476152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:43:34.476152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:43:34.477695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:43:34.477695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:43:34.477695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:43:34.477695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:43:34.477695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 24 12:43:34.477695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 12:43:34.477695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e83ead6-5c97-4b40-9d56-505a6585fb87) Aug 24 12:43:34.477695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:43:34.477695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:43:34.477695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:43:34.477695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:43:34.477695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:43:34.477695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:43:34.477695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:43:34.477695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:43:34.477695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e83ead6-5c97-4b40-9d56-505a6585fb87) Aug 24 12:43:34.477695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 12:43:34.479033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-61f45337-a5ea-40dc-9152-7592a79d8261 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e83ead6-5c97-4b40-9d56-505a6585fb87) {{(pid=121171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:43:34.479033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-61f45337-a5ea-40dc-9152-7592a79d8261 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "DELETE /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments/b4c145b7-fcf4-4bf2-8030-ed47b577a2a6" status: 400 len: 269 microversion: 2.1 time: 0.152475 Aug 24 12:43:34.479033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 905/1809] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 24 12:43:34 2022] DELETE /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4/os-volume_attachments/b4c145b7-fcf4-4bf2-8030-ed47b577a2a6 => generated 269 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 12:43:34.528597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4438d7c4-fea4-4888-8e30-7482c363319b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:34.531030 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4438d7c4-fea4-4888-8e30-7482c363319b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:34.537889 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4438d7c4-fea4-4888-8e30-7482c363319b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:34.538380 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4438d7c4-fea4-4888-8e30-7482c363319b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:34.538854 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4438d7c4-fea4-4888-8e30-7482c363319b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:34.539551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4438d7c4-fea4-4888-8e30-7482c363319b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:34.540013 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4438d7c4-fea4-4888-8e30-7482c363319b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:34.540440 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4438d7c4-fea4-4888-8e30-7482c363319b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:34.573894 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4438d7c4-fea4-4888-8e30-7482c363319b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048150 Aug 24 12:43:34.573894 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 905/1810] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:34 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:34.820665 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-14c75363-f4a6-43dd-b8e3-c332181c1e09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:34.822870 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-14c75363-f4a6-43dd-b8e3-c332181c1e09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:34.829232 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14c75363-f4a6-43dd-b8e3-c332181c1e09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:34.829707 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14c75363-f4a6-43dd-b8e3-c332181c1e09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:34.830137 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14c75363-f4a6-43dd-b8e3-c332181c1e09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:34.830843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14c75363-f4a6-43dd-b8e3-c332181c1e09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:34.831288 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14c75363-f4a6-43dd-b8e3-c332181c1e09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:34.831706 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14c75363-f4a6-43dd-b8e3-c332181c1e09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:34.859971 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-14c75363-f4a6-43dd-b8e3-c332181c1e09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043285 Aug 24 12:43:34.860509 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 906/1811] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:34 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:35.583007 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0db075ad-6dae-4d94-afee-bb48ebfef0a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:35.585181 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0db075ad-6dae-4d94-afee-bb48ebfef0a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:35.591541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0db075ad-6dae-4d94-afee-bb48ebfef0a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:35.592023 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0db075ad-6dae-4d94-afee-bb48ebfef0a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:35.592461 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0db075ad-6dae-4d94-afee-bb48ebfef0a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:35.593154 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0db075ad-6dae-4d94-afee-bb48ebfef0a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:35.593609 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0db075ad-6dae-4d94-afee-bb48ebfef0a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:35.594043 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0db075ad-6dae-4d94-afee-bb48ebfef0a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:35.625716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0db075ad-6dae-4d94-afee-bb48ebfef0a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046590 Aug 24 12:43:35.626261 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 906/1812] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:35 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:35.872941 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4083cc44-e5a3-4c0e-b86c-a46e809d0184 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:35.875088 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4083cc44-e5a3-4c0e-b86c-a46e809d0184 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:35.881394 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4083cc44-e5a3-4c0e-b86c-a46e809d0184 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:35.881872 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4083cc44-e5a3-4c0e-b86c-a46e809d0184 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:35.882290 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4083cc44-e5a3-4c0e-b86c-a46e809d0184 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:35.882992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4083cc44-e5a3-4c0e-b86c-a46e809d0184 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:35.883434 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4083cc44-e5a3-4c0e-b86c-a46e809d0184 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:35.883849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4083cc44-e5a3-4c0e-b86c-a46e809d0184 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:35.911634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4083cc44-e5a3-4c0e-b86c-a46e809d0184 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043230 Aug 24 12:43:35.912170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 907/1813] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:35 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:36.638207 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2a37e939-947e-43ef-9303-145e610fa299 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:36.640388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2a37e939-947e-43ef-9303-145e610fa299 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:36.646556 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a37e939-947e-43ef-9303-145e610fa299 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:36.647059 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a37e939-947e-43ef-9303-145e610fa299 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:36.647491 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a37e939-947e-43ef-9303-145e610fa299 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:36.648175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a37e939-947e-43ef-9303-145e610fa299 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:36.648628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a37e939-947e-43ef-9303-145e610fa299 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:36.649050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a37e939-947e-43ef-9303-145e610fa299 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:36.677814 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2a37e939-947e-43ef-9303-145e610fa299 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044039 Aug 24 12:43:36.678294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 907/1814] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:36 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:36.923641 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-316d0edc-b09e-45f7-b338-c16862f93049 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:36.925795 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-316d0edc-b09e-45f7-b338-c16862f93049 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:36.932320 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-316d0edc-b09e-45f7-b338-c16862f93049 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:36.932737 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-316d0edc-b09e-45f7-b338-c16862f93049 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:36.933162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-316d0edc-b09e-45f7-b338-c16862f93049 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:36.934343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-316d0edc-b09e-45f7-b338-c16862f93049 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:36.934812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-316d0edc-b09e-45f7-b338-c16862f93049 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:36.935228 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-316d0edc-b09e-45f7-b338-c16862f93049 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:36.964047 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-316d0edc-b09e-45f7-b338-c16862f93049 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044346 Aug 24 12:43:36.964581 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 908/1815] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:36 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:37.689581 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a6bdacbc-5be7-4f14-9b4a-dc56acaa4599 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:37.691668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a6bdacbc-5be7-4f14-9b4a-dc56acaa4599 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:37.698249 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6bdacbc-5be7-4f14-9b4a-dc56acaa4599 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:37.698758 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6bdacbc-5be7-4f14-9b4a-dc56acaa4599 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:37.699193 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6bdacbc-5be7-4f14-9b4a-dc56acaa4599 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:37.699947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6bdacbc-5be7-4f14-9b4a-dc56acaa4599 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:37.700408 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6bdacbc-5be7-4f14-9b4a-dc56acaa4599 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:37.700833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6bdacbc-5be7-4f14-9b4a-dc56acaa4599 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:37.731973 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a6bdacbc-5be7-4f14-9b4a-dc56acaa4599 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046440 Aug 24 12:43:37.732674 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 908/1816] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:37 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:37.976198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9b091c85-dcd3-49b1-9d78-4b505b4fc5fe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:37.978296 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9b091c85-dcd3-49b1-9d78-4b505b4fc5fe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:37.984577 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b091c85-dcd3-49b1-9d78-4b505b4fc5fe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:37.985050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b091c85-dcd3-49b1-9d78-4b505b4fc5fe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:37.985479 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b091c85-dcd3-49b1-9d78-4b505b4fc5fe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:37.986153 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b091c85-dcd3-49b1-9d78-4b505b4fc5fe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:37.986596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b091c85-dcd3-49b1-9d78-4b505b4fc5fe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:37.987131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b091c85-dcd3-49b1-9d78-4b505b4fc5fe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:38.015508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9b091c85-dcd3-49b1-9d78-4b505b4fc5fe tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043351 Aug 24 12:43:38.016040 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 909/1817] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:37 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:38.748751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f6e4de41-d872-472b-99e1-7b3665dca7bc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:38.750964 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f6e4de41-d872-472b-99e1-7b3665dca7bc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:38.757499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6e4de41-d872-472b-99e1-7b3665dca7bc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:38.757987 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6e4de41-d872-472b-99e1-7b3665dca7bc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:38.758429 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6e4de41-d872-472b-99e1-7b3665dca7bc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:38.759151 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6e4de41-d872-472b-99e1-7b3665dca7bc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:38.759607 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6e4de41-d872-472b-99e1-7b3665dca7bc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:38.760034 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6e4de41-d872-472b-99e1-7b3665dca7bc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:38.790072 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f6e4de41-d872-472b-99e1-7b3665dca7bc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045919 Aug 24 12:43:38.790621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 909/1818] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:38 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:39.027040 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-769065eb-59a4-4b3a-a6ea-bdcd26a8654c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:39.029599 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-769065eb-59a4-4b3a-a6ea-bdcd26a8654c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:39.035949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-769065eb-59a4-4b3a-a6ea-bdcd26a8654c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:39.036425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-769065eb-59a4-4b3a-a6ea-bdcd26a8654c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:39.036860 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-769065eb-59a4-4b3a-a6ea-bdcd26a8654c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:39.037539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-769065eb-59a4-4b3a-a6ea-bdcd26a8654c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:39.037992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-769065eb-59a4-4b3a-a6ea-bdcd26a8654c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:39.038412 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-769065eb-59a4-4b3a-a6ea-bdcd26a8654c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:39.067139 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-769065eb-59a4-4b3a-a6ea-bdcd26a8654c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044078 Aug 24 12:43:39.067791 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 910/1819] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:39 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:39.802537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f456e390-5dea-439c-a2a6-da3e2c30b079 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:39.804752 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f456e390-5dea-439c-a2a6-da3e2c30b079 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:39.811713 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f456e390-5dea-439c-a2a6-da3e2c30b079 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:39.812206 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f456e390-5dea-439c-a2a6-da3e2c30b079 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:39.812630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f456e390-5dea-439c-a2a6-da3e2c30b079 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:39.813374 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f456e390-5dea-439c-a2a6-da3e2c30b079 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:39.813831 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f456e390-5dea-439c-a2a6-da3e2c30b079 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:39.814251 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f456e390-5dea-439c-a2a6-da3e2c30b079 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:39.844235 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f456e390-5dea-439c-a2a6-da3e2c30b079 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045556 Aug 24 12:43:39.844784 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 910/1820] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:39 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:40.082130 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-442f14da-1091-41d3-a5e0-1a5d56cdbea4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:40.084224 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-442f14da-1091-41d3-a5e0-1a5d56cdbea4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:40.090614 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-442f14da-1091-41d3-a5e0-1a5d56cdbea4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:40.091127 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-442f14da-1091-41d3-a5e0-1a5d56cdbea4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:40.091568 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-442f14da-1091-41d3-a5e0-1a5d56cdbea4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:40.092256 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-442f14da-1091-41d3-a5e0-1a5d56cdbea4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:40.092712 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-442f14da-1091-41d3-a5e0-1a5d56cdbea4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:40.093144 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-442f14da-1091-41d3-a5e0-1a5d56cdbea4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:40.121469 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-442f14da-1091-41d3-a5e0-1a5d56cdbea4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043402 Aug 24 12:43:40.122495 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 911/1821] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:40 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:40.856214 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bc06d3a0-f37d-4009-999c-5b6beedb654f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:40.858983 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bc06d3a0-f37d-4009-999c-5b6beedb654f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:40.865557 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc06d3a0-f37d-4009-999c-5b6beedb654f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:40.866036 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc06d3a0-f37d-4009-999c-5b6beedb654f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:40.866463 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc06d3a0-f37d-4009-999c-5b6beedb654f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:40.867178 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc06d3a0-f37d-4009-999c-5b6beedb654f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:40.867818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc06d3a0-f37d-4009-999c-5b6beedb654f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:40.868242 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc06d3a0-f37d-4009-999c-5b6beedb654f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:40.896369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bc06d3a0-f37d-4009-999c-5b6beedb654f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044067 Aug 24 12:43:40.896908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 911/1822] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:40 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:41.133362 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-22ec11cb-c54e-4757-b2bb-7cda1f67ead8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:41.135417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-22ec11cb-c54e-4757-b2bb-7cda1f67ead8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:41.142303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22ec11cb-c54e-4757-b2bb-7cda1f67ead8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:41.142806 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22ec11cb-c54e-4757-b2bb-7cda1f67ead8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:41.143238 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22ec11cb-c54e-4757-b2bb-7cda1f67ead8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:41.143916 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22ec11cb-c54e-4757-b2bb-7cda1f67ead8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:41.144362 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22ec11cb-c54e-4757-b2bb-7cda1f67ead8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:41.144784 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22ec11cb-c54e-4757-b2bb-7cda1f67ead8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:41.173914 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-22ec11cb-c54e-4757-b2bb-7cda1f67ead8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044605 Aug 24 12:43:41.174438 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 912/1823] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:41 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:41.909082 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-abc24bd8-f7cd-4dd5-a74d-19dae0803289 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:41.911343 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-abc24bd8-f7cd-4dd5-a74d-19dae0803289 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:41.917748 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-abc24bd8-f7cd-4dd5-a74d-19dae0803289 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:41.918237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-abc24bd8-f7cd-4dd5-a74d-19dae0803289 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:41.918707 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-abc24bd8-f7cd-4dd5-a74d-19dae0803289 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:41.919405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-abc24bd8-f7cd-4dd5-a74d-19dae0803289 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:41.919965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-abc24bd8-f7cd-4dd5-a74d-19dae0803289 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:41.920272 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-abc24bd8-f7cd-4dd5-a74d-19dae0803289 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:41.949534 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-abc24bd8-f7cd-4dd5-a74d-19dae0803289 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044443 Aug 24 12:43:41.950589 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 912/1824] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:41 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:42.185889 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5dcc233a-104a-45bf-9058-5c1e244e461f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:42.187962 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5dcc233a-104a-45bf-9058-5c1e244e461f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:42.194264 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5dcc233a-104a-45bf-9058-5c1e244e461f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:42.194884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5dcc233a-104a-45bf-9058-5c1e244e461f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:42.195323 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5dcc233a-104a-45bf-9058-5c1e244e461f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:42.196004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5dcc233a-104a-45bf-9058-5c1e244e461f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:42.196452 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5dcc233a-104a-45bf-9058-5c1e244e461f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:42.196872 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5dcc233a-104a-45bf-9058-5c1e244e461f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:42.225427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5dcc233a-104a-45bf-9058-5c1e244e461f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043527 Aug 24 12:43:42.225962 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 913/1825] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:42 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:42.961915 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-72158acd-67ef-4e36-af61-aa7fcaaada07 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:42.964004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-72158acd-67ef-4e36-af61-aa7fcaaada07 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:42.970377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72158acd-67ef-4e36-af61-aa7fcaaada07 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:42.970991 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72158acd-67ef-4e36-af61-aa7fcaaada07 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:42.971418 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72158acd-67ef-4e36-af61-aa7fcaaada07 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:42.972109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72158acd-67ef-4e36-af61-aa7fcaaada07 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:42.972554 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72158acd-67ef-4e36-af61-aa7fcaaada07 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:42.972977 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72158acd-67ef-4e36-af61-aa7fcaaada07 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:43.002701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-72158acd-67ef-4e36-af61-aa7fcaaada07 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044782 Aug 24 12:43:43.003260 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 913/1826] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:42 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:43.237981 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7acb9850-0e77-4583-8590-a8375ac96884 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:43.240429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7acb9850-0e77-4583-8590-a8375ac96884 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:43.247494 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7acb9850-0e77-4583-8590-a8375ac96884 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:43.247980 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7acb9850-0e77-4583-8590-a8375ac96884 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:43.248417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7acb9850-0e77-4583-8590-a8375ac96884 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:43.249103 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7acb9850-0e77-4583-8590-a8375ac96884 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:43.249550 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7acb9850-0e77-4583-8590-a8375ac96884 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:43.249970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7acb9850-0e77-4583-8590-a8375ac96884 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:43.277966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7acb9850-0e77-4583-8590-a8375ac96884 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043930 Aug 24 12:43:43.278505 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 914/1827] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:43 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:44.015360 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0b3b4904-ab97-4130-96de-8d74f1951301 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:44.017501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0b3b4904-ab97-4130-96de-8d74f1951301 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:44.023894 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b3b4904-ab97-4130-96de-8d74f1951301 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:44.024378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b3b4904-ab97-4130-96de-8d74f1951301 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:44.024819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b3b4904-ab97-4130-96de-8d74f1951301 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:44.025511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b3b4904-ab97-4130-96de-8d74f1951301 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:44.025979 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b3b4904-ab97-4130-96de-8d74f1951301 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:44.026407 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b3b4904-ab97-4130-96de-8d74f1951301 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:44.056298 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0b3b4904-ab97-4130-96de-8d74f1951301 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045420 Aug 24 12:43:44.056846 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 914/1828] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:44 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:44.289680 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7bd9ed01-dba4-454b-be7b-f330bd8a9a8b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:44.291884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7bd9ed01-dba4-454b-be7b-f330bd8a9a8b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:44.298264 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7bd9ed01-dba4-454b-be7b-f330bd8a9a8b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:44.298776 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7bd9ed01-dba4-454b-be7b-f330bd8a9a8b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:44.299212 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7bd9ed01-dba4-454b-be7b-f330bd8a9a8b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:44.299893 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7bd9ed01-dba4-454b-be7b-f330bd8a9a8b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:44.300338 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7bd9ed01-dba4-454b-be7b-f330bd8a9a8b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:44.300837 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7bd9ed01-dba4-454b-be7b-f330bd8a9a8b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:44.330219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7bd9ed01-dba4-454b-be7b-f330bd8a9a8b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044395 Aug 24 12:43:44.330785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 915/1829] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:44 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:45.068505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-253369d0-ddaf-4a47-b494-40d0c9cd9c3b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:45.070628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-253369d0-ddaf-4a47-b494-40d0c9cd9c3b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:45.077065 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-253369d0-ddaf-4a47-b494-40d0c9cd9c3b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:45.077548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-253369d0-ddaf-4a47-b494-40d0c9cd9c3b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:45.077986 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-253369d0-ddaf-4a47-b494-40d0c9cd9c3b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:45.078697 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-253369d0-ddaf-4a47-b494-40d0c9cd9c3b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:45.079164 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-253369d0-ddaf-4a47-b494-40d0c9cd9c3b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:45.079591 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-253369d0-ddaf-4a47-b494-40d0c9cd9c3b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:45.110381 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-253369d0-ddaf-4a47-b494-40d0c9cd9c3b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045914 Aug 24 12:43:45.110983 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 915/1830] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:45 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:45.342035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-41630ea0-c870-43a7-af66-c72edd835d15 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:45.344123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-41630ea0-c870-43a7-af66-c72edd835d15 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:45.350724 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41630ea0-c870-43a7-af66-c72edd835d15 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:45.351219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41630ea0-c870-43a7-af66-c72edd835d15 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:45.351655 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41630ea0-c870-43a7-af66-c72edd835d15 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:45.352346 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41630ea0-c870-43a7-af66-c72edd835d15 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:45.352793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41630ea0-c870-43a7-af66-c72edd835d15 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:45.353216 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41630ea0-c870-43a7-af66-c72edd835d15 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:45.382329 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-41630ea0-c870-43a7-af66-c72edd835d15 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044926 Aug 24 12:43:45.382898 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 916/1831] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:45 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:46.123641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5dd76449-6cbf-48e8-b1d1-a70bf52fb21c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:46.125736 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5dd76449-6cbf-48e8-b1d1-a70bf52fb21c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:46.132129 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5dd76449-6cbf-48e8-b1d1-a70bf52fb21c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:46.132619 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5dd76449-6cbf-48e8-b1d1-a70bf52fb21c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:46.133053 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5dd76449-6cbf-48e8-b1d1-a70bf52fb21c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:46.133756 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5dd76449-6cbf-48e8-b1d1-a70bf52fb21c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:46.134189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5dd76449-6cbf-48e8-b1d1-a70bf52fb21c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:46.134611 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5dd76449-6cbf-48e8-b1d1-a70bf52fb21c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:46.164015 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5dd76449-6cbf-48e8-b1d1-a70bf52fb21c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044864 Aug 24 12:43:46.164567 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 916/1832] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:46 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:46.394737 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a3171ed4-af0d-4060-baf6-d9d17496b304 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:46.396830 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a3171ed4-af0d-4060-baf6-d9d17496b304 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:46.402863 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a3171ed4-af0d-4060-baf6-d9d17496b304 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:46.404020 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a3171ed4-af0d-4060-baf6-d9d17496b304 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:46.404447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a3171ed4-af0d-4060-baf6-d9d17496b304 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:46.405122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a3171ed4-af0d-4060-baf6-d9d17496b304 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:46.405568 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a3171ed4-af0d-4060-baf6-d9d17496b304 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:46.405980 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a3171ed4-af0d-4060-baf6-d9d17496b304 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:46.434641 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a3171ed4-af0d-4060-baf6-d9d17496b304 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044039 Aug 24 12:43:46.435216 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 917/1833] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:46 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:47.176866 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3fefee38-a55f-4943-a475-78219a4a28e8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:47.178965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3fefee38-a55f-4943-a475-78219a4a28e8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:47.191364 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3fefee38-a55f-4943-a475-78219a4a28e8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:47.191857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3fefee38-a55f-4943-a475-78219a4a28e8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:47.192302 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3fefee38-a55f-4943-a475-78219a4a28e8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:47.193000 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3fefee38-a55f-4943-a475-78219a4a28e8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:47.193457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3fefee38-a55f-4943-a475-78219a4a28e8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:47.193882 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3fefee38-a55f-4943-a475-78219a4a28e8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:47.197961 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:47.225067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3fefee38-a55f-4943-a475-78219a4a28e8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052169 Aug 24 12:43:47.225677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 917/1834] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:47 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:47.446311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d7f8fc29-1284-4192-a27b-d61dc34a8d8a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:47.448484 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d7f8fc29-1284-4192-a27b-d61dc34a8d8a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:47.455497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7f8fc29-1284-4192-a27b-d61dc34a8d8a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:47.455971 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7f8fc29-1284-4192-a27b-d61dc34a8d8a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:47.456397 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7f8fc29-1284-4192-a27b-d61dc34a8d8a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:47.458566 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7f8fc29-1284-4192-a27b-d61dc34a8d8a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:47.459054 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7f8fc29-1284-4192-a27b-d61dc34a8d8a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:47.459489 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7f8fc29-1284-4192-a27b-d61dc34a8d8a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:47.463081 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:47.490603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d7f8fc29-1284-4192-a27b-d61dc34a8d8a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048245 Aug 24 12:43:47.491175 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 918/1835] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:47 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:48.237263 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b4035362-adff-4057-a69f-350b72ce9981 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:48.239711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b4035362-adff-4057-a69f-350b72ce9981 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:48.247273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4035362-adff-4057-a69f-350b72ce9981 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:48.247806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4035362-adff-4057-a69f-350b72ce9981 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:48.248238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4035362-adff-4057-a69f-350b72ce9981 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:48.248921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4035362-adff-4057-a69f-350b72ce9981 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:48.249375 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4035362-adff-4057-a69f-350b72ce9981 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:48.249825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4035362-adff-4057-a69f-350b72ce9981 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:48.279341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b4035362-adff-4057-a69f-350b72ce9981 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045985 Aug 24 12:43:48.279892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 918/1836] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:48 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:48.502929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3e2b4229-f1e0-406c-8751-0aa9ebd30b01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:48.505027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3e2b4229-f1e0-406c-8751-0aa9ebd30b01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:48.511570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e2b4229-f1e0-406c-8751-0aa9ebd30b01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:48.512073 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e2b4229-f1e0-406c-8751-0aa9ebd30b01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:48.512509 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e2b4229-f1e0-406c-8751-0aa9ebd30b01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:48.513191 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e2b4229-f1e0-406c-8751-0aa9ebd30b01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:48.513640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e2b4229-f1e0-406c-8751-0aa9ebd30b01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:48.514063 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e2b4229-f1e0-406c-8751-0aa9ebd30b01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:48.541867 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3e2b4229-f1e0-406c-8751-0aa9ebd30b01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043025 Aug 24 12:43:48.542402 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 919/1837] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:48 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:49.291651 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8321322e-86b4-4c7d-9b26-fa1677ef5fd5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:49.294307 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8321322e-86b4-4c7d-9b26-fa1677ef5fd5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:49.300820 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8321322e-86b4-4c7d-9b26-fa1677ef5fd5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:49.301302 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8321322e-86b4-4c7d-9b26-fa1677ef5fd5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:49.301743 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8321322e-86b4-4c7d-9b26-fa1677ef5fd5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:49.302432 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8321322e-86b4-4c7d-9b26-fa1677ef5fd5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:49.302928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8321322e-86b4-4c7d-9b26-fa1677ef5fd5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:49.303354 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8321322e-86b4-4c7d-9b26-fa1677ef5fd5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:49.334073 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8321322e-86b4-4c7d-9b26-fa1677ef5fd5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046359 Aug 24 12:43:49.334779 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 919/1838] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:49 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:49.554541 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-96e92017-65bb-4a58-b5d1-c2412d99c75a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:49.556669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-96e92017-65bb-4a58-b5d1-c2412d99c75a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:49.563485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96e92017-65bb-4a58-b5d1-c2412d99c75a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:49.563953 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96e92017-65bb-4a58-b5d1-c2412d99c75a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:49.564377 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96e92017-65bb-4a58-b5d1-c2412d99c75a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:49.565050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96e92017-65bb-4a58-b5d1-c2412d99c75a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:49.565491 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96e92017-65bb-4a58-b5d1-c2412d99c75a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:49.565909 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96e92017-65bb-4a58-b5d1-c2412d99c75a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:49.594269 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-96e92017-65bb-4a58-b5d1-c2412d99c75a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043761 Aug 24 12:43:49.594828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 920/1839] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:49 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:50.346373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-765e4576-88fb-47f8-87b2-ad914458a204 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:50.348552 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-765e4576-88fb-47f8-87b2-ad914458a204 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:50.354958 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-765e4576-88fb-47f8-87b2-ad914458a204 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:50.355457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-765e4576-88fb-47f8-87b2-ad914458a204 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:50.355881 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-765e4576-88fb-47f8-87b2-ad914458a204 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:50.357199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-765e4576-88fb-47f8-87b2-ad914458a204 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:50.357656 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-765e4576-88fb-47f8-87b2-ad914458a204 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:50.358079 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-765e4576-88fb-47f8-87b2-ad914458a204 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:50.387108 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-765e4576-88fb-47f8-87b2-ad914458a204 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044879 Aug 24 12:43:50.387659 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 920/1840] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:50 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:50.605597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-aee12339-fc09-4c8a-8956-a8e4d17b3475 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:50.607747 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-aee12339-fc09-4c8a-8956-a8e4d17b3475 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:50.614314 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aee12339-fc09-4c8a-8956-a8e4d17b3475 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:50.614863 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aee12339-fc09-4c8a-8956-a8e4d17b3475 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:50.615296 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aee12339-fc09-4c8a-8956-a8e4d17b3475 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:50.616064 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aee12339-fc09-4c8a-8956-a8e4d17b3475 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:50.616515 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aee12339-fc09-4c8a-8956-a8e4d17b3475 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:50.616933 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aee12339-fc09-4c8a-8956-a8e4d17b3475 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:50.645716 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-aee12339-fc09-4c8a-8956-a8e4d17b3475 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044362 Aug 24 12:43:50.646241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 921/1841] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:50 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:51.399381 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7600ec83-62e3-4122-812e-77c2516883b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:51.401418 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7600ec83-62e3-4122-812e-77c2516883b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:51.408435 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7600ec83-62e3-4122-812e-77c2516883b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:51.408915 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7600ec83-62e3-4122-812e-77c2516883b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:51.409344 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7600ec83-62e3-4122-812e-77c2516883b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:51.410022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7600ec83-62e3-4122-812e-77c2516883b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:51.410473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7600ec83-62e3-4122-812e-77c2516883b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:51.410922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7600ec83-62e3-4122-812e-77c2516883b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:51.440535 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7600ec83-62e3-4122-812e-77c2516883b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045158 Aug 24 12:43:51.441301 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 921/1842] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:51 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:51.658287 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e12dde51-ef3b-49f7-a7b1-ecb799633e5d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:51.663016 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e12dde51-ef3b-49f7-a7b1-ecb799633e5d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:51.666749 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e12dde51-ef3b-49f7-a7b1-ecb799633e5d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:51.667232 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e12dde51-ef3b-49f7-a7b1-ecb799633e5d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:51.667670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e12dde51-ef3b-49f7-a7b1-ecb799633e5d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:51.668356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e12dde51-ef3b-49f7-a7b1-ecb799633e5d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:51.668807 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e12dde51-ef3b-49f7-a7b1-ecb799633e5d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:51.669233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e12dde51-ef3b-49f7-a7b1-ecb799633e5d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:51.697308 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e12dde51-ef3b-49f7-a7b1-ecb799633e5d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043036 Aug 24 12:43:51.697849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 922/1843] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:51 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:52.453083 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-044cf830-431b-4c47-8f54-860bf28b2404 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:52.455232 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-044cf830-431b-4c47-8f54-860bf28b2404 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:52.461525 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-044cf830-431b-4c47-8f54-860bf28b2404 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:52.462005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-044cf830-431b-4c47-8f54-860bf28b2404 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:52.462431 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-044cf830-431b-4c47-8f54-860bf28b2404 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:52.463148 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-044cf830-431b-4c47-8f54-860bf28b2404 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:52.463599 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-044cf830-431b-4c47-8f54-860bf28b2404 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:52.464021 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-044cf830-431b-4c47-8f54-860bf28b2404 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:52.493437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-044cf830-431b-4c47-8f54-860bf28b2404 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044307 Aug 24 12:43:52.493996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 922/1844] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:52 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:52.709891 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7a2459bb-9329-4d5e-adf7-9ddaba4a5e82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:52.712019 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7a2459bb-9329-4d5e-adf7-9ddaba4a5e82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:52.718884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a2459bb-9329-4d5e-adf7-9ddaba4a5e82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:52.719364 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a2459bb-9329-4d5e-adf7-9ddaba4a5e82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:52.719799 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a2459bb-9329-4d5e-adf7-9ddaba4a5e82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:52.720489 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a2459bb-9329-4d5e-adf7-9ddaba4a5e82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:52.720939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a2459bb-9329-4d5e-adf7-9ddaba4a5e82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:52.721367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a2459bb-9329-4d5e-adf7-9ddaba4a5e82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:52.751059 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7a2459bb-9329-4d5e-adf7-9ddaba4a5e82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045165 Aug 24 12:43:52.751590 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 923/1845] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:52 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:53.505706 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e2cc343b-5a9a-4a04-b4a7-a083bb75a436 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:53.507882 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e2cc343b-5a9a-4a04-b4a7-a083bb75a436 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:53.514892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2cc343b-5a9a-4a04-b4a7-a083bb75a436 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:53.515382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2cc343b-5a9a-4a04-b4a7-a083bb75a436 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:53.515820 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2cc343b-5a9a-4a04-b4a7-a083bb75a436 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:53.516515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2cc343b-5a9a-4a04-b4a7-a083bb75a436 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:53.516976 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2cc343b-5a9a-4a04-b4a7-a083bb75a436 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:53.517410 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2cc343b-5a9a-4a04-b4a7-a083bb75a436 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:53.545749 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e2cc343b-5a9a-4a04-b4a7-a083bb75a436 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044057 Aug 24 12:43:53.546296 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 923/1846] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:53 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:53.764043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9958f5fc-992a-419b-ac48-41eb8cd76ed4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:53.766157 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9958f5fc-992a-419b-ac48-41eb8cd76ed4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:53.772470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9958f5fc-992a-419b-ac48-41eb8cd76ed4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:53.772941 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9958f5fc-992a-419b-ac48-41eb8cd76ed4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:53.773371 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9958f5fc-992a-419b-ac48-41eb8cd76ed4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:53.774046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9958f5fc-992a-419b-ac48-41eb8cd76ed4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:53.774491 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9958f5fc-992a-419b-ac48-41eb8cd76ed4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:53.774942 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9958f5fc-992a-419b-ac48-41eb8cd76ed4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:53.804647 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9958f5fc-992a-419b-ac48-41eb8cd76ed4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045526 Aug 24 12:43:53.805183 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 924/1847] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:53 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:54.558234 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d72f31a7-11e4-47dd-aa75-ad6ec9f75fd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:54.561015 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d72f31a7-11e4-47dd-aa75-ad6ec9f75fd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:54.567524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d72f31a7-11e4-47dd-aa75-ad6ec9f75fd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:54.568007 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d72f31a7-11e4-47dd-aa75-ad6ec9f75fd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:54.568441 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d72f31a7-11e4-47dd-aa75-ad6ec9f75fd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:54.569117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d72f31a7-11e4-47dd-aa75-ad6ec9f75fd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:54.569568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d72f31a7-11e4-47dd-aa75-ad6ec9f75fd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:54.569992 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d72f31a7-11e4-47dd-aa75-ad6ec9f75fd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:54.598787 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d72f31a7-11e4-47dd-aa75-ad6ec9f75fd8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044538 Aug 24 12:43:54.599337 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 924/1848] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:54 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:54.816158 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9aa4a5f0-3832-47e3-9a3f-01408add3684 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:54.818331 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9aa4a5f0-3832-47e3-9a3f-01408add3684 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:54.824622 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9aa4a5f0-3832-47e3-9a3f-01408add3684 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:54.825092 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9aa4a5f0-3832-47e3-9a3f-01408add3684 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:54.825516 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9aa4a5f0-3832-47e3-9a3f-01408add3684 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:54.826190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9aa4a5f0-3832-47e3-9a3f-01408add3684 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:54.826630 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9aa4a5f0-3832-47e3-9a3f-01408add3684 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:54.827070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9aa4a5f0-3832-47e3-9a3f-01408add3684 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:54.855240 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9aa4a5f0-3832-47e3-9a3f-01408add3684 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043044 Aug 24 12:43:54.856448 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 925/1849] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:54 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:55.611303 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-36bdb63b-8f36-48b5-9eb8-179beb60d157 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:55.613341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-36bdb63b-8f36-48b5-9eb8-179beb60d157 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:55.619978 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-36bdb63b-8f36-48b5-9eb8-179beb60d157 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:55.620458 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-36bdb63b-8f36-48b5-9eb8-179beb60d157 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:55.620892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-36bdb63b-8f36-48b5-9eb8-179beb60d157 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:55.622271 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-36bdb63b-8f36-48b5-9eb8-179beb60d157 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:55.622750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-36bdb63b-8f36-48b5-9eb8-179beb60d157 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:55.623174 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-36bdb63b-8f36-48b5-9eb8-179beb60d157 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:55.651966 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-36bdb63b-8f36-48b5-9eb8-179beb60d157 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045038 Aug 24 12:43:55.652509 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 925/1850] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:55 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:55.868218 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-590efc55-bdbf-4d06-b8f7-19210045d3cf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:55.870274 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-590efc55-bdbf-4d06-b8f7-19210045d3cf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:55.877169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-590efc55-bdbf-4d06-b8f7-19210045d3cf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:55.877652 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-590efc55-bdbf-4d06-b8f7-19210045d3cf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:55.878087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-590efc55-bdbf-4d06-b8f7-19210045d3cf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:55.878800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-590efc55-bdbf-4d06-b8f7-19210045d3cf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:55.879253 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-590efc55-bdbf-4d06-b8f7-19210045d3cf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:55.879678 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-590efc55-bdbf-4d06-b8f7-19210045d3cf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:55.908341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-590efc55-bdbf-4d06-b8f7-19210045d3cf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044411 Aug 24 12:43:55.908877 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 926/1851] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:55 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:56.664063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-62dd1ddd-3de2-41bc-be8f-cec22c5c20bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:56.666192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-62dd1ddd-3de2-41bc-be8f-cec22c5c20bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:56.673120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-62dd1ddd-3de2-41bc-be8f-cec22c5c20bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:56.673597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-62dd1ddd-3de2-41bc-be8f-cec22c5c20bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:56.674030 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-62dd1ddd-3de2-41bc-be8f-cec22c5c20bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:56.674734 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-62dd1ddd-3de2-41bc-be8f-cec22c5c20bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:56.675194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-62dd1ddd-3de2-41bc-be8f-cec22c5c20bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:56.675621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-62dd1ddd-3de2-41bc-be8f-cec22c5c20bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:56.704205 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-62dd1ddd-3de2-41bc-be8f-cec22c5c20bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044087 Aug 24 12:43:56.704766 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 926/1852] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:56 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:56.920530 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8f61f42e-0d5a-467a-9c0b-42d8eaa5b73a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:56.922575 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8f61f42e-0d5a-467a-9c0b-42d8eaa5b73a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:56.928939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f61f42e-0d5a-467a-9c0b-42d8eaa5b73a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:56.929413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f61f42e-0d5a-467a-9c0b-42d8eaa5b73a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:56.929845 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f61f42e-0d5a-467a-9c0b-42d8eaa5b73a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:56.930530 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f61f42e-0d5a-467a-9c0b-42d8eaa5b73a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:56.931005 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f61f42e-0d5a-467a-9c0b-42d8eaa5b73a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:56.931428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f61f42e-0d5a-467a-9c0b-42d8eaa5b73a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:56.959843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8f61f42e-0d5a-467a-9c0b-42d8eaa5b73a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043399 Aug 24 12:43:56.960379 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 927/1853] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:56 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:57.716481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b38a5cd0-2ed4-4d50-b468-6ef2d60d5b37 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:57.718513 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b38a5cd0-2ed4-4d50-b468-6ef2d60d5b37 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:57.720762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=66 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:57.725368 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b38a5cd0-2ed4-4d50-b468-6ef2d60d5b37 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:57.725825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b38a5cd0-2ed4-4d50-b468-6ef2d60d5b37 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:57.726257 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b38a5cd0-2ed4-4d50-b468-6ef2d60d5b37 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:57.726979 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b38a5cd0-2ed4-4d50-b468-6ef2d60d5b37 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:57.727482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b38a5cd0-2ed4-4d50-b468-6ef2d60d5b37 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:57.738888 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b38a5cd0-2ed4-4d50-b468-6ef2d60d5b37 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:57.759080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b38a5cd0-2ed4-4d50-b468-6ef2d60d5b37 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046645 Aug 24 12:43:57.759639 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 927/1854] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:57 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:57.972350 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5920ead7-7e8f-48b3-be67-ac90e559c44e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:57.974403 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5920ead7-7e8f-48b3-be67-ac90e559c44e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:57.976821 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=68 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:57.982038 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5920ead7-7e8f-48b3-be67-ac90e559c44e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:57.982516 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5920ead7-7e8f-48b3-be67-ac90e559c44e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:57.982975 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5920ead7-7e8f-48b3-be67-ac90e559c44e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:57.983662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5920ead7-7e8f-48b3-be67-ac90e559c44e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:57.984111 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5920ead7-7e8f-48b3-be67-ac90e559c44e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:57.984537 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5920ead7-7e8f-48b3-be67-ac90e559c44e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:58.013036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5920ead7-7e8f-48b3-be67-ac90e559c44e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044725 Aug 24 12:43:58.013599 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 928/1855] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:57 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:58.771082 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a6a10f77-1aa7-42fe-b4ac-c5679e2bf0d9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:58.773223 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a6a10f77-1aa7-42fe-b4ac-c5679e2bf0d9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:58.779513 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6a10f77-1aa7-42fe-b4ac-c5679e2bf0d9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:58.779991 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6a10f77-1aa7-42fe-b4ac-c5679e2bf0d9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:58.780419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6a10f77-1aa7-42fe-b4ac-c5679e2bf0d9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:58.781099 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6a10f77-1aa7-42fe-b4ac-c5679e2bf0d9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:58.781548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6a10f77-1aa7-42fe-b4ac-c5679e2bf0d9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:58.781968 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6a10f77-1aa7-42fe-b4ac-c5679e2bf0d9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:58.810330 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a6a10f77-1aa7-42fe-b4ac-c5679e2bf0d9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043202 Aug 24 12:43:58.810901 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 928/1856] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:58 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:59.025190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fc882757-8654-4a11-ae4d-fdeb0edfb586 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:59.027264 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fc882757-8654-4a11-ae4d-fdeb0edfb586 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:59.033527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc882757-8654-4a11-ae4d-fdeb0edfb586 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:59.033999 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc882757-8654-4a11-ae4d-fdeb0edfb586 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:59.034425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc882757-8654-4a11-ae4d-fdeb0edfb586 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:59.035134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc882757-8654-4a11-ae4d-fdeb0edfb586 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:59.035580 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc882757-8654-4a11-ae4d-fdeb0edfb586 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:59.035997 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fc882757-8654-4a11-ae4d-fdeb0edfb586 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:59.065124 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fc882757-8654-4a11-ae4d-fdeb0edfb586 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043921 Aug 24 12:43:59.065657 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 929/1857] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:59 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:59.822847 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c6b42eb9-91bc-49f5-9a01-d33dd035f251 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:59.825535 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c6b42eb9-91bc-49f5-9a01-d33dd035f251 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:59.832014 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6b42eb9-91bc-49f5-9a01-d33dd035f251 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:59.832491 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6b42eb9-91bc-49f5-9a01-d33dd035f251 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:59.832922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6b42eb9-91bc-49f5-9a01-d33dd035f251 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:59.833600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6b42eb9-91bc-49f5-9a01-d33dd035f251 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:59.834050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6b42eb9-91bc-49f5-9a01-d33dd035f251 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:59.834469 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6b42eb9-91bc-49f5-9a01-d33dd035f251 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:59.872247 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c6b42eb9-91bc-49f5-9a01-d33dd035f251 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053377 Aug 24 12:43:59.872789 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 929/1858] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:43:59 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:00.077286 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1999a083-8a42-4e9d-a8e4-82646c4a450e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:00.079378 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1999a083-8a42-4e9d-a8e4-82646c4a450e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:00.085701 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1999a083-8a42-4e9d-a8e4-82646c4a450e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:00.086178 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1999a083-8a42-4e9d-a8e4-82646c4a450e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:00.086616 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1999a083-8a42-4e9d-a8e4-82646c4a450e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:00.087331 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1999a083-8a42-4e9d-a8e4-82646c4a450e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:00.087780 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1999a083-8a42-4e9d-a8e4-82646c4a450e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:00.088201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1999a083-8a42-4e9d-a8e4-82646c4a450e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:00.116404 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1999a083-8a42-4e9d-a8e4-82646c4a450e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043801 Aug 24 12:44:00.116924 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 930/1859] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:00 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:00.883804 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2cbec627-6062-47f4-8917-d7da42d993fc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:00.885924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2cbec627-6062-47f4-8917-d7da42d993fc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:00.892256 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2cbec627-6062-47f4-8917-d7da42d993fc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:00.892730 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2cbec627-6062-47f4-8917-d7da42d993fc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:00.893164 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2cbec627-6062-47f4-8917-d7da42d993fc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:00.893843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2cbec627-6062-47f4-8917-d7da42d993fc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:00.894296 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2cbec627-6062-47f4-8917-d7da42d993fc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:00.894736 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2cbec627-6062-47f4-8917-d7da42d993fc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:00.923568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2cbec627-6062-47f4-8917-d7da42d993fc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043721 Aug 24 12:44:00.924097 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 930/1860] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:00 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:44:01.128141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5672d982-bb33-4d00-acdb-de270ff67da9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:01.130317 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5672d982-bb33-4d00-acdb-de270ff67da9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:01.136717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5672d982-bb33-4d00-acdb-de270ff67da9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:01.137191 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5672d982-bb33-4d00-acdb-de270ff67da9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:01.137626 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5672d982-bb33-4d00-acdb-de270ff67da9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:01.138306 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5672d982-bb33-4d00-acdb-de270ff67da9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:01.138788 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5672d982-bb33-4d00-acdb-de270ff67da9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:01.139210 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5672d982-bb33-4d00-acdb-de270ff67da9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:01.167944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5672d982-bb33-4d00-acdb-de270ff67da9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043720 Aug 24 12:44:01.169056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 931/1861] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:01 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:01.935038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ca42c5ff-4ddc-4219-b3c0-f00fd33b2e3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:01.937172 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ca42c5ff-4ddc-4219-b3c0-f00fd33b2e3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:01.943635 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ca42c5ff-4ddc-4219-b3c0-f00fd33b2e3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:01.944124 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ca42c5ff-4ddc-4219-b3c0-f00fd33b2e3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:01.944570 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ca42c5ff-4ddc-4219-b3c0-f00fd33b2e3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:01.945266 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ca42c5ff-4ddc-4219-b3c0-f00fd33b2e3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:01.945730 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ca42c5ff-4ddc-4219-b3c0-f00fd33b2e3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:01.946195 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ca42c5ff-4ddc-4219-b3c0-f00fd33b2e3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:01.975355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ca42c5ff-4ddc-4219-b3c0-f00fd33b2e3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044313 Aug 24 12:44:01.975904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 931/1862] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:01 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:02.180828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d1122b5c-bea5-4284-abd7-1e6b632a4dc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:02.182958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d1122b5c-bea5-4284-abd7-1e6b632a4dc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:02.189267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d1122b5c-bea5-4284-abd7-1e6b632a4dc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:02.189746 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d1122b5c-bea5-4284-abd7-1e6b632a4dc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:02.190182 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d1122b5c-bea5-4284-abd7-1e6b632a4dc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:02.190891 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d1122b5c-bea5-4284-abd7-1e6b632a4dc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:02.191343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d1122b5c-bea5-4284-abd7-1e6b632a4dc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:02.191767 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d1122b5c-bea5-4284-abd7-1e6b632a4dc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:02.221607 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d1122b5c-bea5-4284-abd7-1e6b632a4dc6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044764 Aug 24 12:44:02.222148 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 932/1863] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:02 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:02.987644 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c70802f6-c9ac-4ded-b5ed-3049f6489529 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:02.990037 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c70802f6-c9ac-4ded-b5ed-3049f6489529 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:02.996983 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c70802f6-c9ac-4ded-b5ed-3049f6489529 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:02.997469 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c70802f6-c9ac-4ded-b5ed-3049f6489529 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:02.997914 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c70802f6-c9ac-4ded-b5ed-3049f6489529 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:02.998601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c70802f6-c9ac-4ded-b5ed-3049f6489529 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:02.999081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c70802f6-c9ac-4ded-b5ed-3049f6489529 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:02.999506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c70802f6-c9ac-4ded-b5ed-3049f6489529 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:03.027383 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c70802f6-c9ac-4ded-b5ed-3049f6489529 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043731 Aug 24 12:44:03.028418 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 932/1864] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:02 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:03.234337 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d1c62f63-59c1-48e6-b005-c067420efbbb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:03.236731 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d1c62f63-59c1-48e6-b005-c067420efbbb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:03.243398 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d1c62f63-59c1-48e6-b005-c067420efbbb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:03.243822 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d1c62f63-59c1-48e6-b005-c067420efbbb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:03.244258 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d1c62f63-59c1-48e6-b005-c067420efbbb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:03.244972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d1c62f63-59c1-48e6-b005-c067420efbbb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:03.245432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d1c62f63-59c1-48e6-b005-c067420efbbb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:03.245858 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d1c62f63-59c1-48e6-b005-c067420efbbb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:03.274257 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d1c62f63-59c1-48e6-b005-c067420efbbb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044712 Aug 24 12:44:03.274820 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 933/1865] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:03 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:04.039972 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bf4ada2c-6536-4a20-a4c8-f9ea0b8f86bb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:04.042131 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bf4ada2c-6536-4a20-a4c8-f9ea0b8f86bb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:04.048479 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf4ada2c-6536-4a20-a4c8-f9ea0b8f86bb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:04.048961 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf4ada2c-6536-4a20-a4c8-f9ea0b8f86bb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:04.049400 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf4ada2c-6536-4a20-a4c8-f9ea0b8f86bb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:04.050088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf4ada2c-6536-4a20-a4c8-f9ea0b8f86bb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:04.050542 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf4ada2c-6536-4a20-a4c8-f9ea0b8f86bb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:04.051002 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf4ada2c-6536-4a20-a4c8-f9ea0b8f86bb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:04.075680 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:44:04.080333 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bf4ada2c-6536-4a20-a4c8-f9ea0b8f86bb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044381 Aug 24 12:44:04.080882 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 933/1866] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:04 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:04.286762 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ef1fc81c-2772-4d84-9f3f-ded583029557 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:04.288867 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ef1fc81c-2772-4d84-9f3f-ded583029557 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:04.295684 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef1fc81c-2772-4d84-9f3f-ded583029557 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:04.296098 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef1fc81c-2772-4d84-9f3f-ded583029557 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:04.296526 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef1fc81c-2772-4d84-9f3f-ded583029557 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:04.297199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef1fc81c-2772-4d84-9f3f-ded583029557 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:04.297646 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef1fc81c-2772-4d84-9f3f-ded583029557 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:04.298064 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef1fc81c-2772-4d84-9f3f-ded583029557 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:04.322845 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:44:04.327570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ef1fc81c-2772-4d84-9f3f-ded583029557 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044793 Aug 24 12:44:04.333444 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 934/1867] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:04 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:05.093425 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a708fc1d-ee5b-41f4-a66e-abc70440e67e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:05.095561 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a708fc1d-ee5b-41f4-a66e-abc70440e67e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:05.101830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a708fc1d-ee5b-41f4-a66e-abc70440e67e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:05.102315 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a708fc1d-ee5b-41f4-a66e-abc70440e67e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:05.102779 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a708fc1d-ee5b-41f4-a66e-abc70440e67e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:05.103462 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a708fc1d-ee5b-41f4-a66e-abc70440e67e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:05.103910 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a708fc1d-ee5b-41f4-a66e-abc70440e67e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:05.104328 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a708fc1d-ee5b-41f4-a66e-abc70440e67e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:05.132495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a708fc1d-ee5b-41f4-a66e-abc70440e67e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044006 Aug 24 12:44:05.133160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 934/1868] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:05 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:05.344000 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ce7ec62c-fd0e-48f7-9b74-0d6a75971730 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:05.346050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ce7ec62c-fd0e-48f7-9b74-0d6a75971730 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:05.352670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce7ec62c-fd0e-48f7-9b74-0d6a75971730 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:05.353140 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce7ec62c-fd0e-48f7-9b74-0d6a75971730 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:05.353571 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce7ec62c-fd0e-48f7-9b74-0d6a75971730 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:05.354242 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce7ec62c-fd0e-48f7-9b74-0d6a75971730 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:05.354708 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce7ec62c-fd0e-48f7-9b74-0d6a75971730 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:05.355137 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce7ec62c-fd0e-48f7-9b74-0d6a75971730 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:05.384618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ce7ec62c-fd0e-48f7-9b74-0d6a75971730 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044585 Aug 24 12:44:05.385159 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 935/1869] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:05 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:06.144281 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-081fa0d2-79e0-4832-9078-8791265b4068 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:06.146341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-081fa0d2-79e0-4832-9078-8791265b4068 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:06.152690 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-081fa0d2-79e0-4832-9078-8791265b4068 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:06.153176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-081fa0d2-79e0-4832-9078-8791265b4068 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:06.154120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-081fa0d2-79e0-4832-9078-8791265b4068 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:06.154843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-081fa0d2-79e0-4832-9078-8791265b4068 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:06.155304 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-081fa0d2-79e0-4832-9078-8791265b4068 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:06.155733 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-081fa0d2-79e0-4832-9078-8791265b4068 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:06.185350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-081fa0d2-79e0-4832-9078-8791265b4068 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045116 Aug 24 12:44:06.185891 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 935/1870] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:06 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:06.397508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-37092655-d952-4db2-a8c6-9c5b6b255bd5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:06.399594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-37092655-d952-4db2-a8c6-9c5b6b255bd5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:06.406589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37092655-d952-4db2-a8c6-9c5b6b255bd5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:06.407091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37092655-d952-4db2-a8c6-9c5b6b255bd5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:06.407521 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37092655-d952-4db2-a8c6-9c5b6b255bd5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:06.408193 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37092655-d952-4db2-a8c6-9c5b6b255bd5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:06.408635 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37092655-d952-4db2-a8c6-9c5b6b255bd5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:06.409047 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37092655-d952-4db2-a8c6-9c5b6b255bd5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:06.437900 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-37092655-d952-4db2-a8c6-9c5b6b255bd5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044563 Aug 24 12:44:06.438441 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 936/1871] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:06 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:07.198123 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-700b4682-c48a-44ec-83e1-54f67b7a9622 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:07.200397 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-700b4682-c48a-44ec-83e1-54f67b7a9622 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:07.206279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-700b4682-c48a-44ec-83e1-54f67b7a9622 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:07.206789 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-700b4682-c48a-44ec-83e1-54f67b7a9622 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:07.207228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-700b4682-c48a-44ec-83e1-54f67b7a9622 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:07.207956 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-700b4682-c48a-44ec-83e1-54f67b7a9622 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:07.208404 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-700b4682-c48a-44ec-83e1-54f67b7a9622 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:07.208823 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-700b4682-c48a-44ec-83e1-54f67b7a9622 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:07.238286 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-700b4682-c48a-44ec-83e1-54f67b7a9622 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044607 Aug 24 12:44:07.239359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 936/1872] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:07 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:07.449549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7deddf51-5fe6-4250-9b70-84fe676891c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:07.451779 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7deddf51-5fe6-4250-9b70-84fe676891c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:07.458059 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7deddf51-5fe6-4250-9b70-84fe676891c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:07.458536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7deddf51-5fe6-4250-9b70-84fe676891c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:07.459012 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7deddf51-5fe6-4250-9b70-84fe676891c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:07.459692 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7deddf51-5fe6-4250-9b70-84fe676891c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:07.460146 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7deddf51-5fe6-4250-9b70-84fe676891c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:07.460582 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7deddf51-5fe6-4250-9b70-84fe676891c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:07.489644 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7deddf51-5fe6-4250-9b70-84fe676891c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044139 Aug 24 12:44:07.490186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 937/1873] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:07 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:08.251441 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c81ec040-3e98-4160-b641-3b1d81d338c7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:08.253563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c81ec040-3e98-4160-b641-3b1d81d338c7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:08.259935 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c81ec040-3e98-4160-b641-3b1d81d338c7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:08.260419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c81ec040-3e98-4160-b641-3b1d81d338c7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:08.260854 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c81ec040-3e98-4160-b641-3b1d81d338c7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:08.261532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c81ec040-3e98-4160-b641-3b1d81d338c7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:08.261984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c81ec040-3e98-4160-b641-3b1d81d338c7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:08.262404 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c81ec040-3e98-4160-b641-3b1d81d338c7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:08.290620 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c81ec040-3e98-4160-b641-3b1d81d338c7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043718 Aug 24 12:44:08.291172 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 937/1874] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:08 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:08.501899 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3dbe04af-ff19-475f-87ec-63727f8d61eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:08.504056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3dbe04af-ff19-475f-87ec-63727f8d61eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:08.510401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3dbe04af-ff19-475f-87ec-63727f8d61eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:08.510919 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3dbe04af-ff19-475f-87ec-63727f8d61eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:08.511352 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3dbe04af-ff19-475f-87ec-63727f8d61eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:08.512033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3dbe04af-ff19-475f-87ec-63727f8d61eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:08.512485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3dbe04af-ff19-475f-87ec-63727f8d61eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:08.513549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3dbe04af-ff19-475f-87ec-63727f8d61eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:08.541565 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3dbe04af-ff19-475f-87ec-63727f8d61eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044164 Aug 24 12:44:08.542094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 938/1875] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:08 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:09.302727 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5d983c2b-1c93-4929-b892-f8ca38a7caa1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:09.304764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5d983c2b-1c93-4929-b892-f8ca38a7caa1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:09.311717 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5d983c2b-1c93-4929-b892-f8ca38a7caa1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:09.312194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5d983c2b-1c93-4929-b892-f8ca38a7caa1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:09.312636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5d983c2b-1c93-4929-b892-f8ca38a7caa1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:09.313315 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5d983c2b-1c93-4929-b892-f8ca38a7caa1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:09.313768 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5d983c2b-1c93-4929-b892-f8ca38a7caa1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:09.314187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5d983c2b-1c93-4929-b892-f8ca38a7caa1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:09.343859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5d983c2b-1c93-4929-b892-f8ca38a7caa1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045121 Aug 24 12:44:09.349075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 938/1876] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:09 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:09.552934 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ff4bacad-5dc2-4477-b432-3273a1cf08f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:09.555070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ff4bacad-5dc2-4477-b432-3273a1cf08f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:09.562339 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ff4bacad-5dc2-4477-b432-3273a1cf08f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:09.562858 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ff4bacad-5dc2-4477-b432-3273a1cf08f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:09.563314 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ff4bacad-5dc2-4477-b432-3273a1cf08f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:09.563990 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ff4bacad-5dc2-4477-b432-3273a1cf08f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:09.564460 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ff4bacad-5dc2-4477-b432-3273a1cf08f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:09.564892 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ff4bacad-5dc2-4477-b432-3273a1cf08f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:09.593737 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ff4bacad-5dc2-4477-b432-3273a1cf08f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044773 Aug 24 12:44:09.594272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 939/1877] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:09 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:10.360524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-166db35f-aa87-4236-8565-ab36df5b5edd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:10.362637 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-166db35f-aa87-4236-8565-ab36df5b5edd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:10.369521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-166db35f-aa87-4236-8565-ab36df5b5edd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:10.370011 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-166db35f-aa87-4236-8565-ab36df5b5edd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:10.370448 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-166db35f-aa87-4236-8565-ab36df5b5edd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:10.371190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-166db35f-aa87-4236-8565-ab36df5b5edd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:10.371623 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-166db35f-aa87-4236-8565-ab36df5b5edd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:10.372669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-166db35f-aa87-4236-8565-ab36df5b5edd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:10.401759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-166db35f-aa87-4236-8565-ab36df5b5edd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046432 Aug 24 12:44:10.402316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 939/1878] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:10 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:44:10.605402 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e1cf2fcf-9152-4446-89c2-8ddd114588aa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:10.608232 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e1cf2fcf-9152-4446-89c2-8ddd114588aa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:10.615648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1cf2fcf-9152-4446-89c2-8ddd114588aa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:10.616116 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1cf2fcf-9152-4446-89c2-8ddd114588aa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:10.616542 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1cf2fcf-9152-4446-89c2-8ddd114588aa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:10.617267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1cf2fcf-9152-4446-89c2-8ddd114588aa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:10.617778 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1cf2fcf-9152-4446-89c2-8ddd114588aa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:10.618208 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1cf2fcf-9152-4446-89c2-8ddd114588aa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:10.646749 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e1cf2fcf-9152-4446-89c2-8ddd114588aa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045331 Aug 24 12:44:10.647300 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 940/1879] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:10 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:11.413954 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-843101bd-e8f5-42a4-8283-35f745d8c171 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:11.416054 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-843101bd-e8f5-42a4-8283-35f745d8c171 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:11.423119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-843101bd-e8f5-42a4-8283-35f745d8c171 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:11.423612 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-843101bd-e8f5-42a4-8283-35f745d8c171 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:11.424050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-843101bd-e8f5-42a4-8283-35f745d8c171 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:11.424750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-843101bd-e8f5-42a4-8283-35f745d8c171 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:11.425213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-843101bd-e8f5-42a4-8283-35f745d8c171 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:11.425642 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-843101bd-e8f5-42a4-8283-35f745d8c171 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:11.454100 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-843101bd-e8f5-42a4-8283-35f745d8c171 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044249 Aug 24 12:44:11.454668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 940/1880] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:11 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:11.659771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-497bf24f-f15e-49b3-b630-52b14045523b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:11.661926 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-497bf24f-f15e-49b3-b630-52b14045523b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:11.668428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-497bf24f-f15e-49b3-b630-52b14045523b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:11.668866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-497bf24f-f15e-49b3-b630-52b14045523b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:11.669305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-497bf24f-f15e-49b3-b630-52b14045523b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:11.669993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-497bf24f-f15e-49b3-b630-52b14045523b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:11.670442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-497bf24f-f15e-49b3-b630-52b14045523b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:11.670890 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-497bf24f-f15e-49b3-b630-52b14045523b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:11.698946 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-497bf24f-f15e-49b3-b630-52b14045523b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043111 Aug 24 12:44:11.699480 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 941/1881] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:11 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:44:12.466360 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-86578f8d-626a-4c7e-ad77-821d7410ad87 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:12.468550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-86578f8d-626a-4c7e-ad77-821d7410ad87 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:12.474904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86578f8d-626a-4c7e-ad77-821d7410ad87 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:12.475389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86578f8d-626a-4c7e-ad77-821d7410ad87 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:12.475825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86578f8d-626a-4c7e-ad77-821d7410ad87 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:12.476512 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86578f8d-626a-4c7e-ad77-821d7410ad87 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:12.476966 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86578f8d-626a-4c7e-ad77-821d7410ad87 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:12.477390 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86578f8d-626a-4c7e-ad77-821d7410ad87 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:12.506817 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-86578f8d-626a-4c7e-ad77-821d7410ad87 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044357 Aug 24 12:44:12.507349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 941/1882] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:12 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:12.711245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-04e8388f-ca79-4fbe-9ef7-0c26b45a14bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:44:12.717518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-04e8388f-ca79-4fbe-9ef7-0c26b45a14bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:12.719775 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04e8388f-ca79-4fbe-9ef7-0c26b45a14bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:12.720261 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04e8388f-ca79-4fbe-9ef7-0c26b45a14bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:12.720698 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04e8388f-ca79-4fbe-9ef7-0c26b45a14bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:12.721386 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04e8388f-ca79-4fbe-9ef7-0c26b45a14bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:12.721838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04e8388f-ca79-4fbe-9ef7-0c26b45a14bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:12.722264 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04e8388f-ca79-4fbe-9ef7-0c26b45a14bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:12.828865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-04e8388f-ca79-4fbe-9ef7-0c26b45a14bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "POST /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/action" status: 200 len: 76183 microversion: 2.1 time: 0.121272 Aug 24 12:44:12.829706 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 942/1883] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 12:44:12 2022] POST /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10/action => generated 76183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:44:13.519773 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-90ab86e1-43a8-4f4f-8476-21c21c0481dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:13.521925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-90ab86e1-43a8-4f4f-8476-21c21c0481dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:13.529547 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-90ab86e1-43a8-4f4f-8476-21c21c0481dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:13.530078 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-90ab86e1-43a8-4f4f-8476-21c21c0481dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:13.530609 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-90ab86e1-43a8-4f4f-8476-21c21c0481dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:13.531501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-90ab86e1-43a8-4f4f-8476-21c21c0481dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:13.531974 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-90ab86e1-43a8-4f4f-8476-21c21c0481dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:13.532399 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-90ab86e1-43a8-4f4f-8476-21c21c0481dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:13.563778 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-90ab86e1-43a8-4f4f-8476-21c21c0481dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047959 Aug 24 12:44:13.564337 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 942/1884] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:13 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:14.577480 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b8c0da15-50e2-4502-9c0e-666a82833cb8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:14.579753 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b8c0da15-50e2-4502-9c0e-666a82833cb8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:14.586886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8c0da15-50e2-4502-9c0e-666a82833cb8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:14.587367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8c0da15-50e2-4502-9c0e-666a82833cb8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:14.587799 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8c0da15-50e2-4502-9c0e-666a82833cb8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:14.588490 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8c0da15-50e2-4502-9c0e-666a82833cb8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:14.589009 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8c0da15-50e2-4502-9c0e-666a82833cb8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:14.589433 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8c0da15-50e2-4502-9c0e-666a82833cb8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:14.618903 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b8c0da15-50e2-4502-9c0e-666a82833cb8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046520 Aug 24 12:44:14.619442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 943/1885] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:14 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:15.631625 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7c99cbbf-423a-4e3d-b1a2-9f18f9079ce1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:15.633693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7c99cbbf-423a-4e3d-b1a2-9f18f9079ce1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:15.640621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7c99cbbf-423a-4e3d-b1a2-9f18f9079ce1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:15.641103 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7c99cbbf-423a-4e3d-b1a2-9f18f9079ce1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:15.641537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7c99cbbf-423a-4e3d-b1a2-9f18f9079ce1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:15.642228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7c99cbbf-423a-4e3d-b1a2-9f18f9079ce1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:15.642703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7c99cbbf-423a-4e3d-b1a2-9f18f9079ce1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:15.643149 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7c99cbbf-423a-4e3d-b1a2-9f18f9079ce1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:15.671673 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7c99cbbf-423a-4e3d-b1a2-9f18f9079ce1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044066 Aug 24 12:44:15.672208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 943/1886] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:15 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:16.685744 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c7a6688a-611d-4e89-96fe-32ab4ecf4326 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:16.687816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c7a6688a-611d-4e89-96fe-32ab4ecf4326 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:16.694110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7a6688a-611d-4e89-96fe-32ab4ecf4326 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:16.694583 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7a6688a-611d-4e89-96fe-32ab4ecf4326 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:16.695041 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7a6688a-611d-4e89-96fe-32ab4ecf4326 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:16.695739 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7a6688a-611d-4e89-96fe-32ab4ecf4326 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:16.696181 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7a6688a-611d-4e89-96fe-32ab4ecf4326 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:16.696905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7a6688a-611d-4e89-96fe-32ab4ecf4326 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:16.725368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c7a6688a-611d-4e89-96fe-32ab4ecf4326 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043761 Aug 24 12:44:16.725898 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 944/1887] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:16 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:17.737927 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3cbb2fc1-5fb3-4b3f-aa0b-62d6660117e2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:17.740354 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3cbb2fc1-5fb3-4b3f-aa0b-62d6660117e2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:17.746732 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3cbb2fc1-5fb3-4b3f-aa0b-62d6660117e2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:17.747779 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3cbb2fc1-5fb3-4b3f-aa0b-62d6660117e2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:17.748223 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3cbb2fc1-5fb3-4b3f-aa0b-62d6660117e2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:17.748917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3cbb2fc1-5fb3-4b3f-aa0b-62d6660117e2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:17.749380 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3cbb2fc1-5fb3-4b3f-aa0b-62d6660117e2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:17.749809 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3cbb2fc1-5fb3-4b3f-aa0b-62d6660117e2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:17.777845 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3cbb2fc1-5fb3-4b3f-aa0b-62d6660117e2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043861 Aug 24 12:44:17.778414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 944/1888] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:17 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:18.790007 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c5e37d5f-e684-4b4a-88f3-aa9f197dc73e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:18.792201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c5e37d5f-e684-4b4a-88f3-aa9f197dc73e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:18.798898 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5e37d5f-e684-4b4a-88f3-aa9f197dc73e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:18.799379 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5e37d5f-e684-4b4a-88f3-aa9f197dc73e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:18.799815 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5e37d5f-e684-4b4a-88f3-aa9f197dc73e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:18.800500 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5e37d5f-e684-4b4a-88f3-aa9f197dc73e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:18.800952 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5e37d5f-e684-4b4a-88f3-aa9f197dc73e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:18.801386 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5e37d5f-e684-4b4a-88f3-aa9f197dc73e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:18.832007 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c5e37d5f-e684-4b4a-88f3-aa9f197dc73e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045949 Aug 24 12:44:18.832570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 945/1889] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:18 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:19.844775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c02f4329-3c84-4d6c-98e6-349c9394517a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:19.846924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c02f4329-3c84-4d6c-98e6-349c9394517a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:19.853226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c02f4329-3c84-4d6c-98e6-349c9394517a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:19.853706 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c02f4329-3c84-4d6c-98e6-349c9394517a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:19.854140 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c02f4329-3c84-4d6c-98e6-349c9394517a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:19.854850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c02f4329-3c84-4d6c-98e6-349c9394517a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:19.855302 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c02f4329-3c84-4d6c-98e6-349c9394517a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:19.855723 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c02f4329-3c84-4d6c-98e6-349c9394517a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:19.885039 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c02f4329-3c84-4d6c-98e6-349c9394517a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044762 Aug 24 12:44:19.885574 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 945/1890] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:19 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:20.897782 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-546b4722-7a81-4ad6-8d35-ba8ad949cda5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:20.899860 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-546b4722-7a81-4ad6-8d35-ba8ad949cda5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:20.906158 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-546b4722-7a81-4ad6-8d35-ba8ad949cda5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:20.906632 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-546b4722-7a81-4ad6-8d35-ba8ad949cda5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:20.907098 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-546b4722-7a81-4ad6-8d35-ba8ad949cda5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:20.907777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-546b4722-7a81-4ad6-8d35-ba8ad949cda5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:20.908226 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-546b4722-7a81-4ad6-8d35-ba8ad949cda5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:20.908648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-546b4722-7a81-4ad6-8d35-ba8ad949cda5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:20.939068 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-546b4722-7a81-4ad6-8d35-ba8ad949cda5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045284 Aug 24 12:44:20.939611 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 946/1891] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:20 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:21.951912 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e9f3b37e-65fa-4345-9646-3ef244e64e85 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:21.954035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e9f3b37e-65fa-4345-9646-3ef244e64e85 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:21.960537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9f3b37e-65fa-4345-9646-3ef244e64e85 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:21.961249 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9f3b37e-65fa-4345-9646-3ef244e64e85 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:21.961690 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9f3b37e-65fa-4345-9646-3ef244e64e85 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:21.962375 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9f3b37e-65fa-4345-9646-3ef244e64e85 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:21.962856 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9f3b37e-65fa-4345-9646-3ef244e64e85 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:21.963281 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9f3b37e-65fa-4345-9646-3ef244e64e85 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:21.992006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e9f3b37e-65fa-4345-9646-3ef244e64e85 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044708 Aug 24 12:44:21.992550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 946/1892] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:21 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:23.003959 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-14a2282a-3a20-4624-b8e3-6ade8f3da9d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:23.006015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-14a2282a-3a20-4624-b8e3-6ade8f3da9d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:23.012367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14a2282a-3a20-4624-b8e3-6ade8f3da9d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:23.012839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14a2282a-3a20-4624-b8e3-6ade8f3da9d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:23.013267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14a2282a-3a20-4624-b8e3-6ade8f3da9d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:23.013994 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14a2282a-3a20-4624-b8e3-6ade8f3da9d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:23.014438 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14a2282a-3a20-4624-b8e3-6ade8f3da9d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:23.014882 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14a2282a-3a20-4624-b8e3-6ade8f3da9d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:23.042553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-14a2282a-3a20-4624-b8e3-6ade8f3da9d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042637 Aug 24 12:44:23.043138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 947/1893] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:22 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:24.055508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3a637ec7-654d-4875-9c94-d3b29133600d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:24.057673 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3a637ec7-654d-4875-9c94-d3b29133600d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:24.064190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a637ec7-654d-4875-9c94-d3b29133600d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:24.070061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a637ec7-654d-4875-9c94-d3b29133600d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:24.070061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a637ec7-654d-4875-9c94-d3b29133600d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:24.070061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a637ec7-654d-4875-9c94-d3b29133600d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:24.070061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a637ec7-654d-4875-9c94-d3b29133600d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:24.070462 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a637ec7-654d-4875-9c94-d3b29133600d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:24.095414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3a637ec7-654d-4875-9c94-d3b29133600d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044080 Aug 24 12:44:24.095971 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 947/1894] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:24 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:25.108120 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6143e9f1-fe35-4207-a16b-386138b953cd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:25.110178 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6143e9f1-fe35-4207-a16b-386138b953cd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:25.116739 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6143e9f1-fe35-4207-a16b-386138b953cd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:25.117207 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6143e9f1-fe35-4207-a16b-386138b953cd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:25.117634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6143e9f1-fe35-4207-a16b-386138b953cd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:25.118309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6143e9f1-fe35-4207-a16b-386138b953cd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:25.118780 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6143e9f1-fe35-4207-a16b-386138b953cd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:25.119202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6143e9f1-fe35-4207-a16b-386138b953cd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:25.148526 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6143e9f1-fe35-4207-a16b-386138b953cd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044941 Aug 24 12:44:25.149073 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 948/1895] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:25 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:26.161410 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ba0f4d12-c4f6-4ec2-93ca-51da02ab9f1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:26.163506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ba0f4d12-c4f6-4ec2-93ca-51da02ab9f1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:26.169875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba0f4d12-c4f6-4ec2-93ca-51da02ab9f1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:26.170351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba0f4d12-c4f6-4ec2-93ca-51da02ab9f1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:26.170814 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba0f4d12-c4f6-4ec2-93ca-51da02ab9f1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:26.171495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba0f4d12-c4f6-4ec2-93ca-51da02ab9f1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:26.171946 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba0f4d12-c4f6-4ec2-93ca-51da02ab9f1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:26.172365 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba0f4d12-c4f6-4ec2-93ca-51da02ab9f1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:26.200083 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ba0f4d12-c4f6-4ec2-93ca-51da02ab9f1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042748 Aug 24 12:44:26.200618 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 948/1896] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:26 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:27.212770 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-059a7277-b734-4ab9-a642-97c8704910e7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:27.214974 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-059a7277-b734-4ab9-a642-97c8704910e7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:27.221813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-059a7277-b734-4ab9-a642-97c8704910e7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:27.222228 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-059a7277-b734-4ab9-a642-97c8704910e7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:27.222677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-059a7277-b734-4ab9-a642-97c8704910e7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:27.223363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-059a7277-b734-4ab9-a642-97c8704910e7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:27.223814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-059a7277-b734-4ab9-a642-97c8704910e7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:27.224235 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-059a7277-b734-4ab9-a642-97c8704910e7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:27.253100 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-059a7277-b734-4ab9-a642-97c8704910e7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044291 Aug 24 12:44:27.253637 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 949/1897] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:27 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:28.265572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-338ddcfd-45ab-46c9-8684-00f136f393b5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:28.267716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-338ddcfd-45ab-46c9-8684-00f136f393b5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:28.269999 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=44 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:44:28.274556 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-338ddcfd-45ab-46c9-8684-00f136f393b5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:28.275110 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-338ddcfd-45ab-46c9-8684-00f136f393b5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:28.275556 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-338ddcfd-45ab-46c9-8684-00f136f393b5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:28.276228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-338ddcfd-45ab-46c9-8684-00f136f393b5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:28.276673 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-338ddcfd-45ab-46c9-8684-00f136f393b5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:28.277090 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-338ddcfd-45ab-46c9-8684-00f136f393b5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:28.308155 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-338ddcfd-45ab-46c9-8684-00f136f393b5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046615 Aug 24 12:44:28.308703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 949/1898] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:28 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:29.320909 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-522cd37a-1072-4f19-a2b2-967ef9db87f5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:29.323067 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-522cd37a-1072-4f19-a2b2-967ef9db87f5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:29.325543 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=44 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:44:29.330814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-522cd37a-1072-4f19-a2b2-967ef9db87f5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:29.331246 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-522cd37a-1072-4f19-a2b2-967ef9db87f5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:29.331676 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-522cd37a-1072-4f19-a2b2-967ef9db87f5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:29.332358 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-522cd37a-1072-4f19-a2b2-967ef9db87f5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:29.332808 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-522cd37a-1072-4f19-a2b2-967ef9db87f5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:29.333227 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-522cd37a-1072-4f19-a2b2-967ef9db87f5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:29.362135 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-522cd37a-1072-4f19-a2b2-967ef9db87f5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045227 Aug 24 12:44:29.362700 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 950/1899] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:29 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:30.374715 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-66cbc21c-a5f9-4803-8383-297ed1707e3e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:30.376848 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-66cbc21c-a5f9-4803-8383-297ed1707e3e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:30.383461 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-66cbc21c-a5f9-4803-8383-297ed1707e3e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:30.383938 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-66cbc21c-a5f9-4803-8383-297ed1707e3e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:30.384408 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-66cbc21c-a5f9-4803-8383-297ed1707e3e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:30.385143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-66cbc21c-a5f9-4803-8383-297ed1707e3e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:30.385540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-66cbc21c-a5f9-4803-8383-297ed1707e3e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:30.385960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-66cbc21c-a5f9-4803-8383-297ed1707e3e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:30.399367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:44:30.415028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-66cbc21c-a5f9-4803-8383-297ed1707e3e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044299 Aug 24 12:44:30.415583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 950/1900] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:30 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:31.426939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-745f8cc6-518b-4a9e-b187-d8dc4fcf1312 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:31.429027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-745f8cc6-518b-4a9e-b187-d8dc4fcf1312 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:31.435558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-745f8cc6-518b-4a9e-b187-d8dc4fcf1312 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:31.436038 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-745f8cc6-518b-4a9e-b187-d8dc4fcf1312 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:31.437169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-745f8cc6-518b-4a9e-b187-d8dc4fcf1312 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:31.437953 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-745f8cc6-518b-4a9e-b187-d8dc4fcf1312 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:31.438405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-745f8cc6-518b-4a9e-b187-d8dc4fcf1312 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:31.438857 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-745f8cc6-518b-4a9e-b187-d8dc4fcf1312 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:31.462387 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:44:31.466892 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-745f8cc6-518b-4a9e-b187-d8dc4fcf1312 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044071 Aug 24 12:44:31.467433 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 951/1901] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:31 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:32.487308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-354a1195-6a71-4e91-9ac9-2bb2f6eeb27a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:32.489897 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-354a1195-6a71-4e91-9ac9-2bb2f6eeb27a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:32.496819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-354a1195-6a71-4e91-9ac9-2bb2f6eeb27a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:32.497300 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-354a1195-6a71-4e91-9ac9-2bb2f6eeb27a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:32.497729 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-354a1195-6a71-4e91-9ac9-2bb2f6eeb27a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:32.498414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-354a1195-6a71-4e91-9ac9-2bb2f6eeb27a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:32.498892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-354a1195-6a71-4e91-9ac9-2bb2f6eeb27a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:32.499344 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-354a1195-6a71-4e91-9ac9-2bb2f6eeb27a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:32.529325 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-354a1195-6a71-4e91-9ac9-2bb2f6eeb27a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046021 Aug 24 12:44:32.529787 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 951/1902] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:32 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:33.541462 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b071cac0-92e5-4ed3-b2b2-9d08060345a2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:33.543628 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b071cac0-92e5-4ed3-b2b2-9d08060345a2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:33.550822 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b071cac0-92e5-4ed3-b2b2-9d08060345a2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:33.551298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b071cac0-92e5-4ed3-b2b2-9d08060345a2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:33.551726 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b071cac0-92e5-4ed3-b2b2-9d08060345a2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:33.552395 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b071cac0-92e5-4ed3-b2b2-9d08060345a2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:33.552840 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b071cac0-92e5-4ed3-b2b2-9d08060345a2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:33.553257 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b071cac0-92e5-4ed3-b2b2-9d08060345a2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:33.582036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b071cac0-92e5-4ed3-b2b2-9d08060345a2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044412 Aug 24 12:44:33.582504 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 952/1903] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:33 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:34.594877 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b4e9bef0-1897-4f78-b158-688191d78201 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:34.596999 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b4e9bef0-1897-4f78-b158-688191d78201 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:34.603530 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4e9bef0-1897-4f78-b158-688191d78201 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:34.604020 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4e9bef0-1897-4f78-b158-688191d78201 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:34.604458 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4e9bef0-1897-4f78-b158-688191d78201 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:34.605151 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4e9bef0-1897-4f78-b158-688191d78201 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:34.605605 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4e9bef0-1897-4f78-b158-688191d78201 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:34.606031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4e9bef0-1897-4f78-b158-688191d78201 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:34.635566 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b4e9bef0-1897-4f78-b158-688191d78201 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045203 Aug 24 12:44:34.636058 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 952/1904] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:34 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:35.647877 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-24713324-8538-4c1c-ac3c-02da1c94808a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:35.650036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-24713324-8538-4c1c-ac3c-02da1c94808a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:35.656454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-24713324-8538-4c1c-ac3c-02da1c94808a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:35.656929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-24713324-8538-4c1c-ac3c-02da1c94808a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:35.657363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-24713324-8538-4c1c-ac3c-02da1c94808a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:35.658069 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-24713324-8538-4c1c-ac3c-02da1c94808a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:35.658518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-24713324-8538-4c1c-ac3c-02da1c94808a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:35.658972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-24713324-8538-4c1c-ac3c-02da1c94808a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:35.688341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-24713324-8538-4c1c-ac3c-02da1c94808a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044476 Aug 24 12:44:35.688811 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 953/1905] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:35 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:36.700379 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3bff369d-c473-4c35-83bf-472cbc9b855f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:36.702443 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3bff369d-c473-4c35-83bf-472cbc9b855f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:36.709104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3bff369d-c473-4c35-83bf-472cbc9b855f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:36.709584 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3bff369d-c473-4c35-83bf-472cbc9b855f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:36.710023 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3bff369d-c473-4c35-83bf-472cbc9b855f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:36.710731 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3bff369d-c473-4c35-83bf-472cbc9b855f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:36.711187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3bff369d-c473-4c35-83bf-472cbc9b855f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:36.711613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3bff369d-c473-4c35-83bf-472cbc9b855f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:36.739929 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3bff369d-c473-4c35-83bf-472cbc9b855f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043622 Aug 24 12:44:36.740463 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 953/1906] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:36 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:37.752557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-336956b2-89dd-4510-9709-d199f23fc0bb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:37.754757 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-336956b2-89dd-4510-9709-d199f23fc0bb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:37.761182 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-336956b2-89dd-4510-9709-d199f23fc0bb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:37.761667 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-336956b2-89dd-4510-9709-d199f23fc0bb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:37.762105 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-336956b2-89dd-4510-9709-d199f23fc0bb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:37.762837 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-336956b2-89dd-4510-9709-d199f23fc0bb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:37.763291 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-336956b2-89dd-4510-9709-d199f23fc0bb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:37.763716 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-336956b2-89dd-4510-9709-d199f23fc0bb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:37.792305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-336956b2-89dd-4510-9709-d199f23fc0bb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044276 Aug 24 12:44:37.792849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 954/1907] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:37 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:38.815062 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-88b42f01-38e7-4389-a516-d20f99390c13 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:38.817186 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-88b42f01-38e7-4389-a516-d20f99390c13 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:38.823522 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-88b42f01-38e7-4389-a516-d20f99390c13 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:38.824002 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-88b42f01-38e7-4389-a516-d20f99390c13 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:38.824435 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-88b42f01-38e7-4389-a516-d20f99390c13 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:38.825120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-88b42f01-38e7-4389-a516-d20f99390c13 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:38.825573 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-88b42f01-38e7-4389-a516-d20f99390c13 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:38.825996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-88b42f01-38e7-4389-a516-d20f99390c13 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:38.855280 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-88b42f01-38e7-4389-a516-d20f99390c13 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044266 Aug 24 12:44:38.855815 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 954/1908] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:38 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:39.867526 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-76a9c38d-0748-43de-baed-0d207ed3b36e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:39.869672 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-76a9c38d-0748-43de-baed-0d207ed3b36e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:39.876048 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76a9c38d-0748-43de-baed-0d207ed3b36e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:39.876525 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76a9c38d-0748-43de-baed-0d207ed3b36e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:39.876954 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76a9c38d-0748-43de-baed-0d207ed3b36e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:39.877627 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76a9c38d-0748-43de-baed-0d207ed3b36e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:39.878070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76a9c38d-0748-43de-baed-0d207ed3b36e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:39.878487 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76a9c38d-0748-43de-baed-0d207ed3b36e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:39.906075 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-76a9c38d-0748-43de-baed-0d207ed3b36e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042731 Aug 24 12:44:39.907080 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 955/1909] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:39 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:40.918523 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-81bd5ec9-ed16-465d-aae7-caedca105065 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:40.920748 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-81bd5ec9-ed16-465d-aae7-caedca105065 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:40.927579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81bd5ec9-ed16-465d-aae7-caedca105065 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:40.928063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81bd5ec9-ed16-465d-aae7-caedca105065 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:40.928497 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81bd5ec9-ed16-465d-aae7-caedca105065 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:40.929180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81bd5ec9-ed16-465d-aae7-caedca105065 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:40.929638 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81bd5ec9-ed16-465d-aae7-caedca105065 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:40.930062 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81bd5ec9-ed16-465d-aae7-caedca105065 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:40.958470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-81bd5ec9-ed16-465d-aae7-caedca105065 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043863 Aug 24 12:44:40.959038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 955/1910] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:40 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:41.971078 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5c199664-dd09-48f7-8bbe-79431ac533e4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:41.973225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5c199664-dd09-48f7-8bbe-79431ac533e4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:41.979536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c199664-dd09-48f7-8bbe-79431ac533e4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:41.980007 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c199664-dd09-48f7-8bbe-79431ac533e4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:41.980437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c199664-dd09-48f7-8bbe-79431ac533e4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:41.981108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c199664-dd09-48f7-8bbe-79431ac533e4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:41.981550 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c199664-dd09-48f7-8bbe-79431ac533e4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:41.981964 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c199664-dd09-48f7-8bbe-79431ac533e4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:42.010965 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5c199664-dd09-48f7-8bbe-79431ac533e4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044276 Aug 24 12:44:42.011499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 956/1911] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:41 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:43.023713 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c9ca2dba-ae11-4f11-a5bf-e8622767a65a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:43.025875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c9ca2dba-ae11-4f11-a5bf-e8622767a65a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:43.032324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9ca2dba-ae11-4f11-a5bf-e8622767a65a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:43.032814 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9ca2dba-ae11-4f11-a5bf-e8622767a65a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:43.033259 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9ca2dba-ae11-4f11-a5bf-e8622767a65a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:43.033957 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9ca2dba-ae11-4f11-a5bf-e8622767a65a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:43.034417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9ca2dba-ae11-4f11-a5bf-e8622767a65a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:43.034885 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9ca2dba-ae11-4f11-a5bf-e8622767a65a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:43.063186 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c9ca2dba-ae11-4f11-a5bf-e8622767a65a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043533 Aug 24 12:44:43.064376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 956/1912] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:43 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:44.075875 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-df4d621b-68e6-46c7-b6da-aaa714e082ce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:44.078019 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-df4d621b-68e6-46c7-b6da-aaa714e082ce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:44.084818 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-df4d621b-68e6-46c7-b6da-aaa714e082ce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:44.085284 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-df4d621b-68e6-46c7-b6da-aaa714e082ce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:44.085718 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-df4d621b-68e6-46c7-b6da-aaa714e082ce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:44.086400 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-df4d621b-68e6-46c7-b6da-aaa714e082ce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:44.086884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-df4d621b-68e6-46c7-b6da-aaa714e082ce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:44.087306 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-df4d621b-68e6-46c7-b6da-aaa714e082ce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:44.116063 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-df4d621b-68e6-46c7-b6da-aaa714e082ce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044117 Aug 24 12:44:44.116592 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 957/1913] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:44 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:45.128060 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-cf9fc633-9d43-4ceb-831a-9c5ae644eb0a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:45.130271 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-cf9fc633-9d43-4ceb-831a-9c5ae644eb0a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:45.136582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cf9fc633-9d43-4ceb-831a-9c5ae644eb0a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:45.137067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cf9fc633-9d43-4ceb-831a-9c5ae644eb0a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:45.137508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cf9fc633-9d43-4ceb-831a-9c5ae644eb0a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:45.138199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cf9fc633-9d43-4ceb-831a-9c5ae644eb0a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:45.138678 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cf9fc633-9d43-4ceb-831a-9c5ae644eb0a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:45.139099 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cf9fc633-9d43-4ceb-831a-9c5ae644eb0a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:45.167453 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-cf9fc633-9d43-4ceb-831a-9c5ae644eb0a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043423 Aug 24 12:44:45.167992 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 957/1914] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:45 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:46.179937 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-41e39983-c0c1-40a4-b8a4-7658b1fe54dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:46.182002 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-41e39983-c0c1-40a4-b8a4-7658b1fe54dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:46.187928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41e39983-c0c1-40a4-b8a4-7658b1fe54dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:46.188406 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41e39983-c0c1-40a4-b8a4-7658b1fe54dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:46.188837 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41e39983-c0c1-40a4-b8a4-7658b1fe54dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:46.189515 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41e39983-c0c1-40a4-b8a4-7658b1fe54dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:46.189964 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41e39983-c0c1-40a4-b8a4-7658b1fe54dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:46.190386 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41e39983-c0c1-40a4-b8a4-7658b1fe54dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:46.220151 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-41e39983-c0c1-40a4-b8a4-7658b1fe54dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043850 Aug 24 12:44:46.220688 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 958/1915] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:46 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:47.232433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-31b0ffa1-eb84-43ac-9799-fd9f0a7566f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:47.234569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-31b0ffa1-eb84-43ac-9799-fd9f0a7566f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:47.241685 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31b0ffa1-eb84-43ac-9799-fd9f0a7566f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:47.242161 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31b0ffa1-eb84-43ac-9799-fd9f0a7566f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:47.242592 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31b0ffa1-eb84-43ac-9799-fd9f0a7566f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:47.243292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31b0ffa1-eb84-43ac-9799-fd9f0a7566f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:47.243741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31b0ffa1-eb84-43ac-9799-fd9f0a7566f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:47.244159 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31b0ffa1-eb84-43ac-9799-fd9f0a7566f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:47.272727 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-31b0ffa1-eb84-43ac-9799-fd9f0a7566f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044299 Aug 24 12:44:47.273264 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 958/1916] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:47 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:48.284984 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5e233f88-d50a-43ad-aab8-94493111d2d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:48.287157 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5e233f88-d50a-43ad-aab8-94493111d2d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:48.293576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5e233f88-d50a-43ad-aab8-94493111d2d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:48.294056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5e233f88-d50a-43ad-aab8-94493111d2d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:48.294494 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5e233f88-d50a-43ad-aab8-94493111d2d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:48.295215 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5e233f88-d50a-43ad-aab8-94493111d2d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:48.295670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5e233f88-d50a-43ad-aab8-94493111d2d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:48.296098 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5e233f88-d50a-43ad-aab8-94493111d2d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:48.325507 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5e233f88-d50a-43ad-aab8-94493111d2d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044471 Aug 24 12:44:48.326053 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 959/1917] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:48 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:49.337515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a4cbef24-3340-46f7-a72c-1c668bfcb307 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:49.339663 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a4cbef24-3340-46f7-a72c-1c668bfcb307 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:49.346664 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a4cbef24-3340-46f7-a72c-1c668bfcb307 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:49.347155 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a4cbef24-3340-46f7-a72c-1c668bfcb307 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:49.347588 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a4cbef24-3340-46f7-a72c-1c668bfcb307 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:49.348273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a4cbef24-3340-46f7-a72c-1c668bfcb307 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:49.348724 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a4cbef24-3340-46f7-a72c-1c668bfcb307 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:49.349146 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a4cbef24-3340-46f7-a72c-1c668bfcb307 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:49.378927 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a4cbef24-3340-46f7-a72c-1c668bfcb307 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045313 Aug 24 12:44:49.379472 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 959/1918] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:49 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:50.391226 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8982632b-a2c1-41e9-9b60-225d8763f2fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:50.393417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8982632b-a2c1-41e9-9b60-225d8763f2fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:50.399929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8982632b-a2c1-41e9-9b60-225d8763f2fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:50.400405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8982632b-a2c1-41e9-9b60-225d8763f2fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:50.400841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8982632b-a2c1-41e9-9b60-225d8763f2fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:50.401521 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8982632b-a2c1-41e9-9b60-225d8763f2fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:50.401970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8982632b-a2c1-41e9-9b60-225d8763f2fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:50.402390 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8982632b-a2c1-41e9-9b60-225d8763f2fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:50.436705 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8982632b-a2c1-41e9-9b60-225d8763f2fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049325 Aug 24 12:44:50.437281 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 960/1919] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:50 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:51.449002 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bd795e8b-7fba-4e0d-bde4-b0a34459635e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:51.451169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bd795e8b-7fba-4e0d-bde4-b0a34459635e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:51.457499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd795e8b-7fba-4e0d-bde4-b0a34459635e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:51.457982 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd795e8b-7fba-4e0d-bde4-b0a34459635e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:51.458421 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd795e8b-7fba-4e0d-bde4-b0a34459635e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:51.459135 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd795e8b-7fba-4e0d-bde4-b0a34459635e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:51.459592 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd795e8b-7fba-4e0d-bde4-b0a34459635e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:51.460015 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd795e8b-7fba-4e0d-bde4-b0a34459635e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:51.488335 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bd795e8b-7fba-4e0d-bde4-b0a34459635e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043381 Aug 24 12:44:51.489119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 960/1920] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:51 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:52.501202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-51e14fc6-a4e0-4510-bed9-4dd02732ef3f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:52.503366 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-51e14fc6-a4e0-4510-bed9-4dd02732ef3f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:52.509645 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51e14fc6-a4e0-4510-bed9-4dd02732ef3f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:52.512637 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51e14fc6-a4e0-4510-bed9-4dd02732ef3f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:52.512637 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51e14fc6-a4e0-4510-bed9-4dd02732ef3f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:52.512637 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51e14fc6-a4e0-4510-bed9-4dd02732ef3f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:52.512637 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51e14fc6-a4e0-4510-bed9-4dd02732ef3f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:52.513001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51e14fc6-a4e0-4510-bed9-4dd02732ef3f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:52.541245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-51e14fc6-a4e0-4510-bed9-4dd02732ef3f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044034 Aug 24 12:44:52.541782 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 961/1921] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:52 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:53.553826 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-80642208-962a-4fc8-aff0-69c8ba8a555c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:53.556010 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-80642208-962a-4fc8-aff0-69c8ba8a555c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:53.562395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-80642208-962a-4fc8-aff0-69c8ba8a555c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:53.562913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-80642208-962a-4fc8-aff0-69c8ba8a555c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:53.563353 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-80642208-962a-4fc8-aff0-69c8ba8a555c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:53.564041 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-80642208-962a-4fc8-aff0-69c8ba8a555c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:53.564510 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-80642208-962a-4fc8-aff0-69c8ba8a555c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:53.565511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-80642208-962a-4fc8-aff0-69c8ba8a555c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:53.594626 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-80642208-962a-4fc8-aff0-69c8ba8a555c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045258 Aug 24 12:44:53.595194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 961/1922] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:53 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:54.607001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b8410db8-544f-42ae-a0fe-14ea443fdd61 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:54.609138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b8410db8-544f-42ae-a0fe-14ea443fdd61 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:54.615806 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8410db8-544f-42ae-a0fe-14ea443fdd61 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:54.616280 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8410db8-544f-42ae-a0fe-14ea443fdd61 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:54.616712 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8410db8-544f-42ae-a0fe-14ea443fdd61 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:54.617388 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8410db8-544f-42ae-a0fe-14ea443fdd61 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:54.617835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8410db8-544f-42ae-a0fe-14ea443fdd61 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:54.618255 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8410db8-544f-42ae-a0fe-14ea443fdd61 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:54.647796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b8410db8-544f-42ae-a0fe-14ea443fdd61 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044875 Aug 24 12:44:54.648330 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 962/1923] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:54 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:55.660386 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f363eaad-cdd4-4d96-ac6a-dc3e02b4384a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:55.662542 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f363eaad-cdd4-4d96-ac6a-dc3e02b4384a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:55.668905 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f363eaad-cdd4-4d96-ac6a-dc3e02b4384a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:55.669390 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f363eaad-cdd4-4d96-ac6a-dc3e02b4384a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:55.669825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f363eaad-cdd4-4d96-ac6a-dc3e02b4384a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:55.670524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f363eaad-cdd4-4d96-ac6a-dc3e02b4384a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:55.671015 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f363eaad-cdd4-4d96-ac6a-dc3e02b4384a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:55.671443 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f363eaad-cdd4-4d96-ac6a-dc3e02b4384a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:55.700120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f363eaad-cdd4-4d96-ac6a-dc3e02b4384a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044087 Aug 24 12:44:55.700761 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 962/1924] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:55 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:56.712487 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5d3b28bd-6a8a-4a70-9fe4-c511e9250d53 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:56.714572 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5d3b28bd-6a8a-4a70-9fe4-c511e9250d53 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:56.722195 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d3b28bd-6a8a-4a70-9fe4-c511e9250d53 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:56.722531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d3b28bd-6a8a-4a70-9fe4-c511e9250d53 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:56.722980 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d3b28bd-6a8a-4a70-9fe4-c511e9250d53 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:56.723662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d3b28bd-6a8a-4a70-9fe4-c511e9250d53 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:56.724102 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d3b28bd-6a8a-4a70-9fe4-c511e9250d53 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:56.724518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d3b28bd-6a8a-4a70-9fe4-c511e9250d53 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:56.752797 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5d3b28bd-6a8a-4a70-9fe4-c511e9250d53 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044230 Aug 24 12:44:56.753341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 963/1925] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:56 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:57.764877 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-be3d9b1c-29bf-4b84-b511-2d4990e74f0c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:57.767049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-be3d9b1c-29bf-4b84-b511-2d4990e74f0c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:57.773372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be3d9b1c-29bf-4b84-b511-2d4990e74f0c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:57.773854 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be3d9b1c-29bf-4b84-b511-2d4990e74f0c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:57.774290 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be3d9b1c-29bf-4b84-b511-2d4990e74f0c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:57.775009 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be3d9b1c-29bf-4b84-b511-2d4990e74f0c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:57.775465 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be3d9b1c-29bf-4b84-b511-2d4990e74f0c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:57.775890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be3d9b1c-29bf-4b84-b511-2d4990e74f0c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:57.804981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-be3d9b1c-29bf-4b84-b511-2d4990e74f0c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044118 Aug 24 12:44:57.805526 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 963/1926] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:57 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:58.817143 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c232737c-6b7c-49fd-b257-431a909a4f63 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:58.819300 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c232737c-6b7c-49fd-b257-431a909a4f63 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:58.825525 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c232737c-6b7c-49fd-b257-431a909a4f63 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:58.825999 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c232737c-6b7c-49fd-b257-431a909a4f63 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:58.826429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c232737c-6b7c-49fd-b257-431a909a4f63 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:58.827135 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c232737c-6b7c-49fd-b257-431a909a4f63 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:58.827576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c232737c-6b7c-49fd-b257-431a909a4f63 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:58.828025 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c232737c-6b7c-49fd-b257-431a909a4f63 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:58.857390 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c232737c-6b7c-49fd-b257-431a909a4f63 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044513 Aug 24 12:44:58.857798 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 964/1927] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:58 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:59.869835 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f9016052-edd6-4707-9132-e7123f3b9a99 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:44:59.871980 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f9016052-edd6-4707-9132-e7123f3b9a99 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:44:59.874282 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=30 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:44:59.878919 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9016052-edd6-4707-9132-e7123f3b9a99 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:59.879904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9016052-edd6-4707-9132-e7123f3b9a99 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:59.880340 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9016052-edd6-4707-9132-e7123f3b9a99 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:59.881030 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9016052-edd6-4707-9132-e7123f3b9a99 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:44:59.881487 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9016052-edd6-4707-9132-e7123f3b9a99 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:44:59.881915 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9016052-edd6-4707-9132-e7123f3b9a99 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:44:59.911698 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f9016052-edd6-4707-9132-e7123f3b9a99 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045821 Aug 24 12:44:59.912213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 964/1928] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:44:59 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:00.924304 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-78144767-fbd7-49b2-a030-295fe8586e3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:00.926471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-78144767-fbd7-49b2-a030-295fe8586e3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:00.932853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-78144767-fbd7-49b2-a030-295fe8586e3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:00.933328 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-78144767-fbd7-49b2-a030-295fe8586e3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:00.933760 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-78144767-fbd7-49b2-a030-295fe8586e3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:00.934439 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-78144767-fbd7-49b2-a030-295fe8586e3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:00.934910 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-78144767-fbd7-49b2-a030-295fe8586e3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:00.935327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-78144767-fbd7-49b2-a030-295fe8586e3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:00.963863 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-78144767-fbd7-49b2-a030-295fe8586e3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043423 Aug 24 12:45:00.964301 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 965/1929] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:00 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:01.976108 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-aad654e9-abad-474e-a544-bfefa87dc844 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:01.978260 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-aad654e9-abad-474e-a544-bfefa87dc844 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:01.984590 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aad654e9-abad-474e-a544-bfefa87dc844 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:01.985073 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aad654e9-abad-474e-a544-bfefa87dc844 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:01.985512 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aad654e9-abad-474e-a544-bfefa87dc844 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:01.986198 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aad654e9-abad-474e-a544-bfefa87dc844 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:01.986682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aad654e9-abad-474e-a544-bfefa87dc844 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:01.987100 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aad654e9-abad-474e-a544-bfefa87dc844 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:02.016565 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-aad654e9-abad-474e-a544-bfefa87dc844 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044510 Aug 24 12:45:02.017118 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 965/1930] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:01 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:03.028619 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a2cb777f-8cac-4abe-88f7-7bf12d98866c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:03.030781 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a2cb777f-8cac-4abe-88f7-7bf12d98866c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:03.033051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=32 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:45:03.038198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2cb777f-8cac-4abe-88f7-7bf12d98866c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:03.038621 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2cb777f-8cac-4abe-88f7-7bf12d98866c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:03.039078 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2cb777f-8cac-4abe-88f7-7bf12d98866c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:03.039752 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2cb777f-8cac-4abe-88f7-7bf12d98866c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:03.040199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2cb777f-8cac-4abe-88f7-7bf12d98866c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:03.040659 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2cb777f-8cac-4abe-88f7-7bf12d98866c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:03.070097 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a2cb777f-8cac-4abe-88f7-7bf12d98866c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045404 Aug 24 12:45:03.070642 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 966/1931] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:03 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:04.082487 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b42267ea-8ea4-47c0-8009-40c25a5e7328 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:04.084634 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b42267ea-8ea4-47c0-8009-40c25a5e7328 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:04.091035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b42267ea-8ea4-47c0-8009-40c25a5e7328 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:04.091515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b42267ea-8ea4-47c0-8009-40c25a5e7328 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:04.091950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b42267ea-8ea4-47c0-8009-40c25a5e7328 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:04.092630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b42267ea-8ea4-47c0-8009-40c25a5e7328 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:04.093084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b42267ea-8ea4-47c0-8009-40c25a5e7328 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:04.093504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b42267ea-8ea4-47c0-8009-40c25a5e7328 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:04.095803 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=94 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:45:04.123700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b42267ea-8ea4-47c0-8009-40c25a5e7328 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045183 Aug 24 12:45:04.124241 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 966/1932] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:04 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:05.136054 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1ecb1014-7cc6-4804-8fa9-4ca1f9459574 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:05.138180 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1ecb1014-7cc6-4804-8fa9-4ca1f9459574 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:05.144443 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1ecb1014-7cc6-4804-8fa9-4ca1f9459574 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:05.144920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1ecb1014-7cc6-4804-8fa9-4ca1f9459574 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:05.145365 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1ecb1014-7cc6-4804-8fa9-4ca1f9459574 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:05.146041 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1ecb1014-7cc6-4804-8fa9-4ca1f9459574 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:05.146480 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1ecb1014-7cc6-4804-8fa9-4ca1f9459574 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:05.146922 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1ecb1014-7cc6-4804-8fa9-4ca1f9459574 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:05.149215 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=91 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:45:05.178594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1ecb1014-7cc6-4804-8fa9-4ca1f9459574 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046670 Aug 24 12:45:05.179182 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 967/1933] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:05 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:06.191193 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-57019ea0-3cf1-48ee-864d-969e741df14c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:06.193905 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-57019ea0-3cf1-48ee-864d-969e741df14c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:06.200658 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57019ea0-3cf1-48ee-864d-969e741df14c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:06.201149 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57019ea0-3cf1-48ee-864d-969e741df14c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:06.201588 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57019ea0-3cf1-48ee-864d-969e741df14c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:06.202279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57019ea0-3cf1-48ee-864d-969e741df14c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:06.202763 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57019ea0-3cf1-48ee-864d-969e741df14c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:06.203194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57019ea0-3cf1-48ee-864d-969e741df14c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:06.231233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-57019ea0-3cf1-48ee-864d-969e741df14c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044198 Aug 24 12:45:06.231780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 967/1934] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:06 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:07.244485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c161d834-c038-4990-9ab4-79c215afa90a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:07.246671 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c161d834-c038-4990-9ab4-79c215afa90a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:07.252934 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c161d834-c038-4990-9ab4-79c215afa90a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:07.253413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c161d834-c038-4990-9ab4-79c215afa90a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:07.253848 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c161d834-c038-4990-9ab4-79c215afa90a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:07.255217 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c161d834-c038-4990-9ab4-79c215afa90a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:07.255674 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c161d834-c038-4990-9ab4-79c215afa90a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:07.256108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c161d834-c038-4990-9ab4-79c215afa90a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:07.284073 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c161d834-c038-4990-9ab4-79c215afa90a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043818 Aug 24 12:45:07.284611 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 968/1935] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:07 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:08.296935 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-db8256ff-c2b6-47ee-92fc-d78cea9c4d0c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:08.299105 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-db8256ff-c2b6-47ee-92fc-d78cea9c4d0c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:08.305245 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db8256ff-c2b6-47ee-92fc-d78cea9c4d0c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:08.305737 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db8256ff-c2b6-47ee-92fc-d78cea9c4d0c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:08.306180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db8256ff-c2b6-47ee-92fc-d78cea9c4d0c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:08.306908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db8256ff-c2b6-47ee-92fc-d78cea9c4d0c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:08.307373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db8256ff-c2b6-47ee-92fc-d78cea9c4d0c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:08.307805 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db8256ff-c2b6-47ee-92fc-d78cea9c4d0c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:08.337924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-db8256ff-c2b6-47ee-92fc-d78cea9c4d0c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044897 Aug 24 12:45:08.338482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 968/1936] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:08 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:09.349683 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-810672b9-7b7f-4ecb-8948-092b2ebd90c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:09.351828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-810672b9-7b7f-4ecb-8948-092b2ebd90c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:09.358039 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-810672b9-7b7f-4ecb-8948-092b2ebd90c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:09.358510 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-810672b9-7b7f-4ecb-8948-092b2ebd90c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:09.359804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-810672b9-7b7f-4ecb-8948-092b2ebd90c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:09.359804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-810672b9-7b7f-4ecb-8948-092b2ebd90c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:09.360137 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-810672b9-7b7f-4ecb-8948-092b2ebd90c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:09.360539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-810672b9-7b7f-4ecb-8948-092b2ebd90c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:09.391132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-810672b9-7b7f-4ecb-8948-092b2ebd90c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045570 Aug 24 12:45:09.391714 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 969/1937] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:09 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:10.403348 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e6e13c89-35af-4df6-8bd4-fcd444203ea9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:10.405489 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e6e13c89-35af-4df6-8bd4-fcd444203ea9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:10.411906 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e6e13c89-35af-4df6-8bd4-fcd444203ea9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:10.412402 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e6e13c89-35af-4df6-8bd4-fcd444203ea9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:10.412843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e6e13c89-35af-4df6-8bd4-fcd444203ea9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:10.413547 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e6e13c89-35af-4df6-8bd4-fcd444203ea9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:10.414008 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e6e13c89-35af-4df6-8bd4-fcd444203ea9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:10.414436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e6e13c89-35af-4df6-8bd4-fcd444203ea9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:10.443965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e6e13c89-35af-4df6-8bd4-fcd444203ea9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044520 Aug 24 12:45:10.444521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 969/1938] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:10 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:11.455741 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fce9cd17-86c5-488f-8fbe-9e0853ea0c00 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:11.457882 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fce9cd17-86c5-488f-8fbe-9e0853ea0c00 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:11.464325 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fce9cd17-86c5-488f-8fbe-9e0853ea0c00 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:11.464793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fce9cd17-86c5-488f-8fbe-9e0853ea0c00 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:11.465223 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fce9cd17-86c5-488f-8fbe-9e0853ea0c00 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:11.465898 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fce9cd17-86c5-488f-8fbe-9e0853ea0c00 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:11.466341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fce9cd17-86c5-488f-8fbe-9e0853ea0c00 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:11.466787 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fce9cd17-86c5-488f-8fbe-9e0853ea0c00 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:11.495519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fce9cd17-86c5-488f-8fbe-9e0853ea0c00 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043690 Aug 24 12:45:11.496051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 970/1939] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:11 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:12.508122 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b0e870b0-ad5e-4e6f-9e1f-e98154bd3b03 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:12.510245 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b0e870b0-ad5e-4e6f-9e1f-e98154bd3b03 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:12.516635 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0e870b0-ad5e-4e6f-9e1f-e98154bd3b03 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:12.517153 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0e870b0-ad5e-4e6f-9e1f-e98154bd3b03 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:12.517594 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0e870b0-ad5e-4e6f-9e1f-e98154bd3b03 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:12.518283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0e870b0-ad5e-4e6f-9e1f-e98154bd3b03 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:12.518762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0e870b0-ad5e-4e6f-9e1f-e98154bd3b03 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:12.519188 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0e870b0-ad5e-4e6f-9e1f-e98154bd3b03 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:12.547885 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b0e870b0-ad5e-4e6f-9e1f-e98154bd3b03 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044250 Aug 24 12:45:12.548409 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 970/1940] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:12 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:13.560031 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4bd9d07d-c9cc-48ae-8188-fb45e8a62052 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:13.562177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4bd9d07d-c9cc-48ae-8188-fb45e8a62052 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:13.568637 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4bd9d07d-c9cc-48ae-8188-fb45e8a62052 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:13.569105 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4bd9d07d-c9cc-48ae-8188-fb45e8a62052 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:13.569532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4bd9d07d-c9cc-48ae-8188-fb45e8a62052 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:13.570233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4bd9d07d-c9cc-48ae-8188-fb45e8a62052 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:13.570740 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4bd9d07d-c9cc-48ae-8188-fb45e8a62052 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:13.571161 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4bd9d07d-c9cc-48ae-8188-fb45e8a62052 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:13.599507 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4bd9d07d-c9cc-48ae-8188-fb45e8a62052 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043448 Aug 24 12:45:13.600034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 971/1941] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:13 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:14.612141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6676f4c8-1dca-43af-84ba-c7a7d0a6beba tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:14.615050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6676f4c8-1dca-43af-84ba-c7a7d0a6beba tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:14.625102 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6676f4c8-1dca-43af-84ba-c7a7d0a6beba tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:14.625771 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6676f4c8-1dca-43af-84ba-c7a7d0a6beba tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:14.626215 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6676f4c8-1dca-43af-84ba-c7a7d0a6beba tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:14.627059 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6676f4c8-1dca-43af-84ba-c7a7d0a6beba tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:14.627514 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6676f4c8-1dca-43af-84ba-c7a7d0a6beba tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:14.627941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6676f4c8-1dca-43af-84ba-c7a7d0a6beba tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:14.657209 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6676f4c8-1dca-43af-84ba-c7a7d0a6beba tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049080 Aug 24 12:45:14.657752 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 971/1942] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:14 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:15.669448 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9903ee49-d975-4a25-adc9-a9b37625acf2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:15.671590 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9903ee49-d975-4a25-adc9-a9b37625acf2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:15.677516 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9903ee49-d975-4a25-adc9-a9b37625acf2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:15.678035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9903ee49-d975-4a25-adc9-a9b37625acf2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:15.678420 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9903ee49-d975-4a25-adc9-a9b37625acf2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:15.679123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9903ee49-d975-4a25-adc9-a9b37625acf2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:15.679600 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9903ee49-d975-4a25-adc9-a9b37625acf2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:15.680021 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9903ee49-d975-4a25-adc9-a9b37625acf2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:15.708710 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9903ee49-d975-4a25-adc9-a9b37625acf2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042861 Aug 24 12:45:15.709237 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 972/1943] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:15 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:16.720992 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c92de5a2-597d-4c2e-bfda-728dd9e3398a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:16.723856 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c92de5a2-597d-4c2e-bfda-728dd9e3398a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:16.730219 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c92de5a2-597d-4c2e-bfda-728dd9e3398a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:16.730729 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c92de5a2-597d-4c2e-bfda-728dd9e3398a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:16.731176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c92de5a2-597d-4c2e-bfda-728dd9e3398a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:16.731873 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c92de5a2-597d-4c2e-bfda-728dd9e3398a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:16.732332 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c92de5a2-597d-4c2e-bfda-728dd9e3398a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:16.732760 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c92de5a2-597d-4c2e-bfda-728dd9e3398a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:16.762058 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c92de5a2-597d-4c2e-bfda-728dd9e3398a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045076 Aug 24 12:45:16.762601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 972/1944] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:16 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:17.773482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-86670865-1d25-4d0f-9235-7e8d5d77b404 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:17.775638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-86670865-1d25-4d0f-9235-7e8d5d77b404 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:17.781921 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86670865-1d25-4d0f-9235-7e8d5d77b404 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:17.782397 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86670865-1d25-4d0f-9235-7e8d5d77b404 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:17.782869 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86670865-1d25-4d0f-9235-7e8d5d77b404 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:17.783545 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86670865-1d25-4d0f-9235-7e8d5d77b404 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:17.783991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86670865-1d25-4d0f-9235-7e8d5d77b404 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:17.784407 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86670865-1d25-4d0f-9235-7e8d5d77b404 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:17.813255 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-86670865-1d25-4d0f-9235-7e8d5d77b404 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043747 Aug 24 12:45:17.813785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 973/1945] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:17 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:18.825052 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-44c37b8e-8c2f-49a6-8bfe-49553cda3544 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:18.827224 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-44c37b8e-8c2f-49a6-8bfe-49553cda3544 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:18.833575 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-44c37b8e-8c2f-49a6-8bfe-49553cda3544 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:18.834640 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-44c37b8e-8c2f-49a6-8bfe-49553cda3544 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:18.835270 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-44c37b8e-8c2f-49a6-8bfe-49553cda3544 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:18.835813 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-44c37b8e-8c2f-49a6-8bfe-49553cda3544 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:18.836388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-44c37b8e-8c2f-49a6-8bfe-49553cda3544 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:18.836699 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-44c37b8e-8c2f-49a6-8bfe-49553cda3544 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:18.866516 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-44c37b8e-8c2f-49a6-8bfe-49553cda3544 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045485 Aug 24 12:45:18.867098 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 973/1946] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:18 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:19.878638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3ce6cdc7-286f-4c7f-bbb8-02811553a29c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:19.880900 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3ce6cdc7-286f-4c7f-bbb8-02811553a29c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:19.887269 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ce6cdc7-286f-4c7f-bbb8-02811553a29c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:19.887819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ce6cdc7-286f-4c7f-bbb8-02811553a29c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:19.888252 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ce6cdc7-286f-4c7f-bbb8-02811553a29c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:19.888927 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ce6cdc7-286f-4c7f-bbb8-02811553a29c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:19.889372 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ce6cdc7-286f-4c7f-bbb8-02811553a29c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:19.889824 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ce6cdc7-286f-4c7f-bbb8-02811553a29c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:19.919023 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3ce6cdc7-286f-4c7f-bbb8-02811553a29c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044270 Aug 24 12:45:19.919553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 974/1947] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:19 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:20.931530 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8379b9a8-f2cc-44df-afcf-2bf7616f63e2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:20.933690 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8379b9a8-f2cc-44df-afcf-2bf7616f63e2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:20.940748 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8379b9a8-f2cc-44df-afcf-2bf7616f63e2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:20.941225 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8379b9a8-f2cc-44df-afcf-2bf7616f63e2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:20.941656 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8379b9a8-f2cc-44df-afcf-2bf7616f63e2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:20.942347 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8379b9a8-f2cc-44df-afcf-2bf7616f63e2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:20.942827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8379b9a8-f2cc-44df-afcf-2bf7616f63e2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:20.943252 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8379b9a8-f2cc-44df-afcf-2bf7616f63e2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:20.973290 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8379b9a8-f2cc-44df-afcf-2bf7616f63e2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046076 Aug 24 12:45:20.973833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 974/1948] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:20 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:21.985285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-64fdf70f-16f2-4bc9-9ea8-bd24bc95e8fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:21.987467 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-64fdf70f-16f2-4bc9-9ea8-bd24bc95e8fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:21.994327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64fdf70f-16f2-4bc9-9ea8-bd24bc95e8fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:21.994848 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64fdf70f-16f2-4bc9-9ea8-bd24bc95e8fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:21.995288 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64fdf70f-16f2-4bc9-9ea8-bd24bc95e8fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:21.995973 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64fdf70f-16f2-4bc9-9ea8-bd24bc95e8fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:21.996421 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64fdf70f-16f2-4bc9-9ea8-bd24bc95e8fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:21.996878 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64fdf70f-16f2-4bc9-9ea8-bd24bc95e8fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:22.025327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-64fdf70f-16f2-4bc9-9ea8-bd24bc95e8fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044097 Aug 24 12:45:22.025855 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 975/1949] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:21 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:23.038370 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f00f0a05-d894-4859-a16b-94b13abdd047 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:23.040553 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f00f0a05-d894-4859-a16b-94b13abdd047 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:23.047027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f00f0a05-d894-4859-a16b-94b13abdd047 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:23.047502 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f00f0a05-d894-4859-a16b-94b13abdd047 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:23.047934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f00f0a05-d894-4859-a16b-94b13abdd047 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:23.048726 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f00f0a05-d894-4859-a16b-94b13abdd047 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:23.049177 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f00f0a05-d894-4859-a16b-94b13abdd047 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:23.049604 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f00f0a05-d894-4859-a16b-94b13abdd047 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:23.078575 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f00f0a05-d894-4859-a16b-94b13abdd047 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045022 Aug 24 12:45:23.079146 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 975/1950] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:23 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:24.091404 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3ba4e94f-64fa-4b51-bbc0-60b13159596e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:24.093567 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3ba4e94f-64fa-4b51-bbc0-60b13159596e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:24.099895 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ba4e94f-64fa-4b51-bbc0-60b13159596e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:24.100376 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ba4e94f-64fa-4b51-bbc0-60b13159596e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:24.100839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ba4e94f-64fa-4b51-bbc0-60b13159596e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:24.101525 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ba4e94f-64fa-4b51-bbc0-60b13159596e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:24.101975 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ba4e94f-64fa-4b51-bbc0-60b13159596e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:24.102399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ba4e94f-64fa-4b51-bbc0-60b13159596e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:24.132408 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3ba4e94f-64fa-4b51-bbc0-60b13159596e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044393 Aug 24 12:45:24.132969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 976/1951] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:24 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:25.144676 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-eba92dd5-8f59-4949-a6bf-e633af1062f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:25.146812 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-eba92dd5-8f59-4949-a6bf-e633af1062f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:25.153716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eba92dd5-8f59-4949-a6bf-e633af1062f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:25.154191 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eba92dd5-8f59-4949-a6bf-e633af1062f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:25.154621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eba92dd5-8f59-4949-a6bf-e633af1062f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:25.155319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eba92dd5-8f59-4949-a6bf-e633af1062f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:25.155772 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eba92dd5-8f59-4949-a6bf-e633af1062f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:25.156191 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eba92dd5-8f59-4949-a6bf-e633af1062f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:25.184590 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-eba92dd5-8f59-4949-a6bf-e633af1062f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043880 Aug 24 12:45:25.185119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 976/1952] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:25 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:26.196841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5df469ea-6a51-4a34-826d-b86987146bbc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:26.198906 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5df469ea-6a51-4a34-826d-b86987146bbc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:26.205183 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5df469ea-6a51-4a34-826d-b86987146bbc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:26.205661 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5df469ea-6a51-4a34-826d-b86987146bbc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:26.206097 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5df469ea-6a51-4a34-826d-b86987146bbc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:26.206814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5df469ea-6a51-4a34-826d-b86987146bbc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:26.207268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5df469ea-6a51-4a34-826d-b86987146bbc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:26.207690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5df469ea-6a51-4a34-826d-b86987146bbc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:26.236013 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5df469ea-6a51-4a34-826d-b86987146bbc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043236 Aug 24 12:45:26.236554 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 977/1953] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:26 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:27.248397 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0ab5b8c8-65a9-4eef-ad0c-c7df33b6e557 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:27.250548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0ab5b8c8-65a9-4eef-ad0c-c7df33b6e557 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:27.256922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0ab5b8c8-65a9-4eef-ad0c-c7df33b6e557 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:27.257405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0ab5b8c8-65a9-4eef-ad0c-c7df33b6e557 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:27.257844 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0ab5b8c8-65a9-4eef-ad0c-c7df33b6e557 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:27.258552 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0ab5b8c8-65a9-4eef-ad0c-c7df33b6e557 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:27.259033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0ab5b8c8-65a9-4eef-ad0c-c7df33b6e557 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:27.259461 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0ab5b8c8-65a9-4eef-ad0c-c7df33b6e557 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:27.293894 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0ab5b8c8-65a9-4eef-ad0c-c7df33b6e557 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049368 Aug 24 12:45:27.294473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 977/1954] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:27 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:28.306587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-52821a5f-e3fa-4476-a151-22aac099bd6c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:28.308760 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-52821a5f-e3fa-4476-a151-22aac099bd6c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:28.315047 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-52821a5f-e3fa-4476-a151-22aac099bd6c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:28.315518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-52821a5f-e3fa-4476-a151-22aac099bd6c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:28.315945 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-52821a5f-e3fa-4476-a151-22aac099bd6c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:28.316617 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-52821a5f-e3fa-4476-a151-22aac099bd6c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:28.317058 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-52821a5f-e3fa-4476-a151-22aac099bd6c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:28.317476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-52821a5f-e3fa-4476-a151-22aac099bd6c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:28.345753 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-52821a5f-e3fa-4476-a151-22aac099bd6c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043644 Aug 24 12:45:28.346277 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 978/1955] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:28 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:29.357902 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-45b070ba-224d-4ee7-8e26-44234b6d3bf8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:29.360065 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-45b070ba-224d-4ee7-8e26-44234b6d3bf8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:29.366624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45b070ba-224d-4ee7-8e26-44234b6d3bf8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:29.367898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45b070ba-224d-4ee7-8e26-44234b6d3bf8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:29.367898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45b070ba-224d-4ee7-8e26-44234b6d3bf8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:29.368284 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45b070ba-224d-4ee7-8e26-44234b6d3bf8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:29.368741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45b070ba-224d-4ee7-8e26-44234b6d3bf8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:29.369171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45b070ba-224d-4ee7-8e26-44234b6d3bf8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:29.397951 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-45b070ba-224d-4ee7-8e26-44234b6d3bf8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044084 Aug 24 12:45:29.401056 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 978/1956] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:29 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:30.410238 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fd814ec1-67d8-4f0e-83c2-c8d95d05fb98 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:30.412430 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fd814ec1-67d8-4f0e-83c2-c8d95d05fb98 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:30.419414 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd814ec1-67d8-4f0e-83c2-c8d95d05fb98 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:30.419897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd814ec1-67d8-4f0e-83c2-c8d95d05fb98 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:30.420336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd814ec1-67d8-4f0e-83c2-c8d95d05fb98 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:30.421026 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd814ec1-67d8-4f0e-83c2-c8d95d05fb98 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:30.421484 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd814ec1-67d8-4f0e-83c2-c8d95d05fb98 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:30.421913 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd814ec1-67d8-4f0e-83c2-c8d95d05fb98 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:30.450966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fd814ec1-67d8-4f0e-83c2-c8d95d05fb98 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044674 Aug 24 12:45:30.451512 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 979/1957] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:30 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:31.463989 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-cf4d26c4-3df2-497e-9e0e-a93b130a83d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:31.466117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-cf4d26c4-3df2-497e-9e0e-a93b130a83d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:31.468404 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=30 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:45:31.473019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cf4d26c4-3df2-497e-9e0e-a93b130a83d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:31.473504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cf4d26c4-3df2-497e-9e0e-a93b130a83d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:31.473953 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cf4d26c4-3df2-497e-9e0e-a93b130a83d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:31.474696 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cf4d26c4-3df2-497e-9e0e-a93b130a83d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:31.475157 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cf4d26c4-3df2-497e-9e0e-a93b130a83d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:31.475584 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cf4d26c4-3df2-497e-9e0e-a93b130a83d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:31.504419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-cf4d26c4-3df2-497e-9e0e-a93b130a83d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045026 Aug 24 12:45:31.505064 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 979/1958] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:31 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:32.517272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8ccd0896-cee0-47cd-abe6-5e143891ffa2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:32.519494 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8ccd0896-cee0-47cd-abe6-5e143891ffa2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:32.526282 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ccd0896-cee0-47cd-abe6-5e143891ffa2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:32.526788 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ccd0896-cee0-47cd-abe6-5e143891ffa2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:32.527226 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ccd0896-cee0-47cd-abe6-5e143891ffa2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:32.527928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ccd0896-cee0-47cd-abe6-5e143891ffa2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:32.528375 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ccd0896-cee0-47cd-abe6-5e143891ffa2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:32.528794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8ccd0896-cee0-47cd-abe6-5e143891ffa2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:32.557387 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8ccd0896-cee0-47cd-abe6-5e143891ffa2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044135 Aug 24 12:45:32.557916 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 980/1959] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:32 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:33.569849 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dc39e2ba-cb05-4335-8e26-23a77a7520c5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:33.572501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dc39e2ba-cb05-4335-8e26-23a77a7520c5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:33.578864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc39e2ba-cb05-4335-8e26-23a77a7520c5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:33.579343 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc39e2ba-cb05-4335-8e26-23a77a7520c5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:33.579775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc39e2ba-cb05-4335-8e26-23a77a7520c5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:33.580456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc39e2ba-cb05-4335-8e26-23a77a7520c5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:33.580906 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc39e2ba-cb05-4335-8e26-23a77a7520c5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:33.581326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc39e2ba-cb05-4335-8e26-23a77a7520c5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:33.609756 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dc39e2ba-cb05-4335-8e26-23a77a7520c5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044254 Aug 24 12:45:33.610290 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 980/1960] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:33 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:34.623444 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-86cf7106-1985-4319-b0dc-e309c2909354 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:34.625668 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-86cf7106-1985-4319-b0dc-e309c2909354 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:34.632923 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86cf7106-1985-4319-b0dc-e309c2909354 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:34.635947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86cf7106-1985-4319-b0dc-e309c2909354 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:34.635947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86cf7106-1985-4319-b0dc-e309c2909354 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:34.635947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86cf7106-1985-4319-b0dc-e309c2909354 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:34.635947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86cf7106-1985-4319-b0dc-e309c2909354 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:34.636348 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86cf7106-1985-4319-b0dc-e309c2909354 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:34.665495 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-86cf7106-1985-4319-b0dc-e309c2909354 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046027 Aug 24 12:45:34.666055 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 981/1961] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:34 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:35.677739 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2202d23c-e9e7-43aa-ac82-5fa8cba5afc5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:35.679811 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2202d23c-e9e7-43aa-ac82-5fa8cba5afc5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:35.686216 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2202d23c-e9e7-43aa-ac82-5fa8cba5afc5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:35.686726 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2202d23c-e9e7-43aa-ac82-5fa8cba5afc5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:35.687163 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2202d23c-e9e7-43aa-ac82-5fa8cba5afc5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:35.687843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2202d23c-e9e7-43aa-ac82-5fa8cba5afc5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:35.688291 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2202d23c-e9e7-43aa-ac82-5fa8cba5afc5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:35.688709 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2202d23c-e9e7-43aa-ac82-5fa8cba5afc5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:35.717663 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2202d23c-e9e7-43aa-ac82-5fa8cba5afc5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043917 Aug 24 12:45:35.718206 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 981/1962] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:35 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:36.730089 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-85fb66f7-2eaa-4b7b-a6c7-544e5bfc384b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:36.732224 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-85fb66f7-2eaa-4b7b-a6c7-544e5bfc384b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:36.734464 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=32 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:45:36.739485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-85fb66f7-2eaa-4b7b-a6c7-544e5bfc384b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:36.739967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-85fb66f7-2eaa-4b7b-a6c7-544e5bfc384b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:36.740406 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-85fb66f7-2eaa-4b7b-a6c7-544e5bfc384b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:36.741087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-85fb66f7-2eaa-4b7b-a6c7-544e5bfc384b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:36.741539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-85fb66f7-2eaa-4b7b-a6c7-544e5bfc384b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:36.741965 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-85fb66f7-2eaa-4b7b-a6c7-544e5bfc384b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:36.770912 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-85fb66f7-2eaa-4b7b-a6c7-544e5bfc384b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045264 Aug 24 12:45:36.771455 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 982/1963] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:36 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:37.783230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e5a653fb-264f-45ee-a0fd-35f1b86ae3d5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:37.785394 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e5a653fb-264f-45ee-a0fd-35f1b86ae3d5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:37.791318 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e5a653fb-264f-45ee-a0fd-35f1b86ae3d5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:37.791813 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e5a653fb-264f-45ee-a0fd-35f1b86ae3d5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:37.792227 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e5a653fb-264f-45ee-a0fd-35f1b86ae3d5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:37.792913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e5a653fb-264f-45ee-a0fd-35f1b86ae3d5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:37.793363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e5a653fb-264f-45ee-a0fd-35f1b86ae3d5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:37.793784 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e5a653fb-264f-45ee-a0fd-35f1b86ae3d5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:37.796108 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=96 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:45:37.823466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e5a653fb-264f-45ee-a0fd-35f1b86ae3d5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044428 Aug 24 12:45:37.824006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 982/1964] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:37 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:38.836049 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a84defbb-b3d7-4d2b-97ba-43bf6f1a5bc5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:38.838774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a84defbb-b3d7-4d2b-97ba-43bf6f1a5bc5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:38.845014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a84defbb-b3d7-4d2b-97ba-43bf6f1a5bc5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:38.845495 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a84defbb-b3d7-4d2b-97ba-43bf6f1a5bc5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:38.845928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a84defbb-b3d7-4d2b-97ba-43bf6f1a5bc5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:38.846607 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a84defbb-b3d7-4d2b-97ba-43bf6f1a5bc5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:38.847081 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a84defbb-b3d7-4d2b-97ba-43bf6f1a5bc5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:38.847503 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a84defbb-b3d7-4d2b-97ba-43bf6f1a5bc5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:38.850997 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=96 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:45:38.875530 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a84defbb-b3d7-4d2b-97ba-43bf6f1a5bc5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043869 Aug 24 12:45:38.876069 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 983/1965] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:38 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:39.887900 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f29082ca-b4fe-465d-adcd-f3dd6d7371a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:39.890015 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f29082ca-b4fe-465d-adcd-f3dd6d7371a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:39.896873 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f29082ca-b4fe-465d-adcd-f3dd6d7371a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:39.897348 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f29082ca-b4fe-465d-adcd-f3dd6d7371a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:39.897778 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f29082ca-b4fe-465d-adcd-f3dd6d7371a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:39.898452 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f29082ca-b4fe-465d-adcd-f3dd6d7371a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:39.899431 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f29082ca-b4fe-465d-adcd-f3dd6d7371a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:39.899857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f29082ca-b4fe-465d-adcd-f3dd6d7371a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:39.928158 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f29082ca-b4fe-465d-adcd-f3dd6d7371a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044278 Aug 24 12:45:39.928686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 983/1966] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:39 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:40.940710 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a2e69510-b716-49ca-8007-a796fba71658 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:40.942866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a2e69510-b716-49ca-8007-a796fba71658 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:40.949819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2e69510-b716-49ca-8007-a796fba71658 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:40.950301 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2e69510-b716-49ca-8007-a796fba71658 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:40.950767 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2e69510-b716-49ca-8007-a796fba71658 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:40.951455 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2e69510-b716-49ca-8007-a796fba71658 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:40.951949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2e69510-b716-49ca-8007-a796fba71658 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:40.952376 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2e69510-b716-49ca-8007-a796fba71658 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:40.980787 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a2e69510-b716-49ca-8007-a796fba71658 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044496 Aug 24 12:45:40.981326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 984/1967] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:40 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:41.993895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-de2afee7-52a6-48d8-8050-382af4d0fabd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:41.996047 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-de2afee7-52a6-48d8-8050-382af4d0fabd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:42.002358 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de2afee7-52a6-48d8-8050-382af4d0fabd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:42.002874 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de2afee7-52a6-48d8-8050-382af4d0fabd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:42.003307 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de2afee7-52a6-48d8-8050-382af4d0fabd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:42.003987 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de2afee7-52a6-48d8-8050-382af4d0fabd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:42.004436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de2afee7-52a6-48d8-8050-382af4d0fabd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:42.004857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de2afee7-52a6-48d8-8050-382af4d0fabd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:42.032656 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-de2afee7-52a6-48d8-8050-382af4d0fabd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043456 Aug 24 12:45:42.033190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 984/1968] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:41 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:43.045830 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c2111fe8-e0dd-4571-8e46-f8c2e25e1c71 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:43.047933 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c2111fe8-e0dd-4571-8e46-f8c2e25e1c71 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:43.054427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2111fe8-e0dd-4571-8e46-f8c2e25e1c71 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:43.054961 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2111fe8-e0dd-4571-8e46-f8c2e25e1c71 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:43.055908 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2111fe8-e0dd-4571-8e46-f8c2e25e1c71 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:43.056587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2111fe8-e0dd-4571-8e46-f8c2e25e1c71 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:43.057038 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2111fe8-e0dd-4571-8e46-f8c2e25e1c71 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:43.057457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2111fe8-e0dd-4571-8e46-f8c2e25e1c71 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:43.088929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c2111fe8-e0dd-4571-8e46-f8c2e25e1c71 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047358 Aug 24 12:45:43.089502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 985/1969] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:43 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:44.101693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-da1ef49e-a461-4115-8881-4aae19e60455 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:44.104385 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-da1ef49e-a461-4115-8881-4aae19e60455 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:44.110777 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da1ef49e-a461-4115-8881-4aae19e60455 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:44.111266 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da1ef49e-a461-4115-8881-4aae19e60455 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:44.111708 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da1ef49e-a461-4115-8881-4aae19e60455 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:44.112400 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da1ef49e-a461-4115-8881-4aae19e60455 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:44.112858 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da1ef49e-a461-4115-8881-4aae19e60455 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:44.113538 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da1ef49e-a461-4115-8881-4aae19e60455 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:44.142940 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-da1ef49e-a461-4115-8881-4aae19e60455 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045156 Aug 24 12:45:44.143494 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 985/1970] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:44 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:45.155147 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ab8ad2a8-140e-4d5b-b6d4-d377eacba26b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:45.158235 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ab8ad2a8-140e-4d5b-b6d4-d377eacba26b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:45.166242 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab8ad2a8-140e-4d5b-b6d4-d377eacba26b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:45.166743 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab8ad2a8-140e-4d5b-b6d4-d377eacba26b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:45.167182 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab8ad2a8-140e-4d5b-b6d4-d377eacba26b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:45.167869 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab8ad2a8-140e-4d5b-b6d4-d377eacba26b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:45.169165 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab8ad2a8-140e-4d5b-b6d4-d377eacba26b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:45.169596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab8ad2a8-140e-4d5b-b6d4-d377eacba26b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:45.199412 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ab8ad2a8-140e-4d5b-b6d4-d377eacba26b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048443 Aug 24 12:45:45.200046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 986/1971] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:45 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:46.212067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ab2d5f26-d1ee-408d-b890-2375ed8d66cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:46.214778 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ab2d5f26-d1ee-408d-b890-2375ed8d66cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:46.221129 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab2d5f26-d1ee-408d-b890-2375ed8d66cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:46.221613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab2d5f26-d1ee-408d-b890-2375ed8d66cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:46.222043 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab2d5f26-d1ee-408d-b890-2375ed8d66cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:46.222793 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab2d5f26-d1ee-408d-b890-2375ed8d66cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:46.223244 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab2d5f26-d1ee-408d-b890-2375ed8d66cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:46.223662 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab2d5f26-d1ee-408d-b890-2375ed8d66cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:46.251890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ab2d5f26-d1ee-408d-b890-2375ed8d66cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044028 Aug 24 12:45:46.252417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 986/1972] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:46 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:45:47.264820 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-77a806af-271b-451e-aa71-284bf916c668 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:47.267029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-77a806af-271b-451e-aa71-284bf916c668 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:47.272879 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-77a806af-271b-451e-aa71-284bf916c668 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:47.273355 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-77a806af-271b-451e-aa71-284bf916c668 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:47.273789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-77a806af-271b-451e-aa71-284bf916c668 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:47.274470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-77a806af-271b-451e-aa71-284bf916c668 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:47.274946 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-77a806af-271b-451e-aa71-284bf916c668 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:47.275372 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-77a806af-271b-451e-aa71-284bf916c668 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:47.304113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-77a806af-271b-451e-aa71-284bf916c668 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043862 Aug 24 12:45:47.304655 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 987/1973] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:47 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:45:48.316949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-15baa36b-a796-46b3-95f0-5c0a81dacd36 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:48.319158 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-15baa36b-a796-46b3-95f0-5c0a81dacd36 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:48.325459 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15baa36b-a796-46b3-95f0-5c0a81dacd36 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:48.325944 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15baa36b-a796-46b3-95f0-5c0a81dacd36 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:48.326384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15baa36b-a796-46b3-95f0-5c0a81dacd36 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:48.327106 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15baa36b-a796-46b3-95f0-5c0a81dacd36 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:48.327586 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15baa36b-a796-46b3-95f0-5c0a81dacd36 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:48.328013 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15baa36b-a796-46b3-95f0-5c0a81dacd36 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:48.357391 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-15baa36b-a796-46b3-95f0-5c0a81dacd36 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044368 Aug 24 12:45:48.357931 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 987/1974] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:48 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:49.369029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2d71d0e0-ae46-4924-a893-fa2b9e490353 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:49.371804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2d71d0e0-ae46-4924-a893-fa2b9e490353 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:49.378200 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d71d0e0-ae46-4924-a893-fa2b9e490353 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:49.378714 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d71d0e0-ae46-4924-a893-fa2b9e490353 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:49.379197 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d71d0e0-ae46-4924-a893-fa2b9e490353 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:49.379887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d71d0e0-ae46-4924-a893-fa2b9e490353 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:49.380342 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d71d0e0-ae46-4924-a893-fa2b9e490353 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:49.380777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d71d0e0-ae46-4924-a893-fa2b9e490353 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:49.409152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2d71d0e0-ae46-4924-a893-fa2b9e490353 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044000 Aug 24 12:45:49.409704 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 988/1975] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:49 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:50.422545 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a543bb9c-ebb8-4d8d-b447-8248a68076ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:50.424721 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a543bb9c-ebb8-4d8d-b447-8248a68076ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:50.431225 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a543bb9c-ebb8-4d8d-b447-8248a68076ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:50.431713 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a543bb9c-ebb8-4d8d-b447-8248a68076ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:50.432142 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a543bb9c-ebb8-4d8d-b447-8248a68076ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:50.432833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a543bb9c-ebb8-4d8d-b447-8248a68076ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:50.433285 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a543bb9c-ebb8-4d8d-b447-8248a68076ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:50.433703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a543bb9c-ebb8-4d8d-b447-8248a68076ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:50.462244 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a543bb9c-ebb8-4d8d-b447-8248a68076ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044194 Aug 24 12:45:50.462813 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 988/1976] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:50 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:51.476190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b68e5c12-3ea4-44ae-9d9f-0e8b767da537 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:51.478347 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b68e5c12-3ea4-44ae-9d9f-0e8b767da537 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:51.484774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b68e5c12-3ea4-44ae-9d9f-0e8b767da537 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:51.485260 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b68e5c12-3ea4-44ae-9d9f-0e8b767da537 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:51.485698 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b68e5c12-3ea4-44ae-9d9f-0e8b767da537 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:51.486388 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b68e5c12-3ea4-44ae-9d9f-0e8b767da537 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:51.486872 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b68e5c12-3ea4-44ae-9d9f-0e8b767da537 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:51.487303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b68e5c12-3ea4-44ae-9d9f-0e8b767da537 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:51.516375 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b68e5c12-3ea4-44ae-9d9f-0e8b767da537 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044275 Aug 24 12:45:51.516841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 989/1977] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:51 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:52.528764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e6f06582-0557-4e34-b2a1-fd1d337b04ee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:52.530945 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e6f06582-0557-4e34-b2a1-fd1d337b04ee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:52.537253 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e6f06582-0557-4e34-b2a1-fd1d337b04ee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:52.537737 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e6f06582-0557-4e34-b2a1-fd1d337b04ee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:52.538173 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e6f06582-0557-4e34-b2a1-fd1d337b04ee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:52.538889 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e6f06582-0557-4e34-b2a1-fd1d337b04ee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:52.539344 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e6f06582-0557-4e34-b2a1-fd1d337b04ee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:52.539863 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e6f06582-0557-4e34-b2a1-fd1d337b04ee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:52.569267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e6f06582-0557-4e34-b2a1-fd1d337b04ee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044565 Aug 24 12:45:52.569811 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 989/1978] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:52 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:53.581600 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3b735184-1521-48d1-8818-50368142d8a9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:53.583771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3b735184-1521-48d1-8818-50368142d8a9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:53.590851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b735184-1521-48d1-8818-50368142d8a9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:53.591338 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b735184-1521-48d1-8818-50368142d8a9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:53.591774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b735184-1521-48d1-8818-50368142d8a9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:53.592456 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b735184-1521-48d1-8818-50368142d8a9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:53.592903 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b735184-1521-48d1-8818-50368142d8a9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:53.593324 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b735184-1521-48d1-8818-50368142d8a9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:53.621508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3b735184-1521-48d1-8818-50368142d8a9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043890 Aug 24 12:45:53.622038 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 990/1979] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:53 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:54.633466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b6dd5b09-a0bd-4fa1-9422-a31a800ea1c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:54.635617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b6dd5b09-a0bd-4fa1-9422-a31a800ea1c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:54.641911 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b6dd5b09-a0bd-4fa1-9422-a31a800ea1c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:54.642394 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b6dd5b09-a0bd-4fa1-9422-a31a800ea1c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:54.642891 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b6dd5b09-a0bd-4fa1-9422-a31a800ea1c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:54.643557 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b6dd5b09-a0bd-4fa1-9422-a31a800ea1c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:54.644015 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b6dd5b09-a0bd-4fa1-9422-a31a800ea1c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:54.644439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b6dd5b09-a0bd-4fa1-9422-a31a800ea1c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:54.673379 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b6dd5b09-a0bd-4fa1-9422-a31a800ea1c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043921 Aug 24 12:45:54.673922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 990/1980] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:54 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:55.685644 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3620819b-a470-4ea2-ad3f-7a8ddb76d95b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:55.687765 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3620819b-a470-4ea2-ad3f-7a8ddb76d95b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:55.694141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3620819b-a470-4ea2-ad3f-7a8ddb76d95b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:55.694622 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3620819b-a470-4ea2-ad3f-7a8ddb76d95b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:55.695100 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3620819b-a470-4ea2-ad3f-7a8ddb76d95b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:55.695785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3620819b-a470-4ea2-ad3f-7a8ddb76d95b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:55.696238 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3620819b-a470-4ea2-ad3f-7a8ddb76d95b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:55.696660 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3620819b-a470-4ea2-ad3f-7a8ddb76d95b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:55.725253 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3620819b-a470-4ea2-ad3f-7a8ddb76d95b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043682 Aug 24 12:45:55.725779 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 991/1981] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:55 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:56.738595 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1e3f5829-213c-48a4-9280-c526012e0a29 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:56.740807 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1e3f5829-213c-48a4-9280-c526012e0a29 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:56.747874 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e3f5829-213c-48a4-9280-c526012e0a29 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:56.748357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e3f5829-213c-48a4-9280-c526012e0a29 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:56.748795 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e3f5829-213c-48a4-9280-c526012e0a29 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:56.749489 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e3f5829-213c-48a4-9280-c526012e0a29 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:56.749945 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e3f5829-213c-48a4-9280-c526012e0a29 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:56.750373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e3f5829-213c-48a4-9280-c526012e0a29 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:56.778699 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1e3f5829-213c-48a4-9280-c526012e0a29 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044324 Aug 24 12:45:56.779246 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 991/1982] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:56 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:57.790933 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9f45cb28-8056-4782-9a29-89de9a7a619f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:57.793171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9f45cb28-8056-4782-9a29-89de9a7a619f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:57.799559 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f45cb28-8056-4782-9a29-89de9a7a619f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:57.800034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f45cb28-8056-4782-9a29-89de9a7a619f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:57.800461 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f45cb28-8056-4782-9a29-89de9a7a619f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:57.801138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f45cb28-8056-4782-9a29-89de9a7a619f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:57.801585 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f45cb28-8056-4782-9a29-89de9a7a619f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:57.802003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f45cb28-8056-4782-9a29-89de9a7a619f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:57.831273 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9f45cb28-8056-4782-9a29-89de9a7a619f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044271 Aug 24 12:45:57.831817 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 992/1983] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:57 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:58.844372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b4489a53-94fd-4481-8e38-567ef3315fe8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:58.846500 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b4489a53-94fd-4481-8e38-567ef3315fe8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:58.852863 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4489a53-94fd-4481-8e38-567ef3315fe8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:58.853350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4489a53-94fd-4481-8e38-567ef3315fe8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:58.853790 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4489a53-94fd-4481-8e38-567ef3315fe8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:58.854479 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4489a53-94fd-4481-8e38-567ef3315fe8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:58.854969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4489a53-94fd-4481-8e38-567ef3315fe8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:58.856072 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4489a53-94fd-4481-8e38-567ef3315fe8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:58.884409 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b4489a53-94fd-4481-8e38-567ef3315fe8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044714 Aug 24 12:45:58.884960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 992/1984] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:58 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:59.896533 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-22cbd500-39a7-49f6-b494-01d1db114edc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:59.898696 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-22cbd500-39a7-49f6-b494-01d1db114edc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:59.905609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22cbd500-39a7-49f6-b494-01d1db114edc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:59.906089 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22cbd500-39a7-49f6-b494-01d1db114edc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:59.906536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22cbd500-39a7-49f6-b494-01d1db114edc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:59.907309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22cbd500-39a7-49f6-b494-01d1db114edc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:59.907756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22cbd500-39a7-49f6-b494-01d1db114edc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:59.908176 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22cbd500-39a7-49f6-b494-01d1db114edc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:59.936543 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-22cbd500-39a7-49f6-b494-01d1db114edc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043973 Aug 24 12:45:59.937076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 993/1985] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:45:59 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:00.948754 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-83647b82-c93c-4a39-83cc-bcb96c7c93d8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:00.950898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-83647b82-c93c-4a39-83cc-bcb96c7c93d8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:00.957296 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83647b82-c93c-4a39-83cc-bcb96c7c93d8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:00.957775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83647b82-c93c-4a39-83cc-bcb96c7c93d8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:00.958209 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83647b82-c93c-4a39-83cc-bcb96c7c93d8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:00.958917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83647b82-c93c-4a39-83cc-bcb96c7c93d8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:00.959373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83647b82-c93c-4a39-83cc-bcb96c7c93d8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:00.959796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83647b82-c93c-4a39-83cc-bcb96c7c93d8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:00.989137 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-83647b82-c93c-4a39-83cc-bcb96c7c93d8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044407 Aug 24 12:46:00.989677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 993/1986] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:00 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:02.001830 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c6dcff48-523e-4039-b4bf-29461634355f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:02.003994 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c6dcff48-523e-4039-b4bf-29461634355f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:02.010278 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c6dcff48-523e-4039-b4bf-29461634355f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:02.010789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c6dcff48-523e-4039-b4bf-29461634355f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:02.011230 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c6dcff48-523e-4039-b4bf-29461634355f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:02.011918 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c6dcff48-523e-4039-b4bf-29461634355f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:02.012374 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c6dcff48-523e-4039-b4bf-29461634355f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:02.012807 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c6dcff48-523e-4039-b4bf-29461634355f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:02.040885 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c6dcff48-523e-4039-b4bf-29461634355f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043028 Aug 24 12:46:02.041445 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 994/1987] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:01 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:03.053781 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8c0535d2-8f28-4ea9-879a-140fca5db841 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:03.055873 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8c0535d2-8f28-4ea9-879a-140fca5db841 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:03.062730 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8c0535d2-8f28-4ea9-879a-140fca5db841 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:03.065933 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8c0535d2-8f28-4ea9-879a-140fca5db841 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:03.065933 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8c0535d2-8f28-4ea9-879a-140fca5db841 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:03.065933 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8c0535d2-8f28-4ea9-879a-140fca5db841 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:03.065933 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8c0535d2-8f28-4ea9-879a-140fca5db841 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:03.066318 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8c0535d2-8f28-4ea9-879a-140fca5db841 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:03.094325 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8c0535d2-8f28-4ea9-879a-140fca5db841 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044764 Aug 24 12:46:03.094916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 994/1988] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:03 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:04.106452 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-22650544-6f3c-4968-89d9-e91e6a83a70b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:04.108598 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-22650544-6f3c-4968-89d9-e91e6a83a70b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:04.115288 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22650544-6f3c-4968-89d9-e91e6a83a70b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:04.115759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22650544-6f3c-4968-89d9-e91e6a83a70b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:04.116192 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22650544-6f3c-4968-89d9-e91e6a83a70b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:04.116868 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22650544-6f3c-4968-89d9-e91e6a83a70b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:04.117313 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22650544-6f3c-4968-89d9-e91e6a83a70b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:04.117731 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22650544-6f3c-4968-89d9-e91e6a83a70b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:04.146645 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-22650544-6f3c-4968-89d9-e91e6a83a70b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044085 Aug 24 12:46:04.147196 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 995/1989] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:04 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:05.158798 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b65c4fe6-a8b8-45bc-8e0c-c3274430ba20 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:05.160948 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b65c4fe6-a8b8-45bc-8e0c-c3274430ba20 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:05.163196 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=32 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:46:05.167770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b65c4fe6-a8b8-45bc-8e0c-c3274430ba20 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:05.168252 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b65c4fe6-a8b8-45bc-8e0c-c3274430ba20 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:05.168683 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b65c4fe6-a8b8-45bc-8e0c-c3274430ba20 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:05.169362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b65c4fe6-a8b8-45bc-8e0c-c3274430ba20 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:05.169812 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b65c4fe6-a8b8-45bc-8e0c-c3274430ba20 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:05.170238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b65c4fe6-a8b8-45bc-8e0c-c3274430ba20 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:05.207094 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b65c4fe6-a8b8-45bc-8e0c-c3274430ba20 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052151 Aug 24 12:46:05.207629 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 995/1990] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:05 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:06.219456 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5d0f50d5-75f6-4258-973f-f15b5ec93bdf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:06.221594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5d0f50d5-75f6-4258-973f-f15b5ec93bdf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:06.227929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d0f50d5-75f6-4258-973f-f15b5ec93bdf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:06.228405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d0f50d5-75f6-4258-973f-f15b5ec93bdf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:06.228843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d0f50d5-75f6-4258-973f-f15b5ec93bdf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:06.229560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d0f50d5-75f6-4258-973f-f15b5ec93bdf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:06.230015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d0f50d5-75f6-4258-973f-f15b5ec93bdf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:06.230595 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d0f50d5-75f6-4258-973f-f15b5ec93bdf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:06.259394 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5d0f50d5-75f6-4258-973f-f15b5ec93bdf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044012 Aug 24 12:46:06.259916 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 996/1991] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:06 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:07.271865 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a3a868ef-aad9-4071-93bf-8202f18df720 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:07.273993 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a3a868ef-aad9-4071-93bf-8202f18df720 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:07.280558 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a3a868ef-aad9-4071-93bf-8202f18df720 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:07.281043 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a3a868ef-aad9-4071-93bf-8202f18df720 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:07.281486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a3a868ef-aad9-4071-93bf-8202f18df720 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:07.282178 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a3a868ef-aad9-4071-93bf-8202f18df720 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:07.282634 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a3a868ef-aad9-4071-93bf-8202f18df720 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:07.283086 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a3a868ef-aad9-4071-93bf-8202f18df720 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:07.312995 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a3a868ef-aad9-4071-93bf-8202f18df720 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045064 Aug 24 12:46:07.313541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 996/1992] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:07 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:08.325645 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c4a4b4c1-12af-4c33-8143-1b48942e9a29 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:08.327833 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c4a4b4c1-12af-4c33-8143-1b48942e9a29 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:08.334190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4a4b4c1-12af-4c33-8143-1b48942e9a29 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:08.334692 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4a4b4c1-12af-4c33-8143-1b48942e9a29 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:08.335135 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4a4b4c1-12af-4c33-8143-1b48942e9a29 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:08.335821 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4a4b4c1-12af-4c33-8143-1b48942e9a29 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:08.336276 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4a4b4c1-12af-4c33-8143-1b48942e9a29 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:08.336702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4a4b4c1-12af-4c33-8143-1b48942e9a29 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:08.365084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c4a4b4c1-12af-4c33-8143-1b48942e9a29 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044040 Aug 24 12:46:08.365619 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 997/1993] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:08 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:09.377902 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-951dd410-9c44-4464-a970-09aeb578ddfa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:09.380107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-951dd410-9c44-4464-a970-09aeb578ddfa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:09.387126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-951dd410-9c44-4464-a970-09aeb578ddfa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:09.387550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-951dd410-9c44-4464-a970-09aeb578ddfa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:09.387986 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-951dd410-9c44-4464-a970-09aeb578ddfa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:09.388684 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-951dd410-9c44-4464-a970-09aeb578ddfa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:09.389143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-951dd410-9c44-4464-a970-09aeb578ddfa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:09.389570 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-951dd410-9c44-4464-a970-09aeb578ddfa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:09.419174 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-951dd410-9c44-4464-a970-09aeb578ddfa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045177 Aug 24 12:46:09.419739 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 997/1994] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:09 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:10.431259 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f2d04ae1-3a2e-4bc8-b6cb-27c8f6384cfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:10.433434 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f2d04ae1-3a2e-4bc8-b6cb-27c8f6384cfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:10.435820 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=32 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:46:10.440538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f2d04ae1-3a2e-4bc8-b6cb-27c8f6384cfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:10.441009 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f2d04ae1-3a2e-4bc8-b6cb-27c8f6384cfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:10.441438 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f2d04ae1-3a2e-4bc8-b6cb-27c8f6384cfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:10.442116 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f2d04ae1-3a2e-4bc8-b6cb-27c8f6384cfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:10.442567 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f2d04ae1-3a2e-4bc8-b6cb-27c8f6384cfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:10.443007 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f2d04ae1-3a2e-4bc8-b6cb-27c8f6384cfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:10.472783 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f2d04ae1-3a2e-4bc8-b6cb-27c8f6384cfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045434 Aug 24 12:46:10.473324 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 998/1995] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:10 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:11.484495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8f710eb0-0a19-43f2-9957-1ec76d1dce73 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:11.486639 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8f710eb0-0a19-43f2-9957-1ec76d1dce73 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:11.493289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f710eb0-0a19-43f2-9957-1ec76d1dce73 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:11.493767 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f710eb0-0a19-43f2-9957-1ec76d1dce73 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:11.494203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f710eb0-0a19-43f2-9957-1ec76d1dce73 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:11.494916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f710eb0-0a19-43f2-9957-1ec76d1dce73 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:11.495373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f710eb0-0a19-43f2-9957-1ec76d1dce73 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:11.495796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f710eb0-0a19-43f2-9957-1ec76d1dce73 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:11.498710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=96 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:46:11.525532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8f710eb0-0a19-43f2-9957-1ec76d1dce73 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044999 Aug 24 12:46:11.526077 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 998/1996] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:11 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:12.537942 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-310ccd54-50ef-4770-ac82-b6545d929538 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:12.540113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-310ccd54-50ef-4770-ac82-b6545d929538 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:12.546847 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-310ccd54-50ef-4770-ac82-b6545d929538 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:12.547330 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-310ccd54-50ef-4770-ac82-b6545d929538 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:12.547773 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-310ccd54-50ef-4770-ac82-b6545d929538 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:12.548451 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-310ccd54-50ef-4770-ac82-b6545d929538 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:12.548903 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-310ccd54-50ef-4770-ac82-b6545d929538 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:12.549326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-310ccd54-50ef-4770-ac82-b6545d929538 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:12.551671 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=96 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:46:12.578431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-310ccd54-50ef-4770-ac82-b6545d929538 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044494 Aug 24 12:46:12.579003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 999/1997] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:12 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:13.591706 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-99e8db08-19b8-443e-9c21-25202e87a00c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:13.593820 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-99e8db08-19b8-443e-9c21-25202e87a00c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:13.600415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-99e8db08-19b8-443e-9c21-25202e87a00c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:13.600880 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-99e8db08-19b8-443e-9c21-25202e87a00c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:13.601315 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-99e8db08-19b8-443e-9c21-25202e87a00c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:13.602002 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-99e8db08-19b8-443e-9c21-25202e87a00c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:13.602460 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-99e8db08-19b8-443e-9c21-25202e87a00c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:13.602924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-99e8db08-19b8-443e-9c21-25202e87a00c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:13.631920 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-99e8db08-19b8-443e-9c21-25202e87a00c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045111 Aug 24 12:46:13.632470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 999/1998] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:13 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:14.813871 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-70f53b11-4c6e-422d-b717-5d2ded897c2e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:14.816106 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-70f53b11-4c6e-422d-b717-5d2ded897c2e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:14.821887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70f53b11-4c6e-422d-b717-5d2ded897c2e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:14.822358 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70f53b11-4c6e-422d-b717-5d2ded897c2e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:14.822833 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70f53b11-4c6e-422d-b717-5d2ded897c2e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:14.823510 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70f53b11-4c6e-422d-b717-5d2ded897c2e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:14.823956 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70f53b11-4c6e-422d-b717-5d2ded897c2e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:14.824371 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70f53b11-4c6e-422d-b717-5d2ded897c2e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:14.852306 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-70f53b11-4c6e-422d-b717-5d2ded897c2e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.213065 Aug 24 12:46:14.852844 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1000/1999] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:14 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:15.865454 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6a185b08-e2b8-452b-8f9c-5a6c7fa06f5f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:15.867593 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6a185b08-e2b8-452b-8f9c-5a6c7fa06f5f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:15.874367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a185b08-e2b8-452b-8f9c-5a6c7fa06f5f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:15.874879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a185b08-e2b8-452b-8f9c-5a6c7fa06f5f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:15.875319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a185b08-e2b8-452b-8f9c-5a6c7fa06f5f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:15.875997 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a185b08-e2b8-452b-8f9c-5a6c7fa06f5f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:15.876450 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a185b08-e2b8-452b-8f9c-5a6c7fa06f5f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:15.876872 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a185b08-e2b8-452b-8f9c-5a6c7fa06f5f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:15.905394 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6a185b08-e2b8-452b-8f9c-5a6c7fa06f5f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044183 Aug 24 12:46:15.905917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1000/2000] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:15 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:16.917631 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d878b9a7-7051-4dbc-bc69-c55beb6152f1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:16.920278 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d878b9a7-7051-4dbc-bc69-c55beb6152f1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:16.926126 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d878b9a7-7051-4dbc-bc69-c55beb6152f1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:16.926602 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d878b9a7-7051-4dbc-bc69-c55beb6152f1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:16.927061 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d878b9a7-7051-4dbc-bc69-c55beb6152f1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:16.927732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d878b9a7-7051-4dbc-bc69-c55beb6152f1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:16.928176 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d878b9a7-7051-4dbc-bc69-c55beb6152f1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:16.928592 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d878b9a7-7051-4dbc-bc69-c55beb6152f1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:16.958041 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d878b9a7-7051-4dbc-bc69-c55beb6152f1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044518 Aug 24 12:46:16.962433 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1001/2001] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:16 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:17.971019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-50742cc5-dff3-4365-8b50-b0d3be9eefca tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:17.973383 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-50742cc5-dff3-4365-8b50-b0d3be9eefca tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:17.982950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50742cc5-dff3-4365-8b50-b0d3be9eefca tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:17.983782 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50742cc5-dff3-4365-8b50-b0d3be9eefca tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:17.984243 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50742cc5-dff3-4365-8b50-b0d3be9eefca tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:17.984963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50742cc5-dff3-4365-8b50-b0d3be9eefca tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:17.985415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50742cc5-dff3-4365-8b50-b0d3be9eefca tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:17.985836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50742cc5-dff3-4365-8b50-b0d3be9eefca tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:18.029937 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-50742cc5-dff3-4365-8b50-b0d3be9eefca tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063210 Aug 24 12:46:18.030557 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1001/2002] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:17 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:19.041545 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b0134206-c233-4d77-ad98-ef5c7e4b543b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:19.043772 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b0134206-c233-4d77-ad98-ef5c7e4b543b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:19.050212 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b0134206-c233-4d77-ad98-ef5c7e4b543b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:19.050728 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b0134206-c233-4d77-ad98-ef5c7e4b543b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:19.051173 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b0134206-c233-4d77-ad98-ef5c7e4b543b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:19.051866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b0134206-c233-4d77-ad98-ef5c7e4b543b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:19.052327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b0134206-c233-4d77-ad98-ef5c7e4b543b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:19.052758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b0134206-c233-4d77-ad98-ef5c7e4b543b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:19.082042 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b0134206-c233-4d77-ad98-ef5c7e4b543b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044535 Aug 24 12:46:19.082586 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1002/2003] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:19 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:20.094414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-01d09026-eedb-4da2-9063-53dffebec14d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:20.096482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-01d09026-eedb-4da2-9063-53dffebec14d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:20.102808 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01d09026-eedb-4da2-9063-53dffebec14d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:20.103288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01d09026-eedb-4da2-9063-53dffebec14d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:20.103719 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01d09026-eedb-4da2-9063-53dffebec14d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:20.104446 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01d09026-eedb-4da2-9063-53dffebec14d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:20.104927 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01d09026-eedb-4da2-9063-53dffebec14d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:20.105350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01d09026-eedb-4da2-9063-53dffebec14d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:20.134819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-01d09026-eedb-4da2-9063-53dffebec14d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044442 Aug 24 12:46:20.135353 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1002/2004] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:20 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:21.146914 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e07da341-29af-4309-8ac5-3b710d58e010 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:21.149048 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e07da341-29af-4309-8ac5-3b710d58e010 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:21.155680 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e07da341-29af-4309-8ac5-3b710d58e010 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:21.156169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e07da341-29af-4309-8ac5-3b710d58e010 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:21.156609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e07da341-29af-4309-8ac5-3b710d58e010 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:21.157302 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e07da341-29af-4309-8ac5-3b710d58e010 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:21.157783 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e07da341-29af-4309-8ac5-3b710d58e010 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:21.158210 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e07da341-29af-4309-8ac5-3b710d58e010 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:21.187551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e07da341-29af-4309-8ac5-3b710d58e010 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044644 Aug 24 12:46:21.188099 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1003/2005] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:21 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:22.200668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1bb41e49-3001-4c24-b15f-ac5e703f6f23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:22.204240 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1bb41e49-3001-4c24-b15f-ac5e703f6f23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:22.210842 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1bb41e49-3001-4c24-b15f-ac5e703f6f23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:22.211326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1bb41e49-3001-4c24-b15f-ac5e703f6f23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:22.211760 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1bb41e49-3001-4c24-b15f-ac5e703f6f23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:22.212441 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1bb41e49-3001-4c24-b15f-ac5e703f6f23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:22.212892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1bb41e49-3001-4c24-b15f-ac5e703f6f23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:22.213312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1bb41e49-3001-4c24-b15f-ac5e703f6f23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:22.244582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1bb41e49-3001-4c24-b15f-ac5e703f6f23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048825 Aug 24 12:46:22.245133 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1003/2006] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:22 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:23.257992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-31628e35-75e1-467f-8592-f8f03643dfc9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:23.264950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-31628e35-75e1-467f-8592-f8f03643dfc9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:23.272046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-31628e35-75e1-467f-8592-f8f03643dfc9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:23.272525 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-31628e35-75e1-467f-8592-f8f03643dfc9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:23.272957 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-31628e35-75e1-467f-8592-f8f03643dfc9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:23.273645 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-31628e35-75e1-467f-8592-f8f03643dfc9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:23.274090 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-31628e35-75e1-467f-8592-f8f03643dfc9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:23.274507 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-31628e35-75e1-467f-8592-f8f03643dfc9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:23.302976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-31628e35-75e1-467f-8592-f8f03643dfc9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049067 Aug 24 12:46:23.303510 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1004/2007] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:23 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:24.315085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1dafb87b-e977-426b-8734-1ba203279973 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:24.317202 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1dafb87b-e977-426b-8734-1ba203279973 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:24.323521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1dafb87b-e977-426b-8734-1ba203279973 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:24.323999 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1dafb87b-e977-426b-8734-1ba203279973 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:24.324434 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1dafb87b-e977-426b-8734-1ba203279973 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:24.325162 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1dafb87b-e977-426b-8734-1ba203279973 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:24.325612 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1dafb87b-e977-426b-8734-1ba203279973 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:24.326032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1dafb87b-e977-426b-8734-1ba203279973 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:24.354323 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1dafb87b-e977-426b-8734-1ba203279973 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043216 Aug 24 12:46:24.354885 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1004/2008] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:24 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:25.367458 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-44594a16-a775-4d54-aaaf-df3cda106645 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:25.369558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-44594a16-a775-4d54-aaaf-df3cda106645 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:25.376630 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-44594a16-a775-4d54-aaaf-df3cda106645 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:25.377106 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-44594a16-a775-4d54-aaaf-df3cda106645 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:25.377539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-44594a16-a775-4d54-aaaf-df3cda106645 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:25.378208 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-44594a16-a775-4d54-aaaf-df3cda106645 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:25.378669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-44594a16-a775-4d54-aaaf-df3cda106645 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:25.379089 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-44594a16-a775-4d54-aaaf-df3cda106645 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:25.407557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-44594a16-a775-4d54-aaaf-df3cda106645 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044321 Aug 24 12:46:25.408100 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1005/2009] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:25 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:26.419309 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9fbf143e-25ca-43fc-a032-e84102c57ff7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:26.421471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9fbf143e-25ca-43fc-a032-e84102c57ff7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:26.428336 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9fbf143e-25ca-43fc-a032-e84102c57ff7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:26.428482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9fbf143e-25ca-43fc-a032-e84102c57ff7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:26.428875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9fbf143e-25ca-43fc-a032-e84102c57ff7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:26.429572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9fbf143e-25ca-43fc-a032-e84102c57ff7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:26.430031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9fbf143e-25ca-43fc-a032-e84102c57ff7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:26.430461 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9fbf143e-25ca-43fc-a032-e84102c57ff7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:26.460022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9fbf143e-25ca-43fc-a032-e84102c57ff7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044851 Aug 24 12:46:26.460604 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1005/2010] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:26 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:27.472201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a90f5bd6-166d-4cd7-8392-10c60380ef9d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:27.474349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a90f5bd6-166d-4cd7-8392-10c60380ef9d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:27.480685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a90f5bd6-166d-4cd7-8392-10c60380ef9d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:27.481671 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a90f5bd6-166d-4cd7-8392-10c60380ef9d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:27.482103 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a90f5bd6-166d-4cd7-8392-10c60380ef9d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:27.482815 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a90f5bd6-166d-4cd7-8392-10c60380ef9d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:27.483268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a90f5bd6-166d-4cd7-8392-10c60380ef9d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:27.483692 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a90f5bd6-166d-4cd7-8392-10c60380ef9d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:27.512849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a90f5bd6-166d-4cd7-8392-10c60380ef9d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044616 Aug 24 12:46:27.513378 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1006/2011] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:27 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:28.524672 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4320a1de-f253-46e9-82b7-1928c47a3095 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:28.526820 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4320a1de-f253-46e9-82b7-1928c47a3095 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:28.533698 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4320a1de-f253-46e9-82b7-1928c47a3095 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:28.534176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4320a1de-f253-46e9-82b7-1928c47a3095 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:28.534611 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4320a1de-f253-46e9-82b7-1928c47a3095 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:28.535319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4320a1de-f253-46e9-82b7-1928c47a3095 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:28.535775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4320a1de-f253-46e9-82b7-1928c47a3095 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:28.536197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4320a1de-f253-46e9-82b7-1928c47a3095 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:28.564653 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4320a1de-f253-46e9-82b7-1928c47a3095 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043972 Aug 24 12:46:28.565192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1006/2012] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:28 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:29.577341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-333717ac-93a9-4ace-b1aa-3bc33fa40f4b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:29.579482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-333717ac-93a9-4ace-b1aa-3bc33fa40f4b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:29.585777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-333717ac-93a9-4ace-b1aa-3bc33fa40f4b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:29.586251 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-333717ac-93a9-4ace-b1aa-3bc33fa40f4b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:29.586701 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-333717ac-93a9-4ace-b1aa-3bc33fa40f4b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:29.587377 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-333717ac-93a9-4ace-b1aa-3bc33fa40f4b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:29.587820 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-333717ac-93a9-4ace-b1aa-3bc33fa40f4b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:29.588235 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-333717ac-93a9-4ace-b1aa-3bc33fa40f4b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:29.617495 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-333717ac-93a9-4ace-b1aa-3bc33fa40f4b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044652 Aug 24 12:46:29.618041 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1007/2013] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:29 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:30.629569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-92952828-1add-4358-a1d4-300adbd144af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:30.631761 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-92952828-1add-4358-a1d4-300adbd144af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:30.638575 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92952828-1add-4358-a1d4-300adbd144af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:30.639091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92952828-1add-4358-a1d4-300adbd144af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:30.639527 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92952828-1add-4358-a1d4-300adbd144af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:30.640251 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92952828-1add-4358-a1d4-300adbd144af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:30.640708 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92952828-1add-4358-a1d4-300adbd144af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:30.641134 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92952828-1add-4358-a1d4-300adbd144af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:30.669683 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-92952828-1add-4358-a1d4-300adbd144af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044168 Aug 24 12:46:30.670216 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1007/2014] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:30 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:31.682146 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8fec9ff0-e1a6-44e5-913e-d15bf3546abe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:31.684263 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8fec9ff0-e1a6-44e5-913e-d15bf3546abe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:31.690721 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8fec9ff0-e1a6-44e5-913e-d15bf3546abe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:31.691158 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8fec9ff0-e1a6-44e5-913e-d15bf3546abe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:31.691586 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8fec9ff0-e1a6-44e5-913e-d15bf3546abe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:31.692258 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8fec9ff0-e1a6-44e5-913e-d15bf3546abe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:31.692704 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8fec9ff0-e1a6-44e5-913e-d15bf3546abe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:31.693118 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8fec9ff0-e1a6-44e5-913e-d15bf3546abe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:31.721650 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8fec9ff0-e1a6-44e5-913e-d15bf3546abe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043514 Aug 24 12:46:31.722189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1008/2015] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:31 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:32.734257 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a424e2d7-88f8-4977-9a36-28edff582327 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:32.736505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a424e2d7-88f8-4977-9a36-28edff582327 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:32.743145 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a424e2d7-88f8-4977-9a36-28edff582327 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:32.743622 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a424e2d7-88f8-4977-9a36-28edff582327 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:32.744056 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a424e2d7-88f8-4977-9a36-28edff582327 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:32.744742 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a424e2d7-88f8-4977-9a36-28edff582327 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:32.745223 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a424e2d7-88f8-4977-9a36-28edff582327 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:32.745642 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a424e2d7-88f8-4977-9a36-28edff582327 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:32.775023 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a424e2d7-88f8-4977-9a36-28edff582327 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045484 Aug 24 12:46:32.775576 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1008/2016] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:32 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:33.787869 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-780f5ea0-a0b6-4376-a261-e1cb2fb6304c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:33.790677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-780f5ea0-a0b6-4376-a261-e1cb2fb6304c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:33.797112 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-780f5ea0-a0b6-4376-a261-e1cb2fb6304c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:33.797594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-780f5ea0-a0b6-4376-a261-e1cb2fb6304c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:33.798034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-780f5ea0-a0b6-4376-a261-e1cb2fb6304c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:33.798741 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-780f5ea0-a0b6-4376-a261-e1cb2fb6304c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:33.799222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-780f5ea0-a0b6-4376-a261-e1cb2fb6304c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:33.799642 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-780f5ea0-a0b6-4376-a261-e1cb2fb6304c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:33.829025 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-780f5ea0-a0b6-4376-a261-e1cb2fb6304c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045143 Aug 24 12:46:33.829568 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1009/2017] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:33 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:46:34.841098 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7a074365-cf6b-42de-8e60-b536bb6f5601 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:34.843270 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7a074365-cf6b-42de-8e60-b536bb6f5601 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:34.849587 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a074365-cf6b-42de-8e60-b536bb6f5601 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:34.850062 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a074365-cf6b-42de-8e60-b536bb6f5601 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:34.850490 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a074365-cf6b-42de-8e60-b536bb6f5601 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:34.851192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a074365-cf6b-42de-8e60-b536bb6f5601 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:34.851644 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a074365-cf6b-42de-8e60-b536bb6f5601 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:34.852061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a074365-cf6b-42de-8e60-b536bb6f5601 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:34.881183 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7a074365-cf6b-42de-8e60-b536bb6f5601 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044043 Aug 24 12:46:34.881716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1009/2018] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:34 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:35.893327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7bda8297-0f32-4c7a-bd31-3b90f439bb39 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:35.895464 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7bda8297-0f32-4c7a-bd31-3b90f439bb39 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:35.901830 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7bda8297-0f32-4c7a-bd31-3b90f439bb39 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:35.902302 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7bda8297-0f32-4c7a-bd31-3b90f439bb39 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:35.902762 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7bda8297-0f32-4c7a-bd31-3b90f439bb39 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:35.903439 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7bda8297-0f32-4c7a-bd31-3b90f439bb39 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:35.903885 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7bda8297-0f32-4c7a-bd31-3b90f439bb39 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:35.904301 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7bda8297-0f32-4c7a-bd31-3b90f439bb39 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:35.933823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7bda8297-0f32-4c7a-bd31-3b90f439bb39 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044524 Aug 24 12:46:35.934360 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1010/2019] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:35 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:36.946000 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-412b3d65-2141-400f-b661-12a9f0be58e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:36.948181 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-412b3d65-2141-400f-b661-12a9f0be58e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:36.954174 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-412b3d65-2141-400f-b661-12a9f0be58e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:36.954677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-412b3d65-2141-400f-b661-12a9f0be58e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:36.955111 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-412b3d65-2141-400f-b661-12a9f0be58e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:36.955795 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-412b3d65-2141-400f-b661-12a9f0be58e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:36.956247 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-412b3d65-2141-400f-b661-12a9f0be58e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:36.956668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-412b3d65-2141-400f-b661-12a9f0be58e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:36.986253 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-412b3d65-2141-400f-b661-12a9f0be58e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044223 Aug 24 12:46:36.986826 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1010/2020] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:36 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:37.998760 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-64e9d94f-c4f3-43b3-bc89-ec135286f084 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:38.001572 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-64e9d94f-c4f3-43b3-bc89-ec135286f084 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:38.007873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64e9d94f-c4f3-43b3-bc89-ec135286f084 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:38.008355 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64e9d94f-c4f3-43b3-bc89-ec135286f084 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:38.008791 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64e9d94f-c4f3-43b3-bc89-ec135286f084 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:38.009485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64e9d94f-c4f3-43b3-bc89-ec135286f084 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:38.009955 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64e9d94f-c4f3-43b3-bc89-ec135286f084 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:38.010363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64e9d94f-c4f3-43b3-bc89-ec135286f084 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:38.039765 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-64e9d94f-c4f3-43b3-bc89-ec135286f084 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044936 Aug 24 12:46:38.040537 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1011/2021] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:37 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:39.052581 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-abd1090a-6a67-48dc-a00c-fe6a1ab2942f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:39.054751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-abd1090a-6a67-48dc-a00c-fe6a1ab2942f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:39.057063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=32 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:46:39.061831 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-abd1090a-6a67-48dc-a00c-fe6a1ab2942f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:39.062315 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-abd1090a-6a67-48dc-a00c-fe6a1ab2942f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:39.063405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-abd1090a-6a67-48dc-a00c-fe6a1ab2942f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:39.064094 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-abd1090a-6a67-48dc-a00c-fe6a1ab2942f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:39.064546 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-abd1090a-6a67-48dc-a00c-fe6a1ab2942f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:39.065016 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-abd1090a-6a67-48dc-a00c-fe6a1ab2942f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:39.094031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-abd1090a-6a67-48dc-a00c-fe6a1ab2942f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045398 Aug 24 12:46:39.094575 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1011/2022] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:39 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:46:39.223959 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:46:39.224185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 12:46:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:46:40.106102 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-695db0cd-8e31-4b8a-b923-d0349571b483 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:40.108277 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-695db0cd-8e31-4b8a-b923-d0349571b483 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:40.115402 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-695db0cd-8e31-4b8a-b923-d0349571b483 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:40.115874 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-695db0cd-8e31-4b8a-b923-d0349571b483 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:40.116303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-695db0cd-8e31-4b8a-b923-d0349571b483 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:40.116977 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-695db0cd-8e31-4b8a-b923-d0349571b483 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:40.117420 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-695db0cd-8e31-4b8a-b923-d0349571b483 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:40.117835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-695db0cd-8e31-4b8a-b923-d0349571b483 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:40.145760 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-695db0cd-8e31-4b8a-b923-d0349571b483 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043734 Aug 24 12:46:40.146289 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1012/2023] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:40 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:41.157835 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0098c35c-1860-46be-84bf-5e5622b5f6ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:41.160629 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0098c35c-1860-46be-84bf-5e5622b5f6ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:41.166915 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0098c35c-1860-46be-84bf-5e5622b5f6ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:41.167392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0098c35c-1860-46be-84bf-5e5622b5f6ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:41.167823 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0098c35c-1860-46be-84bf-5e5622b5f6ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:41.168500 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0098c35c-1860-46be-84bf-5e5622b5f6ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:41.168948 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0098c35c-1860-46be-84bf-5e5622b5f6ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:41.169367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0098c35c-1860-46be-84bf-5e5622b5f6ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:41.197446 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0098c35c-1860-46be-84bf-5e5622b5f6ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043601 Aug 24 12:46:41.197963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1012/2024] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:41 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:42.212531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-52921574-a785-45f0-8633-c3ed3cae70ed tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:42.214630 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-52921574-a785-45f0-8633-c3ed3cae70ed tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:42.221015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-52921574-a785-45f0-8633-c3ed3cae70ed tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:42.222115 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-52921574-a785-45f0-8633-c3ed3cae70ed tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:42.222558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-52921574-a785-45f0-8633-c3ed3cae70ed tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:42.223441 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-52921574-a785-45f0-8633-c3ed3cae70ed tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:42.223706 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-52921574-a785-45f0-8633-c3ed3cae70ed tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:42.224125 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-52921574-a785-45f0-8633-c3ed3cae70ed tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:42.252892 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-52921574-a785-45f0-8633-c3ed3cae70ed tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044270 Aug 24 12:46:42.253361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1013/2025] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:42 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:43.015641 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:46:43.015861 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 12:46:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:46:43.264886 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2377f83c-6da1-469d-93fa-8974bd2d2646 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:43.267299 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2377f83c-6da1-469d-93fa-8974bd2d2646 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:43.274430 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2377f83c-6da1-469d-93fa-8974bd2d2646 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:43.274956 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2377f83c-6da1-469d-93fa-8974bd2d2646 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:43.275398 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2377f83c-6da1-469d-93fa-8974bd2d2646 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:43.276090 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2377f83c-6da1-469d-93fa-8974bd2d2646 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:43.276553 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2377f83c-6da1-469d-93fa-8974bd2d2646 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:43.276985 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2377f83c-6da1-469d-93fa-8974bd2d2646 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:43.304743 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2377f83c-6da1-469d-93fa-8974bd2d2646 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043900 Aug 24 12:46:43.305286 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1013/2026] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:43 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:44.317065 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d7cbc110-48b7-4d04-b8b1-fb057f50a95e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:44.319168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d7cbc110-48b7-4d04-b8b1-fb057f50a95e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:44.321503 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=32 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:46:44.326168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7cbc110-48b7-4d04-b8b1-fb057f50a95e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:44.326671 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7cbc110-48b7-4d04-b8b1-fb057f50a95e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:44.327111 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7cbc110-48b7-4d04-b8b1-fb057f50a95e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:44.327800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7cbc110-48b7-4d04-b8b1-fb057f50a95e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:44.328256 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7cbc110-48b7-4d04-b8b1-fb057f50a95e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:44.328684 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7cbc110-48b7-4d04-b8b1-fb057f50a95e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:44.358813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d7cbc110-48b7-4d04-b8b1-fb057f50a95e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045768 Aug 24 12:46:44.359345 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1014/2027] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:44 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:45.371308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-759f4696-6df4-4f3c-9605-b038e735b945 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:45.373478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-759f4696-6df4-4f3c-9605-b038e735b945 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:45.379841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-759f4696-6df4-4f3c-9605-b038e735b945 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:45.380346 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-759f4696-6df4-4f3c-9605-b038e735b945 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:45.380786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-759f4696-6df4-4f3c-9605-b038e735b945 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:45.381475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-759f4696-6df4-4f3c-9605-b038e735b945 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:45.381944 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-759f4696-6df4-4f3c-9605-b038e735b945 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:45.382373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-759f4696-6df4-4f3c-9605-b038e735b945 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:45.385946 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=96 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:46:45.410804 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-759f4696-6df4-4f3c-9605-b038e735b945 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043460 Aug 24 12:46:45.411348 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1014/2028] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:45 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:46.422477 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a8133a4e-43e7-4571-bc01-f8d2a8f865bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:46.425532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a8133a4e-43e7-4571-bc01-f8d2a8f865bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:46.431726 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a8133a4e-43e7-4571-bc01-f8d2a8f865bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:46.432205 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a8133a4e-43e7-4571-bc01-f8d2a8f865bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:46.432635 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a8133a4e-43e7-4571-bc01-f8d2a8f865bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:46.433317 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a8133a4e-43e7-4571-bc01-f8d2a8f865bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:46.433765 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a8133a4e-43e7-4571-bc01-f8d2a8f865bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:46.434186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a8133a4e-43e7-4571-bc01-f8d2a8f865bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:46.436488 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=96 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:46:46.463896 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a8133a4e-43e7-4571-bc01-f8d2a8f865bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045511 Aug 24 12:46:46.464429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1015/2029] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:46 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:47.476105 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-606ab0ad-447f-4b05-a266-d9f8f637fb80 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:47.478292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-606ab0ad-447f-4b05-a266-d9f8f637fb80 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:47.484647 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-606ab0ad-447f-4b05-a266-d9f8f637fb80 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:47.485126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-606ab0ad-447f-4b05-a266-d9f8f637fb80 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:47.485565 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-606ab0ad-447f-4b05-a266-d9f8f637fb80 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:47.486246 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-606ab0ad-447f-4b05-a266-d9f8f637fb80 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:47.486722 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-606ab0ad-447f-4b05-a266-d9f8f637fb80 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:47.487151 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-606ab0ad-447f-4b05-a266-d9f8f637fb80 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:47.515828 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-606ab0ad-447f-4b05-a266-d9f8f637fb80 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044549 Aug 24 12:46:47.516360 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1015/2030] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:47 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:48.528452 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b64d3596-76ce-4253-9788-42d3f2bf40e0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:48.530546 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b64d3596-76ce-4253-9788-42d3f2bf40e0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:48.536984 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b64d3596-76ce-4253-9788-42d3f2bf40e0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:48.537454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b64d3596-76ce-4253-9788-42d3f2bf40e0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:48.537880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b64d3596-76ce-4253-9788-42d3f2bf40e0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:48.538552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b64d3596-76ce-4253-9788-42d3f2bf40e0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:48.539022 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b64d3596-76ce-4253-9788-42d3f2bf40e0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:48.539440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b64d3596-76ce-4253-9788-42d3f2bf40e0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:48.568604 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b64d3596-76ce-4253-9788-42d3f2bf40e0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044554 Aug 24 12:46:48.569134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1016/2031] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:48 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:49.580492 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c043b53f-4bc2-4d4c-b0cc-8745fad3b50c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:49.582605 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c043b53f-4bc2-4d4c-b0cc-8745fad3b50c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:49.589056 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c043b53f-4bc2-4d4c-b0cc-8745fad3b50c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:49.589540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c043b53f-4bc2-4d4c-b0cc-8745fad3b50c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:49.589972 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c043b53f-4bc2-4d4c-b0cc-8745fad3b50c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:49.590666 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c043b53f-4bc2-4d4c-b0cc-8745fad3b50c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:49.591116 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c043b53f-4bc2-4d4c-b0cc-8745fad3b50c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:49.591535 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c043b53f-4bc2-4d4c-b0cc-8745fad3b50c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:49.621441 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c043b53f-4bc2-4d4c-b0cc-8745fad3b50c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044907 Aug 24 12:46:49.622179 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1016/2032] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:49 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:50.633271 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c57c0cba-1986-4668-b9cb-231c1c6514f2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:50.635405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c57c0cba-1986-4668-b9cb-231c1c6514f2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:50.641920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c57c0cba-1986-4668-b9cb-231c1c6514f2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:50.642396 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c57c0cba-1986-4668-b9cb-231c1c6514f2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:50.642871 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c57c0cba-1986-4668-b9cb-231c1c6514f2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:50.643582 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c57c0cba-1986-4668-b9cb-231c1c6514f2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:50.644027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c57c0cba-1986-4668-b9cb-231c1c6514f2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:50.644442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c57c0cba-1986-4668-b9cb-231c1c6514f2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:50.673611 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c57c0cba-1986-4668-b9cb-231c1c6514f2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044255 Aug 24 12:46:50.674146 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1017/2033] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:50 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:51.686330 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-aabbf7ce-1774-45aa-adca-740e4b7a8d10 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:51.688411 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-aabbf7ce-1774-45aa-adca-740e4b7a8d10 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:51.695315 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aabbf7ce-1774-45aa-adca-740e4b7a8d10 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:51.695900 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aabbf7ce-1774-45aa-adca-740e4b7a8d10 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:51.696340 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aabbf7ce-1774-45aa-adca-740e4b7a8d10 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:51.697016 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aabbf7ce-1774-45aa-adca-740e4b7a8d10 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:51.697466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aabbf7ce-1774-45aa-adca-740e4b7a8d10 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:51.697882 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aabbf7ce-1774-45aa-adca-740e4b7a8d10 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:51.726249 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-aabbf7ce-1774-45aa-adca-740e4b7a8d10 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043930 Aug 24 12:46:51.726827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1017/2034] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:51 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:52.054413 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:46:52.054568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 12:46:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:46:52.528497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:46:52.528991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 12:46:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:46:52.738787 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-96864af4-9a08-4247-acb1-8a099397dc02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:52.740810 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-96864af4-9a08-4247-acb1-8a099397dc02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:52.747199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96864af4-9a08-4247-acb1-8a099397dc02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:52.747677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96864af4-9a08-4247-acb1-8a099397dc02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:52.748111 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96864af4-9a08-4247-acb1-8a099397dc02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:52.748792 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96864af4-9a08-4247-acb1-8a099397dc02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:52.749241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96864af4-9a08-4247-acb1-8a099397dc02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:52.749663 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96864af4-9a08-4247-acb1-8a099397dc02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:52.779162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-96864af4-9a08-4247-acb1-8a099397dc02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044544 Aug 24 12:46:52.779628 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1018/2035] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:52 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:53.791845 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-40b4e190-8f95-4068-b3d0-36a534187ec7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:53.793633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-40b4e190-8f95-4068-b3d0-36a534187ec7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:53.800885 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40b4e190-8f95-4068-b3d0-36a534187ec7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:53.801369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40b4e190-8f95-4068-b3d0-36a534187ec7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:53.801805 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40b4e190-8f95-4068-b3d0-36a534187ec7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:53.802510 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40b4e190-8f95-4068-b3d0-36a534187ec7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:53.802999 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40b4e190-8f95-4068-b3d0-36a534187ec7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:53.803420 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40b4e190-8f95-4068-b3d0-36a534187ec7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:53.834812 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-40b4e190-8f95-4068-b3d0-36a534187ec7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047209 Aug 24 12:46:53.835428 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1018/2036] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:53 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:54.847183 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b6019fba-919a-4e1c-9212-69fadafbd0c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:54.849248 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b6019fba-919a-4e1c-9212-69fadafbd0c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:54.855611 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6019fba-919a-4e1c-9212-69fadafbd0c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:54.856086 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6019fba-919a-4e1c-9212-69fadafbd0c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:54.856514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6019fba-919a-4e1c-9212-69fadafbd0c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:54.857196 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6019fba-919a-4e1c-9212-69fadafbd0c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:54.857648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6019fba-919a-4e1c-9212-69fadafbd0c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:54.858067 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6019fba-919a-4e1c-9212-69fadafbd0c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:54.887406 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b6019fba-919a-4e1c-9212-69fadafbd0c2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044380 Aug 24 12:46:54.888164 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1019/2037] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:54 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:55.900103 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6123efd7-8087-4c17-8f36-01eff15ee0a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:55.902236 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6123efd7-8087-4c17-8f36-01eff15ee0a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:55.908663 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6123efd7-8087-4c17-8f36-01eff15ee0a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:55.909205 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6123efd7-8087-4c17-8f36-01eff15ee0a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:55.909640 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6123efd7-8087-4c17-8f36-01eff15ee0a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:55.910319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6123efd7-8087-4c17-8f36-01eff15ee0a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:55.910801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6123efd7-8087-4c17-8f36-01eff15ee0a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:55.911224 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6123efd7-8087-4c17-8f36-01eff15ee0a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:55.940526 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6123efd7-8087-4c17-8f36-01eff15ee0a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043868 Aug 24 12:46:55.952325 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1019/2038] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:55 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:56.962915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e5144288-85aa-4901-a7e2-5bd33046c806 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:56.965051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e5144288-85aa-4901-a7e2-5bd33046c806 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:56.971717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e5144288-85aa-4901-a7e2-5bd33046c806 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:56.972199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e5144288-85aa-4901-a7e2-5bd33046c806 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:56.972636 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e5144288-85aa-4901-a7e2-5bd33046c806 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:56.973940 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e5144288-85aa-4901-a7e2-5bd33046c806 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:56.974397 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e5144288-85aa-4901-a7e2-5bd33046c806 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:56.974862 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e5144288-85aa-4901-a7e2-5bd33046c806 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:57.003860 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e5144288-85aa-4901-a7e2-5bd33046c806 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044887 Aug 24 12:46:57.004407 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1020/2039] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:56 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:58.015288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6b5f5225-e24e-4628-b118-7340f09306b1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:58.017461 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6b5f5225-e24e-4628-b118-7340f09306b1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:58.023903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b5f5225-e24e-4628-b118-7340f09306b1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:58.024390 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b5f5225-e24e-4628-b118-7340f09306b1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:58.024832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b5f5225-e24e-4628-b118-7340f09306b1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:58.025528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b5f5225-e24e-4628-b118-7340f09306b1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:58.025988 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b5f5225-e24e-4628-b118-7340f09306b1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:58.026418 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b5f5225-e24e-4628-b118-7340f09306b1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:58.055840 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6b5f5225-e24e-4628-b118-7340f09306b1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044511 Aug 24 12:46:58.056385 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1020/2040] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:58 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:59.068038 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-62054c45-a9a7-4e86-9927-ac020a6111e1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:59.070170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-62054c45-a9a7-4e86-9927-ac020a6111e1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:59.076699 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62054c45-a9a7-4e86-9927-ac020a6111e1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:59.077180 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62054c45-a9a7-4e86-9927-ac020a6111e1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:59.077616 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62054c45-a9a7-4e86-9927-ac020a6111e1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:59.078297 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62054c45-a9a7-4e86-9927-ac020a6111e1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:59.078795 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62054c45-a9a7-4e86-9927-ac020a6111e1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:59.079216 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62054c45-a9a7-4e86-9927-ac020a6111e1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:59.108605 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-62054c45-a9a7-4e86-9927-ac020a6111e1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044540 Aug 24 12:46:59.109141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1021/2041] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:46:59 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:00.121569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ad12dcb9-d0f1-419d-b433-86826d9ca58d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:00.123735 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ad12dcb9-d0f1-419d-b433-86826d9ca58d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:00.130816 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad12dcb9-d0f1-419d-b433-86826d9ca58d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:00.131299 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad12dcb9-d0f1-419d-b433-86826d9ca58d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:00.131742 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad12dcb9-d0f1-419d-b433-86826d9ca58d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:00.132431 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad12dcb9-d0f1-419d-b433-86826d9ca58d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:00.132894 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad12dcb9-d0f1-419d-b433-86826d9ca58d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:00.133321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad12dcb9-d0f1-419d-b433-86826d9ca58d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:00.161824 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ad12dcb9-d0f1-419d-b433-86826d9ca58d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043772 Aug 24 12:47:00.162359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1021/2042] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:00 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:01.174559 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cdb35a60-a4ba-4802-9f82-add01a335006 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:01.176731 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cdb35a60-a4ba-4802-9f82-add01a335006 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:01.183019 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cdb35a60-a4ba-4802-9f82-add01a335006 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:01.183493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cdb35a60-a4ba-4802-9f82-add01a335006 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:01.183941 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cdb35a60-a4ba-4802-9f82-add01a335006 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:01.184617 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cdb35a60-a4ba-4802-9f82-add01a335006 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:01.185061 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cdb35a60-a4ba-4802-9f82-add01a335006 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:01.185485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cdb35a60-a4ba-4802-9f82-add01a335006 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:01.214735 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cdb35a60-a4ba-4802-9f82-add01a335006 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044098 Aug 24 12:47:01.215274 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1022/2043] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:01 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:02.227189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7355d024-fe06-495d-becd-38f2fa48a05c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:02.229336 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7355d024-fe06-495d-becd-38f2fa48a05c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:02.235794 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7355d024-fe06-495d-becd-38f2fa48a05c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:02.236285 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7355d024-fe06-495d-becd-38f2fa48a05c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:02.236724 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7355d024-fe06-495d-becd-38f2fa48a05c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:02.237414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7355d024-fe06-495d-becd-38f2fa48a05c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:02.237870 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7355d024-fe06-495d-becd-38f2fa48a05c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:02.238560 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7355d024-fe06-495d-becd-38f2fa48a05c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:02.268175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7355d024-fe06-495d-becd-38f2fa48a05c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044858 Aug 24 12:47:02.268643 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1022/2044] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:02 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:03.280357 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a01ccfff-9436-4070-a3f6-df3994f0f6a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:03.282463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a01ccfff-9436-4070-a3f6-df3994f0f6a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:03.288769 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a01ccfff-9436-4070-a3f6-df3994f0f6a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:03.289245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a01ccfff-9436-4070-a3f6-df3994f0f6a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:03.289680 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a01ccfff-9436-4070-a3f6-df3994f0f6a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:03.290359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a01ccfff-9436-4070-a3f6-df3994f0f6a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:03.290846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a01ccfff-9436-4070-a3f6-df3994f0f6a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:03.291271 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a01ccfff-9436-4070-a3f6-df3994f0f6a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:03.319929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a01ccfff-9436-4070-a3f6-df3994f0f6a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042994 Aug 24 12:47:03.320461 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1023/2045] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:03 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:04.332821 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c36d13d1-0e56-4a91-a8b1-7d76fe54d91d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:04.335615 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c36d13d1-0e56-4a91-a8b1-7d76fe54d91d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:04.342209 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c36d13d1-0e56-4a91-a8b1-7d76fe54d91d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:04.342717 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c36d13d1-0e56-4a91-a8b1-7d76fe54d91d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:04.343154 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c36d13d1-0e56-4a91-a8b1-7d76fe54d91d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:04.343842 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c36d13d1-0e56-4a91-a8b1-7d76fe54d91d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:04.344291 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c36d13d1-0e56-4a91-a8b1-7d76fe54d91d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:04.344738 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c36d13d1-0e56-4a91-a8b1-7d76fe54d91d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:04.373471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c36d13d1-0e56-4a91-a8b1-7d76fe54d91d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045293 Aug 24 12:47:04.373998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1023/2046] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:04 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:05.386382 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1f8db966-a60b-4efa-9eb4-cc567309b143 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:05.388626 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1f8db966-a60b-4efa-9eb4-cc567309b143 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:05.394877 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1f8db966-a60b-4efa-9eb4-cc567309b143 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:05.395349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1f8db966-a60b-4efa-9eb4-cc567309b143 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:05.395780 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1f8db966-a60b-4efa-9eb4-cc567309b143 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:05.396464 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1f8db966-a60b-4efa-9eb4-cc567309b143 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:05.396904 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1f8db966-a60b-4efa-9eb4-cc567309b143 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:05.397905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1f8db966-a60b-4efa-9eb4-cc567309b143 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:05.427479 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1f8db966-a60b-4efa-9eb4-cc567309b143 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045648 Aug 24 12:47:05.428330 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1024/2047] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:05 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:06.439061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c76b6c12-9d59-49d3-9892-6b5d550d8c83 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:06.441326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c76b6c12-9d59-49d3-9892-6b5d550d8c83 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:06.448084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c76b6c12-9d59-49d3-9892-6b5d550d8c83 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:06.448599 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c76b6c12-9d59-49d3-9892-6b5d550d8c83 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:06.449063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c76b6c12-9d59-49d3-9892-6b5d550d8c83 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:06.449803 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c76b6c12-9d59-49d3-9892-6b5d550d8c83 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:06.450278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c76b6c12-9d59-49d3-9892-6b5d550d8c83 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:06.450786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c76b6c12-9d59-49d3-9892-6b5d550d8c83 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:06.482502 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c76b6c12-9d59-49d3-9892-6b5d550d8c83 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047586 Aug 24 12:47:06.483085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1024/2048] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:06 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:07.495578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-43971018-6a6d-4673-b0a8-48dde1fd62a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:07.497693 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-43971018-6a6d-4673-b0a8-48dde1fd62a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:07.504075 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43971018-6a6d-4673-b0a8-48dde1fd62a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:07.504547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43971018-6a6d-4673-b0a8-48dde1fd62a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:07.504978 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43971018-6a6d-4673-b0a8-48dde1fd62a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:07.505655 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43971018-6a6d-4673-b0a8-48dde1fd62a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:07.506101 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43971018-6a6d-4673-b0a8-48dde1fd62a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:07.506521 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-43971018-6a6d-4673-b0a8-48dde1fd62a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:07.535107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-43971018-6a6d-4673-b0a8-48dde1fd62a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044038 Aug 24 12:47:07.535636 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1025/2049] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:07 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:07.735926 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:47:07.736094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 12:47:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:47:08.547285 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b1848027-6806-48a7-9954-1f21c6d681ce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:08.549427 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b1848027-6806-48a7-9954-1f21c6d681ce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:08.555851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1848027-6806-48a7-9954-1f21c6d681ce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:08.556337 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1848027-6806-48a7-9954-1f21c6d681ce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:08.556779 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1848027-6806-48a7-9954-1f21c6d681ce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:08.557481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1848027-6806-48a7-9954-1f21c6d681ce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:08.557944 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1848027-6806-48a7-9954-1f21c6d681ce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:08.558373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1848027-6806-48a7-9954-1f21c6d681ce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:08.588421 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b1848027-6806-48a7-9954-1f21c6d681ce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045024 Aug 24 12:47:08.589636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1025/2050] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:08 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:09.601153 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-91f92a53-a3cc-45d3-a010-a6c66d92fcf1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:09.603319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-91f92a53-a3cc-45d3-a010-a6c66d92fcf1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:09.609540 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91f92a53-a3cc-45d3-a010-a6c66d92fcf1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:09.610011 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91f92a53-a3cc-45d3-a010-a6c66d92fcf1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:09.610441 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91f92a53-a3cc-45d3-a010-a6c66d92fcf1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:09.611141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91f92a53-a3cc-45d3-a010-a6c66d92fcf1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:09.611587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91f92a53-a3cc-45d3-a010-a6c66d92fcf1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:09.612004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91f92a53-a3cc-45d3-a010-a6c66d92fcf1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:09.643693 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-91f92a53-a3cc-45d3-a010-a6c66d92fcf1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046383 Aug 24 12:47:09.644457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1026/2051] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:09 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:10.656209 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-af6d7682-e8a1-4a4e-9709-866110b7db29 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:10.658329 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-af6d7682-e8a1-4a4e-9709-866110b7db29 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:10.660742 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=30 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:47:10.665348 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af6d7682-e8a1-4a4e-9709-866110b7db29 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:10.665826 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af6d7682-e8a1-4a4e-9709-866110b7db29 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:10.666259 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af6d7682-e8a1-4a4e-9709-866110b7db29 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:10.666963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af6d7682-e8a1-4a4e-9709-866110b7db29 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:10.667416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af6d7682-e8a1-4a4e-9709-866110b7db29 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:10.667836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af6d7682-e8a1-4a4e-9709-866110b7db29 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:10.696091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-af6d7682-e8a1-4a4e-9709-866110b7db29 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043766 Aug 24 12:47:10.696549 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1026/2052] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:10 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:11.708719 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-13d83a38-fbfd-4afc-9409-fa9d6b52fd96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:11.710770 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-13d83a38-fbfd-4afc-9409-fa9d6b52fd96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:11.717553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-13d83a38-fbfd-4afc-9409-fa9d6b52fd96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:11.718024 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-13d83a38-fbfd-4afc-9409-fa9d6b52fd96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:11.718458 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-13d83a38-fbfd-4afc-9409-fa9d6b52fd96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:11.719186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-13d83a38-fbfd-4afc-9409-fa9d6b52fd96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:11.719637 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-13d83a38-fbfd-4afc-9409-fa9d6b52fd96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:11.720091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-13d83a38-fbfd-4afc-9409-fa9d6b52fd96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:11.749692 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-13d83a38-fbfd-4afc-9409-fa9d6b52fd96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045002 Aug 24 12:47:11.750225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1027/2053] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:11 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:12.762744 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0f4f5393-b809-4c2e-874d-47110f4353b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:12.764981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0f4f5393-b809-4c2e-874d-47110f4353b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:12.771573 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f4f5393-b809-4c2e-874d-47110f4353b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:12.780119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f4f5393-b809-4c2e-874d-47110f4353b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:12.780119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f4f5393-b809-4c2e-874d-47110f4353b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:12.780119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f4f5393-b809-4c2e-874d-47110f4353b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:12.780119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f4f5393-b809-4c2e-874d-47110f4353b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:12.780534 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f4f5393-b809-4c2e-874d-47110f4353b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:12.803187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0f4f5393-b809-4c2e-874d-47110f4353b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045350 Aug 24 12:47:12.806390 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1027/2054] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:12 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:13.816465 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-94180da6-465b-474d-a392-1879e112dcb3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:13.818592 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-94180da6-465b-474d-a392-1879e112dcb3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:13.825492 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94180da6-465b-474d-a392-1879e112dcb3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:13.825967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94180da6-465b-474d-a392-1879e112dcb3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:13.826397 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94180da6-465b-474d-a392-1879e112dcb3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:13.827107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94180da6-465b-474d-a392-1879e112dcb3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:13.827584 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94180da6-465b-474d-a392-1879e112dcb3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:13.828004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94180da6-465b-474d-a392-1879e112dcb3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:13.856624 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-94180da6-465b-474d-a392-1879e112dcb3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044125 Aug 24 12:47:13.857162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1028/2055] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:13 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:14.868689 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3707448f-6862-4de6-a692-685dd3c8270b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:14.871450 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3707448f-6862-4de6-a692-685dd3c8270b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:14.877762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3707448f-6862-4de6-a692-685dd3c8270b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:14.878245 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3707448f-6862-4de6-a692-685dd3c8270b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:14.878702 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3707448f-6862-4de6-a692-685dd3c8270b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:14.879392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3707448f-6862-4de6-a692-685dd3c8270b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:14.879850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3707448f-6862-4de6-a692-685dd3c8270b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:14.880279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3707448f-6862-4de6-a692-685dd3c8270b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:14.909003 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3707448f-6862-4de6-a692-685dd3c8270b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044229 Aug 24 12:47:14.909536 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1028/2056] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:14 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:15.921108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b8e4ce5e-41c4-40f4-be35-274f2d607d7e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:15.923323 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b8e4ce5e-41c4-40f4-be35-274f2d607d7e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:15.929346 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8e4ce5e-41c4-40f4-be35-274f2d607d7e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:15.929839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8e4ce5e-41c4-40f4-be35-274f2d607d7e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:15.930272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8e4ce5e-41c4-40f4-be35-274f2d607d7e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:15.931010 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8e4ce5e-41c4-40f4-be35-274f2d607d7e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:15.931465 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8e4ce5e-41c4-40f4-be35-274f2d607d7e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:15.931886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b8e4ce5e-41c4-40f4-be35-274f2d607d7e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:15.960736 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b8e4ce5e-41c4-40f4-be35-274f2d607d7e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043576 Aug 24 12:47:15.961284 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1029/2057] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:15 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:16.973575 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6932b594-580a-426f-a8f1-c9fd9fa484f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:16.975768 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6932b594-580a-426f-a8f1-c9fd9fa484f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:16.982602 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6932b594-580a-426f-a8f1-c9fd9fa484f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:16.983118 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6932b594-580a-426f-a8f1-c9fd9fa484f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:16.983552 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6932b594-580a-426f-a8f1-c9fd9fa484f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:16.984231 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6932b594-580a-426f-a8f1-c9fd9fa484f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:16.984681 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6932b594-580a-426f-a8f1-c9fd9fa484f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:16.985101 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6932b594-580a-426f-a8f1-c9fd9fa484f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:17.014608 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6932b594-580a-426f-a8f1-c9fd9fa484f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044997 Aug 24 12:47:17.015166 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1029/2058] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:16 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:18.026468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-18a8f4a5-770e-4c75-9948-ea6b92c0c18f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:18.028626 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-18a8f4a5-770e-4c75-9948-ea6b92c0c18f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:18.031009 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=32 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:47:18.035806 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18a8f4a5-770e-4c75-9948-ea6b92c0c18f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:18.036285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18a8f4a5-770e-4c75-9948-ea6b92c0c18f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:18.036726 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18a8f4a5-770e-4c75-9948-ea6b92c0c18f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:18.037416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18a8f4a5-770e-4c75-9948-ea6b92c0c18f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:18.037871 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18a8f4a5-770e-4c75-9948-ea6b92c0c18f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:18.038295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18a8f4a5-770e-4c75-9948-ea6b92c0c18f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:18.067759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-18a8f4a5-770e-4c75-9948-ea6b92c0c18f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045277 Aug 24 12:47:18.068298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1030/2059] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:18 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:19.080138 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-76e4ccab-17d7-4a62-a577-c8753daa4db3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:19.082264 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-76e4ccab-17d7-4a62-a577-c8753daa4db3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:19.088678 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-76e4ccab-17d7-4a62-a577-c8753daa4db3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:19.089154 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-76e4ccab-17d7-4a62-a577-c8753daa4db3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:19.089585 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-76e4ccab-17d7-4a62-a577-c8753daa4db3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:19.090264 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-76e4ccab-17d7-4a62-a577-c8753daa4db3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:19.090745 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-76e4ccab-17d7-4a62-a577-c8753daa4db3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:19.091165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-76e4ccab-17d7-4a62-a577-c8753daa4db3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:19.093505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=96 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:47:19.121447 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-76e4ccab-17d7-4a62-a577-c8753daa4db3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045286 Aug 24 12:47:19.121984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1030/2060] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:19 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:20.133499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7abc68f8-bbfd-4f1c-b476-b5748ace33a9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:20.135683 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7abc68f8-bbfd-4f1c-b476-b5748ace33a9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:20.142212 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7abc68f8-bbfd-4f1c-b476-b5748ace33a9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:20.142719 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7abc68f8-bbfd-4f1c-b476-b5748ace33a9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:20.143161 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7abc68f8-bbfd-4f1c-b476-b5748ace33a9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:20.143850 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7abc68f8-bbfd-4f1c-b476-b5748ace33a9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:20.144303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7abc68f8-bbfd-4f1c-b476-b5748ace33a9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:20.144732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7abc68f8-bbfd-4f1c-b476-b5748ace33a9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:20.148267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=96 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:47:20.174145 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7abc68f8-bbfd-4f1c-b476-b5748ace33a9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044607 Aug 24 12:47:20.174699 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1031/2061] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:20 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:21.187321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-363951b2-c53f-4ecb-81b3-ca60eb06d79f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:21.189478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-363951b2-c53f-4ecb-81b3-ca60eb06d79f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:21.196095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-363951b2-c53f-4ecb-81b3-ca60eb06d79f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:21.196586 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-363951b2-c53f-4ecb-81b3-ca60eb06d79f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:21.197024 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-363951b2-c53f-4ecb-81b3-ca60eb06d79f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:21.197712 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-363951b2-c53f-4ecb-81b3-ca60eb06d79f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:21.198171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-363951b2-c53f-4ecb-81b3-ca60eb06d79f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:21.198600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-363951b2-c53f-4ecb-81b3-ca60eb06d79f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:21.226925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-363951b2-c53f-4ecb-81b3-ca60eb06d79f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043972 Aug 24 12:47:21.227479 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1031/2062] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:21 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:22.240275 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9d0dcb5f-d656-4a86-b9f4-99ebcb420e65 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:22.242407 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9d0dcb5f-d656-4a86-b9f4-99ebcb420e65 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:22.249024 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9d0dcb5f-d656-4a86-b9f4-99ebcb420e65 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:22.249491 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9d0dcb5f-d656-4a86-b9f4-99ebcb420e65 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:22.249918 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9d0dcb5f-d656-4a86-b9f4-99ebcb420e65 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:22.250585 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9d0dcb5f-d656-4a86-b9f4-99ebcb420e65 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:22.251054 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9d0dcb5f-d656-4a86-b9f4-99ebcb420e65 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:22.251470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9d0dcb5f-d656-4a86-b9f4-99ebcb420e65 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:22.280114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9d0dcb5f-d656-4a86-b9f4-99ebcb420e65 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044301 Aug 24 12:47:22.280580 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1032/2063] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:22 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:23.292221 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b111e9c4-465e-48b6-8d22-a67610b82f77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:23.294384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b111e9c4-465e-48b6-8d22-a67610b82f77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:23.300685 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b111e9c4-465e-48b6-8d22-a67610b82f77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:23.301163 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b111e9c4-465e-48b6-8d22-a67610b82f77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:23.301593 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b111e9c4-465e-48b6-8d22-a67610b82f77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:23.302290 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b111e9c4-465e-48b6-8d22-a67610b82f77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:23.302755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b111e9c4-465e-48b6-8d22-a67610b82f77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:23.303174 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b111e9c4-465e-48b6-8d22-a67610b82f77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:23.331379 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b111e9c4-465e-48b6-8d22-a67610b82f77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043086 Aug 24 12:47:23.331914 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1032/2064] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:23 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:24.343598 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-35f6f3dd-ff1d-4f61-95ae-5ac255e235b1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:24.345650 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-35f6f3dd-ff1d-4f61-95ae-5ac255e235b1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:24.351963 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-35f6f3dd-ff1d-4f61-95ae-5ac255e235b1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:24.352434 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-35f6f3dd-ff1d-4f61-95ae-5ac255e235b1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:24.352864 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-35f6f3dd-ff1d-4f61-95ae-5ac255e235b1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:24.354049 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-35f6f3dd-ff1d-4f61-95ae-5ac255e235b1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:24.354494 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-35f6f3dd-ff1d-4f61-95ae-5ac255e235b1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:24.354939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-35f6f3dd-ff1d-4f61-95ae-5ac255e235b1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:24.386856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-35f6f3dd-ff1d-4f61-95ae-5ac255e235b1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047221 Aug 24 12:47:24.387406 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1033/2065] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:24 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:25.398922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-70cfc19c-a3e1-47f8-bf45-7e167e744f7c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:25.401042 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-70cfc19c-a3e1-47f8-bf45-7e167e744f7c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:25.407383 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70cfc19c-a3e1-47f8-bf45-7e167e744f7c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:25.407959 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70cfc19c-a3e1-47f8-bf45-7e167e744f7c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:25.408431 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70cfc19c-a3e1-47f8-bf45-7e167e744f7c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:25.409111 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70cfc19c-a3e1-47f8-bf45-7e167e744f7c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:25.409566 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70cfc19c-a3e1-47f8-bf45-7e167e744f7c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:25.409990 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70cfc19c-a3e1-47f8-bf45-7e167e744f7c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:25.439170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-70cfc19c-a3e1-47f8-bf45-7e167e744f7c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044137 Aug 24 12:47:25.439708 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1033/2066] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:25 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:26.451349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4b8d98af-0d97-4442-b3b9-8f28a25f5c22 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:26.453486 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4b8d98af-0d97-4442-b3b9-8f28a25f5c22 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:26.459791 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b8d98af-0d97-4442-b3b9-8f28a25f5c22 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:26.460264 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b8d98af-0d97-4442-b3b9-8f28a25f5c22 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:26.460698 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b8d98af-0d97-4442-b3b9-8f28a25f5c22 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:26.461374 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b8d98af-0d97-4442-b3b9-8f28a25f5c22 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:26.461815 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b8d98af-0d97-4442-b3b9-8f28a25f5c22 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:26.462231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b8d98af-0d97-4442-b3b9-8f28a25f5c22 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:26.490688 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4b8d98af-0d97-4442-b3b9-8f28a25f5c22 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043298 Aug 24 12:47:26.491209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1034/2067] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:26 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:27.503197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-de3e7739-9424-44a1-8896-b330c1e879ae tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:27.505336 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-de3e7739-9424-44a1-8896-b330c1e879ae tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:27.512276 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de3e7739-9424-44a1-8896-b330c1e879ae tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:27.512742 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de3e7739-9424-44a1-8896-b330c1e879ae tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:27.513179 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de3e7739-9424-44a1-8896-b330c1e879ae tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:27.513866 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de3e7739-9424-44a1-8896-b330c1e879ae tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:27.514321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de3e7739-9424-44a1-8896-b330c1e879ae tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:27.514783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de3e7739-9424-44a1-8896-b330c1e879ae tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:27.542792 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-de3e7739-9424-44a1-8896-b330c1e879ae tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043510 Aug 24 12:47:27.543323 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1034/2068] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:27 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:28.553813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5aaac31b-80ab-4064-adf1-ac159abc5651 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:28.555989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5aaac31b-80ab-4064-adf1-ac159abc5651 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:28.563056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5aaac31b-80ab-4064-adf1-ac159abc5651 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:28.563529 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5aaac31b-80ab-4064-adf1-ac159abc5651 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:28.563959 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5aaac31b-80ab-4064-adf1-ac159abc5651 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:28.564640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5aaac31b-80ab-4064-adf1-ac159abc5651 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:28.565081 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5aaac31b-80ab-4064-adf1-ac159abc5651 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:28.565499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5aaac31b-80ab-4064-adf1-ac159abc5651 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:28.593181 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5aaac31b-80ab-4064-adf1-ac159abc5651 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043270 Aug 24 12:47:28.593713 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1035/2069] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:28 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:29.605452 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-cd367170-f143-48bb-8a24-c319af3d4194 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:29.607583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-cd367170-f143-48bb-8a24-c319af3d4194 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:29.614076 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd367170-f143-48bb-8a24-c319af3d4194 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:29.614551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd367170-f143-48bb-8a24-c319af3d4194 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:29.615005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd367170-f143-48bb-8a24-c319af3d4194 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:29.615679 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd367170-f143-48bb-8a24-c319af3d4194 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:29.616126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd367170-f143-48bb-8a24-c319af3d4194 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:29.616544 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd367170-f143-48bb-8a24-c319af3d4194 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:29.645872 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-cd367170-f143-48bb-8a24-c319af3d4194 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044519 Aug 24 12:47:29.646442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1035/2070] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:29 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:30.658273 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2fca8f34-d304-4080-9c0b-4cfbca23d181 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:30.660442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2fca8f34-d304-4080-9c0b-4cfbca23d181 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:30.666805 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2fca8f34-d304-4080-9c0b-4cfbca23d181 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:30.667283 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2fca8f34-d304-4080-9c0b-4cfbca23d181 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:30.667710 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2fca8f34-d304-4080-9c0b-4cfbca23d181 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:30.668384 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2fca8f34-d304-4080-9c0b-4cfbca23d181 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:30.668827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2fca8f34-d304-4080-9c0b-4cfbca23d181 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:30.669243 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2fca8f34-d304-4080-9c0b-4cfbca23d181 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:30.698139 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2fca8f34-d304-4080-9c0b-4cfbca23d181 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043850 Aug 24 12:47:30.698690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1036/2071] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:30 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:31.710172 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-29e4caff-fdb2-4a7c-ab96-182baae057c6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:31.712340 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-29e4caff-fdb2-4a7c-ab96-182baae057c6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:31.719366 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29e4caff-fdb2-4a7c-ab96-182baae057c6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:31.719841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29e4caff-fdb2-4a7c-ab96-182baae057c6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:31.720270 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29e4caff-fdb2-4a7c-ab96-182baae057c6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:31.720989 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29e4caff-fdb2-4a7c-ab96-182baae057c6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:31.721437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29e4caff-fdb2-4a7c-ab96-182baae057c6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:31.721858 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29e4caff-fdb2-4a7c-ab96-182baae057c6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:31.750549 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-29e4caff-fdb2-4a7c-ab96-182baae057c6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044237 Aug 24 12:47:31.751144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1036/2072] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:31 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:32.762443 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-08956a23-ff0c-4e88-bf56-d77a8fc5b541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:32.764613 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-08956a23-ff0c-4e88-bf56-d77a8fc5b541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:32.770986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-08956a23-ff0c-4e88-bf56-d77a8fc5b541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:32.771466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-08956a23-ff0c-4e88-bf56-d77a8fc5b541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:32.771899 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-08956a23-ff0c-4e88-bf56-d77a8fc5b541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:32.772587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-08956a23-ff0c-4e88-bf56-d77a8fc5b541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:32.773039 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-08956a23-ff0c-4e88-bf56-d77a8fc5b541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:32.773467 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-08956a23-ff0c-4e88-bf56-d77a8fc5b541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:32.803012 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-08956a23-ff0c-4e88-bf56-d77a8fc5b541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044438 Aug 24 12:47:32.803556 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1037/2073] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:32 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:33.814289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e0ef2b5a-09a4-4153-b63a-67fb3d3c6d14 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:33.816610 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e0ef2b5a-09a4-4153-b63a-67fb3d3c6d14 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:33.822961 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0ef2b5a-09a4-4153-b63a-67fb3d3c6d14 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:33.823435 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0ef2b5a-09a4-4153-b63a-67fb3d3c6d14 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:33.823863 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0ef2b5a-09a4-4153-b63a-67fb3d3c6d14 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:33.824538 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0ef2b5a-09a4-4153-b63a-67fb3d3c6d14 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:33.824984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0ef2b5a-09a4-4153-b63a-67fb3d3c6d14 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:33.825400 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0ef2b5a-09a4-4153-b63a-67fb3d3c6d14 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:33.853238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e0ef2b5a-09a4-4153-b63a-67fb3d3c6d14 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042897 Aug 24 12:47:33.854282 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1037/2074] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:33 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:34.866158 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8c624826-9658-4245-868a-0281d345d32c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:34.868329 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8c624826-9658-4245-868a-0281d345d32c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:34.875109 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c624826-9658-4245-868a-0281d345d32c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:34.875591 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c624826-9658-4245-868a-0281d345d32c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:34.876027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c624826-9658-4245-868a-0281d345d32c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:34.876706 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c624826-9658-4245-868a-0281d345d32c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:34.877158 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c624826-9658-4245-868a-0281d345d32c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:34.877586 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c624826-9658-4245-868a-0281d345d32c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:34.906714 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8c624826-9658-4245-868a-0281d345d32c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044722 Aug 24 12:47:34.907250 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1038/2075] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:34 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:35.919011 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0c267a36-b8f1-4c21-95db-68cfe4eabefd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:35.921284 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0c267a36-b8f1-4c21-95db-68cfe4eabefd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:35.927597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0c267a36-b8f1-4c21-95db-68cfe4eabefd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:35.928079 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0c267a36-b8f1-4c21-95db-68cfe4eabefd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:35.928519 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0c267a36-b8f1-4c21-95db-68cfe4eabefd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:35.929206 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0c267a36-b8f1-4c21-95db-68cfe4eabefd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:35.929691 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0c267a36-b8f1-4c21-95db-68cfe4eabefd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:35.930114 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0c267a36-b8f1-4c21-95db-68cfe4eabefd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:35.959198 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0c267a36-b8f1-4c21-95db-68cfe4eabefd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044153 Aug 24 12:47:35.959750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1038/2076] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:35 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:36.971910 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a139b4dc-1269-477e-91d0-f59baf1d0dbe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:36.974041 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a139b4dc-1269-477e-91d0-f59baf1d0dbe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:36.980941 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a139b4dc-1269-477e-91d0-f59baf1d0dbe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:36.981421 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a139b4dc-1269-477e-91d0-f59baf1d0dbe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:36.981857 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a139b4dc-1269-477e-91d0-f59baf1d0dbe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:36.982549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a139b4dc-1269-477e-91d0-f59baf1d0dbe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:36.983026 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a139b4dc-1269-477e-91d0-f59baf1d0dbe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:36.983451 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a139b4dc-1269-477e-91d0-f59baf1d0dbe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:37.011331 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a139b4dc-1269-477e-91d0-f59baf1d0dbe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043337 Aug 24 12:47:37.011860 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1039/2077] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:36 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:38.023740 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b1cdd283-7a4c-4a33-82e8-9474702a7bbe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:38.025694 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b1cdd283-7a4c-4a33-82e8-9474702a7bbe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:38.031798 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1cdd283-7a4c-4a33-82e8-9474702a7bbe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:38.032279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1cdd283-7a4c-4a33-82e8-9474702a7bbe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:38.032712 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1cdd283-7a4c-4a33-82e8-9474702a7bbe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:38.033399 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1cdd283-7a4c-4a33-82e8-9474702a7bbe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:38.033850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1cdd283-7a4c-4a33-82e8-9474702a7bbe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:38.034272 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1cdd283-7a4c-4a33-82e8-9474702a7bbe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:38.062264 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b1cdd283-7a4c-4a33-82e8-9474702a7bbe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042701 Aug 24 12:47:38.062817 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1039/2078] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:38 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:39.074412 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e2e52642-6485-4fc6-a14e-eb48051880f2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:39.076594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e2e52642-6485-4fc6-a14e-eb48051880f2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:39.083032 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2e52642-6485-4fc6-a14e-eb48051880f2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:39.083510 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2e52642-6485-4fc6-a14e-eb48051880f2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:39.083949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2e52642-6485-4fc6-a14e-eb48051880f2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:39.084632 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2e52642-6485-4fc6-a14e-eb48051880f2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:39.085084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2e52642-6485-4fc6-a14e-eb48051880f2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:39.085510 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2e52642-6485-4fc6-a14e-eb48051880f2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:39.114155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e2e52642-6485-4fc6-a14e-eb48051880f2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043749 Aug 24 12:47:39.114709 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1040/2079] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:39 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:40.126178 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c47b019c-8031-40b0-88e6-7661d0fd269e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:40.128309 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c47b019c-8031-40b0-88e6-7661d0fd269e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:40.134642 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c47b019c-8031-40b0-88e6-7661d0fd269e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:40.135145 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c47b019c-8031-40b0-88e6-7661d0fd269e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:40.135579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c47b019c-8031-40b0-88e6-7661d0fd269e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:40.136250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c47b019c-8031-40b0-88e6-7661d0fd269e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:40.136702 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c47b019c-8031-40b0-88e6-7661d0fd269e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:40.137122 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c47b019c-8031-40b0-88e6-7661d0fd269e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:40.165357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c47b019c-8031-40b0-88e6-7661d0fd269e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043164 Aug 24 12:47:40.166694 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1040/2080] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:40 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:41.177410 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5a68dcca-0e04-4dff-be4f-86ff4c39f8ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:41.179476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5a68dcca-0e04-4dff-be4f-86ff4c39f8ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:41.186257 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5a68dcca-0e04-4dff-be4f-86ff4c39f8ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:41.186773 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5a68dcca-0e04-4dff-be4f-86ff4c39f8ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:41.187206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5a68dcca-0e04-4dff-be4f-86ff4c39f8ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:41.187886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5a68dcca-0e04-4dff-be4f-86ff4c39f8ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:41.188336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5a68dcca-0e04-4dff-be4f-86ff4c39f8ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:41.188755 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5a68dcca-0e04-4dff-be4f-86ff4c39f8ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:41.217225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5a68dcca-0e04-4dff-be4f-86ff4c39f8ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043831 Aug 24 12:47:41.217759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1041/2081] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:41 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:42.229365 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ac234dd3-66fe-497e-bf50-9f7d9df59711 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:42.231426 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ac234dd3-66fe-497e-bf50-9f7d9df59711 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:42.237765 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac234dd3-66fe-497e-bf50-9f7d9df59711 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:42.238496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac234dd3-66fe-497e-bf50-9f7d9df59711 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:42.238962 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac234dd3-66fe-497e-bf50-9f7d9df59711 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:42.239644 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac234dd3-66fe-497e-bf50-9f7d9df59711 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:42.240090 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac234dd3-66fe-497e-bf50-9f7d9df59711 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:42.240506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac234dd3-66fe-497e-bf50-9f7d9df59711 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:42.269354 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ac234dd3-66fe-497e-bf50-9f7d9df59711 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044156 Aug 24 12:47:42.269886 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1041/2082] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:42 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:43.282116 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a5a63bbb-53dd-4e9a-b444-c8a7fbd00c5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:43.284191 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a5a63bbb-53dd-4e9a-b444-c8a7fbd00c5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:43.290490 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5a63bbb-53dd-4e9a-b444-c8a7fbd00c5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:43.291670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5a63bbb-53dd-4e9a-b444-c8a7fbd00c5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:43.292098 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5a63bbb-53dd-4e9a-b444-c8a7fbd00c5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:43.292776 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5a63bbb-53dd-4e9a-b444-c8a7fbd00c5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:43.293227 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5a63bbb-53dd-4e9a-b444-c8a7fbd00c5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:43.293642 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5a63bbb-53dd-4e9a-b444-c8a7fbd00c5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:43.321425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a5a63bbb-53dd-4e9a-b444-c8a7fbd00c5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043410 Aug 24 12:47:43.321957 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1042/2083] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:43 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:44.333460 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-18e41a96-f596-46e7-8d3f-09c3ace4e18e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:44.335648 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-18e41a96-f596-46e7-8d3f-09c3ace4e18e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:44.337897 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=32 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:47:44.342572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-18e41a96-f596-46e7-8d3f-09c3ace4e18e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:44.348087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-18e41a96-f596-46e7-8d3f-09c3ace4e18e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:44.348087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-18e41a96-f596-46e7-8d3f-09c3ace4e18e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:44.348087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-18e41a96-f596-46e7-8d3f-09c3ace4e18e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:44.348087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-18e41a96-f596-46e7-8d3f-09c3ace4e18e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:44.348468 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-18e41a96-f596-46e7-8d3f-09c3ace4e18e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:44.375177 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-18e41a96-f596-46e7-8d3f-09c3ace4e18e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045670 Aug 24 12:47:44.375718 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1042/2084] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:44 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:47:45.387888 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c1e41383-09d8-48ee-b523-f038f6be5c6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:45.389950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c1e41383-09d8-48ee-b523-f038f6be5c6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:45.396222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1e41383-09d8-48ee-b523-f038f6be5c6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:45.396695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1e41383-09d8-48ee-b523-f038f6be5c6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:45.397123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1e41383-09d8-48ee-b523-f038f6be5c6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:45.397799 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1e41383-09d8-48ee-b523-f038f6be5c6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:45.398246 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1e41383-09d8-48ee-b523-f038f6be5c6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:45.398682 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c1e41383-09d8-48ee-b523-f038f6be5c6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:45.427648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c1e41383-09d8-48ee-b523-f038f6be5c6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044319 Aug 24 12:47:45.428361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1043/2085] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:45 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:46.440549 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-49dbe742-8507-4a29-b52e-74192224e111 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:46.442752 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-49dbe742-8507-4a29-b52e-74192224e111 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:46.450255 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49dbe742-8507-4a29-b52e-74192224e111 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:46.450690 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49dbe742-8507-4a29-b52e-74192224e111 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:46.451135 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49dbe742-8507-4a29-b52e-74192224e111 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:46.451835 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49dbe742-8507-4a29-b52e-74192224e111 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:46.452290 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49dbe742-8507-4a29-b52e-74192224e111 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:46.452711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49dbe742-8507-4a29-b52e-74192224e111 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:46.481252 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-49dbe742-8507-4a29-b52e-74192224e111 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044709 Aug 24 12:47:46.481793 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1043/2086] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:46 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:47.493244 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ca35a8f1-6a05-47d1-8b8d-9d71caee6c30 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:47.495449 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ca35a8f1-6a05-47d1-8b8d-9d71caee6c30 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:47.501460 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca35a8f1-6a05-47d1-8b8d-9d71caee6c30 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:47.501944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca35a8f1-6a05-47d1-8b8d-9d71caee6c30 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:47.502407 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca35a8f1-6a05-47d1-8b8d-9d71caee6c30 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:47.503117 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca35a8f1-6a05-47d1-8b8d-9d71caee6c30 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:47.503566 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca35a8f1-6a05-47d1-8b8d-9d71caee6c30 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:47.503984 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca35a8f1-6a05-47d1-8b8d-9d71caee6c30 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:47.532898 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ca35a8f1-6a05-47d1-8b8d-9d71caee6c30 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043598 Aug 24 12:47:47.533451 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1044/2087] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:47 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:48.545148 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1e6d07ba-3957-4b60-b1cb-236eba861060 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:48.547237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1e6d07ba-3957-4b60-b1cb-236eba861060 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:48.553667 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e6d07ba-3957-4b60-b1cb-236eba861060 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:48.554144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e6d07ba-3957-4b60-b1cb-236eba861060 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:48.554578 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e6d07ba-3957-4b60-b1cb-236eba861060 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:48.555335 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e6d07ba-3957-4b60-b1cb-236eba861060 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:48.555785 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e6d07ba-3957-4b60-b1cb-236eba861060 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:48.556723 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e6d07ba-3957-4b60-b1cb-236eba861060 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:48.585489 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1e6d07ba-3957-4b60-b1cb-236eba861060 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044460 Aug 24 12:47:48.586027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1044/2088] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:48 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:49.597524 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4cc1265b-ecff-4842-be78-aa106fb466ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:49.599680 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4cc1265b-ecff-4842-be78-aa106fb466ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:49.606047 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4cc1265b-ecff-4842-be78-aa106fb466ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:49.606521 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4cc1265b-ecff-4842-be78-aa106fb466ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:49.606995 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4cc1265b-ecff-4842-be78-aa106fb466ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:49.607669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4cc1265b-ecff-4842-be78-aa106fb466ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:49.608114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4cc1265b-ecff-4842-be78-aa106fb466ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:49.608548 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4cc1265b-ecff-4842-be78-aa106fb466ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:49.637071 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4cc1265b-ecff-4842-be78-aa106fb466ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043500 Aug 24 12:47:49.637606 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1045/2089] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:49 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:50.649308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8e30e526-906d-4d93-b877-71c2b38c4855 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:50.651451 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8e30e526-906d-4d93-b877-71c2b38c4855 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:50.657662 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8e30e526-906d-4d93-b877-71c2b38c4855 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:50.658139 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8e30e526-906d-4d93-b877-71c2b38c4855 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:50.658571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8e30e526-906d-4d93-b877-71c2b38c4855 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:50.659273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8e30e526-906d-4d93-b877-71c2b38c4855 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:50.659723 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8e30e526-906d-4d93-b877-71c2b38c4855 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:50.660143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8e30e526-906d-4d93-b877-71c2b38c4855 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:50.689991 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8e30e526-906d-4d93-b877-71c2b38c4855 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044570 Aug 24 12:47:50.690539 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1045/2090] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:50 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:51.702142 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0673836e-6671-466d-b9e5-8da32d8ed413 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:51.704283 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0673836e-6671-466d-b9e5-8da32d8ed413 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:51.706507 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=32 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:47:51.712831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0673836e-6671-466d-b9e5-8da32d8ed413 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:51.713337 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0673836e-6671-466d-b9e5-8da32d8ed413 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:51.713766 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0673836e-6671-466d-b9e5-8da32d8ed413 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:51.714879 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0673836e-6671-466d-b9e5-8da32d8ed413 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:51.715687 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0673836e-6671-466d-b9e5-8da32d8ed413 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:51.716437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0673836e-6671-466d-b9e5-8da32d8ed413 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:51.750989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0673836e-6671-466d-b9e5-8da32d8ed413 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052747 Aug 24 12:47:51.751599 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1046/2091] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:51 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:52.763879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d7fd76de-3893-4c48-aeb6-ce276a9303de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:52.766018 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d7fd76de-3893-4c48-aeb6-ce276a9303de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:52.772475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7fd76de-3893-4c48-aeb6-ce276a9303de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:52.772960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7fd76de-3893-4c48-aeb6-ce276a9303de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:52.773400 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7fd76de-3893-4c48-aeb6-ce276a9303de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:52.774089 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7fd76de-3893-4c48-aeb6-ce276a9303de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:52.774548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7fd76de-3893-4c48-aeb6-ce276a9303de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:52.775624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7fd76de-3893-4c48-aeb6-ce276a9303de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:52.777917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=96 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:47:52.805441 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d7fd76de-3893-4c48-aeb6-ce276a9303de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046037 Aug 24 12:47:52.806047 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1046/2092] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:52 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:53.817535 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b3e5e9cd-bb7a-49d9-bce8-e5d8f8bdf76b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:53.819764 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b3e5e9cd-bb7a-49d9-bce8-e5d8f8bdf76b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:53.826706 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b3e5e9cd-bb7a-49d9-bce8-e5d8f8bdf76b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:53.827186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b3e5e9cd-bb7a-49d9-bce8-e5d8f8bdf76b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:53.827617 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b3e5e9cd-bb7a-49d9-bce8-e5d8f8bdf76b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:53.828296 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b3e5e9cd-bb7a-49d9-bce8-e5d8f8bdf76b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:53.828774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b3e5e9cd-bb7a-49d9-bce8-e5d8f8bdf76b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:53.829196 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b3e5e9cd-bb7a-49d9-bce8-e5d8f8bdf76b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:53.831500 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=96 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:47:53.858593 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b3e5e9cd-bb7a-49d9-bce8-e5d8f8bdf76b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045019 Aug 24 12:47:53.859157 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1047/2093] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:53 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:54.871103 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7d9ba99c-5a28-4caf-941a-106b1a87d3e3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:54.873300 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7d9ba99c-5a28-4caf-941a-106b1a87d3e3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:54.879679 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7d9ba99c-5a28-4caf-941a-106b1a87d3e3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:54.880165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7d9ba99c-5a28-4caf-941a-106b1a87d3e3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:54.880628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7d9ba99c-5a28-4caf-941a-106b1a87d3e3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:54.881320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7d9ba99c-5a28-4caf-941a-106b1a87d3e3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:54.881777 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7d9ba99c-5a28-4caf-941a-106b1a87d3e3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:54.882200 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7d9ba99c-5a28-4caf-941a-106b1a87d3e3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:54.911800 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7d9ba99c-5a28-4caf-941a-106b1a87d3e3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045355 Aug 24 12:47:54.912341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1047/2094] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:54 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:55.924782 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-18dda1a8-37bd-4fdd-a38c-2c9d9963ded2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:55.926950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-18dda1a8-37bd-4fdd-a38c-2c9d9963ded2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:55.933884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18dda1a8-37bd-4fdd-a38c-2c9d9963ded2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:55.934316 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18dda1a8-37bd-4fdd-a38c-2c9d9963ded2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:55.934756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18dda1a8-37bd-4fdd-a38c-2c9d9963ded2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:55.935440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18dda1a8-37bd-4fdd-a38c-2c9d9963ded2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:55.935885 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18dda1a8-37bd-4fdd-a38c-2c9d9963ded2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:55.936306 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18dda1a8-37bd-4fdd-a38c-2c9d9963ded2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:55.965679 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-18dda1a8-37bd-4fdd-a38c-2c9d9963ded2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044968 Aug 24 12:47:55.966227 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1048/2095] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:55 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:56.977786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-20c599a2-6f79-44f7-902a-ea56eae80d69 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:56.980393 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-20c599a2-6f79-44f7-902a-ea56eae80d69 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:56.986730 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-20c599a2-6f79-44f7-902a-ea56eae80d69 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:56.987215 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-20c599a2-6f79-44f7-902a-ea56eae80d69 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:56.987653 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-20c599a2-6f79-44f7-902a-ea56eae80d69 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:56.988595 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-20c599a2-6f79-44f7-902a-ea56eae80d69 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:56.989049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-20c599a2-6f79-44f7-902a-ea56eae80d69 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:56.989465 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-20c599a2-6f79-44f7-902a-ea56eae80d69 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:57.017337 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-20c599a2-6f79-44f7-902a-ea56eae80d69 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043596 Aug 24 12:47:57.017877 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1048/2096] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:56 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:58.030184 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-af8be2cf-2694-4567-b548-b2f3d41da26b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:58.032334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-af8be2cf-2694-4567-b548-b2f3d41da26b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:58.038819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af8be2cf-2694-4567-b548-b2f3d41da26b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:58.039307 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af8be2cf-2694-4567-b548-b2f3d41da26b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:58.039741 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af8be2cf-2694-4567-b548-b2f3d41da26b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:58.040433 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af8be2cf-2694-4567-b548-b2f3d41da26b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:58.040882 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af8be2cf-2694-4567-b548-b2f3d41da26b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:58.041310 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af8be2cf-2694-4567-b548-b2f3d41da26b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:58.070226 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-af8be2cf-2694-4567-b548-b2f3d41da26b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043993 Aug 24 12:47:58.070803 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1049/2097] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:58 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:59.083138 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-05e8def1-d579-4396-87bd-21e0e61a2f1f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:59.085197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-05e8def1-d579-4396-87bd-21e0e61a2f1f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:59.091668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-05e8def1-d579-4396-87bd-21e0e61a2f1f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:59.092157 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-05e8def1-d579-4396-87bd-21e0e61a2f1f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:59.092597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-05e8def1-d579-4396-87bd-21e0e61a2f1f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:59.093289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-05e8def1-d579-4396-87bd-21e0e61a2f1f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:59.093746 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-05e8def1-d579-4396-87bd-21e0e61a2f1f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:59.094171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-05e8def1-d579-4396-87bd-21e0e61a2f1f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:59.123703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-05e8def1-d579-4396-87bd-21e0e61a2f1f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044621 Aug 24 12:47:59.124260 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1049/2098] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:47:59 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:48:00.136513 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4570bdb9-ab78-4878-a1b3-23ae5c9bfab7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:00.138643 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4570bdb9-ab78-4878-a1b3-23ae5c9bfab7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:00.145029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4570bdb9-ab78-4878-a1b3-23ae5c9bfab7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:00.145500 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4570bdb9-ab78-4878-a1b3-23ae5c9bfab7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:00.145927 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4570bdb9-ab78-4878-a1b3-23ae5c9bfab7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:00.146604 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4570bdb9-ab78-4878-a1b3-23ae5c9bfab7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:00.147076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4570bdb9-ab78-4878-a1b3-23ae5c9bfab7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:00.147495 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4570bdb9-ab78-4878-a1b3-23ae5c9bfab7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:00.177937 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4570bdb9-ab78-4878-a1b3-23ae5c9bfab7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045978 Aug 24 12:48:00.178481 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1050/2099] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:48:00 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:48:01.189571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ab7a4ee2-3aa8-4183-a952-633ba258bed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:01.191670 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ab7a4ee2-3aa8-4183-a952-633ba258bed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:01.197867 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab7a4ee2-3aa8-4183-a952-633ba258bed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:01.198342 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab7a4ee2-3aa8-4183-a952-633ba258bed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:01.198825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab7a4ee2-3aa8-4183-a952-633ba258bed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:01.199487 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab7a4ee2-3aa8-4183-a952-633ba258bed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:01.199938 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab7a4ee2-3aa8-4183-a952-633ba258bed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:01.200364 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab7a4ee2-3aa8-4183-a952-633ba258bed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:01.228793 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ab7a4ee2-3aa8-4183-a952-633ba258bed5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043212 Aug 24 12:48:01.230045 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1050/2100] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:48:01 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:48:02.242027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c7754788-2d24-4ec5-a5dd-730ed8c8b6bb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:02.244276 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c7754788-2d24-4ec5-a5dd-730ed8c8b6bb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:02.251060 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7754788-2d24-4ec5-a5dd-730ed8c8b6bb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:02.251539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7754788-2d24-4ec5-a5dd-730ed8c8b6bb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:02.251975 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7754788-2d24-4ec5-a5dd-730ed8c8b6bb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:02.252658 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7754788-2d24-4ec5-a5dd-730ed8c8b6bb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:02.253110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7754788-2d24-4ec5-a5dd-730ed8c8b6bb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:02.253535 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c7754788-2d24-4ec5-a5dd-730ed8c8b6bb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:02.282228 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c7754788-2d24-4ec5-a5dd-730ed8c8b6bb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044388 Aug 24 12:48:02.282801 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1051/2101] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:48:02 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:48:03.293616 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-be82b5d2-9f02-40be-b55f-44917d60ad77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:03.295934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-be82b5d2-9f02-40be-b55f-44917d60ad77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:03.302305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be82b5d2-9f02-40be-b55f-44917d60ad77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:03.302833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be82b5d2-9f02-40be-b55f-44917d60ad77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:03.303274 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be82b5d2-9f02-40be-b55f-44917d60ad77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:03.303953 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be82b5d2-9f02-40be-b55f-44917d60ad77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:03.304442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be82b5d2-9f02-40be-b55f-44917d60ad77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:03.304868 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be82b5d2-9f02-40be-b55f-44917d60ad77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:03.333262 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-be82b5d2-9f02-40be-b55f-44917d60ad77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043609 Aug 24 12:48:03.333807 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1051/2102] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:48:03 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:48:04.347998 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1526b0ca-d1fc-421d-a1bf-8c3f55d07aac tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:04.350026 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1526b0ca-d1fc-421d-a1bf-8c3f55d07aac tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:04.356958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1526b0ca-d1fc-421d-a1bf-8c3f55d07aac tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:04.357433 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1526b0ca-d1fc-421d-a1bf-8c3f55d07aac tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:04.357866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1526b0ca-d1fc-421d-a1bf-8c3f55d07aac tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:04.358537 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1526b0ca-d1fc-421d-a1bf-8c3f55d07aac tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:04.359014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1526b0ca-d1fc-421d-a1bf-8c3f55d07aac tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:04.359435 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1526b0ca-d1fc-421d-a1bf-8c3f55d07aac tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:04.387508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1526b0ca-d1fc-421d-a1bf-8c3f55d07aac tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043585 Aug 24 12:48:04.388029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1052/2103] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:48:04 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:48:05.399729 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f872e806-a325-4d54-b77f-11dc209a2726 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:05.401816 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f872e806-a325-4d54-b77f-11dc209a2726 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:05.408160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f872e806-a325-4d54-b77f-11dc209a2726 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:05.408639 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f872e806-a325-4d54-b77f-11dc209a2726 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:05.409075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f872e806-a325-4d54-b77f-11dc209a2726 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:05.409753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f872e806-a325-4d54-b77f-11dc209a2726 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:05.410206 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f872e806-a325-4d54-b77f-11dc209a2726 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:05.410628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f872e806-a325-4d54-b77f-11dc209a2726 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:05.440372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f872e806-a325-4d54-b77f-11dc209a2726 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044685 Aug 24 12:48:05.440921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1052/2104] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:48:05 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:48:06.452905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a368f31a-4b65-43e5-8c9e-9b7f40f6df0d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:06.455037 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a368f31a-4b65-43e5-8c9e-9b7f40f6df0d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:06.461303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a368f31a-4b65-43e5-8c9e-9b7f40f6df0d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:06.461776 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a368f31a-4b65-43e5-8c9e-9b7f40f6df0d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:06.462208 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a368f31a-4b65-43e5-8c9e-9b7f40f6df0d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:06.462917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a368f31a-4b65-43e5-8c9e-9b7f40f6df0d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:06.463398 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a368f31a-4b65-43e5-8c9e-9b7f40f6df0d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:06.463818 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a368f31a-4b65-43e5-8c9e-9b7f40f6df0d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:06.492001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a368f31a-4b65-43e5-8c9e-9b7f40f6df0d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043000 Aug 24 12:48:06.492529 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1053/2105] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:48:06 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:48:07.504530 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9291598d-788c-4f2f-8135-afc5053c4d02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:07.506665 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9291598d-788c-4f2f-8135-afc5053c4d02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:07.513216 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9291598d-788c-4f2f-8135-afc5053c4d02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:07.513693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9291598d-788c-4f2f-8135-afc5053c4d02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:07.514127 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9291598d-788c-4f2f-8135-afc5053c4d02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:07.514843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9291598d-788c-4f2f-8135-afc5053c4d02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:07.515298 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9291598d-788c-4f2f-8135-afc5053c4d02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:07.515718 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9291598d-788c-4f2f-8135-afc5053c4d02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:07.545010 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9291598d-788c-4f2f-8135-afc5053c4d02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044421 Aug 24 12:48:07.545546 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1053/2106] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:48:07 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:48:08.557268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d210fe3b-f8b5-4737-b5a1-776dcac9971f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:08.560105 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d210fe3b-f8b5-4737-b5a1-776dcac9971f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:08.566478 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d210fe3b-f8b5-4737-b5a1-776dcac9971f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:08.566997 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d210fe3b-f8b5-4737-b5a1-776dcac9971f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:08.567431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d210fe3b-f8b5-4737-b5a1-776dcac9971f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:08.568120 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d210fe3b-f8b5-4737-b5a1-776dcac9971f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:08.568591 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d210fe3b-f8b5-4737-b5a1-776dcac9971f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:08.568982 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d210fe3b-f8b5-4737-b5a1-776dcac9971f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:08.598187 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d210fe3b-f8b5-4737-b5a1-776dcac9971f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044832 Aug 24 12:48:08.598746 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1054/2107] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:48:08 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:48:09.610636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6aeea05d-3f01-45cc-a5a5-2cac34aad1f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:09.612759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6aeea05d-3f01-45cc-a5a5-2cac34aad1f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:09.619314 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6aeea05d-3f01-45cc-a5a5-2cac34aad1f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:09.619799 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6aeea05d-3f01-45cc-a5a5-2cac34aad1f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:09.620235 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6aeea05d-3f01-45cc-a5a5-2cac34aad1f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:09.620918 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6aeea05d-3f01-45cc-a5a5-2cac34aad1f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:09.621376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6aeea05d-3f01-45cc-a5a5-2cac34aad1f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:09.621804 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6aeea05d-3f01-45cc-a5a5-2cac34aad1f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:09.650025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6aeea05d-3f01-45cc-a5a5-2cac34aad1f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043425 Aug 24 12:48:09.650558 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1054/2108] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:48:09 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:48:10.662684 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2cda67fc-436f-46ee-99c5-8d063266b8e7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:10.664751 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2cda67fc-436f-46ee-99c5-8d063266b8e7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:10.671688 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2cda67fc-436f-46ee-99c5-8d063266b8e7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:10.672156 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2cda67fc-436f-46ee-99c5-8d063266b8e7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:10.672590 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2cda67fc-436f-46ee-99c5-8d063266b8e7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:10.673257 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2cda67fc-436f-46ee-99c5-8d063266b8e7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:10.673701 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2cda67fc-436f-46ee-99c5-8d063266b8e7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:10.674118 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2cda67fc-436f-46ee-99c5-8d063266b8e7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:10.702316 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2cda67fc-436f-46ee-99c5-8d063266b8e7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043631 Aug 24 12:48:10.702872 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1055/2109] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:48:10 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:48:11.714395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f0aafa03-847b-49ae-8f58-5328df779d55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:11.716550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f0aafa03-847b-49ae-8f58-5328df779d55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:11.722978 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f0aafa03-847b-49ae-8f58-5328df779d55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:11.723443 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f0aafa03-847b-49ae-8f58-5328df779d55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:11.723881 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f0aafa03-847b-49ae-8f58-5328df779d55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:11.724564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f0aafa03-847b-49ae-8f58-5328df779d55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:11.725046 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f0aafa03-847b-49ae-8f58-5328df779d55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:11.725472 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f0aafa03-847b-49ae-8f58-5328df779d55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:11.755051 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f0aafa03-847b-49ae-8f58-5328df779d55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045042 Aug 24 12:48:11.755597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1055/2110] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:48:11 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:48:12.767603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-25739a93-2914-4b4f-8cc4-843aad4126bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:12.769725 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-25739a93-2914-4b4f-8cc4-843aad4126bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:12.775941 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-25739a93-2914-4b4f-8cc4-843aad4126bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:12.777410 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-25739a93-2914-4b4f-8cc4-843aad4126bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:12.777533 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-25739a93-2914-4b4f-8cc4-843aad4126bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:12.778202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-25739a93-2914-4b4f-8cc4-843aad4126bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:12.778676 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-25739a93-2914-4b4f-8cc4-843aad4126bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:12.779107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-25739a93-2914-4b4f-8cc4-843aad4126bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:12.808086 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-25739a93-2914-4b4f-8cc4-843aad4126bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044192 Aug 24 12:48:12.808523 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1056/2111] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:48:12 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:48:13.819935 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6ecf1302-5c1b-48d6-b088-8a60a9345fad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:13.822057 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6ecf1302-5c1b-48d6-b088-8a60a9345fad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:13.828467 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6ecf1302-5c1b-48d6-b088-8a60a9345fad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:13.828947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6ecf1302-5c1b-48d6-b088-8a60a9345fad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:13.829390 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6ecf1302-5c1b-48d6-b088-8a60a9345fad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:13.830067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6ecf1302-5c1b-48d6-b088-8a60a9345fad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:13.830525 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6ecf1302-5c1b-48d6-b088-8a60a9345fad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:13.830984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6ecf1302-5c1b-48d6-b088-8a60a9345fad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:13.859152 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6ecf1302-5c1b-48d6-b088-8a60a9345fad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043030 Aug 24 12:48:13.859684 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1056/2112] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:48:13 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:48:14.871897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e603dc90-7e35-4bef-8cf6-a5266d2924c8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:14.874006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e603dc90-7e35-4bef-8cf6-a5266d2924c8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:14.880604 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e603dc90-7e35-4bef-8cf6-a5266d2924c8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:14.881057 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e603dc90-7e35-4bef-8cf6-a5266d2924c8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:14.881490 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e603dc90-7e35-4bef-8cf6-a5266d2924c8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:14.882158 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e603dc90-7e35-4bef-8cf6-a5266d2924c8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:14.882606 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e603dc90-7e35-4bef-8cf6-a5266d2924c8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:14.883050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e603dc90-7e35-4bef-8cf6-a5266d2924c8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:14.912298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e603dc90-7e35-4bef-8cf6-a5266d2924c8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044856 Aug 24 12:48:14.912841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1057/2113] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 12:48:14 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:48:15.707373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-28d11d4b-212c-4be1-ab4d-d4253f02172e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:15.707886 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-28d11d4b-212c-4be1-ab4d-d4253f02172e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:15.710095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=30 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:48:15.715545 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-28d11d4b-212c-4be1-ab4d-d4253f02172e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:15.716028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-28d11d4b-212c-4be1-ab4d-d4253f02172e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:15.716461 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-28d11d4b-212c-4be1-ab4d-d4253f02172e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:15.717145 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-28d11d4b-212c-4be1-ab4d-d4253f02172e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:15.717596 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-28d11d4b-212c-4be1-ab4d-d4253f02172e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:15.718021 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-28d11d4b-212c-4be1-ab4d-d4253f02172e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:15.744114 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-28d11d4b-212c-4be1-ab4d-d4253f02172e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Going to try to terminate instance {{(pid=121170) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:48:15.924601 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7425b968-1350-4e9b-9b2e-bb2a75a5c7bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:48:15.926774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7425b968-1350-4e9b-9b2e-bb2a75a5c7bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:15.932912 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7425b968-1350-4e9b-9b2e-bb2a75a5c7bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:15.933342 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7425b968-1350-4e9b-9b2e-bb2a75a5c7bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:15.933896 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7425b968-1350-4e9b-9b2e-bb2a75a5c7bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:15.934585 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7425b968-1350-4e9b-9b2e-bb2a75a5c7bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:15.935068 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7425b968-1350-4e9b-9b2e-bb2a75a5c7bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:15.935500 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7425b968-1350-4e9b-9b2e-bb2a75a5c7bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:15.984064 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-28d11d4b-212c-4be1-ab4d-d4253f02172e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 204 len: 0 microversion: 2.1 time: 0.280189 Aug 24 12:48:15.984660 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1057/2114] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 12:48:15 2022] DELETE /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 12:48:15.993256 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c04346a0-0898-458c-8750-3f5b285dba14 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:15.993944 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c04346a0-0898-458c-8750-3f5b285dba14 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:16.000122 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c04346a0-0898-458c-8750-3f5b285dba14 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:16.000623 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c04346a0-0898-458c-8750-3f5b285dba14 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:16.001059 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c04346a0-0898-458c-8750-3f5b285dba14 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:16.001750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c04346a0-0898-458c-8750-3f5b285dba14 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:16.002211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c04346a0-0898-458c-8750-3f5b285dba14 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:16.002640 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c04346a0-0898-458c-8750-3f5b285dba14 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:16.040223 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7425b968-1350-4e9b-9b2e-bb2a75a5c7bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "POST /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/action" status: 200 len: 75807 microversion: 2.1 time: 0.119469 Aug 24 12:48:16.043257 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1058/2115] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 12:48:15 2022] POST /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158/action => generated 75807 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:48:16.212908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c04346a0-0898-458c-8750-3f5b285dba14 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:16.221108 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c04346a0-0898-458c-8750-3f5b285dba14 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.231889 Aug 24 12:48:16.221661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1058/2116] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:15 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:48:17.242049 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-68cb3e30-fce8-4102-886a-3f128cf67c97 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:17.242791 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-68cb3e30-fce8-4102-886a-3f128cf67c97 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:17.250121 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68cb3e30-fce8-4102-886a-3f128cf67c97 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:17.250593 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68cb3e30-fce8-4102-886a-3f128cf67c97 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:17.251047 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68cb3e30-fce8-4102-886a-3f128cf67c97 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:17.251727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68cb3e30-fce8-4102-886a-3f128cf67c97 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:17.252176 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68cb3e30-fce8-4102-886a-3f128cf67c97 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:17.252594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68cb3e30-fce8-4102-886a-3f128cf67c97 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:17.424935 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-68cb3e30-fce8-4102-886a-3f128cf67c97 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:17.433697 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-68cb3e30-fce8-4102-886a-3f128cf67c97 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.196070 Aug 24 12:48:17.434245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1059/2117] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:17 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:18.454376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0bfd9ba9-45a4-47e1-b844-eed75a43445b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:18.455036 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0bfd9ba9-45a4-47e1-b844-eed75a43445b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:18.461586 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bfd9ba9-45a4-47e1-b844-eed75a43445b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:18.462067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bfd9ba9-45a4-47e1-b844-eed75a43445b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:18.462506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bfd9ba9-45a4-47e1-b844-eed75a43445b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:18.463221 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bfd9ba9-45a4-47e1-b844-eed75a43445b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:18.464185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bfd9ba9-45a4-47e1-b844-eed75a43445b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:18.464611 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bfd9ba9-45a4-47e1-b844-eed75a43445b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:18.591835 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0bfd9ba9-45a4-47e1-b844-eed75a43445b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:18.599987 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0bfd9ba9-45a4-47e1-b844-eed75a43445b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149436 Aug 24 12:48:18.600545 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1059/2118] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:18 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:19.622241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-783d347f-27c5-4aee-a4c9-c6931e067483 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:19.623350 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-783d347f-27c5-4aee-a4c9-c6931e067483 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:19.632808 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-783d347f-27c5-4aee-a4c9-c6931e067483 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:19.633296 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-783d347f-27c5-4aee-a4c9-c6931e067483 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:19.633729 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-783d347f-27c5-4aee-a4c9-c6931e067483 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:19.634423 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-783d347f-27c5-4aee-a4c9-c6931e067483 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:19.634919 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-783d347f-27c5-4aee-a4c9-c6931e067483 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:19.635348 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-783d347f-27c5-4aee-a4c9-c6931e067483 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:19.761922 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-783d347f-27c5-4aee-a4c9-c6931e067483 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:19.769993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-783d347f-27c5-4aee-a4c9-c6931e067483 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.152514 Aug 24 12:48:19.770552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1060/2119] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:19 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:20.792675 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ac3fe180-0e9d-4a16-af45-360a40718b35 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:20.793287 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ac3fe180-0e9d-4a16-af45-360a40718b35 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:20.799661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac3fe180-0e9d-4a16-af45-360a40718b35 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:20.800143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac3fe180-0e9d-4a16-af45-360a40718b35 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:20.800579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac3fe180-0e9d-4a16-af45-360a40718b35 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:20.801262 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac3fe180-0e9d-4a16-af45-360a40718b35 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:20.801720 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac3fe180-0e9d-4a16-af45-360a40718b35 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:20.802145 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac3fe180-0e9d-4a16-af45-360a40718b35 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:20.927991 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ac3fe180-0e9d-4a16-af45-360a40718b35 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:20.935969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ac3fe180-0e9d-4a16-af45-360a40718b35 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147790 Aug 24 12:48:20.936514 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1060/2120] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:20 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:21.956779 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0d1ebf3c-af3c-497d-8efb-13ae892aaecc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:21.957382 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0d1ebf3c-af3c-497d-8efb-13ae892aaecc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:21.959870 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=30 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:48:21.965079 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d1ebf3c-af3c-497d-8efb-13ae892aaecc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:21.965553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d1ebf3c-af3c-497d-8efb-13ae892aaecc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:21.970768 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d1ebf3c-af3c-497d-8efb-13ae892aaecc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:21.970768 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d1ebf3c-af3c-497d-8efb-13ae892aaecc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:21.970768 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d1ebf3c-af3c-497d-8efb-13ae892aaecc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:21.970768 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d1ebf3c-af3c-497d-8efb-13ae892aaecc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:22.106429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0d1ebf3c-af3c-497d-8efb-13ae892aaecc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:22.117920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0d1ebf3c-af3c-497d-8efb-13ae892aaecc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.165020 Aug 24 12:48:22.118601 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1061/2121] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:21 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:23.140167 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-624125b9-3857-4d54-8c50-02e0b38d819b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:23.140825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-624125b9-3857-4d54-8c50-02e0b38d819b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:23.146892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-624125b9-3857-4d54-8c50-02e0b38d819b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:23.147376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-624125b9-3857-4d54-8c50-02e0b38d819b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:23.147812 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-624125b9-3857-4d54-8c50-02e0b38d819b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:23.148488 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-624125b9-3857-4d54-8c50-02e0b38d819b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:23.148938 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-624125b9-3857-4d54-8c50-02e0b38d819b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:23.149358 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-624125b9-3857-4d54-8c50-02e0b38d819b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:23.152441 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:48:23.301721 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-624125b9-3857-4d54-8c50-02e0b38d819b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:23.310517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-624125b9-3857-4d54-8c50-02e0b38d819b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.175066 Aug 24 12:48:23.311232 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1061/2122] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:23 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:24.331354 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-de7e6eb1-467b-4ec7-95a6-d8f62f4e5626 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:24.331972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-de7e6eb1-467b-4ec7-95a6-d8f62f4e5626 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:24.338235 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de7e6eb1-467b-4ec7-95a6-d8f62f4e5626 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:24.338810 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de7e6eb1-467b-4ec7-95a6-d8f62f4e5626 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:24.339772 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de7e6eb1-467b-4ec7-95a6-d8f62f4e5626 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:24.340446 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de7e6eb1-467b-4ec7-95a6-d8f62f4e5626 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:24.340897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de7e6eb1-467b-4ec7-95a6-d8f62f4e5626 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:24.341315 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de7e6eb1-467b-4ec7-95a6-d8f62f4e5626 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:24.343799 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=88 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:48:24.469367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-de7e6eb1-467b-4ec7-95a6-d8f62f4e5626 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:24.477385 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-de7e6eb1-467b-4ec7-95a6-d8f62f4e5626 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149805 Aug 24 12:48:24.477940 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1062/2123] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:24 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:25.509279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a55d6a3f-cd90-41b6-9f9a-293f617e24c6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:25.509279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a55d6a3f-cd90-41b6-9f9a-293f617e24c6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:25.509279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a55d6a3f-cd90-41b6-9f9a-293f617e24c6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:25.509279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a55d6a3f-cd90-41b6-9f9a-293f617e24c6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:25.512012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a55d6a3f-cd90-41b6-9f9a-293f617e24c6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:25.512012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a55d6a3f-cd90-41b6-9f9a-293f617e24c6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:25.512012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a55d6a3f-cd90-41b6-9f9a-293f617e24c6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:25.512012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a55d6a3f-cd90-41b6-9f9a-293f617e24c6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:25.667533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a55d6a3f-cd90-41b6-9f9a-293f617e24c6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:25.675659 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a55d6a3f-cd90-41b6-9f9a-293f617e24c6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.181431 Aug 24 12:48:25.676216 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1062/2124] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:25 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:26.697043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4653f312-064b-4cf5-86e4-0691a3ecda70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:26.697655 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4653f312-064b-4cf5-86e4-0691a3ecda70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:26.704642 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4653f312-064b-4cf5-86e4-0691a3ecda70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:26.705123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4653f312-064b-4cf5-86e4-0691a3ecda70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:26.705556 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4653f312-064b-4cf5-86e4-0691a3ecda70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:26.706235 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4653f312-064b-4cf5-86e4-0691a3ecda70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:26.706717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4653f312-064b-4cf5-86e4-0691a3ecda70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:26.707143 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4653f312-064b-4cf5-86e4-0691a3ecda70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:26.835052 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4653f312-064b-4cf5-86e4-0691a3ecda70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:26.843099 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4653f312-064b-4cf5-86e4-0691a3ecda70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149882 Aug 24 12:48:26.843651 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1063/2125] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:26 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:27.864048 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f2b45b89-7e12-453d-9df2-eb535e242a5c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:27.864623 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f2b45b89-7e12-453d-9df2-eb535e242a5c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:27.871803 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2b45b89-7e12-453d-9df2-eb535e242a5c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:27.872279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2b45b89-7e12-453d-9df2-eb535e242a5c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:27.872710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2b45b89-7e12-453d-9df2-eb535e242a5c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:27.873391 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2b45b89-7e12-453d-9df2-eb535e242a5c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:27.874013 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2b45b89-7e12-453d-9df2-eb535e242a5c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:27.874442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2b45b89-7e12-453d-9df2-eb535e242a5c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:27.999682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f2b45b89-7e12-453d-9df2-eb535e242a5c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:28.007611 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f2b45b89-7e12-453d-9df2-eb535e242a5c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147750 Aug 24 12:48:28.008162 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1063/2126] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:27 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:29.028401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b9a3caf6-7995-46bb-90b6-af2c2e922a19 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:29.029028 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b9a3caf6-7995-46bb-90b6-af2c2e922a19 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:29.035410 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b9a3caf6-7995-46bb-90b6-af2c2e922a19 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:29.035887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b9a3caf6-7995-46bb-90b6-af2c2e922a19 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:29.036347 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b9a3caf6-7995-46bb-90b6-af2c2e922a19 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:29.037043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b9a3caf6-7995-46bb-90b6-af2c2e922a19 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:29.037474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b9a3caf6-7995-46bb-90b6-af2c2e922a19 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:29.037897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b9a3caf6-7995-46bb-90b6-af2c2e922a19 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:29.164235 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b9a3caf6-7995-46bb-90b6-af2c2e922a19 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:29.172311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b9a3caf6-7995-46bb-90b6-af2c2e922a19 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147770 Aug 24 12:48:29.172859 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1064/2127] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:29 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:30.193518 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4f95378e-b084-4d85-baa7-71a4fc8a20e2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:30.194132 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4f95378e-b084-4d85-baa7-71a4fc8a20e2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:30.200583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4f95378e-b084-4d85-baa7-71a4fc8a20e2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:30.201069 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4f95378e-b084-4d85-baa7-71a4fc8a20e2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:30.201508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4f95378e-b084-4d85-baa7-71a4fc8a20e2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:30.202198 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4f95378e-b084-4d85-baa7-71a4fc8a20e2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:30.202677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4f95378e-b084-4d85-baa7-71a4fc8a20e2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:30.203104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4f95378e-b084-4d85-baa7-71a4fc8a20e2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:30.334494 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4f95378e-b084-4d85-baa7-71a4fc8a20e2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:30.343030 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4f95378e-b084-4d85-baa7-71a4fc8a20e2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.153384 Aug 24 12:48:30.343579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1064/2128] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:30 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:31.365307 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-338d7af4-bb1f-4a1d-b079-55937057617a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:31.365896 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-338d7af4-bb1f-4a1d-b079-55937057617a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:31.372723 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-338d7af4-bb1f-4a1d-b079-55937057617a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:31.373200 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-338d7af4-bb1f-4a1d-b079-55937057617a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:31.373630 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-338d7af4-bb1f-4a1d-b079-55937057617a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:31.374310 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-338d7af4-bb1f-4a1d-b079-55937057617a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:31.374791 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-338d7af4-bb1f-4a1d-b079-55937057617a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:31.375218 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-338d7af4-bb1f-4a1d-b079-55937057617a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:31.500952 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-338d7af4-bb1f-4a1d-b079-55937057617a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:31.509094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-338d7af4-bb1f-4a1d-b079-55937057617a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147974 Aug 24 12:48:31.509643 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1065/2129] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:31 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:32.530338 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-13a8d574-84ab-417d-86d8-193fb2df1d3a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:32.530973 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-13a8d574-84ab-417d-86d8-193fb2df1d3a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:32.537358 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13a8d574-84ab-417d-86d8-193fb2df1d3a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:32.537840 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13a8d574-84ab-417d-86d8-193fb2df1d3a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:32.538279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13a8d574-84ab-417d-86d8-193fb2df1d3a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:32.538997 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13a8d574-84ab-417d-86d8-193fb2df1d3a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:32.539459 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13a8d574-84ab-417d-86d8-193fb2df1d3a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:32.539883 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13a8d574-84ab-417d-86d8-193fb2df1d3a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:32.665654 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-13a8d574-84ab-417d-86d8-193fb2df1d3a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:32.674334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-13a8d574-84ab-417d-86d8-193fb2df1d3a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.148448 Aug 24 12:48:32.674924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1065/2130] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:32 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:33.695096 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-07eb3694-64be-43ae-870e-3ba899d3056b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:33.695842 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-07eb3694-64be-43ae-870e-3ba899d3056b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:33.703133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-07eb3694-64be-43ae-870e-3ba899d3056b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:33.703623 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-07eb3694-64be-43ae-870e-3ba899d3056b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:33.704065 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-07eb3694-64be-43ae-870e-3ba899d3056b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:33.704760 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-07eb3694-64be-43ae-870e-3ba899d3056b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:33.705358 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-07eb3694-64be-43ae-870e-3ba899d3056b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:33.705789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-07eb3694-64be-43ae-870e-3ba899d3056b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:33.837331 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-07eb3694-64be-43ae-870e-3ba899d3056b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:33.846028 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-07eb3694-64be-43ae-870e-3ba899d3056b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.154782 Aug 24 12:48:33.846591 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1066/2131] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:33 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:34.866786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8f3d58a7-1f32-4f6f-bbeb-9bbc56e8ea29 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:34.867423 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8f3d58a7-1f32-4f6f-bbeb-9bbc56e8ea29 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:34.873714 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f3d58a7-1f32-4f6f-bbeb-9bbc56e8ea29 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:34.874202 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f3d58a7-1f32-4f6f-bbeb-9bbc56e8ea29 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:34.874621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f3d58a7-1f32-4f6f-bbeb-9bbc56e8ea29 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:34.875326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f3d58a7-1f32-4f6f-bbeb-9bbc56e8ea29 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:34.875775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f3d58a7-1f32-4f6f-bbeb-9bbc56e8ea29 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:34.876194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f3d58a7-1f32-4f6f-bbeb-9bbc56e8ea29 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:35.009392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8f3d58a7-1f32-4f6f-bbeb-9bbc56e8ea29 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:35.018308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8f3d58a7-1f32-4f6f-bbeb-9bbc56e8ea29 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.155565 Aug 24 12:48:35.018894 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1066/2132] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:34 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:36.039295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e6b48c36-d16d-4adb-b7a1-d9c2f3c6a134 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:36.040092 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e6b48c36-d16d-4adb-b7a1-d9c2f3c6a134 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:36.046979 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e6b48c36-d16d-4adb-b7a1-d9c2f3c6a134 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:36.047479 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e6b48c36-d16d-4adb-b7a1-d9c2f3c6a134 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:36.047897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e6b48c36-d16d-4adb-b7a1-d9c2f3c6a134 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:36.048580 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e6b48c36-d16d-4adb-b7a1-d9c2f3c6a134 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:36.049029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e6b48c36-d16d-4adb-b7a1-d9c2f3c6a134 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:36.049452 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e6b48c36-d16d-4adb-b7a1-d9c2f3c6a134 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:36.182050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e6b48c36-d16d-4adb-b7a1-d9c2f3c6a134 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:36.190876 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e6b48c36-d16d-4adb-b7a1-d9c2f3c6a134 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.155405 Aug 24 12:48:36.191424 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1067/2133] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:36 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:37.211944 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-02eb48eb-c8ae-438a-8ac0-2465a622102b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:37.212584 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-02eb48eb-c8ae-438a-8ac0-2465a622102b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:37.218432 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-02eb48eb-c8ae-438a-8ac0-2465a622102b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:37.219030 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-02eb48eb-c8ae-438a-8ac0-2465a622102b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:37.219437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-02eb48eb-c8ae-438a-8ac0-2465a622102b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:37.223925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-02eb48eb-c8ae-438a-8ac0-2465a622102b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:37.223925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-02eb48eb-c8ae-438a-8ac0-2465a622102b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:37.223925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-02eb48eb-c8ae-438a-8ac0-2465a622102b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:37.346054 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-02eb48eb-c8ae-438a-8ac0-2465a622102b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:37.354157 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-02eb48eb-c8ae-438a-8ac0-2465a622102b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.146216 Aug 24 12:48:37.354723 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1067/2134] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:37 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:48:38.374818 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4b68fb4c-d15b-40f3-9767-efe853c96ce1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:38.375443 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4b68fb4c-d15b-40f3-9767-efe853c96ce1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:38.381669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b68fb4c-d15b-40f3-9767-efe853c96ce1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:38.382136 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b68fb4c-d15b-40f3-9767-efe853c96ce1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:38.382562 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b68fb4c-d15b-40f3-9767-efe853c96ce1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:38.383259 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b68fb4c-d15b-40f3-9767-efe853c96ce1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:38.383704 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b68fb4c-d15b-40f3-9767-efe853c96ce1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:38.384120 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b68fb4c-d15b-40f3-9767-efe853c96ce1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:38.519611 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4b68fb4c-d15b-40f3-9767-efe853c96ce1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:38.527790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4b68fb4c-d15b-40f3-9767-efe853c96ce1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.156834 Aug 24 12:48:38.528915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1068/2135] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:38 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:39.549036 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c7150f45-8466-4ea4-a93b-09a12daac90f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:39.549654 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c7150f45-8466-4ea4-a93b-09a12daac90f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:39.556040 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7150f45-8466-4ea4-a93b-09a12daac90f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:39.556525 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7150f45-8466-4ea4-a93b-09a12daac90f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:39.556967 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7150f45-8466-4ea4-a93b-09a12daac90f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:39.557651 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7150f45-8466-4ea4-a93b-09a12daac90f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:39.558113 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7150f45-8466-4ea4-a93b-09a12daac90f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:39.558541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7150f45-8466-4ea4-a93b-09a12daac90f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:39.687373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c7150f45-8466-4ea4-a93b-09a12daac90f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:39.695420 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c7150f45-8466-4ea4-a93b-09a12daac90f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150315 Aug 24 12:48:39.695977 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1068/2136] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:39 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:40.717321 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9f07b442-51c9-4f1e-ba14-a068b3001696 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:40.717986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9f07b442-51c9-4f1e-ba14-a068b3001696 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:40.724251 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f07b442-51c9-4f1e-ba14-a068b3001696 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:40.724727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f07b442-51c9-4f1e-ba14-a068b3001696 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:40.725162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f07b442-51c9-4f1e-ba14-a068b3001696 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:40.725836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f07b442-51c9-4f1e-ba14-a068b3001696 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:40.726284 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f07b442-51c9-4f1e-ba14-a068b3001696 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:40.726725 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f07b442-51c9-4f1e-ba14-a068b3001696 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:40.853880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9f07b442-51c9-4f1e-ba14-a068b3001696 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:40.861908 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9f07b442-51c9-4f1e-ba14-a068b3001696 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149147 Aug 24 12:48:40.862461 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1069/2137] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:40 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:41.883826 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1ec67a03-c94d-448b-80b8-242911f5709e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:41.884367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1ec67a03-c94d-448b-80b8-242911f5709e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:41.891393 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1ec67a03-c94d-448b-80b8-242911f5709e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:41.891872 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1ec67a03-c94d-448b-80b8-242911f5709e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:41.892304 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1ec67a03-c94d-448b-80b8-242911f5709e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:41.892984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1ec67a03-c94d-448b-80b8-242911f5709e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:41.893437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1ec67a03-c94d-448b-80b8-242911f5709e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:41.893862 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1ec67a03-c94d-448b-80b8-242911f5709e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:42.021030 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1ec67a03-c94d-448b-80b8-242911f5709e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:42.029102 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1ec67a03-c94d-448b-80b8-242911f5709e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149253 Aug 24 12:48:42.029684 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1069/2138] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:41 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:43.049388 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ab5e6b0b-15e8-4e14-8d62-c6426126fd31 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:43.049928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ab5e6b0b-15e8-4e14-8d62-c6426126fd31 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:43.056298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab5e6b0b-15e8-4e14-8d62-c6426126fd31 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:43.056776 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab5e6b0b-15e8-4e14-8d62-c6426126fd31 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:43.057209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab5e6b0b-15e8-4e14-8d62-c6426126fd31 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:43.057890 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab5e6b0b-15e8-4e14-8d62-c6426126fd31 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:43.058346 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab5e6b0b-15e8-4e14-8d62-c6426126fd31 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:43.058798 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab5e6b0b-15e8-4e14-8d62-c6426126fd31 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:43.190243 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ab5e6b0b-15e8-4e14-8d62-c6426126fd31 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:43.198602 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ab5e6b0b-15e8-4e14-8d62-c6426126fd31 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.153188 Aug 24 12:48:43.199416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1070/2139] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:43 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:44.220100 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-63e08cb8-d294-4c88-b01d-73369998b96d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:44.220731 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-63e08cb8-d294-4c88-b01d-73369998b96d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:44.227837 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63e08cb8-d294-4c88-b01d-73369998b96d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:44.228325 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63e08cb8-d294-4c88-b01d-73369998b96d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:44.228764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63e08cb8-d294-4c88-b01d-73369998b96d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:44.229501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63e08cb8-d294-4c88-b01d-73369998b96d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:44.229959 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63e08cb8-d294-4c88-b01d-73369998b96d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:44.230418 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63e08cb8-d294-4c88-b01d-73369998b96d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:44.356822 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-63e08cb8-d294-4c88-b01d-73369998b96d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:44.365104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-63e08cb8-d294-4c88-b01d-73369998b96d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149002 Aug 24 12:48:44.365663 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1070/2140] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:44 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:45.385559 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6ec7eee2-8d9f-4028-8d42-a92b7b8e77d6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:45.386167 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6ec7eee2-8d9f-4028-8d42-a92b7b8e77d6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:45.392708 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6ec7eee2-8d9f-4028-8d42-a92b7b8e77d6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:45.393185 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6ec7eee2-8d9f-4028-8d42-a92b7b8e77d6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:45.393619 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6ec7eee2-8d9f-4028-8d42-a92b7b8e77d6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:45.394298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6ec7eee2-8d9f-4028-8d42-a92b7b8e77d6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:45.394778 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6ec7eee2-8d9f-4028-8d42-a92b7b8e77d6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:45.395205 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6ec7eee2-8d9f-4028-8d42-a92b7b8e77d6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:45.520818 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6ec7eee2-8d9f-4028-8d42-a92b7b8e77d6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:45.529346 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6ec7eee2-8d9f-4028-8d42-a92b7b8e77d6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147590 Aug 24 12:48:45.529906 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1071/2141] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:45 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:46.550096 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b65e6a81-d01f-4706-8f82-451e43c4a101 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:46.550732 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b65e6a81-d01f-4706-8f82-451e43c4a101 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:46.552982 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:48:46.557566 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b65e6a81-d01f-4706-8f82-451e43c4a101 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:46.558050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b65e6a81-d01f-4706-8f82-451e43c4a101 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:46.558478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b65e6a81-d01f-4706-8f82-451e43c4a101 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:46.559836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b65e6a81-d01f-4706-8f82-451e43c4a101 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:46.560285 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b65e6a81-d01f-4706-8f82-451e43c4a101 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:46.560706 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b65e6a81-d01f-4706-8f82-451e43c4a101 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:46.704372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b65e6a81-d01f-4706-8f82-451e43c4a101 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:46.704372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b65e6a81-d01f-4706-8f82-451e43c4a101 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.154736 Aug 24 12:48:46.704372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1071/2142] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:46 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:47.721928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1bbf1407-b28a-481a-b16f-0edf1a35dc4a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:47.722536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1bbf1407-b28a-481a-b16f-0edf1a35dc4a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:47.728827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1bbf1407-b28a-481a-b16f-0edf1a35dc4a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:47.729302 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1bbf1407-b28a-481a-b16f-0edf1a35dc4a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:47.729729 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1bbf1407-b28a-481a-b16f-0edf1a35dc4a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:47.730405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1bbf1407-b28a-481a-b16f-0edf1a35dc4a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:47.730881 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1bbf1407-b28a-481a-b16f-0edf1a35dc4a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:47.731300 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1bbf1407-b28a-481a-b16f-0edf1a35dc4a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:47.859862 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1bbf1407-b28a-481a-b16f-0edf1a35dc4a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:47.868134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1bbf1407-b28a-481a-b16f-0edf1a35dc4a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149952 Aug 24 12:48:47.868693 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1072/2143] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:47 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:48.888654 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-cb44b907-9922-47bb-b6f2-09abbde14281 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:48.889279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-cb44b907-9922-47bb-b6f2-09abbde14281 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:48.895925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cb44b907-9922-47bb-b6f2-09abbde14281 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:48.896442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cb44b907-9922-47bb-b6f2-09abbde14281 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:48.896882 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cb44b907-9922-47bb-b6f2-09abbde14281 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:48.897576 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cb44b907-9922-47bb-b6f2-09abbde14281 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:48.898037 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cb44b907-9922-47bb-b6f2-09abbde14281 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:48.898465 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cb44b907-9922-47bb-b6f2-09abbde14281 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:49.024349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-cb44b907-9922-47bb-b6f2-09abbde14281 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:49.033015 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-cb44b907-9922-47bb-b6f2-09abbde14281 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.148737 Aug 24 12:48:49.033586 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1072/2144] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:48 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:50.053534 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-59788c37-4519-40f0-aafd-38503adf14ac tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:50.054091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-59788c37-4519-40f0-aafd-38503adf14ac tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:50.061130 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59788c37-4519-40f0-aafd-38503adf14ac tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:50.061614 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59788c37-4519-40f0-aafd-38503adf14ac tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:50.062048 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59788c37-4519-40f0-aafd-38503adf14ac tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:50.062770 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59788c37-4519-40f0-aafd-38503adf14ac tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:50.063228 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59788c37-4519-40f0-aafd-38503adf14ac tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:50.063656 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59788c37-4519-40f0-aafd-38503adf14ac tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:50.193391 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-59788c37-4519-40f0-aafd-38503adf14ac tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:50.201968 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-59788c37-4519-40f0-aafd-38503adf14ac tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.152300 Aug 24 12:48:50.202520 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1073/2145] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:50 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:51.222429 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c5483a5e-dcff-4a70-aefb-89ad9d1ffa37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:51.223006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c5483a5e-dcff-4a70-aefb-89ad9d1ffa37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:51.229440 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c5483a5e-dcff-4a70-aefb-89ad9d1ffa37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:51.229932 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c5483a5e-dcff-4a70-aefb-89ad9d1ffa37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:51.230399 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c5483a5e-dcff-4a70-aefb-89ad9d1ffa37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:51.231154 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c5483a5e-dcff-4a70-aefb-89ad9d1ffa37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:51.231618 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c5483a5e-dcff-4a70-aefb-89ad9d1ffa37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:51.232050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c5483a5e-dcff-4a70-aefb-89ad9d1ffa37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:51.368295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c5483a5e-dcff-4a70-aefb-89ad9d1ffa37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:51.376984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c5483a5e-dcff-4a70-aefb-89ad9d1ffa37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.158545 Aug 24 12:48:51.377575 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1073/2146] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:51 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:52.398571 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2660d2fb-d50e-4b5d-aa06-6e9a1b336a04 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:52.399261 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2660d2fb-d50e-4b5d-aa06-6e9a1b336a04 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:52.401511 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=26 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:48:52.406262 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2660d2fb-d50e-4b5d-aa06-6e9a1b336a04 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:52.406750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2660d2fb-d50e-4b5d-aa06-6e9a1b336a04 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:52.407184 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2660d2fb-d50e-4b5d-aa06-6e9a1b336a04 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:52.407870 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2660d2fb-d50e-4b5d-aa06-6e9a1b336a04 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:52.408325 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2660d2fb-d50e-4b5d-aa06-6e9a1b336a04 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:52.408748 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2660d2fb-d50e-4b5d-aa06-6e9a1b336a04 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:52.540571 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2660d2fb-d50e-4b5d-aa06-6e9a1b336a04 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:52.549640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2660d2fb-d50e-4b5d-aa06-6e9a1b336a04 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.154822 Aug 24 12:48:52.550211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1074/2147] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:52 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:48:53.571030 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3e626331-c640-4a3e-8e6e-ed5e672fce4d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:53.571634 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3e626331-c640-4a3e-8e6e-ed5e672fce4d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:53.578277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e626331-c640-4a3e-8e6e-ed5e672fce4d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:53.578994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e626331-c640-4a3e-8e6e-ed5e672fce4d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:53.579587 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e626331-c640-4a3e-8e6e-ed5e672fce4d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:53.580528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e626331-c640-4a3e-8e6e-ed5e672fce4d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:53.580980 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e626331-c640-4a3e-8e6e-ed5e672fce4d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:53.581571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e626331-c640-4a3e-8e6e-ed5e672fce4d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:53.584821 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=78 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:48:53.710670 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3e626331-c640-4a3e-8e6e-ed5e672fce4d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:53.719257 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3e626331-c640-4a3e-8e6e-ed5e672fce4d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.152012 Aug 24 12:48:53.724549 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1074/2148] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:53 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:54.741344 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-724b76bc-8753-4953-9408-f526cc1b8be0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:54.742017 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-724b76bc-8753-4953-9408-f526cc1b8be0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:54.748284 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-724b76bc-8753-4953-9408-f526cc1b8be0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:54.748762 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-724b76bc-8753-4953-9408-f526cc1b8be0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:54.749199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-724b76bc-8753-4953-9408-f526cc1b8be0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:54.749880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-724b76bc-8753-4953-9408-f526cc1b8be0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:54.750332 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-724b76bc-8753-4953-9408-f526cc1b8be0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:54.750791 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-724b76bc-8753-4953-9408-f526cc1b8be0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:54.753295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=78 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:48:54.886371 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-724b76bc-8753-4953-9408-f526cc1b8be0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:54.894547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-724b76bc-8753-4953-9408-f526cc1b8be0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.157289 Aug 24 12:48:54.895138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1075/2149] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:54 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:55.915634 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0102540d-4057-40f8-a373-b2e03b040922 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:55.916248 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0102540d-4057-40f8-a373-b2e03b040922 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:55.923207 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0102540d-4057-40f8-a373-b2e03b040922 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:55.923688 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0102540d-4057-40f8-a373-b2e03b040922 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:55.924123 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0102540d-4057-40f8-a373-b2e03b040922 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:55.924807 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0102540d-4057-40f8-a373-b2e03b040922 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:55.925263 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0102540d-4057-40f8-a373-b2e03b040922 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:55.925684 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0102540d-4057-40f8-a373-b2e03b040922 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:56.052168 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0102540d-4057-40f8-a373-b2e03b040922 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:56.060346 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0102540d-4057-40f8-a373-b2e03b040922 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.148502 Aug 24 12:48:56.060920 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1075/2150] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:55 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:57.081035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-46e14be1-340b-476b-8a44-bd5e943ad2bc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:57.081676 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-46e14be1-340b-476b-8a44-bd5e943ad2bc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:57.088187 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46e14be1-340b-476b-8a44-bd5e943ad2bc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:57.088677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46e14be1-340b-476b-8a44-bd5e943ad2bc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:57.089113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46e14be1-340b-476b-8a44-bd5e943ad2bc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:57.089797 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46e14be1-340b-476b-8a44-bd5e943ad2bc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:57.090251 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46e14be1-340b-476b-8a44-bd5e943ad2bc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:57.090708 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46e14be1-340b-476b-8a44-bd5e943ad2bc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:57.221919 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-46e14be1-340b-476b-8a44-bd5e943ad2bc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:57.230579 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-46e14be1-340b-476b-8a44-bd5e943ad2bc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.153354 Aug 24 12:48:57.231440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1076/2151] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:57 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:58.252853 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fcf79d63-6493-402e-b307-2e32f8aac0b0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:58.253456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fcf79d63-6493-402e-b307-2e32f8aac0b0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:58.259781 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fcf79d63-6493-402e-b307-2e32f8aac0b0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:58.260258 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fcf79d63-6493-402e-b307-2e32f8aac0b0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:58.260692 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fcf79d63-6493-402e-b307-2e32f8aac0b0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:58.261370 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fcf79d63-6493-402e-b307-2e32f8aac0b0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:58.261819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fcf79d63-6493-402e-b307-2e32f8aac0b0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:58.262243 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fcf79d63-6493-402e-b307-2e32f8aac0b0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:58.392167 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fcf79d63-6493-402e-b307-2e32f8aac0b0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:58.400262 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fcf79d63-6493-402e-b307-2e32f8aac0b0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151219 Aug 24 12:48:58.400815 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1076/2152] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:58 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:48:59.421282 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-90cbedda-82f6-4ebe-9a5b-bc2056c0aaf3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:48:59.422434 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-90cbedda-82f6-4ebe-9a5b-bc2056c0aaf3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:48:59.432681 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-90cbedda-82f6-4ebe-9a5b-bc2056c0aaf3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:59.432681 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-90cbedda-82f6-4ebe-9a5b-bc2056c0aaf3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:59.432681 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-90cbedda-82f6-4ebe-9a5b-bc2056c0aaf3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:59.432681 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-90cbedda-82f6-4ebe-9a5b-bc2056c0aaf3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:48:59.433084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-90cbedda-82f6-4ebe-9a5b-bc2056c0aaf3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:48:59.433084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-90cbedda-82f6-4ebe-9a5b-bc2056c0aaf3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:48:59.557929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-90cbedda-82f6-4ebe-9a5b-bc2056c0aaf3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:48:59.566785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-90cbedda-82f6-4ebe-9a5b-bc2056c0aaf3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149358 Aug 24 12:48:59.567342 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1077/2153] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:48:59 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:00.434751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-eca9167d-07d1-4f91-ba96-cfadb28c09ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:00.435256 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-eca9167d-07d1-4f91-ba96-cfadb28c09ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:00.441492 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eca9167d-07d1-4f91-ba96-cfadb28c09ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:00.444084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eca9167d-07d1-4f91-ba96-cfadb28c09ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:00.444666 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eca9167d-07d1-4f91-ba96-cfadb28c09ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:00.445548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eca9167d-07d1-4f91-ba96-cfadb28c09ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:00.446107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eca9167d-07d1-4f91-ba96-cfadb28c09ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:00.446631 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eca9167d-07d1-4f91-ba96-cfadb28c09ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:00.474031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-eca9167d-07d1-4f91-ba96-cfadb28c09ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Going to try to terminate instance {{(pid=121170) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:49:00.587771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e276364f-22e6-48a8-9764-73499cce755c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:00.588353 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e276364f-22e6-48a8-9764-73499cce755c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:00.595111 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e276364f-22e6-48a8-9764-73499cce755c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:00.595611 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e276364f-22e6-48a8-9764-73499cce755c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:00.596038 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e276364f-22e6-48a8-9764-73499cce755c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:00.596717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e276364f-22e6-48a8-9764-73499cce755c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:00.597162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e276364f-22e6-48a8-9764-73499cce755c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:00.597582 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e276364f-22e6-48a8-9764-73499cce755c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:00.714892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-eca9167d-07d1-4f91-ba96-cfadb28c09ea tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 204 len: 0 microversion: 2.20 time: 0.283488 Aug 24 12:49:00.715476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1077/2154] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Aug 24 12:49:00 2022] DELETE /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 12:49:00.723863 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7e8f8eb1-429f-4c08-844a-2e8e0612f649 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:00.724659 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7e8f8eb1-429f-4c08-844a-2e8e0612f649 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:00.728996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e276364f-22e6-48a8-9764-73499cce755c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:00.730818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e8f8eb1-429f-4c08-844a-2e8e0612f649 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:00.731307 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e8f8eb1-429f-4c08-844a-2e8e0612f649 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:00.731740 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e8f8eb1-429f-4c08-844a-2e8e0612f649 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:00.732436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e8f8eb1-429f-4c08-844a-2e8e0612f649 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:00.732886 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e8f8eb1-429f-4c08-844a-2e8e0612f649 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:00.733312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e8f8eb1-429f-4c08-844a-2e8e0612f649 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:00.739595 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e276364f-22e6-48a8-9764-73499cce755c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.155090 Aug 24 12:49:00.740436 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1078/2155] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:00 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:49:00.861535 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7e8f8eb1-429f-4c08-844a-2e8e0612f649 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:00.870356 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7e8f8eb1-429f-4c08-844a-2e8e0612f649 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:00.871871 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7e8f8eb1-429f-4c08-844a-2e8e0612f649 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:00.873560 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7e8f8eb1-429f-4c08-844a-2e8e0612f649 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.153203 Aug 24 12:49:00.874115 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1078/2156] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:00 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:49:01.761180 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-328abf36-e06f-4ee5-83e8-c6661bf8d515 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:01.761786 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-328abf36-e06f-4ee5-83e8-c6661bf8d515 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:01.768098 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-328abf36-e06f-4ee5-83e8-c6661bf8d515 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:01.768580 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-328abf36-e06f-4ee5-83e8-c6661bf8d515 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:01.769007 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-328abf36-e06f-4ee5-83e8-c6661bf8d515 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:01.769679 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-328abf36-e06f-4ee5-83e8-c6661bf8d515 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:01.770124 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-328abf36-e06f-4ee5-83e8-c6661bf8d515 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:01.770542 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-328abf36-e06f-4ee5-83e8-c6661bf8d515 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:01.896986 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-727f5bf0-60ba-4188-b919-72d006864865 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:01.897482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-727f5bf0-60ba-4188-b919-72d006864865 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:01.899369 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-328abf36-e06f-4ee5-83e8-c6661bf8d515 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:01.903862 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-727f5bf0-60ba-4188-b919-72d006864865 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:01.904949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-727f5bf0-60ba-4188-b919-72d006864865 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:01.905387 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-727f5bf0-60ba-4188-b919-72d006864865 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:01.906071 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-727f5bf0-60ba-4188-b919-72d006864865 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:01.906524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-727f5bf0-60ba-4188-b919-72d006864865 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:01.906968 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-727f5bf0-60ba-4188-b919-72d006864865 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:01.908077 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-328abf36-e06f-4ee5-83e8-c6661bf8d515 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150750 Aug 24 12:49:01.908630 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1079/2157] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:01 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:02.037181 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-727f5bf0-60ba-4188-b919-72d006864865 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:02.045832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-727f5bf0-60ba-4188-b919-72d006864865 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:02.047382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-727f5bf0-60ba-4188-b919-72d006864865 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:02.048567 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-727f5bf0-60ba-4188-b919-72d006864865 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155800 Aug 24 12:49:02.049099 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1079/2158] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:01 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:49:02.929229 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-05c0f849-f970-4652-9c51-706ec864625b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:02.929839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-05c0f849-f970-4652-9c51-706ec864625b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:02.936313 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-05c0f849-f970-4652-9c51-706ec864625b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:02.936793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-05c0f849-f970-4652-9c51-706ec864625b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:02.937229 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-05c0f849-f970-4652-9c51-706ec864625b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:02.937904 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-05c0f849-f970-4652-9c51-706ec864625b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:02.938358 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-05c0f849-f970-4652-9c51-706ec864625b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:02.938816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-05c0f849-f970-4652-9c51-706ec864625b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:03.066759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-05c0f849-f970-4652-9c51-706ec864625b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:03.071255 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c6c40ba3-517b-4b42-b27c-5d52ee1bb9c1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:03.071869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c6c40ba3-517b-4b42-b27c-5d52ee1bb9c1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:03.074967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-05c0f849-f970-4652-9c51-706ec864625b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149506 Aug 24 12:49:03.075533 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1080/2159] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:02 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:03.078441 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6c40ba3-517b-4b42-b27c-5d52ee1bb9c1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:03.078952 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6c40ba3-517b-4b42-b27c-5d52ee1bb9c1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:03.079390 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6c40ba3-517b-4b42-b27c-5d52ee1bb9c1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:03.080076 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6c40ba3-517b-4b42-b27c-5d52ee1bb9c1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:03.080532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6c40ba3-517b-4b42-b27c-5d52ee1bb9c1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:03.080955 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6c40ba3-517b-4b42-b27c-5d52ee1bb9c1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:03.209601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c6c40ba3-517b-4b42-b27c-5d52ee1bb9c1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:03.218858 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c6c40ba3-517b-4b42-b27c-5d52ee1bb9c1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:03.220347 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c6c40ba3-517b-4b42-b27c-5d52ee1bb9c1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:03.221507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c6c40ba3-517b-4b42-b27c-5d52ee1bb9c1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154053 Aug 24 12:49:03.222059 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1080/2160] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:03 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:49:04.096131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bdd0ca3d-de00-4822-b40d-fa8762e96c7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:04.096746 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-bdd0ca3d-de00-4822-b40d-fa8762e96c7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:04.103745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bdd0ca3d-de00-4822-b40d-fa8762e96c7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:04.104218 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bdd0ca3d-de00-4822-b40d-fa8762e96c7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:04.104646 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bdd0ca3d-de00-4822-b40d-fa8762e96c7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:04.105315 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bdd0ca3d-de00-4822-b40d-fa8762e96c7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:04.105761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bdd0ca3d-de00-4822-b40d-fa8762e96c7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:04.106177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bdd0ca3d-de00-4822-b40d-fa8762e96c7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:04.231794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-bdd0ca3d-de00-4822-b40d-fa8762e96c7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:04.240093 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bdd0ca3d-de00-4822-b40d-fa8762e96c7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.148427 Aug 24 12:49:04.240641 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1081/2161] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:04 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:04.245120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-981acd73-59a6-4cc0-8dac-daa4f44cc3a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:04.245722 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-981acd73-59a6-4cc0-8dac-daa4f44cc3a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:04.252414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-981acd73-59a6-4cc0-8dac-daa4f44cc3a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:04.252888 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-981acd73-59a6-4cc0-8dac-daa4f44cc3a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:04.253317 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-981acd73-59a6-4cc0-8dac-daa4f44cc3a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:04.253990 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-981acd73-59a6-4cc0-8dac-daa4f44cc3a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:04.254439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-981acd73-59a6-4cc0-8dac-daa4f44cc3a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:04.254883 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-981acd73-59a6-4cc0-8dac-daa4f44cc3a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:04.386150 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-981acd73-59a6-4cc0-8dac-daa4f44cc3a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:04.395215 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-981acd73-59a6-4cc0-8dac-daa4f44cc3a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:04.396691 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-981acd73-59a6-4cc0-8dac-daa4f44cc3a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:04.397873 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-981acd73-59a6-4cc0-8dac-daa4f44cc3a2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.156558 Aug 24 12:49:04.398417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1081/2162] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:04 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:05.260649 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c6a78d34-960d-43dc-85e4-2bb657586625 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:05.261249 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c6a78d34-960d-43dc-85e4-2bb657586625 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:05.267613 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c6a78d34-960d-43dc-85e4-2bb657586625 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:05.268091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c6a78d34-960d-43dc-85e4-2bb657586625 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:05.268521 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c6a78d34-960d-43dc-85e4-2bb657586625 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:05.269195 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c6a78d34-960d-43dc-85e4-2bb657586625 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:05.269646 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c6a78d34-960d-43dc-85e4-2bb657586625 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:05.270066 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c6a78d34-960d-43dc-85e4-2bb657586625 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:05.398812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c6a78d34-960d-43dc-85e4-2bb657586625 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:05.407413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c6a78d34-960d-43dc-85e4-2bb657586625 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150598 Aug 24 12:49:05.407970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1082/2163] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:05 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:05.426877 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-075ab577-aec5-4ee7-ba42-61919c39463f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:05.426877 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-075ab577-aec5-4ee7-ba42-61919c39463f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:05.432556 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-075ab577-aec5-4ee7-ba42-61919c39463f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:05.433033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-075ab577-aec5-4ee7-ba42-61919c39463f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:05.433464 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-075ab577-aec5-4ee7-ba42-61919c39463f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:05.434154 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-075ab577-aec5-4ee7-ba42-61919c39463f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:05.434609 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-075ab577-aec5-4ee7-ba42-61919c39463f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:05.435131 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-075ab577-aec5-4ee7-ba42-61919c39463f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:05.561866 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-075ab577-aec5-4ee7-ba42-61919c39463f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:05.570365 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-075ab577-aec5-4ee7-ba42-61919c39463f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:05.571884 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-075ab577-aec5-4ee7-ba42-61919c39463f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:05.573034 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-075ab577-aec5-4ee7-ba42-61919c39463f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155748 Aug 24 12:49:05.573588 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1082/2164] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:05 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:06.429060 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d4cb6dc4-241b-42ca-99e9-4b4a12dac000 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:06.429669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d4cb6dc4-241b-42ca-99e9-4b4a12dac000 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:06.436559 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d4cb6dc4-241b-42ca-99e9-4b4a12dac000 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:06.437043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d4cb6dc4-241b-42ca-99e9-4b4a12dac000 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:06.437470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d4cb6dc4-241b-42ca-99e9-4b4a12dac000 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:06.438159 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d4cb6dc4-241b-42ca-99e9-4b4a12dac000 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:06.438608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d4cb6dc4-241b-42ca-99e9-4b4a12dac000 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:06.439293 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d4cb6dc4-241b-42ca-99e9-4b4a12dac000 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:06.577204 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d4cb6dc4-241b-42ca-99e9-4b4a12dac000 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:06.585352 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d4cb6dc4-241b-42ca-99e9-4b4a12dac000 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.160074 Aug 24 12:49:06.585903 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1083/2165] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:06 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:06.596913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-64e17578-2529-4aeb-a668-06db0bd824d8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:06.597521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-64e17578-2529-4aeb-a668-06db0bd824d8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:06.603353 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-64e17578-2529-4aeb-a668-06db0bd824d8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:06.603834 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-64e17578-2529-4aeb-a668-06db0bd824d8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:06.604271 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-64e17578-2529-4aeb-a668-06db0bd824d8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:06.604948 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-64e17578-2529-4aeb-a668-06db0bd824d8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:06.605408 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-64e17578-2529-4aeb-a668-06db0bd824d8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:06.605832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-64e17578-2529-4aeb-a668-06db0bd824d8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:06.733333 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-64e17578-2529-4aeb-a668-06db0bd824d8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:06.742057 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-64e17578-2529-4aeb-a668-06db0bd824d8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:06.743560 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-64e17578-2529-4aeb-a668-06db0bd824d8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:06.744692 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-64e17578-2529-4aeb-a668-06db0bd824d8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.151789 Aug 24 12:49:06.745263 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1083/2166] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:06 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:07.607563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-edae91ef-ea9d-482c-ae67-d1643daf8e37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:07.608184 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-edae91ef-ea9d-482c-ae67-d1643daf8e37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:07.614347 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-edae91ef-ea9d-482c-ae67-d1643daf8e37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:07.614845 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-edae91ef-ea9d-482c-ae67-d1643daf8e37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:07.615283 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-edae91ef-ea9d-482c-ae67-d1643daf8e37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:07.615967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-edae91ef-ea9d-482c-ae67-d1643daf8e37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:07.616422 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-edae91ef-ea9d-482c-ae67-d1643daf8e37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:07.616856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-edae91ef-ea9d-482c-ae67-d1643daf8e37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:07.744805 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-edae91ef-ea9d-482c-ae67-d1643daf8e37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:07.753044 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-edae91ef-ea9d-482c-ae67-d1643daf8e37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150494 Aug 24 12:49:07.753597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1084/2167] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:07 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:07.769043 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-675ce978-21f3-40de-ad78-7761f1cb7418 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:07.769673 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-675ce978-21f3-40de-ad78-7761f1cb7418 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:07.775978 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-675ce978-21f3-40de-ad78-7761f1cb7418 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:07.776456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-675ce978-21f3-40de-ad78-7761f1cb7418 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:07.776888 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-675ce978-21f3-40de-ad78-7761f1cb7418 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:07.777561 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-675ce978-21f3-40de-ad78-7761f1cb7418 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:07.778013 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-675ce978-21f3-40de-ad78-7761f1cb7418 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:07.778432 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-675ce978-21f3-40de-ad78-7761f1cb7418 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:07.910433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-675ce978-21f3-40de-ad78-7761f1cb7418 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:07.918939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-675ce978-21f3-40de-ad78-7761f1cb7418 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:07.920429 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-675ce978-21f3-40de-ad78-7761f1cb7418 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:07.921569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-675ce978-21f3-40de-ad78-7761f1cb7418 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.156722 Aug 24 12:49:07.922126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1084/2168] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:07 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:08.773089 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f39a2ea4-0daa-41a3-91ec-b5b29059d7d3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:08.773539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f39a2ea4-0daa-41a3-91ec-b5b29059d7d3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:08.779842 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f39a2ea4-0daa-41a3-91ec-b5b29059d7d3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:08.780315 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f39a2ea4-0daa-41a3-91ec-b5b29059d7d3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:08.780744 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f39a2ea4-0daa-41a3-91ec-b5b29059d7d3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:08.781424 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f39a2ea4-0daa-41a3-91ec-b5b29059d7d3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:08.781869 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f39a2ea4-0daa-41a3-91ec-b5b29059d7d3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:08.782290 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f39a2ea4-0daa-41a3-91ec-b5b29059d7d3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:08.914935 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f39a2ea4-0daa-41a3-91ec-b5b29059d7d3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:08.923059 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f39a2ea4-0daa-41a3-91ec-b5b29059d7d3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.153811 Aug 24 12:49:08.923599 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1085/2169] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:08 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:08.944273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d33fd14e-2edd-442d-ae46-6cfa2c517539 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:08.944878 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d33fd14e-2edd-442d-ae46-6cfa2c517539 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:08.951807 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d33fd14e-2edd-442d-ae46-6cfa2c517539 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:08.952313 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d33fd14e-2edd-442d-ae46-6cfa2c517539 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:08.952753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d33fd14e-2edd-442d-ae46-6cfa2c517539 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:08.953432 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d33fd14e-2edd-442d-ae46-6cfa2c517539 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:08.953889 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d33fd14e-2edd-442d-ae46-6cfa2c517539 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:08.954310 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d33fd14e-2edd-442d-ae46-6cfa2c517539 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:09.079054 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d33fd14e-2edd-442d-ae46-6cfa2c517539 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:09.087516 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d33fd14e-2edd-442d-ae46-6cfa2c517539 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:09.089027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d33fd14e-2edd-442d-ae46-6cfa2c517539 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:09.090169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d33fd14e-2edd-442d-ae46-6cfa2c517539 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.149869 Aug 24 12:49:09.090864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1085/2170] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:08 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:09.944207 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-06bb068b-b059-417d-ba55-5c81ed287c70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:09.944822 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-06bb068b-b059-417d-ba55-5c81ed287c70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:09.951087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-06bb068b-b059-417d-ba55-5c81ed287c70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:09.951568 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-06bb068b-b059-417d-ba55-5c81ed287c70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:09.952002 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-06bb068b-b059-417d-ba55-5c81ed287c70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:09.952686 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-06bb068b-b059-417d-ba55-5c81ed287c70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:09.953139 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-06bb068b-b059-417d-ba55-5c81ed287c70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:09.953565 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-06bb068b-b059-417d-ba55-5c81ed287c70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:10.081540 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-06bb068b-b059-417d-ba55-5c81ed287c70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:10.089621 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-06bb068b-b059-417d-ba55-5c81ed287c70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149217 Aug 24 12:49:10.090154 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1086/2171] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:09 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:10.113117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0da5796f-1361-4ee7-926e-93cd31f856bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:10.113732 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0da5796f-1361-4ee7-926e-93cd31f856bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:10.120078 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0da5796f-1361-4ee7-926e-93cd31f856bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:10.120561 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0da5796f-1361-4ee7-926e-93cd31f856bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:10.120998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0da5796f-1361-4ee7-926e-93cd31f856bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:10.121683 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0da5796f-1361-4ee7-926e-93cd31f856bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:10.122142 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0da5796f-1361-4ee7-926e-93cd31f856bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:10.122570 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0da5796f-1361-4ee7-926e-93cd31f856bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:10.256118 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0da5796f-1361-4ee7-926e-93cd31f856bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:10.265203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0da5796f-1361-4ee7-926e-93cd31f856bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:10.266704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0da5796f-1361-4ee7-926e-93cd31f856bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:10.267860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0da5796f-1361-4ee7-926e-93cd31f856bd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.158970 Aug 24 12:49:10.268408 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1086/2172] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:10 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:11.110938 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3654bb17-1f26-4876-8775-c3b8a696eb67 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:11.111544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3654bb17-1f26-4876-8775-c3b8a696eb67 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:11.118000 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3654bb17-1f26-4876-8775-c3b8a696eb67 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:11.118472 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3654bb17-1f26-4876-8775-c3b8a696eb67 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:11.118936 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3654bb17-1f26-4876-8775-c3b8a696eb67 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:11.119603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3654bb17-1f26-4876-8775-c3b8a696eb67 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:11.120044 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3654bb17-1f26-4876-8775-c3b8a696eb67 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:11.120459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3654bb17-1f26-4876-8775-c3b8a696eb67 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:11.251884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3654bb17-1f26-4876-8775-c3b8a696eb67 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:11.260000 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3654bb17-1f26-4876-8775-c3b8a696eb67 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.152977 Aug 24 12:49:11.260557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1087/2173] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:11 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:11.291039 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-78114989-e157-4261-b64d-e4d8144f47ed tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:11.291655 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-78114989-e157-4261-b64d-e4d8144f47ed tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:11.298192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-78114989-e157-4261-b64d-e4d8144f47ed tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:11.298765 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-78114989-e157-4261-b64d-e4d8144f47ed tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:11.299211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-78114989-e157-4261-b64d-e4d8144f47ed tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:11.299901 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-78114989-e157-4261-b64d-e4d8144f47ed tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:11.300360 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-78114989-e157-4261-b64d-e4d8144f47ed tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:11.300793 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-78114989-e157-4261-b64d-e4d8144f47ed tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:11.427385 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-78114989-e157-4261-b64d-e4d8144f47ed tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:11.436579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-78114989-e157-4261-b64d-e4d8144f47ed tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:11.438082 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-78114989-e157-4261-b64d-e4d8144f47ed tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:11.439288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-78114989-e157-4261-b64d-e4d8144f47ed tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.152148 Aug 24 12:49:11.439839 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1087/2174] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:11 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:12.281671 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-27c96289-3a3e-429d-b362-2cb0d82e3d36 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:12.282258 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-27c96289-3a3e-429d-b362-2cb0d82e3d36 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:12.288551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-27c96289-3a3e-429d-b362-2cb0d82e3d36 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:12.289027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-27c96289-3a3e-429d-b362-2cb0d82e3d36 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:12.289451 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-27c96289-3a3e-429d-b362-2cb0d82e3d36 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:12.290116 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-27c96289-3a3e-429d-b362-2cb0d82e3d36 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:12.290559 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-27c96289-3a3e-429d-b362-2cb0d82e3d36 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:12.291000 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-27c96289-3a3e-429d-b362-2cb0d82e3d36 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:12.416153 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-27c96289-3a3e-429d-b362-2cb0d82e3d36 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:12.424363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-27c96289-3a3e-429d-b362-2cb0d82e3d36 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147079 Aug 24 12:49:12.424983 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1088/2175] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:12 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:12.462698 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-994a90b9-734c-4ec4-8f8e-b0d5123eee8a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:12.463309 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-994a90b9-734c-4ec4-8f8e-b0d5123eee8a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:12.470266 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-994a90b9-734c-4ec4-8f8e-b0d5123eee8a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:12.470771 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-994a90b9-734c-4ec4-8f8e-b0d5123eee8a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:12.471204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-994a90b9-734c-4ec4-8f8e-b0d5123eee8a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:12.471880 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-994a90b9-734c-4ec4-8f8e-b0d5123eee8a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:12.472330 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-994a90b9-734c-4ec4-8f8e-b0d5123eee8a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:12.472751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-994a90b9-734c-4ec4-8f8e-b0d5123eee8a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:12.601198 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-994a90b9-734c-4ec4-8f8e-b0d5123eee8a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:12.609703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-994a90b9-734c-4ec4-8f8e-b0d5123eee8a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:12.611208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-994a90b9-734c-4ec4-8f8e-b0d5123eee8a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:12.613116 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-994a90b9-734c-4ec4-8f8e-b0d5123eee8a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.153662 Aug 24 12:49:12.613715 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1088/2176] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:12 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:13.445240 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b3d9db77-4c3f-4010-8658-d7bd21fe1661 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:13.445843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b3d9db77-4c3f-4010-8658-d7bd21fe1661 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:13.452095 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b3d9db77-4c3f-4010-8658-d7bd21fe1661 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:13.452566 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b3d9db77-4c3f-4010-8658-d7bd21fe1661 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:13.452989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b3d9db77-4c3f-4010-8658-d7bd21fe1661 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:13.453655 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b3d9db77-4c3f-4010-8658-d7bd21fe1661 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:13.454099 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b3d9db77-4c3f-4010-8658-d7bd21fe1661 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:13.454516 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b3d9db77-4c3f-4010-8658-d7bd21fe1661 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:13.578600 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b3d9db77-4c3f-4010-8658-d7bd21fe1661 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:13.586721 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b3d9db77-4c3f-4010-8658-d7bd21fe1661 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.145251 Aug 24 12:49:13.587280 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1089/2177] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:13 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:13.636297 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-21defc28-2133-409b-ba1d-7a5664b58e74 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:13.636911 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-21defc28-2133-409b-ba1d-7a5664b58e74 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:13.643221 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-21defc28-2133-409b-ba1d-7a5664b58e74 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:13.643704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-21defc28-2133-409b-ba1d-7a5664b58e74 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:13.644143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-21defc28-2133-409b-ba1d-7a5664b58e74 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:13.644849 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-21defc28-2133-409b-ba1d-7a5664b58e74 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:13.645306 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-21defc28-2133-409b-ba1d-7a5664b58e74 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:13.645731 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-21defc28-2133-409b-ba1d-7a5664b58e74 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:13.648357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:49:13.776111 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-21defc28-2133-409b-ba1d-7a5664b58e74 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:13.785170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-21defc28-2133-409b-ba1d-7a5664b58e74 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:13.786678 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-21defc28-2133-409b-ba1d-7a5664b58e74 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:13.787824 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-21defc28-2133-409b-ba1d-7a5664b58e74 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155393 Aug 24 12:49:13.788373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1089/2178] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:13 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:14.608584 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5b4e22ae-9cce-45ff-a417-8c386c97423e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:14.609235 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5b4e22ae-9cce-45ff-a417-8c386c97423e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:14.616006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5b4e22ae-9cce-45ff-a417-8c386c97423e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:14.616481 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5b4e22ae-9cce-45ff-a417-8c386c97423e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:14.616909 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5b4e22ae-9cce-45ff-a417-8c386c97423e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:14.617582 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5b4e22ae-9cce-45ff-a417-8c386c97423e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:14.618024 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5b4e22ae-9cce-45ff-a417-8c386c97423e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:14.618440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5b4e22ae-9cce-45ff-a417-8c386c97423e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:14.756377 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5b4e22ae-9cce-45ff-a417-8c386c97423e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:14.765131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5b4e22ae-9cce-45ff-a417-8c386c97423e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.160356 Aug 24 12:49:14.765679 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1090/2179] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:14 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:14.810957 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9a468f9b-39f5-41f9-a09f-b38fa2d91a13 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:14.811570 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9a468f9b-39f5-41f9-a09f-b38fa2d91a13 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:14.817924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a468f9b-39f5-41f9-a09f-b38fa2d91a13 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:14.818398 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a468f9b-39f5-41f9-a09f-b38fa2d91a13 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:14.818868 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a468f9b-39f5-41f9-a09f-b38fa2d91a13 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:14.819756 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a468f9b-39f5-41f9-a09f-b38fa2d91a13 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:14.820328 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a468f9b-39f5-41f9-a09f-b38fa2d91a13 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:14.820811 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a468f9b-39f5-41f9-a09f-b38fa2d91a13 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:14.951786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9a468f9b-39f5-41f9-a09f-b38fa2d91a13 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:14.960786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9a468f9b-39f5-41f9-a09f-b38fa2d91a13 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:14.962261 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9a468f9b-39f5-41f9-a09f-b38fa2d91a13 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:14.963459 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9a468f9b-39f5-41f9-a09f-b38fa2d91a13 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.156584 Aug 24 12:49:14.964000 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1090/2180] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:14 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:15.785854 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-710fb17c-e915-4ba2-b786-2c89e86d7047 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:15.786467 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-710fb17c-e915-4ba2-b786-2c89e86d7047 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:15.792619 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-710fb17c-e915-4ba2-b786-2c89e86d7047 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:15.793103 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-710fb17c-e915-4ba2-b786-2c89e86d7047 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:15.793538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-710fb17c-e915-4ba2-b786-2c89e86d7047 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:15.794256 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-710fb17c-e915-4ba2-b786-2c89e86d7047 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:15.794740 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-710fb17c-e915-4ba2-b786-2c89e86d7047 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:15.795170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-710fb17c-e915-4ba2-b786-2c89e86d7047 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:15.919916 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-710fb17c-e915-4ba2-b786-2c89e86d7047 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:15.922702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:49:15.929218 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-710fb17c-e915-4ba2-b786-2c89e86d7047 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147293 Aug 24 12:49:15.929773 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1091/2181] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:15 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:15.986560 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-54fd42cb-d453-45c8-89f5-43b6d0aa677d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:15.987206 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-54fd42cb-d453-45c8-89f5-43b6d0aa677d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:15.993819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-54fd42cb-d453-45c8-89f5-43b6d0aa677d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:15.994296 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-54fd42cb-d453-45c8-89f5-43b6d0aa677d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:15.994811 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-54fd42cb-d453-45c8-89f5-43b6d0aa677d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:15.995496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-54fd42cb-d453-45c8-89f5-43b6d0aa677d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:15.995950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-54fd42cb-d453-45c8-89f5-43b6d0aa677d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:15.996375 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-54fd42cb-d453-45c8-89f5-43b6d0aa677d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:16.128947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-54fd42cb-d453-45c8-89f5-43b6d0aa677d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:16.137574 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-54fd42cb-d453-45c8-89f5-43b6d0aa677d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:16.139097 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-54fd42cb-d453-45c8-89f5-43b6d0aa677d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:16.140248 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-54fd42cb-d453-45c8-89f5-43b6d0aa677d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.158225 Aug 24 12:49:16.140795 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1091/2182] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:15 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:16.950225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-86897097-78be-482e-839d-95227b5ec18d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:16.950858 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-86897097-78be-482e-839d-95227b5ec18d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:16.957764 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86897097-78be-482e-839d-95227b5ec18d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:16.958239 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86897097-78be-482e-839d-95227b5ec18d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:16.958679 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86897097-78be-482e-839d-95227b5ec18d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:16.959363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86897097-78be-482e-839d-95227b5ec18d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:16.960079 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86897097-78be-482e-839d-95227b5ec18d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:16.960504 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86897097-78be-482e-839d-95227b5ec18d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:17.089961 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-86897097-78be-482e-839d-95227b5ec18d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:17.098033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-86897097-78be-482e-839d-95227b5ec18d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.152037 Aug 24 12:49:17.098587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1092/2183] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:16 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:17.163323 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d52a804c-7016-4ad8-9f81-42dd465f641b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:17.164024 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d52a804c-7016-4ad8-9f81-42dd465f641b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:17.166252 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:49:17.171495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d52a804c-7016-4ad8-9f81-42dd465f641b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:17.171979 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d52a804c-7016-4ad8-9f81-42dd465f641b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:17.172410 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d52a804c-7016-4ad8-9f81-42dd465f641b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:17.173081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d52a804c-7016-4ad8-9f81-42dd465f641b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:17.173525 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d52a804c-7016-4ad8-9f81-42dd465f641b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:17.173942 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d52a804c-7016-4ad8-9f81-42dd465f641b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:17.304349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d52a804c-7016-4ad8-9f81-42dd465f641b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:17.313264 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d52a804c-7016-4ad8-9f81-42dd465f641b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:17.314780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d52a804c-7016-4ad8-9f81-42dd465f641b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:17.315966 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d52a804c-7016-4ad8-9f81-42dd465f641b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.156499 Aug 24 12:49:17.316513 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1092/2184] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:17 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:18.119247 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-418f88cc-341b-4efd-bde4-915364f99240 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:18.119859 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-418f88cc-341b-4efd-bde4-915364f99240 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:18.126800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-418f88cc-341b-4efd-bde4-915364f99240 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:18.127283 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-418f88cc-341b-4efd-bde4-915364f99240 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:18.127719 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-418f88cc-341b-4efd-bde4-915364f99240 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:18.128393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-418f88cc-341b-4efd-bde4-915364f99240 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:18.128845 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-418f88cc-341b-4efd-bde4-915364f99240 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:18.129270 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-418f88cc-341b-4efd-bde4-915364f99240 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:18.260857 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-418f88cc-341b-4efd-bde4-915364f99240 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:18.270070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-418f88cc-341b-4efd-bde4-915364f99240 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.154529 Aug 24 12:49:18.270827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1093/2185] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:18 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:18.338457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6cedcf91-c1aa-4983-a129-910c71ba7d37 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:18.339100 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6cedcf91-c1aa-4983-a129-910c71ba7d37 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:18.345473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6cedcf91-c1aa-4983-a129-910c71ba7d37 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:18.345955 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6cedcf91-c1aa-4983-a129-910c71ba7d37 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:18.346393 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6cedcf91-c1aa-4983-a129-910c71ba7d37 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:18.347111 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6cedcf91-c1aa-4983-a129-910c71ba7d37 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:18.347569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6cedcf91-c1aa-4983-a129-910c71ba7d37 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:18.347997 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6cedcf91-c1aa-4983-a129-910c71ba7d37 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:18.482187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6cedcf91-c1aa-4983-a129-910c71ba7d37 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:18.491089 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6cedcf91-c1aa-4983-a129-910c71ba7d37 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:18.492586 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6cedcf91-c1aa-4983-a129-910c71ba7d37 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:18.493745 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6cedcf91-c1aa-4983-a129-910c71ba7d37 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.159145 Aug 24 12:49:18.494302 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1093/2186] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:18 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:19.290661 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-30b8709e-bacd-4eb2-b0f0-97cb29dfef01 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:19.291309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-30b8709e-bacd-4eb2-b0f0-97cb29dfef01 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:19.298077 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-30b8709e-bacd-4eb2-b0f0-97cb29dfef01 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:19.298556 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-30b8709e-bacd-4eb2-b0f0-97cb29dfef01 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:19.299016 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-30b8709e-bacd-4eb2-b0f0-97cb29dfef01 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:19.299694 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-30b8709e-bacd-4eb2-b0f0-97cb29dfef01 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:19.300149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-30b8709e-bacd-4eb2-b0f0-97cb29dfef01 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:19.300572 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-30b8709e-bacd-4eb2-b0f0-97cb29dfef01 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:19.432912 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-30b8709e-bacd-4eb2-b0f0-97cb29dfef01 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:19.441193 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-30b8709e-bacd-4eb2-b0f0-97cb29dfef01 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.154347 Aug 24 12:49:19.441835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1094/2187] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:19 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:19.516394 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0d0dc792-073b-4d0b-a569-ec05415f7498 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:19.517006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0d0dc792-073b-4d0b-a569-ec05415f7498 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:19.523329 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0d0dc792-073b-4d0b-a569-ec05415f7498 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:19.523813 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0d0dc792-073b-4d0b-a569-ec05415f7498 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:19.524250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0d0dc792-073b-4d0b-a569-ec05415f7498 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:19.524937 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0d0dc792-073b-4d0b-a569-ec05415f7498 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:19.525393 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0d0dc792-073b-4d0b-a569-ec05415f7498 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:19.525850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0d0dc792-073b-4d0b-a569-ec05415f7498 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:19.652547 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0d0dc792-073b-4d0b-a569-ec05415f7498 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:19.661574 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0d0dc792-073b-4d0b-a569-ec05415f7498 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:19.663082 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0d0dc792-073b-4d0b-a569-ec05415f7498 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:19.664236 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0d0dc792-073b-4d0b-a569-ec05415f7498 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.151709 Aug 24 12:49:19.664780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1094/2188] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:19 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:20.462474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6a7a9255-f754-4c29-9f25-921933872fca tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:20.463113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6a7a9255-f754-4c29-9f25-921933872fca tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:20.470020 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6a7a9255-f754-4c29-9f25-921933872fca tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:20.470499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6a7a9255-f754-4c29-9f25-921933872fca tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:20.470953 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6a7a9255-f754-4c29-9f25-921933872fca tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:20.471629 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6a7a9255-f754-4c29-9f25-921933872fca tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:20.472073 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6a7a9255-f754-4c29-9f25-921933872fca tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:20.472490 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6a7a9255-f754-4c29-9f25-921933872fca tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:20.600383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6a7a9255-f754-4c29-9f25-921933872fca tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:20.608414 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6a7a9255-f754-4c29-9f25-921933872fca tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149703 Aug 24 12:49:20.609098 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1095/2189] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:20 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:20.687313 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-78d786d9-f9b9-41a5-ab72-545b8f670e1b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:20.687848 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-78d786d9-f9b9-41a5-ab72-545b8f670e1b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:20.694231 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-78d786d9-f9b9-41a5-ab72-545b8f670e1b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:20.694740 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-78d786d9-f9b9-41a5-ab72-545b8f670e1b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:20.695177 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-78d786d9-f9b9-41a5-ab72-545b8f670e1b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:20.695856 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-78d786d9-f9b9-41a5-ab72-545b8f670e1b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:20.696311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-78d786d9-f9b9-41a5-ab72-545b8f670e1b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:20.696736 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-78d786d9-f9b9-41a5-ab72-545b8f670e1b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:20.823072 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-78d786d9-f9b9-41a5-ab72-545b8f670e1b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:20.832102 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-78d786d9-f9b9-41a5-ab72-545b8f670e1b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:20.833613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-78d786d9-f9b9-41a5-ab72-545b8f670e1b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:20.834870 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-78d786d9-f9b9-41a5-ab72-545b8f670e1b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.151505 Aug 24 12:49:20.835440 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1095/2190] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:20 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:21.632447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ebb35bee-15f5-45c3-8382-6c401634d080 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:21.633033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ebb35bee-15f5-45c3-8382-6c401634d080 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:21.639522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ebb35bee-15f5-45c3-8382-6c401634d080 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:21.640004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ebb35bee-15f5-45c3-8382-6c401634d080 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:21.640449 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ebb35bee-15f5-45c3-8382-6c401634d080 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:21.641162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ebb35bee-15f5-45c3-8382-6c401634d080 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:21.641621 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ebb35bee-15f5-45c3-8382-6c401634d080 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:21.642054 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ebb35bee-15f5-45c3-8382-6c401634d080 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:21.769609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ebb35bee-15f5-45c3-8382-6c401634d080 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:21.777747 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ebb35bee-15f5-45c3-8382-6c401634d080 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149238 Aug 24 12:49:21.778300 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1096/2191] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:21 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:21.857263 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f07338a0-cbe0-4227-bf46-e152a1a659a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:21.857872 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f07338a0-cbe0-4227-bf46-e152a1a659a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:21.865339 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f07338a0-cbe0-4227-bf46-e152a1a659a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:21.865816 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f07338a0-cbe0-4227-bf46-e152a1a659a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:21.866251 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f07338a0-cbe0-4227-bf46-e152a1a659a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:21.867008 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f07338a0-cbe0-4227-bf46-e152a1a659a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:21.867467 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f07338a0-cbe0-4227-bf46-e152a1a659a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:21.867890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f07338a0-cbe0-4227-bf46-e152a1a659a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:21.998621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f07338a0-cbe0-4227-bf46-e152a1a659a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:22.007319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f07338a0-cbe0-4227-bf46-e152a1a659a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:22.008811 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f07338a0-cbe0-4227-bf46-e152a1a659a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:22.009964 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f07338a0-cbe0-4227-bf46-e152a1a659a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.156605 Aug 24 12:49:22.010505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1096/2192] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:21 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:22.798955 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2f7a1ab2-3977-4519-88e3-0c0eda371dac tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:22.799573 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2f7a1ab2-3977-4519-88e3-0c0eda371dac tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:22.801882 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=46 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:49:22.806496 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f7a1ab2-3977-4519-88e3-0c0eda371dac tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:22.807011 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f7a1ab2-3977-4519-88e3-0c0eda371dac tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:22.807482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f7a1ab2-3977-4519-88e3-0c0eda371dac tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:22.808167 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f7a1ab2-3977-4519-88e3-0c0eda371dac tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:22.808619 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f7a1ab2-3977-4519-88e3-0c0eda371dac tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:22.809049 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f7a1ab2-3977-4519-88e3-0c0eda371dac tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:22.941816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2f7a1ab2-3977-4519-88e3-0c0eda371dac tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:22.949906 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2f7a1ab2-3977-4519-88e3-0c0eda371dac tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.155378 Aug 24 12:49:22.950455 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1097/2193] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:22 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:23.033525 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-cf7100b1-1c29-4d1f-8d6c-d171163a038b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:23.034161 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-cf7100b1-1c29-4d1f-8d6c-d171163a038b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:23.040757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cf7100b1-1c29-4d1f-8d6c-d171163a038b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:23.041243 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cf7100b1-1c29-4d1f-8d6c-d171163a038b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:23.041683 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cf7100b1-1c29-4d1f-8d6c-d171163a038b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:23.042367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cf7100b1-1c29-4d1f-8d6c-d171163a038b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:23.042940 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cf7100b1-1c29-4d1f-8d6c-d171163a038b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:23.043315 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cf7100b1-1c29-4d1f-8d6c-d171163a038b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:23.170074 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-cf7100b1-1c29-4d1f-8d6c-d171163a038b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:23.179311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-cf7100b1-1c29-4d1f-8d6c-d171163a038b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:23.180825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-cf7100b1-1c29-4d1f-8d6c-d171163a038b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:23.181958 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-cf7100b1-1c29-4d1f-8d6c-d171163a038b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.152466 Aug 24 12:49:23.182506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1097/2194] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:23 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:23.970337 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3afa9c41-4f9d-4d85-a69c-590cb348a103 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:23.970892 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3afa9c41-4f9d-4d85-a69c-590cb348a103 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:23.977268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3afa9c41-4f9d-4d85-a69c-590cb348a103 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:23.977742 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3afa9c41-4f9d-4d85-a69c-590cb348a103 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:23.978206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3afa9c41-4f9d-4d85-a69c-590cb348a103 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:23.978905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3afa9c41-4f9d-4d85-a69c-590cb348a103 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:23.979363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3afa9c41-4f9d-4d85-a69c-590cb348a103 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:23.979780 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3afa9c41-4f9d-4d85-a69c-590cb348a103 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:24.108070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3afa9c41-4f9d-4d85-a69c-590cb348a103 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:24.116622 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3afa9c41-4f9d-4d85-a69c-590cb348a103 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150231 Aug 24 12:49:24.117205 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1098/2195] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:23 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:24.204382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-377c2b42-a4fa-4310-9afb-d1b626531dd4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:24.204992 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-377c2b42-a4fa-4310-9afb-d1b626531dd4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:24.211371 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-377c2b42-a4fa-4310-9afb-d1b626531dd4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:24.211854 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-377c2b42-a4fa-4310-9afb-d1b626531dd4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:24.212293 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-377c2b42-a4fa-4310-9afb-d1b626531dd4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:24.212974 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-377c2b42-a4fa-4310-9afb-d1b626531dd4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:24.213430 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-377c2b42-a4fa-4310-9afb-d1b626531dd4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:24.213853 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-377c2b42-a4fa-4310-9afb-d1b626531dd4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:24.344485 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-377c2b42-a4fa-4310-9afb-d1b626531dd4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:24.352982 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-377c2b42-a4fa-4310-9afb-d1b626531dd4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:24.354476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-377c2b42-a4fa-4310-9afb-d1b626531dd4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:24.355654 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-377c2b42-a4fa-4310-9afb-d1b626531dd4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155763 Aug 24 12:49:24.356201 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1098/2196] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:24 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:25.137939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a2438c24-05ed-4cf9-afd7-d860b1e2f46b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:25.138522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a2438c24-05ed-4cf9-afd7-d860b1e2f46b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:25.145350 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2438c24-05ed-4cf9-afd7-d860b1e2f46b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:25.145825 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2438c24-05ed-4cf9-afd7-d860b1e2f46b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:25.146256 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2438c24-05ed-4cf9-afd7-d860b1e2f46b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:25.146955 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2438c24-05ed-4cf9-afd7-d860b1e2f46b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:25.147405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2438c24-05ed-4cf9-afd7-d860b1e2f46b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:25.148089 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2438c24-05ed-4cf9-afd7-d860b1e2f46b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:25.277333 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a2438c24-05ed-4cf9-afd7-d860b1e2f46b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:25.286221 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a2438c24-05ed-4cf9-afd7-d860b1e2f46b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.152050 Aug 24 12:49:25.286817 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1099/2197] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:25 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:25.379245 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-530a3c9d-c6f3-4041-acc4-1bd740b78303 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:25.379850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-530a3c9d-c6f3-4041-acc4-1bd740b78303 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:25.386156 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-530a3c9d-c6f3-4041-acc4-1bd740b78303 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:25.386632 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-530a3c9d-c6f3-4041-acc4-1bd740b78303 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:25.387101 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-530a3c9d-c6f3-4041-acc4-1bd740b78303 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:25.387778 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-530a3c9d-c6f3-4041-acc4-1bd740b78303 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:25.388283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-530a3c9d-c6f3-4041-acc4-1bd740b78303 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:25.388656 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-530a3c9d-c6f3-4041-acc4-1bd740b78303 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:25.519321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-530a3c9d-c6f3-4041-acc4-1bd740b78303 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:25.527928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-530a3c9d-c6f3-4041-acc4-1bd740b78303 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:25.529437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-530a3c9d-c6f3-4041-acc4-1bd740b78303 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:25.530584 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-530a3c9d-c6f3-4041-acc4-1bd740b78303 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155186 Aug 24 12:49:25.531155 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1099/2198] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:25 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:26.306890 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e4d7c096-4ea8-4414-9247-f6f60e21c48c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:26.307519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e4d7c096-4ea8-4414-9247-f6f60e21c48c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:26.314390 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4d7c096-4ea8-4414-9247-f6f60e21c48c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:26.314892 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4d7c096-4ea8-4414-9247-f6f60e21c48c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:26.315324 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4d7c096-4ea8-4414-9247-f6f60e21c48c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:26.316000 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4d7c096-4ea8-4414-9247-f6f60e21c48c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:26.316447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4d7c096-4ea8-4414-9247-f6f60e21c48c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:26.316864 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4d7c096-4ea8-4414-9247-f6f60e21c48c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:26.443377 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e4d7c096-4ea8-4414-9247-f6f60e21c48c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:26.451392 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e4d7c096-4ea8-4414-9247-f6f60e21c48c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.148376 Aug 24 12:49:26.452529 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1100/2199] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:26 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:26.553264 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-29709457-8ff2-4f14-8e37-d0e4ce6cbe66 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:26.553890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-29709457-8ff2-4f14-8e37-d0e4ce6cbe66 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:26.560179 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29709457-8ff2-4f14-8e37-d0e4ce6cbe66 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:26.560653 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29709457-8ff2-4f14-8e37-d0e4ce6cbe66 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:26.561084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29709457-8ff2-4f14-8e37-d0e4ce6cbe66 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:26.562455 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29709457-8ff2-4f14-8e37-d0e4ce6cbe66 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:26.562927 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29709457-8ff2-4f14-8e37-d0e4ce6cbe66 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:26.563352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29709457-8ff2-4f14-8e37-d0e4ce6cbe66 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:26.695159 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-29709457-8ff2-4f14-8e37-d0e4ce6cbe66 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:26.704052 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-29709457-8ff2-4f14-8e37-d0e4ce6cbe66 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:26.705564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-29709457-8ff2-4f14-8e37-d0e4ce6cbe66 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:26.706736 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-29709457-8ff2-4f14-8e37-d0e4ce6cbe66 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.157378 Aug 24 12:49:26.707273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1100/2200] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:26 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:27.473045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-14cfb847-31a3-4087-bd3b-3c159495fd63 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:27.473650 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-14cfb847-31a3-4087-bd3b-3c159495fd63 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:27.479962 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14cfb847-31a3-4087-bd3b-3c159495fd63 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:27.480436 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14cfb847-31a3-4087-bd3b-3c159495fd63 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:27.480872 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14cfb847-31a3-4087-bd3b-3c159495fd63 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:27.481541 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14cfb847-31a3-4087-bd3b-3c159495fd63 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:27.481992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14cfb847-31a3-4087-bd3b-3c159495fd63 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:27.482414 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14cfb847-31a3-4087-bd3b-3c159495fd63 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:27.608461 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-14cfb847-31a3-4087-bd3b-3c159495fd63 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:27.617044 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-14cfb847-31a3-4087-bd3b-3c159495fd63 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147915 Aug 24 12:49:27.617596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1101/2201] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:27 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:27.729387 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0b94cdb6-b211-4327-9561-08ed0fae0e39 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:27.729911 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0b94cdb6-b211-4327-9561-08ed0fae0e39 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:27.736370 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b94cdb6-b211-4327-9561-08ed0fae0e39 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:27.736855 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b94cdb6-b211-4327-9561-08ed0fae0e39 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:27.737299 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b94cdb6-b211-4327-9561-08ed0fae0e39 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:27.738245 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b94cdb6-b211-4327-9561-08ed0fae0e39 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:27.738724 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b94cdb6-b211-4327-9561-08ed0fae0e39 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:27.739180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b94cdb6-b211-4327-9561-08ed0fae0e39 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:27.871491 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0b94cdb6-b211-4327-9561-08ed0fae0e39 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:27.880886 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0b94cdb6-b211-4327-9561-08ed0fae0e39 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:27.882376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0b94cdb6-b211-4327-9561-08ed0fae0e39 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:27.883562 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0b94cdb6-b211-4327-9561-08ed0fae0e39 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.158163 Aug 24 12:49:27.884114 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1101/2202] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:27 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:28.638031 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-eab76cca-e1ca-4dc0-aa39-497fdd385b05 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:28.638472 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-eab76cca-e1ca-4dc0-aa39-497fdd385b05 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:28.644735 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eab76cca-e1ca-4dc0-aa39-497fdd385b05 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:28.645215 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eab76cca-e1ca-4dc0-aa39-497fdd385b05 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:28.645651 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eab76cca-e1ca-4dc0-aa39-497fdd385b05 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:28.646331 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eab76cca-e1ca-4dc0-aa39-497fdd385b05 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:28.646816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eab76cca-e1ca-4dc0-aa39-497fdd385b05 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:28.647239 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eab76cca-e1ca-4dc0-aa39-497fdd385b05 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:28.785795 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-eab76cca-e1ca-4dc0-aa39-497fdd385b05 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:28.793986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-eab76cca-e1ca-4dc0-aa39-497fdd385b05 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.160084 Aug 24 12:49:28.794545 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1102/2203] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:28 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:28.907185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-928ef077-3f46-445a-8ce7-ccfffb4848f7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:28.907788 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-928ef077-3f46-445a-8ce7-ccfffb4848f7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:28.914000 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-928ef077-3f46-445a-8ce7-ccfffb4848f7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:28.914480 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-928ef077-3f46-445a-8ce7-ccfffb4848f7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:28.914941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-928ef077-3f46-445a-8ce7-ccfffb4848f7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:28.915613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-928ef077-3f46-445a-8ce7-ccfffb4848f7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:28.916061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-928ef077-3f46-445a-8ce7-ccfffb4848f7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:28.916479 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-928ef077-3f46-445a-8ce7-ccfffb4848f7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:29.044168 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-928ef077-3f46-445a-8ce7-ccfffb4848f7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:29.053107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-928ef077-3f46-445a-8ce7-ccfffb4848f7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:29.054669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-928ef077-3f46-445a-8ce7-ccfffb4848f7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:29.055834 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-928ef077-3f46-445a-8ce7-ccfffb4848f7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.153110 Aug 24 12:49:29.056382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1102/2204] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:28 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:29.815091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-01bc6552-37c0-4ea2-8b08-27dcc1f943e7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:29.815701 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-01bc6552-37c0-4ea2-8b08-27dcc1f943e7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:29.821983 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01bc6552-37c0-4ea2-8b08-27dcc1f943e7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:29.822460 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01bc6552-37c0-4ea2-8b08-27dcc1f943e7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:29.822932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01bc6552-37c0-4ea2-8b08-27dcc1f943e7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:29.823612 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01bc6552-37c0-4ea2-8b08-27dcc1f943e7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:29.824063 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01bc6552-37c0-4ea2-8b08-27dcc1f943e7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:29.824485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01bc6552-37c0-4ea2-8b08-27dcc1f943e7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:29.952251 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-01bc6552-37c0-4ea2-8b08-27dcc1f943e7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:29.960682 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-01bc6552-37c0-4ea2-8b08-27dcc1f943e7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150069 Aug 24 12:49:29.961231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1103/2205] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:29 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:30.078393 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5f05fddb-3678-4413-912c-45839f002224 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:30.079020 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5f05fddb-3678-4413-912c-45839f002224 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:30.085450 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f05fddb-3678-4413-912c-45839f002224 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:30.085934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f05fddb-3678-4413-912c-45839f002224 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:30.086365 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f05fddb-3678-4413-912c-45839f002224 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:30.087081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f05fddb-3678-4413-912c-45839f002224 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:30.087533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f05fddb-3678-4413-912c-45839f002224 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:30.087957 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f05fddb-3678-4413-912c-45839f002224 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:30.218405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5f05fddb-3678-4413-912c-45839f002224 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:30.226361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5f05fddb-3678-4413-912c-45839f002224 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:30.227930 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5f05fddb-3678-4413-912c-45839f002224 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:30.229098 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5f05fddb-3678-4413-912c-45839f002224 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155206 Aug 24 12:49:30.229851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1103/2206] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:30 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:49:30.981306 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9517149c-eb25-447f-85dd-46441c21f0b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:30.981978 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9517149c-eb25-447f-85dd-46441c21f0b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:30.991577 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9517149c-eb25-447f-85dd-46441c21f0b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:30.991577 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9517149c-eb25-447f-85dd-46441c21f0b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:30.991577 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9517149c-eb25-447f-85dd-46441c21f0b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:30.991577 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9517149c-eb25-447f-85dd-46441c21f0b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:30.992088 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9517149c-eb25-447f-85dd-46441c21f0b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:30.992088 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9517149c-eb25-447f-85dd-46441c21f0b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:31.122023 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9517149c-eb25-447f-85dd-46441c21f0b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:31.130072 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9517149c-eb25-447f-85dd-46441c21f0b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.152728 Aug 24 12:49:31.130625 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1104/2207] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:30 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:31.252849 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-da6732d4-521d-4626-83e4-3b3ab0e1f104 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:31.253465 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-da6732d4-521d-4626-83e4-3b3ab0e1f104 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:31.259861 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da6732d4-521d-4626-83e4-3b3ab0e1f104 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:31.260350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da6732d4-521d-4626-83e4-3b3ab0e1f104 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:31.260790 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da6732d4-521d-4626-83e4-3b3ab0e1f104 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:31.261477 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da6732d4-521d-4626-83e4-3b3ab0e1f104 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:31.261936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da6732d4-521d-4626-83e4-3b3ab0e1f104 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:31.262364 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-da6732d4-521d-4626-83e4-3b3ab0e1f104 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:31.389137 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-da6732d4-521d-4626-83e4-3b3ab0e1f104 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:31.398289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-da6732d4-521d-4626-83e4-3b3ab0e1f104 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:31.399814 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-da6732d4-521d-4626-83e4-3b3ab0e1f104 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:31.400974 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-da6732d4-521d-4626-83e4-3b3ab0e1f104 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.152158 Aug 24 12:49:31.401533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1104/2208] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:31 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:32.151284 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bb4b4aae-6c63-4c42-ad08-3d76dac8ef37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:32.151926 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-bb4b4aae-6c63-4c42-ad08-3d76dac8ef37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:32.158254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb4b4aae-6c63-4c42-ad08-3d76dac8ef37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:32.158763 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb4b4aae-6c63-4c42-ad08-3d76dac8ef37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:32.159198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb4b4aae-6c63-4c42-ad08-3d76dac8ef37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:32.159875 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb4b4aae-6c63-4c42-ad08-3d76dac8ef37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:32.160326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb4b4aae-6c63-4c42-ad08-3d76dac8ef37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:32.160749 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb4b4aae-6c63-4c42-ad08-3d76dac8ef37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:32.285548 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-bb4b4aae-6c63-4c42-ad08-3d76dac8ef37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:32.293732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bb4b4aae-6c63-4c42-ad08-3d76dac8ef37 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.146216 Aug 24 12:49:32.294227 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1105/2209] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:32 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:32.423639 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-afc5511c-b711-49e7-9d78-23d9e8fcf0b7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:32.424246 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-afc5511c-b711-49e7-9d78-23d9e8fcf0b7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:32.431260 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-afc5511c-b711-49e7-9d78-23d9e8fcf0b7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:32.431750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-afc5511c-b711-49e7-9d78-23d9e8fcf0b7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:32.432210 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-afc5511c-b711-49e7-9d78-23d9e8fcf0b7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:32.432904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-afc5511c-b711-49e7-9d78-23d9e8fcf0b7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:32.433360 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-afc5511c-b711-49e7-9d78-23d9e8fcf0b7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:32.433784 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-afc5511c-b711-49e7-9d78-23d9e8fcf0b7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:32.564094 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-afc5511c-b711-49e7-9d78-23d9e8fcf0b7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:32.566224 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:49:32.573115 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-afc5511c-b711-49e7-9d78-23d9e8fcf0b7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:32.574598 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-afc5511c-b711-49e7-9d78-23d9e8fcf0b7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:32.575770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-afc5511c-b711-49e7-9d78-23d9e8fcf0b7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155982 Aug 24 12:49:32.576326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1105/2210] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:32 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:49:33.314906 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-28978332-a6d9-4d03-9123-580302b4dbd0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:33.315526 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-28978332-a6d9-4d03-9123-580302b4dbd0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:33.323291 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28978332-a6d9-4d03-9123-580302b4dbd0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:33.323987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28978332-a6d9-4d03-9123-580302b4dbd0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:33.324586 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28978332-a6d9-4d03-9123-580302b4dbd0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:33.325260 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28978332-a6d9-4d03-9123-580302b4dbd0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:33.325701 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28978332-a6d9-4d03-9123-580302b4dbd0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:33.326118 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28978332-a6d9-4d03-9123-580302b4dbd0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:33.464147 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-28978332-a6d9-4d03-9123-580302b4dbd0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:33.472238 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-28978332-a6d9-4d03-9123-580302b4dbd0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.161894 Aug 24 12:49:33.472846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1106/2211] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:33 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:33.599310 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f1ad8930-833e-479b-a069-5a2d5a0898a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:33.599925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f1ad8930-833e-479b-a069-5a2d5a0898a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:33.607084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1ad8930-833e-479b-a069-5a2d5a0898a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:33.607650 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1ad8930-833e-479b-a069-5a2d5a0898a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:33.608749 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1ad8930-833e-479b-a069-5a2d5a0898a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:33.609547 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1ad8930-833e-479b-a069-5a2d5a0898a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:33.610076 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1ad8930-833e-479b-a069-5a2d5a0898a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:33.610577 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1ad8930-833e-479b-a069-5a2d5a0898a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:33.744919 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f1ad8930-833e-479b-a069-5a2d5a0898a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:33.753571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f1ad8930-833e-479b-a069-5a2d5a0898a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:33.755067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f1ad8930-833e-479b-a069-5a2d5a0898a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:33.756217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f1ad8930-833e-479b-a069-5a2d5a0898a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.160883 Aug 24 12:49:33.756768 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1106/2212] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:33 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:34.495020 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-84d0245a-d782-4db0-95fc-c94aaf2834f1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:34.495652 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-84d0245a-d782-4db0-95fc-c94aaf2834f1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:34.502534 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-84d0245a-d782-4db0-95fc-c94aaf2834f1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:34.503107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-84d0245a-d782-4db0-95fc-c94aaf2834f1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:34.503535 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-84d0245a-d782-4db0-95fc-c94aaf2834f1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:34.504205 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-84d0245a-d782-4db0-95fc-c94aaf2834f1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:34.504651 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-84d0245a-d782-4db0-95fc-c94aaf2834f1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:34.505068 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-84d0245a-d782-4db0-95fc-c94aaf2834f1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:34.630021 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-84d0245a-d782-4db0-95fc-c94aaf2834f1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:34.638148 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-84d0245a-d782-4db0-95fc-c94aaf2834f1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.146918 Aug 24 12:49:34.638724 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1107/2213] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:34 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:34.778998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-098236a2-9001-4f4d-a1a0-83483d515e78 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:34.784952 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-098236a2-9001-4f4d-a1a0-83483d515e78 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:34.785950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-098236a2-9001-4f4d-a1a0-83483d515e78 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:34.786426 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-098236a2-9001-4f4d-a1a0-83483d515e78 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:34.786881 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-098236a2-9001-4f4d-a1a0-83483d515e78 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:34.787741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-098236a2-9001-4f4d-a1a0-83483d515e78 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:34.788195 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-098236a2-9001-4f4d-a1a0-83483d515e78 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:34.788616 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-098236a2-9001-4f4d-a1a0-83483d515e78 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:34.917628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-098236a2-9001-4f4d-a1a0-83483d515e78 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:34.926820 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-098236a2-9001-4f4d-a1a0-83483d515e78 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:34.928337 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-098236a2-9001-4f4d-a1a0-83483d515e78 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:34.929546 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-098236a2-9001-4f4d-a1a0-83483d515e78 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154458 Aug 24 12:49:34.930103 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1107/2214] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:34 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:35.006359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-921a22b0-448f-4126-a8f5-1b60e29a633a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:35.006902 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-921a22b0-448f-4126-a8f5-1b60e29a633a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:35.012704 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-921a22b0-448f-4126-a8f5-1b60e29a633a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:35.013179 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-921a22b0-448f-4126-a8f5-1b60e29a633a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:35.013612 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-921a22b0-448f-4126-a8f5-1b60e29a633a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:35.014285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-921a22b0-448f-4126-a8f5-1b60e29a633a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:35.014767 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-921a22b0-448f-4126-a8f5-1b60e29a633a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:35.015188 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-921a22b0-448f-4126-a8f5-1b60e29a633a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:35.029570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:49:35.038767 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-921a22b0-448f-4126-a8f5-1b60e29a633a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Going to try to terminate instance {{(pid=121171) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:49:35.343316 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-921a22b0-448f-4126-a8f5-1b60e29a633a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "DELETE /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 204 len: 0 microversion: 2.1 time: 0.339818 Aug 24 12:49:35.343890 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1108/2215] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 12:49:35 2022] DELETE /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 12:49:35.351915 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b673f61c-7231-45db-97af-56542527d9f7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:35.352532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b673f61c-7231-45db-97af-56542527d9f7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:35.359523 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b673f61c-7231-45db-97af-56542527d9f7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:35.360004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b673f61c-7231-45db-97af-56542527d9f7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:35.360438 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b673f61c-7231-45db-97af-56542527d9f7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:35.361117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b673f61c-7231-45db-97af-56542527d9f7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:35.361598 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b673f61c-7231-45db-97af-56542527d9f7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:35.362044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b673f61c-7231-45db-97af-56542527d9f7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:35.492226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b673f61c-7231-45db-97af-56542527d9f7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:35.500423 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b673f61c-7231-45db-97af-56542527d9f7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152361 Aug 24 12:49:35.500976 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1108/2216] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:35 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:35.660498 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-eb232a73-530b-4b67-98f6-bc663a5f6da2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:35.661114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-eb232a73-530b-4b67-98f6-bc663a5f6da2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:35.667418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb232a73-530b-4b67-98f6-bc663a5f6da2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:35.667916 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb232a73-530b-4b67-98f6-bc663a5f6da2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:35.668362 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb232a73-530b-4b67-98f6-bc663a5f6da2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:35.669040 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb232a73-530b-4b67-98f6-bc663a5f6da2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:35.669490 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb232a73-530b-4b67-98f6-bc663a5f6da2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:35.669912 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb232a73-530b-4b67-98f6-bc663a5f6da2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:35.796926 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-eb232a73-530b-4b67-98f6-bc663a5f6da2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:35.805110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-eb232a73-530b-4b67-98f6-bc663a5f6da2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.148863 Aug 24 12:49:35.805660 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1109/2217] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:35 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:35.953951 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-94295434-1790-4cd8-ae5c-6101a0bf2af3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:35.954473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-94295434-1790-4cd8-ae5c-6101a0bf2af3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:35.960823 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94295434-1790-4cd8-ae5c-6101a0bf2af3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:35.961340 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94295434-1790-4cd8-ae5c-6101a0bf2af3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:35.961772 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94295434-1790-4cd8-ae5c-6101a0bf2af3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:35.962489 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94295434-1790-4cd8-ae5c-6101a0bf2af3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:35.962968 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94295434-1790-4cd8-ae5c-6101a0bf2af3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:35.963440 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94295434-1790-4cd8-ae5c-6101a0bf2af3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:36.091879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-94295434-1790-4cd8-ae5c-6101a0bf2af3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:36.100516 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-94295434-1790-4cd8-ae5c-6101a0bf2af3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:36.102146 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-94295434-1790-4cd8-ae5c-6101a0bf2af3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:36.103348 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-94295434-1790-4cd8-ae5c-6101a0bf2af3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.153996 Aug 24 12:49:36.103907 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1109/2218] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:35 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:36.522477 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-46ed3550-0fe8-4d19-9a6e-76337284267b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:36.523241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-46ed3550-0fe8-4d19-9a6e-76337284267b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:36.529242 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46ed3550-0fe8-4d19-9a6e-76337284267b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:36.530235 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46ed3550-0fe8-4d19-9a6e-76337284267b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:36.530700 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46ed3550-0fe8-4d19-9a6e-76337284267b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:36.531380 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46ed3550-0fe8-4d19-9a6e-76337284267b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:36.531828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46ed3550-0fe8-4d19-9a6e-76337284267b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:36.532254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46ed3550-0fe8-4d19-9a6e-76337284267b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:36.663096 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-46ed3550-0fe8-4d19-9a6e-76337284267b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:36.669305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-46ed3550-0fe8-4d19-9a6e-76337284267b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150640 Aug 24 12:49:36.669857 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1110/2219] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:36 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:36.825520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-56f722a6-ea53-4b7a-8d2c-c9814a2bbf20 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:36.826042 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-56f722a6-ea53-4b7a-8d2c-c9814a2bbf20 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:36.832031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-56f722a6-ea53-4b7a-8d2c-c9814a2bbf20 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:36.832507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-56f722a6-ea53-4b7a-8d2c-c9814a2bbf20 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:36.832941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-56f722a6-ea53-4b7a-8d2c-c9814a2bbf20 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:36.833619 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-56f722a6-ea53-4b7a-8d2c-c9814a2bbf20 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:36.834073 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-56f722a6-ea53-4b7a-8d2c-c9814a2bbf20 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:36.834501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-56f722a6-ea53-4b7a-8d2c-c9814a2bbf20 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:36.962593 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-56f722a6-ea53-4b7a-8d2c-c9814a2bbf20 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:36.971252 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-56f722a6-ea53-4b7a-8d2c-c9814a2bbf20 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149791 Aug 24 12:49:36.971808 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1110/2220] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:36 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:37.125479 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7a46ea02-8e97-4ae3-8be7-70b41866cbbb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:37.126145 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7a46ea02-8e97-4ae3-8be7-70b41866cbbb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:37.132293 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a46ea02-8e97-4ae3-8be7-70b41866cbbb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:37.132777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a46ea02-8e97-4ae3-8be7-70b41866cbbb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:37.133231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a46ea02-8e97-4ae3-8be7-70b41866cbbb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:37.133891 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a46ea02-8e97-4ae3-8be7-70b41866cbbb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:37.134340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a46ea02-8e97-4ae3-8be7-70b41866cbbb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:37.134794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a46ea02-8e97-4ae3-8be7-70b41866cbbb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:37.260531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7a46ea02-8e97-4ae3-8be7-70b41866cbbb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:37.269552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7a46ea02-8e97-4ae3-8be7-70b41866cbbb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:37.271060 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7a46ea02-8e97-4ae3-8be7-70b41866cbbb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:37.272206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7a46ea02-8e97-4ae3-8be7-70b41866cbbb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.150815 Aug 24 12:49:37.272756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1111/2221] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:37 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:37.691467 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5fadc1a1-f312-49ba-96cb-b5487fc59f66 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:37.692035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5fadc1a1-f312-49ba-96cb-b5487fc59f66 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:37.697852 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5fadc1a1-f312-49ba-96cb-b5487fc59f66 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:37.698342 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5fadc1a1-f312-49ba-96cb-b5487fc59f66 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:37.698797 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5fadc1a1-f312-49ba-96cb-b5487fc59f66 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:37.699479 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5fadc1a1-f312-49ba-96cb-b5487fc59f66 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:37.699934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5fadc1a1-f312-49ba-96cb-b5487fc59f66 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:37.700359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5fadc1a1-f312-49ba-96cb-b5487fc59f66 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:37.826037 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5fadc1a1-f312-49ba-96cb-b5487fc59f66 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:37.834353 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5fadc1a1-f312-49ba-96cb-b5487fc59f66 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.146848 Aug 24 12:49:37.834940 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1111/2222] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:37 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:37.992601 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-21a83650-a503-49a8-8c1d-68a0f198bbfa tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:37.993210 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-21a83650-a503-49a8-8c1d-68a0f198bbfa tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:38.000071 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-21a83650-a503-49a8-8c1d-68a0f198bbfa tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:38.000552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-21a83650-a503-49a8-8c1d-68a0f198bbfa tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:38.000987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-21a83650-a503-49a8-8c1d-68a0f198bbfa tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:38.001666 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-21a83650-a503-49a8-8c1d-68a0f198bbfa tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:38.002118 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-21a83650-a503-49a8-8c1d-68a0f198bbfa tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:38.002546 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-21a83650-a503-49a8-8c1d-68a0f198bbfa tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:38.295608 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7dfd39b7-8bcb-47e5-8251-ddda03aec81b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:38.296164 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7dfd39b7-8bcb-47e5-8251-ddda03aec81b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:38.303081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7dfd39b7-8bcb-47e5-8251-ddda03aec81b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:38.303584 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7dfd39b7-8bcb-47e5-8251-ddda03aec81b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:38.304027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7dfd39b7-8bcb-47e5-8251-ddda03aec81b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:38.304730 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7dfd39b7-8bcb-47e5-8251-ddda03aec81b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:38.305192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7dfd39b7-8bcb-47e5-8251-ddda03aec81b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:38.305624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7dfd39b7-8bcb-47e5-8251-ddda03aec81b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:38.389661 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-21a83650-a503-49a8-8c1d-68a0f198bbfa tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:38.399656 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-21a83650-a503-49a8-8c1d-68a0f198bbfa tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.410557 Aug 24 12:49:38.400666 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1112/2223] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:37 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:38.441493 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7dfd39b7-8bcb-47e5-8251-ddda03aec81b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:38.450144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7dfd39b7-8bcb-47e5-8251-ddda03aec81b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:38.451676 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7dfd39b7-8bcb-47e5-8251-ddda03aec81b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:38.453701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7dfd39b7-8bcb-47e5-8251-ddda03aec81b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.161255 Aug 24 12:49:38.453971 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1112/2224] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:38 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:49:38.854492 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bb6782b0-93f0-41bb-9d70-ed642e28132e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:38.855123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-bb6782b0-93f0-41bb-9d70-ed642e28132e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:38.861071 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb6782b0-93f0-41bb-9d70-ed642e28132e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:38.861541 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb6782b0-93f0-41bb-9d70-ed642e28132e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:38.861971 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb6782b0-93f0-41bb-9d70-ed642e28132e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:38.862925 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb6782b0-93f0-41bb-9d70-ed642e28132e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:38.863376 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb6782b0-93f0-41bb-9d70-ed642e28132e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:38.863793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb6782b0-93f0-41bb-9d70-ed642e28132e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:38.987999 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-bb6782b0-93f0-41bb-9d70-ed642e28132e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:38.996018 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bb6782b0-93f0-41bb-9d70-ed642e28132e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.145327 Aug 24 12:49:38.996596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1113/2225] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:38 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:39.429275 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6d197d1a-f120-4681-812b-4a904ae1b78b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:39.430036 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6d197d1a-f120-4681-812b-4a904ae1b78b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:39.440540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d197d1a-f120-4681-812b-4a904ae1b78b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:39.441898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d197d1a-f120-4681-812b-4a904ae1b78b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:39.441898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d197d1a-f120-4681-812b-4a904ae1b78b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:39.442164 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d197d1a-f120-4681-812b-4a904ae1b78b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:39.442667 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d197d1a-f120-4681-812b-4a904ae1b78b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:39.443088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d197d1a-f120-4681-812b-4a904ae1b78b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:39.480049 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e4638edb-c50e-4c6b-b1f6-342641b7c6f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:39.480775 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e4638edb-c50e-4c6b-b1f6-342641b7c6f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:39.488073 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4638edb-c50e-4c6b-b1f6-342641b7c6f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:39.488953 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4638edb-c50e-4c6b-b1f6-342641b7c6f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:39.489475 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4638edb-c50e-4c6b-b1f6-342641b7c6f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:39.490344 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4638edb-c50e-4c6b-b1f6-342641b7c6f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:39.490910 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4638edb-c50e-4c6b-b1f6-342641b7c6f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:39.491409 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4638edb-c50e-4c6b-b1f6-342641b7c6f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:39.578171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6d197d1a-f120-4681-812b-4a904ae1b78b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:39.586516 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6d197d1a-f120-4681-812b-4a904ae1b78b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.161428 Aug 24 12:49:39.587660 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1113/2226] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:39 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:39.628074 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e4638edb-c50e-4c6b-b1f6-342641b7c6f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:39.636549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e4638edb-c50e-4c6b-b1f6-342641b7c6f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:39.638037 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e4638edb-c50e-4c6b-b1f6-342641b7c6f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:39.639240 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e4638edb-c50e-4c6b-b1f6-342641b7c6f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.163027 Aug 24 12:49:39.639788 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1114/2227] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:39 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:49:40.018194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6b7c9d1e-6c71-451b-82e3-8311f38b2029 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:40.018852 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6b7c9d1e-6c71-451b-82e3-8311f38b2029 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:40.024826 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b7c9d1e-6c71-451b-82e3-8311f38b2029 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:40.025309 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b7c9d1e-6c71-451b-82e3-8311f38b2029 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:40.025747 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b7c9d1e-6c71-451b-82e3-8311f38b2029 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:40.026430 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b7c9d1e-6c71-451b-82e3-8311f38b2029 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:40.026914 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b7c9d1e-6c71-451b-82e3-8311f38b2029 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:40.027344 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b7c9d1e-6c71-451b-82e3-8311f38b2029 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:40.158140 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6b7c9d1e-6c71-451b-82e3-8311f38b2029 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:40.166247 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6b7c9d1e-6c71-451b-82e3-8311f38b2029 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152475 Aug 24 12:49:40.166892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1114/2228] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:40 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:40.606926 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-68457436-d393-4bca-a7ac-26772bf0a00c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:40.607530 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-68457436-d393-4bca-a7ac-26772bf0a00c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:40.614198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68457436-d393-4bca-a7ac-26772bf0a00c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:40.614703 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68457436-d393-4bca-a7ac-26772bf0a00c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:40.615137 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68457436-d393-4bca-a7ac-26772bf0a00c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:40.615842 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68457436-d393-4bca-a7ac-26772bf0a00c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:40.616312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68457436-d393-4bca-a7ac-26772bf0a00c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:40.616731 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68457436-d393-4bca-a7ac-26772bf0a00c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:40.661334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0a3ffc33-0223-4540-96dd-503e8d6f354d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:40.661950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0a3ffc33-0223-4540-96dd-503e8d6f354d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:40.668272 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a3ffc33-0223-4540-96dd-503e8d6f354d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:40.668760 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a3ffc33-0223-4540-96dd-503e8d6f354d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:40.669201 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a3ffc33-0223-4540-96dd-503e8d6f354d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:40.669889 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a3ffc33-0223-4540-96dd-503e8d6f354d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:40.670346 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a3ffc33-0223-4540-96dd-503e8d6f354d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:40.670806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a3ffc33-0223-4540-96dd-503e8d6f354d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:40.744893 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-68457436-d393-4bca-a7ac-26772bf0a00c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:40.753583 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-68457436-d393-4bca-a7ac-26772bf0a00c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150419 Aug 24 12:49:40.754149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1115/2229] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:40 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:40.805718 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0a3ffc33-0223-4540-96dd-503e8d6f354d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:40.814981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0a3ffc33-0223-4540-96dd-503e8d6f354d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:40.816468 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0a3ffc33-0223-4540-96dd-503e8d6f354d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:40.817626 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0a3ffc33-0223-4540-96dd-503e8d6f354d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.160249 Aug 24 12:49:40.818179 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1115/2230] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:40 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:49:41.187189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0a890840-830b-46d9-8c75-60aaad0824aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:41.187843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0a890840-830b-46d9-8c75-60aaad0824aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:41.193789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a890840-830b-46d9-8c75-60aaad0824aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:41.194269 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a890840-830b-46d9-8c75-60aaad0824aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:41.194730 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a890840-830b-46d9-8c75-60aaad0824aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:41.195416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a890840-830b-46d9-8c75-60aaad0824aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:41.195866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a890840-830b-46d9-8c75-60aaad0824aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:41.196290 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a890840-830b-46d9-8c75-60aaad0824aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:41.320488 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0a890840-830b-46d9-8c75-60aaad0824aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:41.328555 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0a890840-830b-46d9-8c75-60aaad0824aa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.145226 Aug 24 12:49:41.329113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1116/2231] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:41 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:41.783075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-059783ce-9e69-48d0-a7cf-1b78fb55a300 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:41.783622 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-059783ce-9e69-48d0-a7cf-1b78fb55a300 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:41.790084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-059783ce-9e69-48d0-a7cf-1b78fb55a300 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:41.790566 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-059783ce-9e69-48d0-a7cf-1b78fb55a300 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:41.791033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-059783ce-9e69-48d0-a7cf-1b78fb55a300 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:41.791716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-059783ce-9e69-48d0-a7cf-1b78fb55a300 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:41.792171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-059783ce-9e69-48d0-a7cf-1b78fb55a300 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:41.792594 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-059783ce-9e69-48d0-a7cf-1b78fb55a300 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:41.840337 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e378c28f-d99b-4870-bad7-2b8fca8eb3d3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:41.840921 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e378c28f-d99b-4870-bad7-2b8fca8eb3d3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:41.847438 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e378c28f-d99b-4870-bad7-2b8fca8eb3d3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:41.847917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e378c28f-d99b-4870-bad7-2b8fca8eb3d3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:41.848355 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e378c28f-d99b-4870-bad7-2b8fca8eb3d3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:41.849037 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e378c28f-d99b-4870-bad7-2b8fca8eb3d3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:41.849485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e378c28f-d99b-4870-bad7-2b8fca8eb3d3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:41.849906 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e378c28f-d99b-4870-bad7-2b8fca8eb3d3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:41.920299 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-059783ce-9e69-48d0-a7cf-1b78fb55a300 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:41.928671 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-059783ce-9e69-48d0-a7cf-1b78fb55a300 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150081 Aug 24 12:49:41.929563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1116/2232] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:41 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:41.980460 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e378c28f-d99b-4870-bad7-2b8fca8eb3d3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:41.989793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e378c28f-d99b-4870-bad7-2b8fca8eb3d3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:41.991303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e378c28f-d99b-4870-bad7-2b8fca8eb3d3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:41.992443 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e378c28f-d99b-4870-bad7-2b8fca8eb3d3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155961 Aug 24 12:49:41.992988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1117/2233] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:41 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:49:42.349440 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-35a17368-fc4c-4a8b-8b54-3aa83b79f7d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:42.350072 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-35a17368-fc4c-4a8b-8b54-3aa83b79f7d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:42.355942 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35a17368-fc4c-4a8b-8b54-3aa83b79f7d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:42.356419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35a17368-fc4c-4a8b-8b54-3aa83b79f7d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:42.356849 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35a17368-fc4c-4a8b-8b54-3aa83b79f7d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:42.357524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35a17368-fc4c-4a8b-8b54-3aa83b79f7d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:42.357971 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35a17368-fc4c-4a8b-8b54-3aa83b79f7d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:42.358389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35a17368-fc4c-4a8b-8b54-3aa83b79f7d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:42.488131 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-35a17368-fc4c-4a8b-8b54-3aa83b79f7d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:42.496247 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-35a17368-fc4c-4a8b-8b54-3aa83b79f7d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150612 Aug 24 12:49:42.496809 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1117/2234] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:42 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:42.949929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a58195ee-2e49-466d-ae22-2a08c5e9201e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:42.950466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a58195ee-2e49-466d-ae22-2a08c5e9201e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:42.957331 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a58195ee-2e49-466d-ae22-2a08c5e9201e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:42.957806 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a58195ee-2e49-466d-ae22-2a08c5e9201e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:42.958236 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a58195ee-2e49-466d-ae22-2a08c5e9201e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:42.958927 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a58195ee-2e49-466d-ae22-2a08c5e9201e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:42.959377 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a58195ee-2e49-466d-ae22-2a08c5e9201e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:42.959792 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a58195ee-2e49-466d-ae22-2a08c5e9201e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:43.014642 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-65c2b5ab-71e7-4c65-af18-876966d8e2a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:43.015272 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-65c2b5ab-71e7-4c65-af18-876966d8e2a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:43.021990 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-65c2b5ab-71e7-4c65-af18-876966d8e2a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:43.023560 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-65c2b5ab-71e7-4c65-af18-876966d8e2a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:43.023560 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-65c2b5ab-71e7-4c65-af18-876966d8e2a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:43.023560 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-65c2b5ab-71e7-4c65-af18-876966d8e2a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:43.024046 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-65c2b5ab-71e7-4c65-af18-876966d8e2a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:43.024447 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-65c2b5ab-71e7-4c65-af18-876966d8e2a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:43.087927 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a58195ee-2e49-466d-ae22-2a08c5e9201e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:43.096654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a58195ee-2e49-466d-ae22-2a08c5e9201e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150598 Aug 24 12:49:43.097216 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1118/2235] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:42 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:43.153947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-65c2b5ab-71e7-4c65-af18-876966d8e2a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:43.163165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-65c2b5ab-71e7-4c65-af18-876966d8e2a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:43.164673 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-65c2b5ab-71e7-4c65-af18-876966d8e2a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:43.165810 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-65c2b5ab-71e7-4c65-af18-876966d8e2a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155061 Aug 24 12:49:43.166359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1118/2236] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:43 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:49:43.517897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d219b3d8-84df-43b5-8cff-bf649fe62428 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:43.518524 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d219b3d8-84df-43b5-8cff-bf649fe62428 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:43.524413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d219b3d8-84df-43b5-8cff-bf649fe62428 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:43.524895 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d219b3d8-84df-43b5-8cff-bf649fe62428 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:43.525330 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d219b3d8-84df-43b5-8cff-bf649fe62428 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:43.526006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d219b3d8-84df-43b5-8cff-bf649fe62428 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:43.526456 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d219b3d8-84df-43b5-8cff-bf649fe62428 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:43.526911 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d219b3d8-84df-43b5-8cff-bf649fe62428 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:43.655974 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d219b3d8-84df-43b5-8cff-bf649fe62428 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:43.664274 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d219b3d8-84df-43b5-8cff-bf649fe62428 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150919 Aug 24 12:49:43.664825 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1119/2237] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:43 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:44.117920 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-158a196d-1001-4d6d-9a23-7889102cb1cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:44.118533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-158a196d-1001-4d6d-9a23-7889102cb1cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:44.124948 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-158a196d-1001-4d6d-9a23-7889102cb1cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:44.125429 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-158a196d-1001-4d6d-9a23-7889102cb1cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:44.126401 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-158a196d-1001-4d6d-9a23-7889102cb1cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:44.127116 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-158a196d-1001-4d6d-9a23-7889102cb1cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:44.127570 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-158a196d-1001-4d6d-9a23-7889102cb1cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:44.127994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-158a196d-1001-4d6d-9a23-7889102cb1cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:44.188972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-619a5284-f87b-4c66-856f-07d8eef801a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:44.189555 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-619a5284-f87b-4c66-856f-07d8eef801a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:44.195891 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-619a5284-f87b-4c66-856f-07d8eef801a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:44.196369 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-619a5284-f87b-4c66-856f-07d8eef801a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:44.196803 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-619a5284-f87b-4c66-856f-07d8eef801a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:44.197481 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-619a5284-f87b-4c66-856f-07d8eef801a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:44.197930 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-619a5284-f87b-4c66-856f-07d8eef801a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:44.198346 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-619a5284-f87b-4c66-856f-07d8eef801a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:44.255195 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-158a196d-1001-4d6d-9a23-7889102cb1cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:44.263460 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-158a196d-1001-4d6d-9a23-7889102cb1cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149390 Aug 24 12:49:44.264025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1119/2238] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:44 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:44.325658 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-619a5284-f87b-4c66-856f-07d8eef801a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:44.334909 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-619a5284-f87b-4c66-856f-07d8eef801a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:44.336395 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-619a5284-f87b-4c66-856f-07d8eef801a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:44.337544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-619a5284-f87b-4c66-856f-07d8eef801a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.153031 Aug 24 12:49:44.338093 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1120/2239] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:44 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:49:44.685152 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bfaac5b7-b58b-4f80-88d4-cb7adf366b12 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:44.685725 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bfaac5b7-b58b-4f80-88d4-cb7adf366b12 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:44.692181 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bfaac5b7-b58b-4f80-88d4-cb7adf366b12 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:44.692655 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bfaac5b7-b58b-4f80-88d4-cb7adf366b12 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:44.693081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bfaac5b7-b58b-4f80-88d4-cb7adf366b12 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:44.693759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bfaac5b7-b58b-4f80-88d4-cb7adf366b12 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:44.694204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bfaac5b7-b58b-4f80-88d4-cb7adf366b12 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:44.694629 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bfaac5b7-b58b-4f80-88d4-cb7adf366b12 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:44.827094 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bfaac5b7-b58b-4f80-88d4-cb7adf366b12 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:44.835520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bfaac5b7-b58b-4f80-88d4-cb7adf366b12 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.154198 Aug 24 12:49:44.839765 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1120/2240] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:44 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:45.283920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-36cbf1e8-e5e4-4902-8761-7c29b30cd3e5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:45.284513 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-36cbf1e8-e5e4-4902-8761-7c29b30cd3e5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:45.290900 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36cbf1e8-e5e4-4902-8761-7c29b30cd3e5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:45.291372 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36cbf1e8-e5e4-4902-8761-7c29b30cd3e5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:45.291797 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36cbf1e8-e5e4-4902-8761-7c29b30cd3e5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:45.292470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36cbf1e8-e5e4-4902-8761-7c29b30cd3e5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:45.292912 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36cbf1e8-e5e4-4902-8761-7c29b30cd3e5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:45.293329 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36cbf1e8-e5e4-4902-8761-7c29b30cd3e5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:45.361067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f71f9f72-faaa-4240-aef3-ae14b12abe3a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:45.361674 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f71f9f72-faaa-4240-aef3-ae14b12abe3a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:45.368378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f71f9f72-faaa-4240-aef3-ae14b12abe3a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:45.368861 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f71f9f72-faaa-4240-aef3-ae14b12abe3a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:45.369295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f71f9f72-faaa-4240-aef3-ae14b12abe3a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:45.369987 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f71f9f72-faaa-4240-aef3-ae14b12abe3a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:45.370439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f71f9f72-faaa-4240-aef3-ae14b12abe3a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:45.370891 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f71f9f72-faaa-4240-aef3-ae14b12abe3a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:45.426824 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-36cbf1e8-e5e4-4902-8761-7c29b30cd3e5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:45.435602 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-36cbf1e8-e5e4-4902-8761-7c29b30cd3e5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.155458 Aug 24 12:49:45.436172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1121/2241] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:45 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:45.499892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f71f9f72-faaa-4240-aef3-ae14b12abe3a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:45.509124 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f71f9f72-faaa-4240-aef3-ae14b12abe3a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:45.510630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f71f9f72-faaa-4240-aef3-ae14b12abe3a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:45.511813 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f71f9f72-faaa-4240-aef3-ae14b12abe3a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155211 Aug 24 12:49:45.512360 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1121/2242] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:45 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:49:45.858605 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c339d1a6-b29a-4f98-97f8-563c2ebd2dae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:45.859161 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c339d1a6-b29a-4f98-97f8-563c2ebd2dae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:45.865589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c339d1a6-b29a-4f98-97f8-563c2ebd2dae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:45.866075 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c339d1a6-b29a-4f98-97f8-563c2ebd2dae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:45.866509 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c339d1a6-b29a-4f98-97f8-563c2ebd2dae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:45.867223 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c339d1a6-b29a-4f98-97f8-563c2ebd2dae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:45.867682 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c339d1a6-b29a-4f98-97f8-563c2ebd2dae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:45.868226 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c339d1a6-b29a-4f98-97f8-563c2ebd2dae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:45.998212 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c339d1a6-b29a-4f98-97f8-563c2ebd2dae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:46.007069 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c339d1a6-b29a-4f98-97f8-563c2ebd2dae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152411 Aug 24 12:49:46.007622 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1122/2243] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:45 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:46.457663 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-df078f44-d6cc-4289-bf33-39c09d811dbb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:46.458274 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-df078f44-d6cc-4289-bf33-39c09d811dbb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:46.464647 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df078f44-d6cc-4289-bf33-39c09d811dbb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:46.465122 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df078f44-d6cc-4289-bf33-39c09d811dbb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:46.465555 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df078f44-d6cc-4289-bf33-39c09d811dbb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:46.466230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df078f44-d6cc-4289-bf33-39c09d811dbb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:46.466711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df078f44-d6cc-4289-bf33-39c09d811dbb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:46.467134 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df078f44-d6cc-4289-bf33-39c09d811dbb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:46.481367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:49:46.534756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-972df69c-6262-47f9-a658-a59dc3f45fbc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:46.535366 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-972df69c-6262-47f9-a658-a59dc3f45fbc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:46.541201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-972df69c-6262-47f9-a658-a59dc3f45fbc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:46.541686 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-972df69c-6262-47f9-a658-a59dc3f45fbc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:46.542118 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-972df69c-6262-47f9-a658-a59dc3f45fbc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:46.542826 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-972df69c-6262-47f9-a658-a59dc3f45fbc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:46.543278 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-972df69c-6262-47f9-a658-a59dc3f45fbc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:46.543701 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-972df69c-6262-47f9-a658-a59dc3f45fbc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:46.558591 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:49:46.601890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-df078f44-d6cc-4289-bf33-39c09d811dbb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:46.610640 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-df078f44-d6cc-4289-bf33-39c09d811dbb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.157325 Aug 24 12:49:46.611241 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1122/2244] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:46 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:46.673751 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-972df69c-6262-47f9-a658-a59dc3f45fbc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:46.682245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-972df69c-6262-47f9-a658-a59dc3f45fbc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:46.683667 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-972df69c-6262-47f9-a658-a59dc3f45fbc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:46.684802 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-972df69c-6262-47f9-a658-a59dc3f45fbc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154164 Aug 24 12:49:46.685345 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1123/2245] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:46 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:47.029427 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-29daa3af-f2e3-423d-ac5b-e3ed91e6aeb8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:47.030027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-29daa3af-f2e3-423d-ac5b-e3ed91e6aeb8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:47.035862 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29daa3af-f2e3-423d-ac5b-e3ed91e6aeb8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:47.036339 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29daa3af-f2e3-423d-ac5b-e3ed91e6aeb8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:47.036790 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29daa3af-f2e3-423d-ac5b-e3ed91e6aeb8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:47.037449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29daa3af-f2e3-423d-ac5b-e3ed91e6aeb8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:47.037899 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29daa3af-f2e3-423d-ac5b-e3ed91e6aeb8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:47.038315 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29daa3af-f2e3-423d-ac5b-e3ed91e6aeb8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:47.163128 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-29daa3af-f2e3-423d-ac5b-e3ed91e6aeb8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:47.171427 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-29daa3af-f2e3-423d-ac5b-e3ed91e6aeb8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.145677 Aug 24 12:49:47.171988 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1123/2246] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:47 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:47.632225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fa6caafa-ed80-4ddc-b281-e43f9175fea8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:47.632870 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fa6caafa-ed80-4ddc-b281-e43f9175fea8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:47.639192 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa6caafa-ed80-4ddc-b281-e43f9175fea8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:47.639701 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa6caafa-ed80-4ddc-b281-e43f9175fea8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:47.640137 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa6caafa-ed80-4ddc-b281-e43f9175fea8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:47.640819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa6caafa-ed80-4ddc-b281-e43f9175fea8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:47.641273 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa6caafa-ed80-4ddc-b281-e43f9175fea8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:47.641702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa6caafa-ed80-4ddc-b281-e43f9175fea8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:47.708010 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-23ef12ed-6eeb-41c4-9c50-e4625cd13edb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:47.708572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-23ef12ed-6eeb-41c4-9c50-e4625cd13edb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:47.710804 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=64 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:49:47.715459 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-23ef12ed-6eeb-41c4-9c50-e4625cd13edb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:47.715956 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-23ef12ed-6eeb-41c4-9c50-e4625cd13edb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:47.716395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-23ef12ed-6eeb-41c4-9c50-e4625cd13edb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:47.717073 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-23ef12ed-6eeb-41c4-9c50-e4625cd13edb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:47.717521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-23ef12ed-6eeb-41c4-9c50-e4625cd13edb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:47.717942 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-23ef12ed-6eeb-41c4-9c50-e4625cd13edb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:47.772920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fa6caafa-ed80-4ddc-b281-e43f9175fea8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:47.781401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fa6caafa-ed80-4ddc-b281-e43f9175fea8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.153039 Aug 24 12:49:47.781983 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1124/2247] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:47 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:47.847009 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-23ef12ed-6eeb-41c4-9c50-e4625cd13edb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:47.855551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-23ef12ed-6eeb-41c4-9c50-e4625cd13edb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:47.857094 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-23ef12ed-6eeb-41c4-9c50-e4625cd13edb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:47.858253 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-23ef12ed-6eeb-41c4-9c50-e4625cd13edb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154376 Aug 24 12:49:47.858831 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1124/2248] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:47 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:49:48.193325 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-93323c31-4a0a-49f9-a1ee-bd2c6d23df75 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:48.193933 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-93323c31-4a0a-49f9-a1ee-bd2c6d23df75 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:48.199796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-93323c31-4a0a-49f9-a1ee-bd2c6d23df75 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:48.200272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-93323c31-4a0a-49f9-a1ee-bd2c6d23df75 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:48.200706 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-93323c31-4a0a-49f9-a1ee-bd2c6d23df75 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:48.201380 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-93323c31-4a0a-49f9-a1ee-bd2c6d23df75 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:48.201844 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-93323c31-4a0a-49f9-a1ee-bd2c6d23df75 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:48.202252 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-93323c31-4a0a-49f9-a1ee-bd2c6d23df75 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:48.327084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-93323c31-4a0a-49f9-a1ee-bd2c6d23df75 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:48.335886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-93323c31-4a0a-49f9-a1ee-bd2c6d23df75 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.146959 Aug 24 12:49:48.336445 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1125/2249] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:48 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:48.803876 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e3c0af7c-e338-4303-914e-7b5ccea4365d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:48.804486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e3c0af7c-e338-4303-914e-7b5ccea4365d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:48.810892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3c0af7c-e338-4303-914e-7b5ccea4365d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:48.811374 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3c0af7c-e338-4303-914e-7b5ccea4365d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:48.811803 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3c0af7c-e338-4303-914e-7b5ccea4365d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:48.812483 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3c0af7c-e338-4303-914e-7b5ccea4365d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:48.812939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3c0af7c-e338-4303-914e-7b5ccea4365d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:48.813360 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3c0af7c-e338-4303-914e-7b5ccea4365d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:48.882051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-618b58af-d731-47bc-ac1d-35343c468171 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:48.882682 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-618b58af-d731-47bc-ac1d-35343c468171 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:48.889255 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-618b58af-d731-47bc-ac1d-35343c468171 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:48.889746 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-618b58af-d731-47bc-ac1d-35343c468171 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:48.890181 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-618b58af-d731-47bc-ac1d-35343c468171 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:48.891153 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-618b58af-d731-47bc-ac1d-35343c468171 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:48.891999 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-618b58af-d731-47bc-ac1d-35343c468171 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:48.892949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-618b58af-d731-47bc-ac1d-35343c468171 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:48.965181 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e3c0af7c-e338-4303-914e-7b5ccea4365d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:48.973468 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e3c0af7c-e338-4303-914e-7b5ccea4365d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.174664 Aug 24 12:49:48.974040 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1125/2250] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:48 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:49.036754 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-618b58af-d731-47bc-ac1d-35343c468171 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:49.046921 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-618b58af-d731-47bc-ac1d-35343c468171 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:49.048529 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-618b58af-d731-47bc-ac1d-35343c468171 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:49.049779 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-618b58af-d731-47bc-ac1d-35343c468171 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.171755 Aug 24 12:49:49.050403 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1126/2251] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:48 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:49.356683 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0f68323e-3afd-4003-b7e6-cf8b4d672168 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:49.357330 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0f68323e-3afd-4003-b7e6-cf8b4d672168 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:49.364019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f68323e-3afd-4003-b7e6-cf8b4d672168 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:49.364505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f68323e-3afd-4003-b7e6-cf8b4d672168 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:49.364948 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f68323e-3afd-4003-b7e6-cf8b4d672168 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:49.365636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f68323e-3afd-4003-b7e6-cf8b4d672168 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:49.366095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f68323e-3afd-4003-b7e6-cf8b4d672168 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:49.366522 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f68323e-3afd-4003-b7e6-cf8b4d672168 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:49.493499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0f68323e-3afd-4003-b7e6-cf8b4d672168 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:49.502301 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0f68323e-3afd-4003-b7e6-cf8b4d672168 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.148899 Aug 24 12:49:49.502900 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1126/2252] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:49 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:49.994357 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1b6af1d0-bbea-49a8-b1d6-d8f80d41702c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:49.994986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1b6af1d0-bbea-49a8-b1d6-d8f80d41702c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:50.001427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b6af1d0-bbea-49a8-b1d6-d8f80d41702c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:50.002416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b6af1d0-bbea-49a8-b1d6-d8f80d41702c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:50.002883 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b6af1d0-bbea-49a8-b1d6-d8f80d41702c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:50.003560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b6af1d0-bbea-49a8-b1d6-d8f80d41702c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:50.004033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b6af1d0-bbea-49a8-b1d6-d8f80d41702c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:50.004451 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b6af1d0-bbea-49a8-b1d6-d8f80d41702c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:50.072505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e4f12535-2240-405b-b438-714e273038b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:50.073110 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e4f12535-2240-405b-b438-714e273038b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:50.079591 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e4f12535-2240-405b-b438-714e273038b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:50.080119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e4f12535-2240-405b-b438-714e273038b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:50.080552 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e4f12535-2240-405b-b438-714e273038b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:50.081583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e4f12535-2240-405b-b438-714e273038b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:50.081696 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e4f12535-2240-405b-b438-714e273038b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:50.082229 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e4f12535-2240-405b-b438-714e273038b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:50.133914 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1b6af1d0-bbea-49a8-b1d6-d8f80d41702c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:50.142054 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1b6af1d0-bbea-49a8-b1d6-d8f80d41702c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151449 Aug 24 12:49:50.142674 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1127/2253] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:49 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:50.222838 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e4f12535-2240-405b-b438-714e273038b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:50.231990 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e4f12535-2240-405b-b438-714e273038b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:50.233474 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e4f12535-2240-405b-b438-714e273038b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:50.234631 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e4f12535-2240-405b-b438-714e273038b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.165958 Aug 24 12:49:50.235204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1127/2254] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:50 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:49:50.522446 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7d9c4587-08e1-48bc-b932-17849dcd2ae0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:50.523080 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7d9c4587-08e1-48bc-b932-17849dcd2ae0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:50.529010 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7d9c4587-08e1-48bc-b932-17849dcd2ae0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:50.529501 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7d9c4587-08e1-48bc-b932-17849dcd2ae0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:50.529923 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7d9c4587-08e1-48bc-b932-17849dcd2ae0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:50.530602 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7d9c4587-08e1-48bc-b932-17849dcd2ae0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:50.531117 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7d9c4587-08e1-48bc-b932-17849dcd2ae0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:50.531539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7d9c4587-08e1-48bc-b932-17849dcd2ae0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:50.656027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7d9c4587-08e1-48bc-b932-17849dcd2ae0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:50.664549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7d9c4587-08e1-48bc-b932-17849dcd2ae0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.146039 Aug 24 12:49:50.665104 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1128/2255] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:50 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:51.164569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0aa9fd6f-ff4d-4f52-b97a-6c373254b6b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:51.165484 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0aa9fd6f-ff4d-4f52-b97a-6c373254b6b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:51.171866 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0aa9fd6f-ff4d-4f52-b97a-6c373254b6b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:51.172371 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0aa9fd6f-ff4d-4f52-b97a-6c373254b6b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:51.172794 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0aa9fd6f-ff4d-4f52-b97a-6c373254b6b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:51.173485 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0aa9fd6f-ff4d-4f52-b97a-6c373254b6b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:51.173938 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0aa9fd6f-ff4d-4f52-b97a-6c373254b6b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:51.174369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0aa9fd6f-ff4d-4f52-b97a-6c373254b6b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:51.266463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3a2f813d-0863-459c-850f-4acb75b0aeaf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:51.267898 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3a2f813d-0863-459c-850f-4acb75b0aeaf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:51.274897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a2f813d-0863-459c-850f-4acb75b0aeaf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:51.275470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a2f813d-0863-459c-850f-4acb75b0aeaf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:51.275983 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a2f813d-0863-459c-850f-4acb75b0aeaf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:51.276748 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a2f813d-0863-459c-850f-4acb75b0aeaf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:51.277300 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a2f813d-0863-459c-850f-4acb75b0aeaf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:51.277764 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a2f813d-0863-459c-850f-4acb75b0aeaf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:51.318361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0aa9fd6f-ff4d-4f52-b97a-6c373254b6b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:51.326992 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0aa9fd6f-ff4d-4f52-b97a-6c373254b6b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.167038 Aug 24 12:49:51.327586 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1128/2256] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:51 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:51.415527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3a2f813d-0863-459c-850f-4acb75b0aeaf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:51.424819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3a2f813d-0863-459c-850f-4acb75b0aeaf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:51.426416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3a2f813d-0863-459c-850f-4acb75b0aeaf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:51.427632 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3a2f813d-0863-459c-850f-4acb75b0aeaf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.165159 Aug 24 12:49:51.428478 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1129/2257] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:51 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:49:51.685860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d73feb13-4526-4ceb-8fff-67811930437e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:51.686608 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d73feb13-4526-4ceb-8fff-67811930437e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:51.693251 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d73feb13-4526-4ceb-8fff-67811930437e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:51.693736 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d73feb13-4526-4ceb-8fff-67811930437e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:51.694183 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d73feb13-4526-4ceb-8fff-67811930437e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:51.694900 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d73feb13-4526-4ceb-8fff-67811930437e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:51.695360 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d73feb13-4526-4ceb-8fff-67811930437e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:51.695786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d73feb13-4526-4ceb-8fff-67811930437e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:51.831234 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d73feb13-4526-4ceb-8fff-67811930437e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:51.839430 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d73feb13-4526-4ceb-8fff-67811930437e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.158120 Aug 24 12:49:51.839978 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1129/2258] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:51 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:49:52.349448 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5be3cff1-24f4-4ff8-ad94-e80f2f558d80 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:52.350010 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5be3cff1-24f4-4ff8-ad94-e80f2f558d80 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:52.356416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5be3cff1-24f4-4ff8-ad94-e80f2f558d80 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:52.356899 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5be3cff1-24f4-4ff8-ad94-e80f2f558d80 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:52.357334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5be3cff1-24f4-4ff8-ad94-e80f2f558d80 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:52.358015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5be3cff1-24f4-4ff8-ad94-e80f2f558d80 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:52.358468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5be3cff1-24f4-4ff8-ad94-e80f2f558d80 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:52.358923 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5be3cff1-24f4-4ff8-ad94-e80f2f558d80 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:52.450760 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b7fcaa50-731d-44c6-937b-070c61a424f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:52.451377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b7fcaa50-731d-44c6-937b-070c61a424f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:52.458444 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7fcaa50-731d-44c6-937b-070c61a424f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:52.458963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7fcaa50-731d-44c6-937b-070c61a424f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:52.459413 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7fcaa50-731d-44c6-937b-070c61a424f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:52.460150 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7fcaa50-731d-44c6-937b-070c61a424f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:52.460612 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7fcaa50-731d-44c6-937b-070c61a424f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:52.461042 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7fcaa50-731d-44c6-937b-070c61a424f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:52.493112 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5be3cff1-24f4-4ff8-ad94-e80f2f558d80 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:52.504652 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5be3cff1-24f4-4ff8-ad94-e80f2f558d80 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.159531 Aug 24 12:49:52.508981 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1130/2259] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:52 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:52.737470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b7fcaa50-731d-44c6-937b-070c61a424f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:52.746259 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b7fcaa50-731d-44c6-937b-070c61a424f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:52.747793 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b7fcaa50-731d-44c6-937b-070c61a424f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:52.748955 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b7fcaa50-731d-44c6-937b-070c61a424f3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.302052 Aug 24 12:49:52.749531 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1130/2260] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:52 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:49:52.859941 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-aa48f63e-2ec1-464d-b0bf-b5846c4f16a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:52.860550 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-aa48f63e-2ec1-464d-b0bf-b5846c4f16a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:52.862387 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:49:52.867342 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aa48f63e-2ec1-464d-b0bf-b5846c4f16a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:52.872913 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aa48f63e-2ec1-464d-b0bf-b5846c4f16a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:52.872913 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aa48f63e-2ec1-464d-b0bf-b5846c4f16a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:52.872913 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aa48f63e-2ec1-464d-b0bf-b5846c4f16a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:52.872913 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aa48f63e-2ec1-464d-b0bf-b5846c4f16a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:52.873465 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aa48f63e-2ec1-464d-b0bf-b5846c4f16a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:53.000623 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-aa48f63e-2ec1-464d-b0bf-b5846c4f16a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:53.009229 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-aa48f63e-2ec1-464d-b0bf-b5846c4f16a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.153091 Aug 24 12:49:53.009777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1131/2261] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:52 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:53.527924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2482f2bd-9abc-4fca-9158-aa9d33675aa4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:53.528458 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2482f2bd-9abc-4fca-9158-aa9d33675aa4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:53.535389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2482f2bd-9abc-4fca-9158-aa9d33675aa4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:53.535870 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2482f2bd-9abc-4fca-9158-aa9d33675aa4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:53.536303 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2482f2bd-9abc-4fca-9158-aa9d33675aa4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:53.536983 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2482f2bd-9abc-4fca-9158-aa9d33675aa4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:53.537433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2482f2bd-9abc-4fca-9158-aa9d33675aa4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:53.537853 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2482f2bd-9abc-4fca-9158-aa9d33675aa4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:53.663711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2482f2bd-9abc-4fca-9158-aa9d33675aa4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:53.671971 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2482f2bd-9abc-4fca-9158-aa9d33675aa4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147970 Aug 24 12:49:53.672527 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1131/2262] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:53 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:53.771781 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cdeab623-c9d4-4596-8fb1-62b81dfbd636 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:53.772384 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cdeab623-c9d4-4596-8fb1-62b81dfbd636 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:53.779182 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cdeab623-c9d4-4596-8fb1-62b81dfbd636 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:53.779671 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cdeab623-c9d4-4596-8fb1-62b81dfbd636 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:53.780156 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cdeab623-c9d4-4596-8fb1-62b81dfbd636 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:53.780833 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cdeab623-c9d4-4596-8fb1-62b81dfbd636 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:53.781282 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cdeab623-c9d4-4596-8fb1-62b81dfbd636 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:53.781705 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cdeab623-c9d4-4596-8fb1-62b81dfbd636 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:53.918921 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cdeab623-c9d4-4596-8fb1-62b81dfbd636 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:53.927530 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cdeab623-c9d4-4596-8fb1-62b81dfbd636 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:53.929130 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cdeab623-c9d4-4596-8fb1-62b81dfbd636 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:53.930314 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cdeab623-c9d4-4596-8fb1-62b81dfbd636 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.162443 Aug 24 12:49:53.930889 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1132/2263] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:53 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:54.030809 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b90453bf-b119-416d-b9ef-2e1437fe7eb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:54.031344 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b90453bf-b119-416d-b9ef-2e1437fe7eb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:54.037800 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b90453bf-b119-416d-b9ef-2e1437fe7eb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:54.038302 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b90453bf-b119-416d-b9ef-2e1437fe7eb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:54.038765 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b90453bf-b119-416d-b9ef-2e1437fe7eb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:54.039441 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b90453bf-b119-416d-b9ef-2e1437fe7eb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:54.039899 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b90453bf-b119-416d-b9ef-2e1437fe7eb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:54.040323 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b90453bf-b119-416d-b9ef-2e1437fe7eb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:54.171276 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b90453bf-b119-416d-b9ef-2e1437fe7eb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:54.182335 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b90453bf-b119-416d-b9ef-2e1437fe7eb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.155292 Aug 24 12:49:54.182964 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1132/2264] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:54 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:54.693893 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-993971d5-0af6-4455-854d-3315c5a7858a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:54.694403 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-993971d5-0af6-4455-854d-3315c5a7858a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:54.700281 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-993971d5-0af6-4455-854d-3315c5a7858a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:54.700756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-993971d5-0af6-4455-854d-3315c5a7858a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:54.701188 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-993971d5-0af6-4455-854d-3315c5a7858a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:54.701855 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-993971d5-0af6-4455-854d-3315c5a7858a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:54.702301 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-993971d5-0af6-4455-854d-3315c5a7858a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:54.702741 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-993971d5-0af6-4455-854d-3315c5a7858a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:54.830480 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-993971d5-0af6-4455-854d-3315c5a7858a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:54.838529 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-993971d5-0af6-4455-854d-3315c5a7858a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.148546 Aug 24 12:49:54.841929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1133/2265] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:54 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:54.953463 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9399bd8a-18a7-4b70-a896-accfa3b5f15a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:54.954003 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9399bd8a-18a7-4b70-a896-accfa3b5f15a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:54.960357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9399bd8a-18a7-4b70-a896-accfa3b5f15a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:54.960833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9399bd8a-18a7-4b70-a896-accfa3b5f15a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:54.961262 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9399bd8a-18a7-4b70-a896-accfa3b5f15a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:54.961932 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9399bd8a-18a7-4b70-a896-accfa3b5f15a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:54.962382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9399bd8a-18a7-4b70-a896-accfa3b5f15a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:54.962831 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9399bd8a-18a7-4b70-a896-accfa3b5f15a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:55.087759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9399bd8a-18a7-4b70-a896-accfa3b5f15a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:55.096828 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9399bd8a-18a7-4b70-a896-accfa3b5f15a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:55.098316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9399bd8a-18a7-4b70-a896-accfa3b5f15a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:55.099508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9399bd8a-18a7-4b70-a896-accfa3b5f15a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.149998 Aug 24 12:49:55.100058 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1133/2266] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:54 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:55.204121 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-170e7883-5096-4bdf-aa69-bc3be55a8f7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:55.204662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-170e7883-5096-4bdf-aa69-bc3be55a8f7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:55.210511 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-170e7883-5096-4bdf-aa69-bc3be55a8f7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:55.211027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-170e7883-5096-4bdf-aa69-bc3be55a8f7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:55.211464 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-170e7883-5096-4bdf-aa69-bc3be55a8f7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:55.212133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-170e7883-5096-4bdf-aa69-bc3be55a8f7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:55.212587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-170e7883-5096-4bdf-aa69-bc3be55a8f7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:55.213013 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-170e7883-5096-4bdf-aa69-bc3be55a8f7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:55.344929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-170e7883-5096-4bdf-aa69-bc3be55a8f7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:55.353830 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-170e7883-5096-4bdf-aa69-bc3be55a8f7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.153590 Aug 24 12:49:55.354394 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1134/2267] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:55 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:55.859590 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-be44e00c-2f83-49ce-b86d-165e9bc5a49e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:55.860194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-be44e00c-2f83-49ce-b86d-165e9bc5a49e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:55.866274 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be44e00c-2f83-49ce-b86d-165e9bc5a49e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:55.866783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be44e00c-2f83-49ce-b86d-165e9bc5a49e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:55.867212 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be44e00c-2f83-49ce-b86d-165e9bc5a49e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:55.867886 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be44e00c-2f83-49ce-b86d-165e9bc5a49e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:55.868357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be44e00c-2f83-49ce-b86d-165e9bc5a49e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:55.868774 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be44e00c-2f83-49ce-b86d-165e9bc5a49e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:55.998268 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-be44e00c-2f83-49ce-b86d-165e9bc5a49e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:56.006882 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-be44e00c-2f83-49ce-b86d-165e9bc5a49e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151145 Aug 24 12:49:56.007442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1134/2268] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:55 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:56.123293 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5838ae85-79c2-4424-b28e-caf17060f99c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:56.123956 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5838ae85-79c2-4424-b28e-caf17060f99c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:56.131068 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5838ae85-79c2-4424-b28e-caf17060f99c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:56.131555 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5838ae85-79c2-4424-b28e-caf17060f99c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:56.132018 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5838ae85-79c2-4424-b28e-caf17060f99c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:56.132734 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5838ae85-79c2-4424-b28e-caf17060f99c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:56.133192 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5838ae85-79c2-4424-b28e-caf17060f99c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:56.133632 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5838ae85-79c2-4424-b28e-caf17060f99c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:56.260821 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5838ae85-79c2-4424-b28e-caf17060f99c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:56.269363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5838ae85-79c2-4424-b28e-caf17060f99c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:56.270891 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5838ae85-79c2-4424-b28e-caf17060f99c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:56.272040 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5838ae85-79c2-4424-b28e-caf17060f99c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.152793 Aug 24 12:49:56.272589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1135/2269] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:56 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:56.374409 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0cedeff2-2e83-4bc5-839c-d453ded4b534 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:56.374990 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0cedeff2-2e83-4bc5-839c-d453ded4b534 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:56.381416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0cedeff2-2e83-4bc5-839c-d453ded4b534 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:56.381902 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0cedeff2-2e83-4bc5-839c-d453ded4b534 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:56.382342 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0cedeff2-2e83-4bc5-839c-d453ded4b534 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:56.383066 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0cedeff2-2e83-4bc5-839c-d453ded4b534 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:56.383511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0cedeff2-2e83-4bc5-839c-d453ded4b534 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:56.383939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0cedeff2-2e83-4bc5-839c-d453ded4b534 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:56.511396 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0cedeff2-2e83-4bc5-839c-d453ded4b534 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:56.519557 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0cedeff2-2e83-4bc5-839c-d453ded4b534 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.148990 Aug 24 12:49:56.520110 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1135/2270] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:56 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:57.028134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1b0f7efa-7a7d-4863-9f15-a3600a08af7a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:57.028772 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1b0f7efa-7a7d-4863-9f15-a3600a08af7a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:57.035487 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b0f7efa-7a7d-4863-9f15-a3600a08af7a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:57.035973 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b0f7efa-7a7d-4863-9f15-a3600a08af7a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:57.036409 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b0f7efa-7a7d-4863-9f15-a3600a08af7a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:57.037089 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b0f7efa-7a7d-4863-9f15-a3600a08af7a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:57.037543 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b0f7efa-7a7d-4863-9f15-a3600a08af7a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:57.037969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b0f7efa-7a7d-4863-9f15-a3600a08af7a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:57.170787 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1b0f7efa-7a7d-4863-9f15-a3600a08af7a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:57.178405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1b0f7efa-7a7d-4863-9f15-a3600a08af7a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.154136 Aug 24 12:49:57.178989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1136/2271] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:57 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:57.294811 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3d0b88ce-639a-4532-a4ec-d5260f31fb95 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:57.295354 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3d0b88ce-639a-4532-a4ec-d5260f31fb95 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:57.301619 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d0b88ce-639a-4532-a4ec-d5260f31fb95 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:57.302093 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d0b88ce-639a-4532-a4ec-d5260f31fb95 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:57.302526 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d0b88ce-639a-4532-a4ec-d5260f31fb95 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:57.303226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d0b88ce-639a-4532-a4ec-d5260f31fb95 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:57.303676 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d0b88ce-639a-4532-a4ec-d5260f31fb95 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:57.304096 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d0b88ce-639a-4532-a4ec-d5260f31fb95 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:57.434922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3d0b88ce-639a-4532-a4ec-d5260f31fb95 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:57.444419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3d0b88ce-639a-4532-a4ec-d5260f31fb95 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:57.445927 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3d0b88ce-639a-4532-a4ec-d5260f31fb95 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:57.447171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3d0b88ce-639a-4532-a4ec-d5260f31fb95 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.156379 Aug 24 12:49:57.447727 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1136/2272] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:57 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:57.540749 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9cf6c1cc-24ab-4e1f-8dde-b4abbc20e896 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:57.541355 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9cf6c1cc-24ab-4e1f-8dde-b4abbc20e896 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:57.547247 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9cf6c1cc-24ab-4e1f-8dde-b4abbc20e896 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:57.547659 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9cf6c1cc-24ab-4e1f-8dde-b4abbc20e896 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:57.548577 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9cf6c1cc-24ab-4e1f-8dde-b4abbc20e896 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:57.549254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9cf6c1cc-24ab-4e1f-8dde-b4abbc20e896 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:57.549704 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9cf6c1cc-24ab-4e1f-8dde-b4abbc20e896 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:57.550120 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9cf6c1cc-24ab-4e1f-8dde-b4abbc20e896 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:57.676761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9cf6c1cc-24ab-4e1f-8dde-b4abbc20e896 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:57.684810 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9cf6c1cc-24ab-4e1f-8dde-b4abbc20e896 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.147833 Aug 24 12:49:57.685367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1137/2273] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:57 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:58.199757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fffa0713-8992-496a-a376-59758759b58f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:58.200367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fffa0713-8992-496a-a376-59758759b58f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:58.206280 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fffa0713-8992-496a-a376-59758759b58f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:58.206795 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fffa0713-8992-496a-a376-59758759b58f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:58.207233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fffa0713-8992-496a-a376-59758759b58f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:58.207921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fffa0713-8992-496a-a376-59758759b58f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:58.208377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fffa0713-8992-496a-a376-59758759b58f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:58.208806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fffa0713-8992-496a-a376-59758759b58f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:58.336695 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fffa0713-8992-496a-a376-59758759b58f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:58.344910 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fffa0713-8992-496a-a376-59758759b58f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.148953 Aug 24 12:49:58.346045 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1137/2274] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:58 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:58.476398 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5b2a47e3-5c78-485a-9c7c-1bbc8f7283db tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:58.477018 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5b2a47e3-5c78-485a-9c7c-1bbc8f7283db tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:58.483389 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5b2a47e3-5c78-485a-9c7c-1bbc8f7283db tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:58.483871 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5b2a47e3-5c78-485a-9c7c-1bbc8f7283db tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:58.484313 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5b2a47e3-5c78-485a-9c7c-1bbc8f7283db tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:58.484994 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5b2a47e3-5c78-485a-9c7c-1bbc8f7283db tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:58.485476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5b2a47e3-5c78-485a-9c7c-1bbc8f7283db tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:58.485909 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5b2a47e3-5c78-485a-9c7c-1bbc8f7283db tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:58.619790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5b2a47e3-5c78-485a-9c7c-1bbc8f7283db tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:58.628254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5b2a47e3-5c78-485a-9c7c-1bbc8f7283db tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:58.629755 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5b2a47e3-5c78-485a-9c7c-1bbc8f7283db tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:58.630928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5b2a47e3-5c78-485a-9c7c-1bbc8f7283db tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.158699 Aug 24 12:49:58.631477 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1138/2275] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:58 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:58.706576 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4ce43714-d7a6-423f-ab73-7f0d9447cd54 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:58.707226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4ce43714-d7a6-423f-ab73-7f0d9447cd54 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:58.713126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4ce43714-d7a6-423f-ab73-7f0d9447cd54 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:58.713614 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4ce43714-d7a6-423f-ab73-7f0d9447cd54 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:58.714092 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4ce43714-d7a6-423f-ab73-7f0d9447cd54 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:58.714804 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4ce43714-d7a6-423f-ab73-7f0d9447cd54 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:58.715269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4ce43714-d7a6-423f-ab73-7f0d9447cd54 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:58.715698 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4ce43714-d7a6-423f-ab73-7f0d9447cd54 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:58.841813 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4ce43714-d7a6-423f-ab73-7f0d9447cd54 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:58.849951 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4ce43714-d7a6-423f-ab73-7f0d9447cd54 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.147793 Aug 24 12:49:58.850505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1138/2276] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:58 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:59.232140 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:49:59.232373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 12:49:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:49:59.442080 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b6ea496f-b551-4102-9439-a01a689926f9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:59.442728 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b6ea496f-b551-4102-9439-a01a689926f9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:59.448569 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6ea496f-b551-4102-9439-a01a689926f9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:59.449052 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6ea496f-b551-4102-9439-a01a689926f9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:59.455195 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6ea496f-b551-4102-9439-a01a689926f9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:59.455195 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6ea496f-b551-4102-9439-a01a689926f9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:59.455195 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6ea496f-b551-4102-9439-a01a689926f9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:59.455195 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6ea496f-b551-4102-9439-a01a689926f9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:59.578908 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b6ea496f-b551-4102-9439-a01a689926f9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:59.587079 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b6ea496f-b551-4102-9439-a01a689926f9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.224346 Aug 24 12:49:59.587638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1139/2277] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:59 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:49:59.653029 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9de58a52-46a9-4ce5-966c-1746a139ccb3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:59.653633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9de58a52-46a9-4ce5-966c-1746a139ccb3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:59.659998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9de58a52-46a9-4ce5-966c-1746a139ccb3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:59.660486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9de58a52-46a9-4ce5-966c-1746a139ccb3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:59.660920 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9de58a52-46a9-4ce5-966c-1746a139ccb3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:59.661599 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9de58a52-46a9-4ce5-966c-1746a139ccb3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:59.662055 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9de58a52-46a9-4ce5-966c-1746a139ccb3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:59.662481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9de58a52-46a9-4ce5-966c-1746a139ccb3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:59.664984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:49:59.790969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9de58a52-46a9-4ce5-966c-1746a139ccb3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:59.800060 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9de58a52-46a9-4ce5-966c-1746a139ccb3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:59.801547 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9de58a52-46a9-4ce5-966c-1746a139ccb3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:49:59.802730 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9de58a52-46a9-4ce5-966c-1746a139ccb3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.153515 Aug 24 12:49:59.803305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1139/2278] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:49:59 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:49:59.871450 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e0e27daf-de31-433a-8cd8-3d4b8e3770e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:49:59.872057 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e0e27daf-de31-433a-8cd8-3d4b8e3770e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:49:59.878565 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0e27daf-de31-433a-8cd8-3d4b8e3770e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:59.879074 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0e27daf-de31-433a-8cd8-3d4b8e3770e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:59.879510 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0e27daf-de31-433a-8cd8-3d4b8e3770e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:59.880188 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0e27daf-de31-433a-8cd8-3d4b8e3770e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:49:59.880634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0e27daf-de31-433a-8cd8-3d4b8e3770e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:49:59.881054 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0e27daf-de31-433a-8cd8-3d4b8e3770e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:49:59.883539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:50:00.007431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e0e27daf-de31-433a-8cd8-3d4b8e3770e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:00.015402 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e0e27daf-de31-433a-8cd8-3d4b8e3770e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.147766 Aug 24 12:50:00.015957 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1140/2279] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:49:59 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:00.609001 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-df03bdf5-5718-42b8-a577-2e4937038dae tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:00.609639 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-df03bdf5-5718-42b8-a577-2e4937038dae tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:00.615921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df03bdf5-5718-42b8-a577-2e4937038dae tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:00.616400 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df03bdf5-5718-42b8-a577-2e4937038dae tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:00.616840 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df03bdf5-5718-42b8-a577-2e4937038dae tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:00.617517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df03bdf5-5718-42b8-a577-2e4937038dae tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:00.617971 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df03bdf5-5718-42b8-a577-2e4937038dae tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:00.618393 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df03bdf5-5718-42b8-a577-2e4937038dae tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:00.743772 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-df03bdf5-5718-42b8-a577-2e4937038dae tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:00.751782 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-df03bdf5-5718-42b8-a577-2e4937038dae tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.146559 Aug 24 12:50:00.752396 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1140/2280] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:00 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:00.826192 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d445fc8b-ef99-4f33-ab39-7eac26383a28 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:00.826857 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d445fc8b-ef99-4f33-ab39-7eac26383a28 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:00.833769 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d445fc8b-ef99-4f33-ab39-7eac26383a28 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:00.834242 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d445fc8b-ef99-4f33-ab39-7eac26383a28 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:00.834693 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d445fc8b-ef99-4f33-ab39-7eac26383a28 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:00.835373 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d445fc8b-ef99-4f33-ab39-7eac26383a28 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:00.835822 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d445fc8b-ef99-4f33-ab39-7eac26383a28 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:00.836241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d445fc8b-ef99-4f33-ab39-7eac26383a28 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:00.967634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d445fc8b-ef99-4f33-ab39-7eac26383a28 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:00.976193 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d445fc8b-ef99-4f33-ab39-7eac26383a28 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:00.977682 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d445fc8b-ef99-4f33-ab39-7eac26383a28 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:00.978871 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d445fc8b-ef99-4f33-ab39-7eac26383a28 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.156594 Aug 24 12:50:00.979418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1141/2281] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:00 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:01.035981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-de10c0e5-86ee-41a9-a637-91951738362b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:01.036587 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-de10c0e5-86ee-41a9-a637-91951738362b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:01.042433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de10c0e5-86ee-41a9-a637-91951738362b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:01.042952 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de10c0e5-86ee-41a9-a637-91951738362b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:01.043384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de10c0e5-86ee-41a9-a637-91951738362b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:01.044059 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de10c0e5-86ee-41a9-a637-91951738362b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:01.044513 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de10c0e5-86ee-41a9-a637-91951738362b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:01.044934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de10c0e5-86ee-41a9-a637-91951738362b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:01.173168 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-de10c0e5-86ee-41a9-a637-91951738362b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:01.181281 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-de10c0e5-86ee-41a9-a637-91951738362b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149217 Aug 24 12:50:01.181831 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1141/2282] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:01 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:01.772674 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c2228881-ecf0-419c-b3ee-2cac2ce9eee5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:01.773312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c2228881-ecf0-419c-b3ee-2cac2ce9eee5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:01.779318 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2228881-ecf0-419c-b3ee-2cac2ce9eee5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:01.779796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2228881-ecf0-419c-b3ee-2cac2ce9eee5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:01.780231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2228881-ecf0-419c-b3ee-2cac2ce9eee5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:01.780908 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2228881-ecf0-419c-b3ee-2cac2ce9eee5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:01.781362 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2228881-ecf0-419c-b3ee-2cac2ce9eee5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:01.781785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2228881-ecf0-419c-b3ee-2cac2ce9eee5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:01.907137 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c2228881-ecf0-419c-b3ee-2cac2ce9eee5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:01.915646 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c2228881-ecf0-419c-b3ee-2cac2ce9eee5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.146852 Aug 24 12:50:01.916201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1142/2283] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:01 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:02.002004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-69870ffb-22d7-468a-b029-04c779c762b2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:02.002672 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-69870ffb-22d7-468a-b029-04c779c762b2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:02.009035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-69870ffb-22d7-468a-b029-04c779c762b2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:02.009515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-69870ffb-22d7-468a-b029-04c779c762b2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:02.009949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-69870ffb-22d7-468a-b029-04c779c762b2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:02.010632 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-69870ffb-22d7-468a-b029-04c779c762b2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:02.011109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-69870ffb-22d7-468a-b029-04c779c762b2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:02.011535 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-69870ffb-22d7-468a-b029-04c779c762b2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:02.137718 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-69870ffb-22d7-468a-b029-04c779c762b2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:02.146930 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-69870ffb-22d7-468a-b029-04c779c762b2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:02.148421 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-69870ffb-22d7-468a-b029-04c779c762b2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:02.149579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-69870ffb-22d7-468a-b029-04c779c762b2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.151479 Aug 24 12:50:02.150129 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1142/2284] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:01 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:02.202019 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-11718bf0-6877-4b63-a8f5-b6aa037003c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:02.202631 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-11718bf0-6877-4b63-a8f5-b6aa037003c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:02.209048 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-11718bf0-6877-4b63-a8f5-b6aa037003c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:02.209522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-11718bf0-6877-4b63-a8f5-b6aa037003c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:02.209953 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-11718bf0-6877-4b63-a8f5-b6aa037003c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:02.210626 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-11718bf0-6877-4b63-a8f5-b6aa037003c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:02.211098 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-11718bf0-6877-4b63-a8f5-b6aa037003c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:02.211518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-11718bf0-6877-4b63-a8f5-b6aa037003c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:02.342302 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-11718bf0-6877-4b63-a8f5-b6aa037003c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:02.351140 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-11718bf0-6877-4b63-a8f5-b6aa037003c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152947 Aug 24 12:50:02.351698 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1143/2285] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:02 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:02.936890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b272bab4-25ed-433a-bc62-c33e8e292184 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:02.937428 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b272bab4-25ed-433a-bc62-c33e8e292184 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:02.944080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b272bab4-25ed-433a-bc62-c33e8e292184 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:02.944560 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b272bab4-25ed-433a-bc62-c33e8e292184 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:02.944992 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b272bab4-25ed-433a-bc62-c33e8e292184 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:02.945664 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b272bab4-25ed-433a-bc62-c33e8e292184 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:02.946118 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b272bab4-25ed-433a-bc62-c33e8e292184 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:02.946539 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b272bab4-25ed-433a-bc62-c33e8e292184 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:03.024500 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:50:03.025099 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 12:50:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:50:03.080430 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b272bab4-25ed-433a-bc62-c33e8e292184 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:03.088543 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b272bab4-25ed-433a-bc62-c33e8e292184 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.155526 Aug 24 12:50:03.089094 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1143/2286] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:02 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:03.218295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e2d6b658-2513-4de6-9faa-03808967b05e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:03.219015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e2d6b658-2513-4de6-9faa-03808967b05e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:03.225578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2d6b658-2513-4de6-9faa-03808967b05e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:03.226057 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2d6b658-2513-4de6-9faa-03808967b05e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:03.226483 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2d6b658-2513-4de6-9faa-03808967b05e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:03.227250 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2d6b658-2513-4de6-9faa-03808967b05e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:03.227694 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2d6b658-2513-4de6-9faa-03808967b05e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:03.228167 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2d6b658-2513-4de6-9faa-03808967b05e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:03.356359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e2d6b658-2513-4de6-9faa-03808967b05e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:03.366070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e2d6b658-2513-4de6-9faa-03808967b05e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:03.367700 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e2d6b658-2513-4de6-9faa-03808967b05e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:03.368900 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e2d6b658-2513-4de6-9faa-03808967b05e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.200087 Aug 24 12:50:03.369450 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1144/2287] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:03 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:03.372749 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1a57c541-b967-4325-9fe6-264ce9810961 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:03.373391 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1a57c541-b967-4325-9fe6-264ce9810961 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:03.379339 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1a57c541-b967-4325-9fe6-264ce9810961 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:03.379943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1a57c541-b967-4325-9fe6-264ce9810961 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:03.380386 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1a57c541-b967-4325-9fe6-264ce9810961 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:03.381076 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1a57c541-b967-4325-9fe6-264ce9810961 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:03.381533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1a57c541-b967-4325-9fe6-264ce9810961 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:03.381959 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1a57c541-b967-4325-9fe6-264ce9810961 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:03.512395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1a57c541-b967-4325-9fe6-264ce9810961 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:03.520476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1a57c541-b967-4325-9fe6-264ce9810961 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151862 Aug 24 12:50:03.521042 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1144/2288] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:03 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:04.109406 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-73c31e0a-6f19-4e3b-a75d-5f0aab07c3a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:04.110021 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-73c31e0a-6f19-4e3b-a75d-5f0aab07c3a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:04.116270 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-73c31e0a-6f19-4e3b-a75d-5f0aab07c3a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:04.116752 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-73c31e0a-6f19-4e3b-a75d-5f0aab07c3a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:04.117188 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-73c31e0a-6f19-4e3b-a75d-5f0aab07c3a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:04.117881 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-73c31e0a-6f19-4e3b-a75d-5f0aab07c3a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:04.118319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-73c31e0a-6f19-4e3b-a75d-5f0aab07c3a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:04.118775 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-73c31e0a-6f19-4e3b-a75d-5f0aab07c3a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:04.247866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-73c31e0a-6f19-4e3b-a75d-5f0aab07c3a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:04.256657 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-73c31e0a-6f19-4e3b-a75d-5f0aab07c3a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151150 Aug 24 12:50:04.257206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1145/2289] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:04 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:04.393295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3b3844a7-c3d0-4a5a-9525-9d9f69c263b7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:04.393822 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3b3844a7-c3d0-4a5a-9525-9d9f69c263b7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:04.400185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b3844a7-c3d0-4a5a-9525-9d9f69c263b7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:04.400700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b3844a7-c3d0-4a5a-9525-9d9f69c263b7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:04.401139 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b3844a7-c3d0-4a5a-9525-9d9f69c263b7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:04.401816 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b3844a7-c3d0-4a5a-9525-9d9f69c263b7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:04.402272 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b3844a7-c3d0-4a5a-9525-9d9f69c263b7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:04.402725 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b3844a7-c3d0-4a5a-9525-9d9f69c263b7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:04.529298 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3b3844a7-c3d0-4a5a-9525-9d9f69c263b7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:04.537941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3b3844a7-c3d0-4a5a-9525-9d9f69c263b7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:04.539454 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3b3844a7-c3d0-4a5a-9525-9d9f69c263b7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:04.540620 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3b3844a7-c3d0-4a5a-9525-9d9f69c263b7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.151377 Aug 24 12:50:04.541179 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1145/2290] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:04 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:04.542052 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9e26686e-6c95-4e5a-8bda-6a59ea387e30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:04.542776 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9e26686e-6c95-4e5a-8bda-6a59ea387e30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:04.549592 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9e26686e-6c95-4e5a-8bda-6a59ea387e30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:04.550167 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9e26686e-6c95-4e5a-8bda-6a59ea387e30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:04.550605 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9e26686e-6c95-4e5a-8bda-6a59ea387e30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:04.551320 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9e26686e-6c95-4e5a-8bda-6a59ea387e30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:04.551772 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9e26686e-6c95-4e5a-8bda-6a59ea387e30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:04.552195 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9e26686e-6c95-4e5a-8bda-6a59ea387e30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:04.684055 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9e26686e-6c95-4e5a-8bda-6a59ea387e30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:04.692243 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9e26686e-6c95-4e5a-8bda-6a59ea387e30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.154477 Aug 24 12:50:04.692795 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1146/2291] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:04 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:05.277342 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-29d24c6f-7d8f-4522-b083-dde4140763fe tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:05.277956 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-29d24c6f-7d8f-4522-b083-dde4140763fe tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:05.283864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29d24c6f-7d8f-4522-b083-dde4140763fe tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:05.284354 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29d24c6f-7d8f-4522-b083-dde4140763fe tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:05.284796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29d24c6f-7d8f-4522-b083-dde4140763fe tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:05.285486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29d24c6f-7d8f-4522-b083-dde4140763fe tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:05.285947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29d24c6f-7d8f-4522-b083-dde4140763fe tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:05.286378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29d24c6f-7d8f-4522-b083-dde4140763fe tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:05.413399 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-29d24c6f-7d8f-4522-b083-dde4140763fe tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:05.421599 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-29d24c6f-7d8f-4522-b083-dde4140763fe tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.148130 Aug 24 12:50:05.422154 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1146/2292] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:05 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:05.564496 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d66926e7-f018-46ff-bcfc-c0b427d98a06 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:05.565029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d66926e7-f018-46ff-bcfc-c0b427d98a06 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:05.571405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d66926e7-f018-46ff-bcfc-c0b427d98a06 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:05.571882 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d66926e7-f018-46ff-bcfc-c0b427d98a06 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:05.572307 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d66926e7-f018-46ff-bcfc-c0b427d98a06 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:05.572973 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d66926e7-f018-46ff-bcfc-c0b427d98a06 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:05.573415 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d66926e7-f018-46ff-bcfc-c0b427d98a06 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:05.573830 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d66926e7-f018-46ff-bcfc-c0b427d98a06 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:05.698907 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d66926e7-f018-46ff-bcfc-c0b427d98a06 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:05.707333 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d66926e7-f018-46ff-bcfc-c0b427d98a06 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:05.708907 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d66926e7-f018-46ff-bcfc-c0b427d98a06 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:05.710056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d66926e7-f018-46ff-bcfc-c0b427d98a06 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.149618 Aug 24 12:50:05.710599 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1147/2293] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:05 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:05.712928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-de1fdb38-1713-4b96-86b8-5575e61bf1fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:05.713553 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-de1fdb38-1713-4b96-86b8-5575e61bf1fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:05.719713 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de1fdb38-1713-4b96-86b8-5575e61bf1fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:05.720200 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de1fdb38-1713-4b96-86b8-5575e61bf1fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:05.721155 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de1fdb38-1713-4b96-86b8-5575e61bf1fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:05.721848 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de1fdb38-1713-4b96-86b8-5575e61bf1fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:05.722303 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de1fdb38-1713-4b96-86b8-5575e61bf1fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:05.722760 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de1fdb38-1713-4b96-86b8-5575e61bf1fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:05.851673 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-de1fdb38-1713-4b96-86b8-5575e61bf1fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:05.859874 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-de1fdb38-1713-4b96-86b8-5575e61bf1fa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150713 Aug 24 12:50:05.860438 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1147/2294] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:05 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:06.442597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-92e49f70-871e-44fc-b0c8-845b15553a58 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:06.443223 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-92e49f70-871e-44fc-b0c8-845b15553a58 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:06.449129 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92e49f70-871e-44fc-b0c8-845b15553a58 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:06.449600 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92e49f70-871e-44fc-b0c8-845b15553a58 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:06.450028 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92e49f70-871e-44fc-b0c8-845b15553a58 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:06.450717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92e49f70-871e-44fc-b0c8-845b15553a58 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:06.451164 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92e49f70-871e-44fc-b0c8-845b15553a58 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:06.451583 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92e49f70-871e-44fc-b0c8-845b15553a58 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:06.581350 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-92e49f70-871e-44fc-b0c8-845b15553a58 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:06.589505 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-92e49f70-871e-44fc-b0c8-845b15553a58 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150649 Aug 24 12:50:06.590061 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1148/2295] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:06 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:06.733063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2f48c20c-5839-41dc-9906-260d7dc9b02d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:06.733679 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2f48c20c-5839-41dc-9906-260d7dc9b02d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:06.740215 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f48c20c-5839-41dc-9906-260d7dc9b02d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:06.740703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f48c20c-5839-41dc-9906-260d7dc9b02d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:06.741147 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f48c20c-5839-41dc-9906-260d7dc9b02d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:06.741842 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f48c20c-5839-41dc-9906-260d7dc9b02d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:06.742307 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f48c20c-5839-41dc-9906-260d7dc9b02d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:06.742765 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f48c20c-5839-41dc-9906-260d7dc9b02d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:06.867559 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2f48c20c-5839-41dc-9906-260d7dc9b02d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:06.876322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2f48c20c-5839-41dc-9906-260d7dc9b02d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:06.878100 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2f48c20c-5839-41dc-9906-260d7dc9b02d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:06.879384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2f48c20c-5839-41dc-9906-260d7dc9b02d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.150145 Aug 24 12:50:06.880170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1148/2296] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:06 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:06.880515 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-573df228-15e3-4cc6-870c-961e410b3aaf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:06.881123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-573df228-15e3-4cc6-870c-961e410b3aaf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:06.886951 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-573df228-15e3-4cc6-870c-961e410b3aaf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:06.887441 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-573df228-15e3-4cc6-870c-961e410b3aaf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:06.887864 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-573df228-15e3-4cc6-870c-961e410b3aaf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:06.888540 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-573df228-15e3-4cc6-870c-961e410b3aaf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:06.888989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-573df228-15e3-4cc6-870c-961e410b3aaf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:06.889408 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-573df228-15e3-4cc6-870c-961e410b3aaf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:07.016602 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-573df228-15e3-4cc6-870c-961e410b3aaf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:07.026266 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-573df228-15e3-4cc6-870c-961e410b3aaf tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149861 Aug 24 12:50:07.026866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1149/2297] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:06 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:07.610969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-460af20e-b4f6-45dc-ba78-8bdf365c4051 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:07.612073 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-460af20e-b4f6-45dc-ba78-8bdf365c4051 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:07.618406 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-460af20e-b4f6-45dc-ba78-8bdf365c4051 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:07.618921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-460af20e-b4f6-45dc-ba78-8bdf365c4051 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:07.619361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-460af20e-b4f6-45dc-ba78-8bdf365c4051 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:07.620051 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-460af20e-b4f6-45dc-ba78-8bdf365c4051 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:07.620507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-460af20e-b4f6-45dc-ba78-8bdf365c4051 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:07.620932 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-460af20e-b4f6-45dc-ba78-8bdf365c4051 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:07.754418 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-460af20e-b4f6-45dc-ba78-8bdf365c4051 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:07.762700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-460af20e-b4f6-45dc-ba78-8bdf365c4051 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.155502 Aug 24 12:50:07.763276 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1149/2298] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:07 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:07.902813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e731a0c7-6580-419a-8eb6-8d66d33183e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:07.903486 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e731a0c7-6580-419a-8eb6-8d66d33183e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:07.911338 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e731a0c7-6580-419a-8eb6-8d66d33183e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:07.911815 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e731a0c7-6580-419a-8eb6-8d66d33183e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:07.912250 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e731a0c7-6580-419a-8eb6-8d66d33183e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:07.913141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e731a0c7-6580-419a-8eb6-8d66d33183e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:07.913361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e731a0c7-6580-419a-8eb6-8d66d33183e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:07.913774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e731a0c7-6580-419a-8eb6-8d66d33183e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:08.046875 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e731a0c7-6580-419a-8eb6-8d66d33183e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:08.047881 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c0b421eb-bf72-4c9c-b7d5-9b2a2db1c7dd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:08.048560 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c0b421eb-bf72-4c9c-b7d5-9b2a2db1c7dd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:08.055561 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c0b421eb-bf72-4c9c-b7d5-9b2a2db1c7dd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:08.056074 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e731a0c7-6580-419a-8eb6-8d66d33183e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:08.056312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c0b421eb-bf72-4c9c-b7d5-9b2a2db1c7dd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:08.056618 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c0b421eb-bf72-4c9c-b7d5-9b2a2db1c7dd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:08.057389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c0b421eb-bf72-4c9c-b7d5-9b2a2db1c7dd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:08.057567 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e731a0c7-6580-419a-8eb6-8d66d33183e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:08.057939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c0b421eb-bf72-4c9c-b7d5-9b2a2db1c7dd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:08.058744 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c0b421eb-bf72-4c9c-b7d5-9b2a2db1c7dd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:08.058902 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e731a0c7-6580-419a-8eb6-8d66d33183e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.159890 Aug 24 12:50:08.059639 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1150/2299] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:07 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:08.182975 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c0b421eb-bf72-4c9c-b7d5-9b2a2db1c7dd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:08.191562 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c0b421eb-bf72-4c9c-b7d5-9b2a2db1c7dd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.147709 Aug 24 12:50:08.192123 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1150/2300] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:08 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:08.783939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-37331a37-36fe-4ab8-aa1b-24852e98ca33 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:08.784576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-37331a37-36fe-4ab8-aa1b-24852e98ca33 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:08.790494 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37331a37-36fe-4ab8-aa1b-24852e98ca33 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:08.791004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37331a37-36fe-4ab8-aa1b-24852e98ca33 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:08.791443 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37331a37-36fe-4ab8-aa1b-24852e98ca33 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:08.792117 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37331a37-36fe-4ab8-aa1b-24852e98ca33 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:08.792568 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37331a37-36fe-4ab8-aa1b-24852e98ca33 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:08.792987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37331a37-36fe-4ab8-aa1b-24852e98ca33 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:08.919519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-37331a37-36fe-4ab8-aa1b-24852e98ca33 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:08.927509 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-37331a37-36fe-4ab8-aa1b-24852e98ca33 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147907 Aug 24 12:50:08.928059 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1151/2301] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:08 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:09.081687 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-180f5495-42d5-4034-885f-1b896fb75d42 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:09.082290 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-180f5495-42d5-4034-885f-1b896fb75d42 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:09.088991 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-180f5495-42d5-4034-885f-1b896fb75d42 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:09.089469 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-180f5495-42d5-4034-885f-1b896fb75d42 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:09.089902 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-180f5495-42d5-4034-885f-1b896fb75d42 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:09.090581 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-180f5495-42d5-4034-885f-1b896fb75d42 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:09.091059 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-180f5495-42d5-4034-885f-1b896fb75d42 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:09.091481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-180f5495-42d5-4034-885f-1b896fb75d42 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:09.212339 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0f598a61-64f1-4218-97be-eb98e4704632 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:09.213062 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0f598a61-64f1-4218-97be-eb98e4704632 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:09.218905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f598a61-64f1-4218-97be-eb98e4704632 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:09.219386 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f598a61-64f1-4218-97be-eb98e4704632 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:09.219824 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f598a61-64f1-4218-97be-eb98e4704632 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:09.221171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f598a61-64f1-4218-97be-eb98e4704632 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:09.221627 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f598a61-64f1-4218-97be-eb98e4704632 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:09.222052 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f598a61-64f1-4218-97be-eb98e4704632 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:09.223075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-180f5495-42d5-4034-885f-1b896fb75d42 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:09.231764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-180f5495-42d5-4034-885f-1b896fb75d42 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:09.233285 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-180f5495-42d5-4034-885f-1b896fb75d42 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:09.234470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-180f5495-42d5-4034-885f-1b896fb75d42 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.157231 Aug 24 12:50:09.235057 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1151/2302] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:09 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:09.350057 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0f598a61-64f1-4218-97be-eb98e4704632 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:09.358127 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0f598a61-64f1-4218-97be-eb98e4704632 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149594 Aug 24 12:50:09.358694 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1152/2303] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:09 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:09.948484 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-40696c04-b792-499a-be72-a26718d981c6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:09.949097 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-40696c04-b792-499a-be72-a26718d981c6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:09.955317 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40696c04-b792-499a-be72-a26718d981c6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:09.955796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40696c04-b792-499a-be72-a26718d981c6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:09.956229 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40696c04-b792-499a-be72-a26718d981c6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:09.956941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40696c04-b792-499a-be72-a26718d981c6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:09.957392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40696c04-b792-499a-be72-a26718d981c6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:09.957814 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40696c04-b792-499a-be72-a26718d981c6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:10.086082 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-40696c04-b792-499a-be72-a26718d981c6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:10.094596 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-40696c04-b792-499a-be72-a26718d981c6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150010 Aug 24 12:50:10.095174 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1152/2304] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:09 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:10.257288 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-19454dfc-2a13-4246-9a58-af1dd07bff25 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:10.257896 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-19454dfc-2a13-4246-9a58-af1dd07bff25 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:10.264305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19454dfc-2a13-4246-9a58-af1dd07bff25 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:10.264781 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19454dfc-2a13-4246-9a58-af1dd07bff25 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:10.265211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19454dfc-2a13-4246-9a58-af1dd07bff25 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:10.265887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19454dfc-2a13-4246-9a58-af1dd07bff25 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:10.266337 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19454dfc-2a13-4246-9a58-af1dd07bff25 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:10.266785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19454dfc-2a13-4246-9a58-af1dd07bff25 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:10.380269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-baba91c6-dda6-4062-a2ed-9d85c5a085cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:10.381013 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-baba91c6-dda6-4062-a2ed-9d85c5a085cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:10.386960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-baba91c6-dda6-4062-a2ed-9d85c5a085cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:10.387539 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-baba91c6-dda6-4062-a2ed-9d85c5a085cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:10.388046 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-baba91c6-dda6-4062-a2ed-9d85c5a085cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:10.388812 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-baba91c6-dda6-4062-a2ed-9d85c5a085cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:10.389406 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-baba91c6-dda6-4062-a2ed-9d85c5a085cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:10.389843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-baba91c6-dda6-4062-a2ed-9d85c5a085cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:10.400739 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-19454dfc-2a13-4246-9a58-af1dd07bff25 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:10.410203 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-19454dfc-2a13-4246-9a58-af1dd07bff25 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:10.411889 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-19454dfc-2a13-4246-9a58-af1dd07bff25 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:10.413061 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-19454dfc-2a13-4246-9a58-af1dd07bff25 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.159669 Aug 24 12:50:10.413651 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1153/2305] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:10 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:10.519752 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-baba91c6-dda6-4062-a2ed-9d85c5a085cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:10.527869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-baba91c6-dda6-4062-a2ed-9d85c5a085cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151523 Aug 24 12:50:10.528425 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1153/2306] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:10 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:11.116731 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-39c0c6db-99f6-40ac-b838-4b93bdec0752 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:11.117418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-39c0c6db-99f6-40ac-b838-4b93bdec0752 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:11.123327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-39c0c6db-99f6-40ac-b838-4b93bdec0752 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:11.123805 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-39c0c6db-99f6-40ac-b838-4b93bdec0752 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:11.124233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-39c0c6db-99f6-40ac-b838-4b93bdec0752 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:11.124914 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-39c0c6db-99f6-40ac-b838-4b93bdec0752 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:11.125358 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-39c0c6db-99f6-40ac-b838-4b93bdec0752 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:11.125781 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-39c0c6db-99f6-40ac-b838-4b93bdec0752 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:11.257533 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-39c0c6db-99f6-40ac-b838-4b93bdec0752 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:11.265734 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-39c0c6db-99f6-40ac-b838-4b93bdec0752 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.153100 Aug 24 12:50:11.266298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1154/2307] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:11 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:11.437101 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9b1b0152-27ca-4f9e-a855-24baae810657 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:11.437742 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9b1b0152-27ca-4f9e-a855-24baae810657 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:11.444656 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9b1b0152-27ca-4f9e-a855-24baae810657 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:11.445140 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9b1b0152-27ca-4f9e-a855-24baae810657 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:11.445576 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9b1b0152-27ca-4f9e-a855-24baae810657 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:11.446273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9b1b0152-27ca-4f9e-a855-24baae810657 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:11.446749 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9b1b0152-27ca-4f9e-a855-24baae810657 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:11.447181 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9b1b0152-27ca-4f9e-a855-24baae810657 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:11.548263 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e12cfde2-041c-412c-a195-e5485e199d36 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:11.548936 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e12cfde2-041c-412c-a195-e5485e199d36 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:11.554982 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e12cfde2-041c-412c-a195-e5485e199d36 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:11.555464 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e12cfde2-041c-412c-a195-e5485e199d36 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:11.555890 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e12cfde2-041c-412c-a195-e5485e199d36 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:11.556575 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e12cfde2-041c-412c-a195-e5485e199d36 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:11.557021 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e12cfde2-041c-412c-a195-e5485e199d36 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:11.557437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e12cfde2-041c-412c-a195-e5485e199d36 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:11.574879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9b1b0152-27ca-4f9e-a855-24baae810657 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:11.584936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9b1b0152-27ca-4f9e-a855-24baae810657 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:11.586433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9b1b0152-27ca-4f9e-a855-24baae810657 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:11.587628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9b1b0152-27ca-4f9e-a855-24baae810657 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154462 Aug 24 12:50:11.588181 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1154/2308] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:11 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:11.689847 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e12cfde2-041c-412c-a195-e5485e199d36 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:11.698285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e12cfde2-041c-412c-a195-e5485e199d36 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.153977 Aug 24 12:50:11.698926 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1155/2309] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:11 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:12.062826 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:50:12.063040 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 12:50:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:50:12.288284 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fba9422b-0bbb-40be-8834-aa3f6dcdd368 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:12.289159 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fba9422b-0bbb-40be-8834-aa3f6dcdd368 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:12.295570 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fba9422b-0bbb-40be-8834-aa3f6dcdd368 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:12.296058 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fba9422b-0bbb-40be-8834-aa3f6dcdd368 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:12.296497 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fba9422b-0bbb-40be-8834-aa3f6dcdd368 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:12.297189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fba9422b-0bbb-40be-8834-aa3f6dcdd368 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:12.297645 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fba9422b-0bbb-40be-8834-aa3f6dcdd368 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:12.298071 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fba9422b-0bbb-40be-8834-aa3f6dcdd368 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:12.365524 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6dbfc6e6-aaf4-476a-8db8-232aaf20dccc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:12.366596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6dbfc6e6-aaf4-476a-8db8-232aaf20dccc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:12.373133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6dbfc6e6-aaf4-476a-8db8-232aaf20dccc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:12.373841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6dbfc6e6-aaf4-476a-8db8-232aaf20dccc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:12.374494 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6dbfc6e6-aaf4-476a-8db8-232aaf20dccc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:12.375380 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6dbfc6e6-aaf4-476a-8db8-232aaf20dccc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:12.376000 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6dbfc6e6-aaf4-476a-8db8-232aaf20dccc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:12.377140 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6dbfc6e6-aaf4-476a-8db8-232aaf20dccc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:12.404994 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6dbfc6e6-aaf4-476a-8db8-232aaf20dccc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Going to try to terminate instance {{(pid=121171) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:50:12.408409 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:50:12.430442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fba9422b-0bbb-40be-8834-aa3f6dcdd368 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:12.432755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:50:12.440501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fba9422b-0bbb-40be-8834-aa3f6dcdd368 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.155783 Aug 24 12:50:12.441204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1155/2310] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:12 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:12.573485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:50:12.573729 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 12:50:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 (ip 10.222.0.45) !!! Aug 24 12:50:12.612031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ad14a4b4-223a-4c01-9a95-6cca8fce1612 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:12.612900 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ad14a4b4-223a-4c01-9a95-6cca8fce1612 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:12.619534 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad14a4b4-223a-4c01-9a95-6cca8fce1612 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:12.619964 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad14a4b4-223a-4c01-9a95-6cca8fce1612 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:12.620405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad14a4b4-223a-4c01-9a95-6cca8fce1612 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:12.621095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad14a4b4-223a-4c01-9a95-6cca8fce1612 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:12.621562 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad14a4b4-223a-4c01-9a95-6cca8fce1612 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:12.621993 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ad14a4b4-223a-4c01-9a95-6cca8fce1612 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:12.758622 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ad14a4b4-223a-4c01-9a95-6cca8fce1612 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:12.767412 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ad14a4b4-223a-4c01-9a95-6cca8fce1612 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:12.768928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ad14a4b4-223a-4c01-9a95-6cca8fce1612 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:12.770088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ad14a4b4-223a-4c01-9a95-6cca8fce1612 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.162975 Aug 24 12:50:12.770635 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1156/2311] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:12 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:50:12.774995 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-97a80794-1267-4fd1-a9c5-9f0b71355733 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:12.775596 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-97a80794-1267-4fd1-a9c5-9f0b71355733 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:12.781319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97a80794-1267-4fd1-a9c5-9f0b71355733 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:12.781850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97a80794-1267-4fd1-a9c5-9f0b71355733 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:12.782391 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97a80794-1267-4fd1-a9c5-9f0b71355733 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:12.783270 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97a80794-1267-4fd1-a9c5-9f0b71355733 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:12.783706 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97a80794-1267-4fd1-a9c5-9f0b71355733 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:12.784163 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97a80794-1267-4fd1-a9c5-9f0b71355733 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:12.793019 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6dbfc6e6-aaf4-476a-8db8-232aaf20dccc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "DELETE /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 204 len: 0 microversion: 2.1 time: 0.431504 Aug 24 12:50:12.793812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1156/2312] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 12:50:12 2022] DELETE /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 12:50:12.803856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d50c0aac-1685-429c-9dc3-cd9a72fa6142 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:12.805491 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d50c0aac-1685-429c-9dc3-cd9a72fa6142 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:12.811707 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d50c0aac-1685-429c-9dc3-cd9a72fa6142 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:12.812182 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d50c0aac-1685-429c-9dc3-cd9a72fa6142 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:12.812664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d50c0aac-1685-429c-9dc3-cd9a72fa6142 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:12.813336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d50c0aac-1685-429c-9dc3-cd9a72fa6142 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:12.813865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d50c0aac-1685-429c-9dc3-cd9a72fa6142 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:12.815125 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d50c0aac-1685-429c-9dc3-cd9a72fa6142 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:12.918784 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-97a80794-1267-4fd1-a9c5-9f0b71355733 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:12.928841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-97a80794-1267-4fd1-a9c5-9f0b71355733 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.157177 Aug 24 12:50:12.929431 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1157/2313] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:12 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:12.954278 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d50c0aac-1685-429c-9dc3-cd9a72fa6142 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:12.962482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d50c0aac-1685-429c-9dc3-cd9a72fa6142 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.164432 Aug 24 12:50:12.963136 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1157/2314] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:12 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:13.461979 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-51cdca80-ed31-44cb-b224-6d9d6a00b4f7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:13.462696 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-51cdca80-ed31-44cb-b224-6d9d6a00b4f7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:13.468678 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51cdca80-ed31-44cb-b224-6d9d6a00b4f7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:13.469166 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51cdca80-ed31-44cb-b224-6d9d6a00b4f7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:13.469606 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51cdca80-ed31-44cb-b224-6d9d6a00b4f7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:13.470925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51cdca80-ed31-44cb-b224-6d9d6a00b4f7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:13.471392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51cdca80-ed31-44cb-b224-6d9d6a00b4f7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:13.471821 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51cdca80-ed31-44cb-b224-6d9d6a00b4f7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:13.605916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-51cdca80-ed31-44cb-b224-6d9d6a00b4f7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:13.614440 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-51cdca80-ed31-44cb-b224-6d9d6a00b4f7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.156443 Aug 24 12:50:13.615032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1158/2315] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:13 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:13.794156 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-36a2fd68-6b50-4a32-be5b-871e4ee0f41d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:13.794849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-36a2fd68-6b50-4a32-be5b-871e4ee0f41d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:13.801610 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36a2fd68-6b50-4a32-be5b-871e4ee0f41d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:13.802176 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36a2fd68-6b50-4a32-be5b-871e4ee0f41d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:13.802620 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36a2fd68-6b50-4a32-be5b-871e4ee0f41d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:13.803333 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36a2fd68-6b50-4a32-be5b-871e4ee0f41d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:13.803902 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36a2fd68-6b50-4a32-be5b-871e4ee0f41d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:13.804328 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36a2fd68-6b50-4a32-be5b-871e4ee0f41d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:13.938682 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-36a2fd68-6b50-4a32-be5b-871e4ee0f41d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:13.947721 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-36a2fd68-6b50-4a32-be5b-871e4ee0f41d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:13.949207 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-36a2fd68-6b50-4a32-be5b-871e4ee0f41d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:13.950352 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-36a2fd68-6b50-4a32-be5b-871e4ee0f41d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.160244 Aug 24 12:50:13.950920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1158/2316] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:13 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:13.953397 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9601990e-b771-4ff3-bd22-ec698e31c291 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:13.954042 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9601990e-b771-4ff3-bd22-ec698e31c291 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:13.960972 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9601990e-b771-4ff3-bd22-ec698e31c291 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:13.961454 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9601990e-b771-4ff3-bd22-ec698e31c291 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:13.961889 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9601990e-b771-4ff3-bd22-ec698e31c291 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:13.962575 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9601990e-b771-4ff3-bd22-ec698e31c291 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:13.963054 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9601990e-b771-4ff3-bd22-ec698e31c291 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:13.963480 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9601990e-b771-4ff3-bd22-ec698e31c291 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:13.984259 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b23d9937-b3a3-41b7-8d29-83c6e67fe76e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:13.984869 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b23d9937-b3a3-41b7-8d29-83c6e67fe76e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:13.991722 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b23d9937-b3a3-41b7-8d29-83c6e67fe76e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:13.992408 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b23d9937-b3a3-41b7-8d29-83c6e67fe76e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:13.992850 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b23d9937-b3a3-41b7-8d29-83c6e67fe76e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:13.993538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b23d9937-b3a3-41b7-8d29-83c6e67fe76e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:13.993990 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b23d9937-b3a3-41b7-8d29-83c6e67fe76e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:13.994411 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b23d9937-b3a3-41b7-8d29-83c6e67fe76e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:14.092094 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9601990e-b771-4ff3-bd22-ec698e31c291 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:14.100472 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9601990e-b771-4ff3-bd22-ec698e31c291 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150996 Aug 24 12:50:14.101031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1159/2317] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:13 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:14.123857 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b23d9937-b3a3-41b7-8d29-83c6e67fe76e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:14.132617 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b23d9937-b3a3-41b7-8d29-83c6e67fe76e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152201 Aug 24 12:50:14.133174 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1159/2318] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:13 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:14.635014 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2888ec6b-9402-4a10-9b41-9ef86cce2a2d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:14.635577 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2888ec6b-9402-4a10-9b41-9ef86cce2a2d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:14.641666 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2888ec6b-9402-4a10-9b41-9ef86cce2a2d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:14.642218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2888ec6b-9402-4a10-9b41-9ef86cce2a2d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:14.642677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2888ec6b-9402-4a10-9b41-9ef86cce2a2d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:14.643373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2888ec6b-9402-4a10-9b41-9ef86cce2a2d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:14.643836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2888ec6b-9402-4a10-9b41-9ef86cce2a2d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:14.644268 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2888ec6b-9402-4a10-9b41-9ef86cce2a2d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:14.769035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2888ec6b-9402-4a10-9b41-9ef86cce2a2d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:14.777170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2888ec6b-9402-4a10-9b41-9ef86cce2a2d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.146204 Aug 24 12:50:14.777806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1160/2319] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:14 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:14.973884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3cfb8401-da8f-4f8a-ac44-011e90571e5a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:14.974491 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3cfb8401-da8f-4f8a-ac44-011e90571e5a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:14.980829 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3cfb8401-da8f-4f8a-ac44-011e90571e5a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:14.981335 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3cfb8401-da8f-4f8a-ac44-011e90571e5a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:14.981775 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3cfb8401-da8f-4f8a-ac44-011e90571e5a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:14.982459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3cfb8401-da8f-4f8a-ac44-011e90571e5a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:14.982939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3cfb8401-da8f-4f8a-ac44-011e90571e5a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:14.983363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3cfb8401-da8f-4f8a-ac44-011e90571e5a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:15.113996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3cfb8401-da8f-4f8a-ac44-011e90571e5a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:15.121154 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c1a50c90-9dd5-4362-9c86-e8be4b2efa5b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:15.121770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c1a50c90-9dd5-4362-9c86-e8be4b2efa5b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:15.122820 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3cfb8401-da8f-4f8a-ac44-011e90571e5a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:15.124325 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3cfb8401-da8f-4f8a-ac44-011e90571e5a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:15.125494 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3cfb8401-da8f-4f8a-ac44-011e90571e5a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.156118 Aug 24 12:50:15.126044 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1160/2320] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:14 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:15.128128 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1a50c90-9dd5-4362-9c86-e8be4b2efa5b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:15.128655 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1a50c90-9dd5-4362-9c86-e8be4b2efa5b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:15.129096 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1a50c90-9dd5-4362-9c86-e8be4b2efa5b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:15.129812 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1a50c90-9dd5-4362-9c86-e8be4b2efa5b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:15.130269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1a50c90-9dd5-4362-9c86-e8be4b2efa5b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:15.130714 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1a50c90-9dd5-4362-9c86-e8be4b2efa5b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:15.153034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e79ab211-08d3-418e-a391-5803c6f1a8cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:15.153579 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e79ab211-08d3-418e-a391-5803c6f1a8cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:15.160048 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e79ab211-08d3-418e-a391-5803c6f1a8cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:15.160536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e79ab211-08d3-418e-a391-5803c6f1a8cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:15.160983 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e79ab211-08d3-418e-a391-5803c6f1a8cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:15.161676 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e79ab211-08d3-418e-a391-5803c6f1a8cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:15.162136 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e79ab211-08d3-418e-a391-5803c6f1a8cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:15.162564 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e79ab211-08d3-418e-a391-5803c6f1a8cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:15.264255 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c1a50c90-9dd5-4362-9c86-e8be4b2efa5b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:15.273213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c1a50c90-9dd5-4362-9c86-e8be4b2efa5b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.155791 Aug 24 12:50:15.273795 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1161/2321] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:15 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:15.295529 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e79ab211-08d3-418e-a391-5803c6f1a8cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:15.303674 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e79ab211-08d3-418e-a391-5803c6f1a8cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.154387 Aug 24 12:50:15.304234 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1161/2322] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:15 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:15.798218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5d6b9457-11f9-432a-a7fe-acaec3ad2fbe tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:15.799404 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5d6b9457-11f9-432a-a7fe-acaec3ad2fbe tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:15.805437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5d6b9457-11f9-432a-a7fe-acaec3ad2fbe tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:15.805922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5d6b9457-11f9-432a-a7fe-acaec3ad2fbe tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:15.806363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5d6b9457-11f9-432a-a7fe-acaec3ad2fbe tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:15.807084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5d6b9457-11f9-432a-a7fe-acaec3ad2fbe tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:15.807542 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5d6b9457-11f9-432a-a7fe-acaec3ad2fbe tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:15.807973 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5d6b9457-11f9-432a-a7fe-acaec3ad2fbe tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:15.938043 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5d6b9457-11f9-432a-a7fe-acaec3ad2fbe tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:15.946564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5d6b9457-11f9-432a-a7fe-acaec3ad2fbe tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151999 Aug 24 12:50:15.947160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1162/2323] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:15 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:16.148644 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-724733c4-f713-4bd5-aff2-a97c8957a97c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:16.149255 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-724733c4-f713-4bd5-aff2-a97c8957a97c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:16.155108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-724733c4-f713-4bd5-aff2-a97c8957a97c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:16.155589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-724733c4-f713-4bd5-aff2-a97c8957a97c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:16.156027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-724733c4-f713-4bd5-aff2-a97c8957a97c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:16.156707 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-724733c4-f713-4bd5-aff2-a97c8957a97c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:16.157158 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-724733c4-f713-4bd5-aff2-a97c8957a97c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:16.157585 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-724733c4-f713-4bd5-aff2-a97c8957a97c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:16.285499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-724733c4-f713-4bd5-aff2-a97c8957a97c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:16.293583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-155d5904-d291-4837-beff-bb5d5b955d11 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:16.294185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-155d5904-d291-4837-beff-bb5d5b955d11 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:16.294300 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-724733c4-f713-4bd5-aff2-a97c8957a97c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:16.295795 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-724733c4-f713-4bd5-aff2-a97c8957a97c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:16.296948 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-724733c4-f713-4bd5-aff2-a97c8957a97c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.152381 Aug 24 12:50:16.297500 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1162/2324] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:16 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:16.301600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-155d5904-d291-4837-beff-bb5d5b955d11 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:16.302081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-155d5904-d291-4837-beff-bb5d5b955d11 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:16.302513 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-155d5904-d291-4837-beff-bb5d5b955d11 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:16.303224 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-155d5904-d291-4837-beff-bb5d5b955d11 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:16.303677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-155d5904-d291-4837-beff-bb5d5b955d11 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:16.304097 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-155d5904-d291-4837-beff-bb5d5b955d11 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:16.324713 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cd0a9cd7-2f19-4af9-9e87-64d6db979670 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:16.325328 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cd0a9cd7-2f19-4af9-9e87-64d6db979670 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:16.331804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd0a9cd7-2f19-4af9-9e87-64d6db979670 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:16.332281 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd0a9cd7-2f19-4af9-9e87-64d6db979670 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:16.332719 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd0a9cd7-2f19-4af9-9e87-64d6db979670 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:16.333405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd0a9cd7-2f19-4af9-9e87-64d6db979670 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:16.333863 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd0a9cd7-2f19-4af9-9e87-64d6db979670 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:16.334310 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd0a9cd7-2f19-4af9-9e87-64d6db979670 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:16.434701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-155d5904-d291-4837-beff-bb5d5b955d11 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:16.442872 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-155d5904-d291-4837-beff-bb5d5b955d11 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.153032 Aug 24 12:50:16.443545 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1163/2325] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:16 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:16.467342 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cd0a9cd7-2f19-4af9-9e87-64d6db979670 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:16.475663 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cd0a9cd7-2f19-4af9-9e87-64d6db979670 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.154691 Aug 24 12:50:16.476207 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1163/2326] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:16 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:16.967324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-56f4843e-8e64-4a1c-8d39-83b24f4519cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:16.967933 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-56f4843e-8e64-4a1c-8d39-83b24f4519cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:16.974348 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-56f4843e-8e64-4a1c-8d39-83b24f4519cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:16.974868 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-56f4843e-8e64-4a1c-8d39-83b24f4519cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:16.975305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-56f4843e-8e64-4a1c-8d39-83b24f4519cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:16.975987 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-56f4843e-8e64-4a1c-8d39-83b24f4519cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:16.976443 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-56f4843e-8e64-4a1c-8d39-83b24f4519cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:16.976868 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-56f4843e-8e64-4a1c-8d39-83b24f4519cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:17.102136 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-56f4843e-8e64-4a1c-8d39-83b24f4519cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:17.110169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-56f4843e-8e64-4a1c-8d39-83b24f4519cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.146715 Aug 24 12:50:17.110762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1164/2327] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:16 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:17.320557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8152f9c6-6548-4ef5-a84a-679916d7742d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:17.321280 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8152f9c6-6548-4ef5-a84a-679916d7742d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:17.327572 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8152f9c6-6548-4ef5-a84a-679916d7742d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:17.328052 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8152f9c6-6548-4ef5-a84a-679916d7742d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:17.328482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8152f9c6-6548-4ef5-a84a-679916d7742d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:17.329153 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8152f9c6-6548-4ef5-a84a-679916d7742d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:17.330282 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8152f9c6-6548-4ef5-a84a-679916d7742d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:17.330740 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8152f9c6-6548-4ef5-a84a-679916d7742d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:17.458357 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8152f9c6-6548-4ef5-a84a-679916d7742d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:17.464294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7864bc83-3eaf-4fd6-bd94-172db84f20a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:17.464907 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7864bc83-3eaf-4fd6-bd94-172db84f20a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:17.467055 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8152f9c6-6548-4ef5-a84a-679916d7742d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:17.468551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8152f9c6-6548-4ef5-a84a-679916d7742d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:17.469706 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8152f9c6-6548-4ef5-a84a-679916d7742d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.153053 Aug 24 12:50:17.470271 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1164/2328] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:17 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:17.471403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7864bc83-3eaf-4fd6-bd94-172db84f20a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:17.471893 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7864bc83-3eaf-4fd6-bd94-172db84f20a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:17.472332 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7864bc83-3eaf-4fd6-bd94-172db84f20a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:17.473026 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7864bc83-3eaf-4fd6-bd94-172db84f20a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:17.473486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7864bc83-3eaf-4fd6-bd94-172db84f20a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:17.473926 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7864bc83-3eaf-4fd6-bd94-172db84f20a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:17.496711 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-926fffc8-28ed-4c49-9952-28bc64d89124 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:17.497398 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-926fffc8-28ed-4c49-9952-28bc64d89124 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:17.503826 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-926fffc8-28ed-4c49-9952-28bc64d89124 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:17.504311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-926fffc8-28ed-4c49-9952-28bc64d89124 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:17.504747 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-926fffc8-28ed-4c49-9952-28bc64d89124 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:17.505432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-926fffc8-28ed-4c49-9952-28bc64d89124 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:17.505885 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-926fffc8-28ed-4c49-9952-28bc64d89124 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:17.506306 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-926fffc8-28ed-4c49-9952-28bc64d89124 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:17.611841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7864bc83-3eaf-4fd6-bd94-172db84f20a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:17.620333 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7864bc83-3eaf-4fd6-bd94-172db84f20a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.159817 Aug 24 12:50:17.621069 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1165/2329] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:17 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:17.637164 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-926fffc8-28ed-4c49-9952-28bc64d89124 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:17.645973 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-926fffc8-28ed-4c49-9952-28bc64d89124 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153062 Aug 24 12:50:17.646533 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1165/2330] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:17 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:18.131817 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4dbbd991-3faf-42bb-828e-76db90cc1312 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:18.132423 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4dbbd991-3faf-42bb-828e-76db90cc1312 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:18.134235 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=84 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:50:18.138934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4dbbd991-3faf-42bb-828e-76db90cc1312 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:18.139414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4dbbd991-3faf-42bb-828e-76db90cc1312 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:18.139851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4dbbd991-3faf-42bb-828e-76db90cc1312 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:18.140582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4dbbd991-3faf-42bb-828e-76db90cc1312 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:18.140968 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4dbbd991-3faf-42bb-828e-76db90cc1312 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:18.141389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4dbbd991-3faf-42bb-828e-76db90cc1312 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:18.473381 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4dbbd991-3faf-42bb-828e-76db90cc1312 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:18.481449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4dbbd991-3faf-42bb-828e-76db90cc1312 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.353496 Aug 24 12:50:18.482008 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1166/2331] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:18 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:18.493128 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8c192b7f-eb43-4d65-9e37-eb6d4a8ae999 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:18.493748 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8c192b7f-eb43-4d65-9e37-eb6d4a8ae999 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:18.500419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c192b7f-eb43-4d65-9e37-eb6d4a8ae999 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:18.500903 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c192b7f-eb43-4d65-9e37-eb6d4a8ae999 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:18.501372 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c192b7f-eb43-4d65-9e37-eb6d4a8ae999 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:18.502057 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c192b7f-eb43-4d65-9e37-eb6d4a8ae999 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:18.502514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c192b7f-eb43-4d65-9e37-eb6d4a8ae999 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:18.502977 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c192b7f-eb43-4d65-9e37-eb6d4a8ae999 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:18.632582 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8c192b7f-eb43-4d65-9e37-eb6d4a8ae999 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:18.641433 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8c192b7f-eb43-4d65-9e37-eb6d4a8ae999 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:18.643530 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8c192b7f-eb43-4d65-9e37-eb6d4a8ae999 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:18.644684 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8c192b7f-eb43-4d65-9e37-eb6d4a8ae999 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155415 Aug 24 12:50:18.645363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1166/2332] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:18 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:18.645498 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-df619808-a010-45f3-b7fb-9b23ce7599dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:18.646239 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-df619808-a010-45f3-b7fb-9b23ce7599dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:18.652566 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df619808-a010-45f3-b7fb-9b23ce7599dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:18.653050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df619808-a010-45f3-b7fb-9b23ce7599dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:18.653482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df619808-a010-45f3-b7fb-9b23ce7599dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:18.654167 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df619808-a010-45f3-b7fb-9b23ce7599dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:18.654619 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df619808-a010-45f3-b7fb-9b23ce7599dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:18.655068 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df619808-a010-45f3-b7fb-9b23ce7599dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:18.666203 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bd924033-2288-4b8d-aa2d-d22449599896 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:18.666834 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-bd924033-2288-4b8d-aa2d-d22449599896 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:18.672637 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd924033-2288-4b8d-aa2d-d22449599896 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:18.673051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd924033-2288-4b8d-aa2d-d22449599896 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:18.673510 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd924033-2288-4b8d-aa2d-d22449599896 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:18.674186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd924033-2288-4b8d-aa2d-d22449599896 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:18.674633 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd924033-2288-4b8d-aa2d-d22449599896 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:18.675073 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd924033-2288-4b8d-aa2d-d22449599896 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:18.784413 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-df619808-a010-45f3-b7fb-9b23ce7599dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:18.792899 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-df619808-a010-45f3-b7fb-9b23ce7599dc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151702 Aug 24 12:50:18.793461 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1167/2333] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:18 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:18.802835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-bd924033-2288-4b8d-aa2d-d22449599896 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:18.810984 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bd924033-2288-4b8d-aa2d-d22449599896 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148387 Aug 24 12:50:18.811529 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1167/2334] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:18 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:19.502275 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-85d2c7eb-48af-4616-bd3b-ff3e6aba9e82 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:19.502906 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-85d2c7eb-48af-4616-bd3b-ff3e6aba9e82 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:19.509350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-85d2c7eb-48af-4616-bd3b-ff3e6aba9e82 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:19.509829 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-85d2c7eb-48af-4616-bd3b-ff3e6aba9e82 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:19.510337 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-85d2c7eb-48af-4616-bd3b-ff3e6aba9e82 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:19.511040 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-85d2c7eb-48af-4616-bd3b-ff3e6aba9e82 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:19.511728 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-85d2c7eb-48af-4616-bd3b-ff3e6aba9e82 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:19.512153 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-85d2c7eb-48af-4616-bd3b-ff3e6aba9e82 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:19.644843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-85d2c7eb-48af-4616-bd3b-ff3e6aba9e82 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:19.653170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-85d2c7eb-48af-4616-bd3b-ff3e6aba9e82 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.154752 Aug 24 12:50:19.653723 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1168/2335] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:19 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:19.668738 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-26f575be-b578-4808-ad70-0e110db74c22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:19.669367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-26f575be-b578-4808-ad70-0e110db74c22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:19.675745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26f575be-b578-4808-ad70-0e110db74c22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:19.676217 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26f575be-b578-4808-ad70-0e110db74c22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:19.676652 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26f575be-b578-4808-ad70-0e110db74c22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:19.677328 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26f575be-b578-4808-ad70-0e110db74c22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:19.677837 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26f575be-b578-4808-ad70-0e110db74c22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:19.678222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26f575be-b578-4808-ad70-0e110db74c22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:19.810912 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-26f575be-b578-4808-ad70-0e110db74c22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:19.813430 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5463ca1c-5762-474f-b7c0-eb5e8761408c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:19.814545 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5463ca1c-5762-474f-b7c0-eb5e8761408c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:19.820023 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-26f575be-b578-4808-ad70-0e110db74c22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:19.820618 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5463ca1c-5762-474f-b7c0-eb5e8761408c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:19.821135 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5463ca1c-5762-474f-b7c0-eb5e8761408c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:19.821509 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-26f575be-b578-4808-ad70-0e110db74c22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:19.821903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5463ca1c-5762-474f-b7c0-eb5e8761408c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:19.822457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5463ca1c-5762-474f-b7c0-eb5e8761408c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:19.822680 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-26f575be-b578-4808-ad70-0e110db74c22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.157790 Aug 24 12:50:19.822941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5463ca1c-5762-474f-b7c0-eb5e8761408c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:19.823219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1168/2336] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:19 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:19.823476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5463ca1c-5762-474f-b7c0-eb5e8761408c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:19.833894 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bb321301-298e-4a9b-8669-d99d5c433e8e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:19.834528 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-bb321301-298e-4a9b-8669-d99d5c433e8e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:19.840186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb321301-298e-4a9b-8669-d99d5c433e8e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:19.840655 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb321301-298e-4a9b-8669-d99d5c433e8e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:19.841106 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb321301-298e-4a9b-8669-d99d5c433e8e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:19.841808 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb321301-298e-4a9b-8669-d99d5c433e8e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:19.842259 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb321301-298e-4a9b-8669-d99d5c433e8e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:19.842693 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bb321301-298e-4a9b-8669-d99d5c433e8e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:19.951509 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5463ca1c-5762-474f-b7c0-eb5e8761408c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:19.960795 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5463ca1c-5762-474f-b7c0-eb5e8761408c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151176 Aug 24 12:50:19.961364 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1169/2337] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:19 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:19.972465 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-bb321301-298e-4a9b-8669-d99d5c433e8e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:19.980905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bb321301-298e-4a9b-8669-d99d5c433e8e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151351 Aug 24 12:50:19.981457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1169/2338] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:19 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:20.675104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c6fdcd5a-fac9-4920-9e85-19b23348f70f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:20.675700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c6fdcd5a-fac9-4920-9e85-19b23348f70f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:20.682228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6fdcd5a-fac9-4920-9e85-19b23348f70f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:20.682642 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6fdcd5a-fac9-4920-9e85-19b23348f70f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:20.683096 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6fdcd5a-fac9-4920-9e85-19b23348f70f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:20.683770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6fdcd5a-fac9-4920-9e85-19b23348f70f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:20.684220 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6fdcd5a-fac9-4920-9e85-19b23348f70f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:20.684637 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6fdcd5a-fac9-4920-9e85-19b23348f70f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:20.817090 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c6fdcd5a-fac9-4920-9e85-19b23348f70f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:20.825241 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c6fdcd5a-fac9-4920-9e85-19b23348f70f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.154587 Aug 24 12:50:20.825797 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1170/2339] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:20 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:20.845932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e63ef1c9-94b4-429c-a521-8f3526bdf46b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:20.846699 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e63ef1c9-94b4-429c-a521-8f3526bdf46b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:20.853125 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e63ef1c9-94b4-429c-a521-8f3526bdf46b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:20.853593 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e63ef1c9-94b4-429c-a521-8f3526bdf46b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:20.854034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e63ef1c9-94b4-429c-a521-8f3526bdf46b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:20.854745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e63ef1c9-94b4-429c-a521-8f3526bdf46b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:20.855198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e63ef1c9-94b4-429c-a521-8f3526bdf46b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:20.855620 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e63ef1c9-94b4-429c-a521-8f3526bdf46b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:20.982950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-308530a1-bc78-4105-8d75-40f6bc87aa6e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:20.983593 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-308530a1-bc78-4105-8d75-40f6bc87aa6e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:20.985056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e63ef1c9-94b4-429c-a521-8f3526bdf46b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:20.989759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-308530a1-bc78-4105-8d75-40f6bc87aa6e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:20.990253 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-308530a1-bc78-4105-8d75-40f6bc87aa6e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:20.990715 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-308530a1-bc78-4105-8d75-40f6bc87aa6e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:20.991416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-308530a1-bc78-4105-8d75-40f6bc87aa6e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:20.991877 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-308530a1-bc78-4105-8d75-40f6bc87aa6e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:20.992340 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-308530a1-bc78-4105-8d75-40f6bc87aa6e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:20.993980 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e63ef1c9-94b4-429c-a521-8f3526bdf46b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:20.995517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e63ef1c9-94b4-429c-a521-8f3526bdf46b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:20.996763 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e63ef1c9-94b4-429c-a521-8f3526bdf46b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155357 Aug 24 12:50:20.997324 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1170/2340] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:20 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:21.001756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-59bbff45-6449-4555-80cb-c85523837d14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:21.002358 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-59bbff45-6449-4555-80cb-c85523837d14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:21.008375 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59bbff45-6449-4555-80cb-c85523837d14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:21.009066 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59bbff45-6449-4555-80cb-c85523837d14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:21.009502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59bbff45-6449-4555-80cb-c85523837d14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:21.010183 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59bbff45-6449-4555-80cb-c85523837d14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:21.010841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59bbff45-6449-4555-80cb-c85523837d14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:21.011268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59bbff45-6449-4555-80cb-c85523837d14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:21.120919 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-308530a1-bc78-4105-8d75-40f6bc87aa6e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:21.129185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-308530a1-bc78-4105-8d75-40f6bc87aa6e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150190 Aug 24 12:50:21.129955 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1171/2341] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:20 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:21.145964 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-59bbff45-6449-4555-80cb-c85523837d14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:21.148242 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:50:21.154642 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-59bbff45-6449-4555-80cb-c85523837d14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.156400 Aug 24 12:50:21.155364 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1171/2342] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:20 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:21.847212 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bca353bf-07fd-4646-850e-fae13cf9dc87 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:21.847878 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bca353bf-07fd-4646-850e-fae13cf9dc87 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:21.854293 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bca353bf-07fd-4646-850e-fae13cf9dc87 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:21.854809 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bca353bf-07fd-4646-850e-fae13cf9dc87 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:21.855239 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bca353bf-07fd-4646-850e-fae13cf9dc87 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:21.855913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bca353bf-07fd-4646-850e-fae13cf9dc87 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:21.856363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bca353bf-07fd-4646-850e-fae13cf9dc87 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:21.856780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bca353bf-07fd-4646-850e-fae13cf9dc87 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:21.871965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:50:21.989559 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bca353bf-07fd-4646-850e-fae13cf9dc87 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:21.997630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bca353bf-07fd-4646-850e-fae13cf9dc87 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.154249 Aug 24 12:50:21.998182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1172/2343] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:21 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:22.018937 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6f1426fa-3109-4dde-bbf8-df2624655763 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:22.019546 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6f1426fa-3109-4dde-bbf8-df2624655763 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:22.026635 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6f1426fa-3109-4dde-bbf8-df2624655763 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:22.027155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6f1426fa-3109-4dde-bbf8-df2624655763 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:22.027514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6f1426fa-3109-4dde-bbf8-df2624655763 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:22.028191 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6f1426fa-3109-4dde-bbf8-df2624655763 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:22.028642 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6f1426fa-3109-4dde-bbf8-df2624655763 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:22.029067 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6f1426fa-3109-4dde-bbf8-df2624655763 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:22.150600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9a3c6419-dd40-4f53-8e59-e4d0697d3f45 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:22.151238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9a3c6419-dd40-4f53-8e59-e4d0697d3f45 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:22.157236 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a3c6419-dd40-4f53-8e59-e4d0697d3f45 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:22.157563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6f1426fa-3109-4dde-bbf8-df2624655763 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:22.157724 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a3c6419-dd40-4f53-8e59-e4d0697d3f45 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:22.158681 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a3c6419-dd40-4f53-8e59-e4d0697d3f45 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:22.159364 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a3c6419-dd40-4f53-8e59-e4d0697d3f45 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:22.159819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a3c6419-dd40-4f53-8e59-e4d0697d3f45 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:22.160241 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a3c6419-dd40-4f53-8e59-e4d0697d3f45 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:22.167006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6f1426fa-3109-4dde-bbf8-df2624655763 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:22.168480 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6f1426fa-3109-4dde-bbf8-df2624655763 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:22.169648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6f1426fa-3109-4dde-bbf8-df2624655763 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154686 Aug 24 12:50:22.170196 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1172/2344] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:22 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:22.177358 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a5d57154-9e5c-496b-88bc-7a1cd05ce47b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:22.178268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a5d57154-9e5c-496b-88bc-7a1cd05ce47b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:22.184219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5d57154-9e5c-496b-88bc-7a1cd05ce47b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:22.184785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5d57154-9e5c-496b-88bc-7a1cd05ce47b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:22.185289 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5d57154-9e5c-496b-88bc-7a1cd05ce47b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:22.186192 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5d57154-9e5c-496b-88bc-7a1cd05ce47b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:22.186677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5d57154-9e5c-496b-88bc-7a1cd05ce47b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:22.187109 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5d57154-9e5c-496b-88bc-7a1cd05ce47b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:22.291366 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9a3c6419-dd40-4f53-8e59-e4d0697d3f45 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:22.299656 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9a3c6419-dd40-4f53-8e59-e4d0697d3f45 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152967 Aug 24 12:50:22.300303 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1173/2345] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:22 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:22.320025 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a5d57154-9e5c-496b-88bc-7a1cd05ce47b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:22.328344 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a5d57154-9e5c-496b-88bc-7a1cd05ce47b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.155105 Aug 24 12:50:22.328901 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1173/2346] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:22 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:23.018826 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b5c55ff8-db39-42e0-850c-19e87723213b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:23.019435 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b5c55ff8-db39-42e0-850c-19e87723213b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:23.026475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b5c55ff8-db39-42e0-850c-19e87723213b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:23.026998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b5c55ff8-db39-42e0-850c-19e87723213b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:23.027436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b5c55ff8-db39-42e0-850c-19e87723213b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:23.028121 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b5c55ff8-db39-42e0-850c-19e87723213b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:23.028579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b5c55ff8-db39-42e0-850c-19e87723213b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:23.029010 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b5c55ff8-db39-42e0-850c-19e87723213b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:23.155534 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b5c55ff8-db39-42e0-850c-19e87723213b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:23.163916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b5c55ff8-db39-42e0-850c-19e87723213b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149679 Aug 24 12:50:23.164474 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1174/2347] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:23 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:23.193547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4b10ea5c-a8f0-4722-9a9c-c8da376aeb56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:23.194146 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4b10ea5c-a8f0-4722-9a9c-c8da376aeb56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:23.196449 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:50:23.201010 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b10ea5c-a8f0-4722-9a9c-c8da376aeb56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:23.201485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b10ea5c-a8f0-4722-9a9c-c8da376aeb56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:23.201915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b10ea5c-a8f0-4722-9a9c-c8da376aeb56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:23.202582 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b10ea5c-a8f0-4722-9a9c-c8da376aeb56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:23.203053 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b10ea5c-a8f0-4722-9a9c-c8da376aeb56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:23.203470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b10ea5c-a8f0-4722-9a9c-c8da376aeb56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:23.320968 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7114dab4-9b45-40f9-8931-93669a01acae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:23.321580 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7114dab4-9b45-40f9-8931-93669a01acae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:23.327734 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7114dab4-9b45-40f9-8931-93669a01acae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:23.328234 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7114dab4-9b45-40f9-8931-93669a01acae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:23.328677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7114dab4-9b45-40f9-8931-93669a01acae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:23.329383 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7114dab4-9b45-40f9-8931-93669a01acae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:23.329864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7114dab4-9b45-40f9-8931-93669a01acae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:23.330295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7114dab4-9b45-40f9-8931-93669a01acae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:23.342613 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4b10ea5c-a8f0-4722-9a9c-c8da376aeb56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:23.351664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4b10ea5c-a8f0-4722-9a9c-c8da376aeb56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:23.370872 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4b10ea5c-a8f0-4722-9a9c-c8da376aeb56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:23.370872 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4b10ea5c-a8f0-4722-9a9c-c8da376aeb56 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.165254 Aug 24 12:50:23.370872 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1174/2348] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:23 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:50:23.370872 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b993b375-d685-42f0-bd2b-e26b4a3a3126 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:23.371355 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b993b375-d685-42f0-bd2b-e26b4a3a3126 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:23.371355 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b993b375-d685-42f0-bd2b-e26b4a3a3126 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:23.371355 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b993b375-d685-42f0-bd2b-e26b4a3a3126 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:23.371355 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b993b375-d685-42f0-bd2b-e26b4a3a3126 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:23.371734 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b993b375-d685-42f0-bd2b-e26b4a3a3126 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:23.371734 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b993b375-d685-42f0-bd2b-e26b4a3a3126 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:23.371734 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b993b375-d685-42f0-bd2b-e26b4a3a3126 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:23.465542 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7114dab4-9b45-40f9-8931-93669a01acae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:23.475045 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7114dab4-9b45-40f9-8931-93669a01acae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.157873 Aug 24 12:50:23.475747 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1175/2349] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:23 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:23.507654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b993b375-d685-42f0-bd2b-e26b4a3a3126 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:23.515676 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b993b375-d685-42f0-bd2b-e26b4a3a3126 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.159804 Aug 24 12:50:23.516238 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1175/2350] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:23 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:24.185341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-50cf16cb-97ab-4a82-a99b-e1906863785e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:24.185947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-50cf16cb-97ab-4a82-a99b-e1906863785e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:24.192755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50cf16cb-97ab-4a82-a99b-e1906863785e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:24.193237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50cf16cb-97ab-4a82-a99b-e1906863785e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:24.193671 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50cf16cb-97ab-4a82-a99b-e1906863785e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:24.194350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50cf16cb-97ab-4a82-a99b-e1906863785e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:24.194895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50cf16cb-97ab-4a82-a99b-e1906863785e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:24.195318 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50cf16cb-97ab-4a82-a99b-e1906863785e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:24.322613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-50cf16cb-97ab-4a82-a99b-e1906863785e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:24.330637 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-50cf16cb-97ab-4a82-a99b-e1906863785e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149409 Aug 24 12:50:24.331280 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1176/2351] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:24 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:24.379596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9570823b-5c8d-40ff-aeb8-ca6805477a07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:24.380202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9570823b-5c8d-40ff-aeb8-ca6805477a07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:24.386593 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9570823b-5c8d-40ff-aeb8-ca6805477a07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:24.387171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9570823b-5c8d-40ff-aeb8-ca6805477a07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:24.387605 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9570823b-5c8d-40ff-aeb8-ca6805477a07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:24.388315 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9570823b-5c8d-40ff-aeb8-ca6805477a07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:24.388769 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9570823b-5c8d-40ff-aeb8-ca6805477a07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:24.389195 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9570823b-5c8d-40ff-aeb8-ca6805477a07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:24.497411 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c3bd90cb-94a6-49aa-a7ba-33131bf9489f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:24.498012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c3bd90cb-94a6-49aa-a7ba-33131bf9489f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:24.503792 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3bd90cb-94a6-49aa-a7ba-33131bf9489f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:24.504269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3bd90cb-94a6-49aa-a7ba-33131bf9489f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:24.504696 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3bd90cb-94a6-49aa-a7ba-33131bf9489f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:24.505370 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3bd90cb-94a6-49aa-a7ba-33131bf9489f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:24.505819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3bd90cb-94a6-49aa-a7ba-33131bf9489f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:24.506238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3bd90cb-94a6-49aa-a7ba-33131bf9489f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:24.517214 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9570823b-5c8d-40ff-aeb8-ca6805477a07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:24.526204 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9570823b-5c8d-40ff-aeb8-ca6805477a07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:24.527706 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9570823b-5c8d-40ff-aeb8-ca6805477a07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:24.528851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9570823b-5c8d-40ff-aeb8-ca6805477a07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.153169 Aug 24 12:50:24.529401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1176/2352] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:24 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:24.538642 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-da1027a9-ea76-49a5-bd3f-575e3012d0f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:24.539364 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-da1027a9-ea76-49a5-bd3f-575e3012d0f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:24.545310 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-da1027a9-ea76-49a5-bd3f-575e3012d0f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:24.545860 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-da1027a9-ea76-49a5-bd3f-575e3012d0f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:24.546359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-da1027a9-ea76-49a5-bd3f-575e3012d0f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:24.547144 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-da1027a9-ea76-49a5-bd3f-575e3012d0f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:24.547667 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-da1027a9-ea76-49a5-bd3f-575e3012d0f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:24.548092 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-da1027a9-ea76-49a5-bd3f-575e3012d0f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:24.639451 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c3bd90cb-94a6-49aa-a7ba-33131bf9489f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:24.648148 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c3bd90cb-94a6-49aa-a7ba-33131bf9489f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.154531 Aug 24 12:50:24.648727 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1177/2353] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:24 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:24.676608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-da1027a9-ea76-49a5-bd3f-575e3012d0f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:24.684634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-da1027a9-ea76-49a5-bd3f-575e3012d0f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149536 Aug 24 12:50:24.685179 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1177/2354] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:24 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:25.352111 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-93692a90-5ee6-431a-ba07-18a44869be23 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:25.352865 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-93692a90-5ee6-431a-ba07-18a44869be23 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:25.359023 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-93692a90-5ee6-431a-ba07-18a44869be23 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:25.359498 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-93692a90-5ee6-431a-ba07-18a44869be23 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:25.359927 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-93692a90-5ee6-431a-ba07-18a44869be23 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:25.360602 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-93692a90-5ee6-431a-ba07-18a44869be23 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:25.361054 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-93692a90-5ee6-431a-ba07-18a44869be23 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:25.361471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-93692a90-5ee6-431a-ba07-18a44869be23 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:25.488439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-93692a90-5ee6-431a-ba07-18a44869be23 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:25.497044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-93692a90-5ee6-431a-ba07-18a44869be23 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.148749 Aug 24 12:50:25.497599 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1178/2355] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:25 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:25.552911 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-41ff55de-611b-44c7-b067-5ba050ddfa89 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:25.553515 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-41ff55de-611b-44c7-b067-5ba050ddfa89 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:25.559928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41ff55de-611b-44c7-b067-5ba050ddfa89 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:25.560406 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41ff55de-611b-44c7-b067-5ba050ddfa89 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:25.560838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41ff55de-611b-44c7-b067-5ba050ddfa89 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:25.561513 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41ff55de-611b-44c7-b067-5ba050ddfa89 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:25.561959 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41ff55de-611b-44c7-b067-5ba050ddfa89 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:25.562377 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41ff55de-611b-44c7-b067-5ba050ddfa89 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:25.669229 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-cad089eb-8b74-42f3-884d-7fc4d03e2cd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:25.669939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-cad089eb-8b74-42f3-884d-7fc4d03e2cd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:25.675900 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cad089eb-8b74-42f3-884d-7fc4d03e2cd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:25.676380 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cad089eb-8b74-42f3-884d-7fc4d03e2cd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:25.676818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cad089eb-8b74-42f3-884d-7fc4d03e2cd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:25.677506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cad089eb-8b74-42f3-884d-7fc4d03e2cd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:25.677958 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cad089eb-8b74-42f3-884d-7fc4d03e2cd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:25.678384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cad089eb-8b74-42f3-884d-7fc4d03e2cd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:25.694761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-41ff55de-611b-44c7-b067-5ba050ddfa89 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:25.703600 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-41ff55de-611b-44c7-b067-5ba050ddfa89 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:25.705668 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-41ff55de-611b-44c7-b067-5ba050ddfa89 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:25.706878 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-41ff55de-611b-44c7-b067-5ba050ddfa89 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.157848 Aug 24 12:50:25.707426 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1178/2356] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:25 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:25.711847 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f282f4d7-893b-4cdc-92a0-6066b7ebcdd7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:25.712440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f282f4d7-893b-4cdc-92a0-6066b7ebcdd7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:25.718291 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f282f4d7-893b-4cdc-92a0-6066b7ebcdd7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:25.718938 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f282f4d7-893b-4cdc-92a0-6066b7ebcdd7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:25.719379 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f282f4d7-893b-4cdc-92a0-6066b7ebcdd7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:25.720304 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f282f4d7-893b-4cdc-92a0-6066b7ebcdd7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:25.720782 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f282f4d7-893b-4cdc-92a0-6066b7ebcdd7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:25.721204 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f282f4d7-893b-4cdc-92a0-6066b7ebcdd7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:25.808731 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-cad089eb-8b74-42f3-884d-7fc4d03e2cd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:25.817605 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-cad089eb-8b74-42f3-884d-7fc4d03e2cd3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152150 Aug 24 12:50:25.818162 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1179/2357] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:25 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:25.849664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f282f4d7-893b-4cdc-92a0-6066b7ebcdd7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:25.857747 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f282f4d7-893b-4cdc-92a0-6066b7ebcdd7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149402 Aug 24 12:50:25.858301 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1179/2358] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:25 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:26.517953 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-97a67527-1021-4809-a14f-18f6c939e41a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:26.518563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-97a67527-1021-4809-a14f-18f6c939e41a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:26.524930 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97a67527-1021-4809-a14f-18f6c939e41a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:26.525419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97a67527-1021-4809-a14f-18f6c939e41a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:26.525860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97a67527-1021-4809-a14f-18f6c939e41a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:26.526545 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97a67527-1021-4809-a14f-18f6c939e41a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:26.527025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97a67527-1021-4809-a14f-18f6c939e41a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:26.527454 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97a67527-1021-4809-a14f-18f6c939e41a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:26.658799 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-97a67527-1021-4809-a14f-18f6c939e41a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:26.669795 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-97a67527-1021-4809-a14f-18f6c939e41a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.155432 Aug 24 12:50:26.670674 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1180/2359] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:26 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:26.731467 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-16621880-66b4-459b-a38b-4dd375d2e20f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:26.732074 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-16621880-66b4-459b-a38b-4dd375d2e20f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:26.739632 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-16621880-66b4-459b-a38b-4dd375d2e20f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:26.740115 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-16621880-66b4-459b-a38b-4dd375d2e20f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:26.740552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-16621880-66b4-459b-a38b-4dd375d2e20f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:26.741267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-16621880-66b4-459b-a38b-4dd375d2e20f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:26.741718 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-16621880-66b4-459b-a38b-4dd375d2e20f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:26.742149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-16621880-66b4-459b-a38b-4dd375d2e20f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:26.840458 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0b4e584f-4493-4e2d-bb28-cef799e42874 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:26.841185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0b4e584f-4493-4e2d-bb28-cef799e42874 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:26.847934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b4e584f-4493-4e2d-bb28-cef799e42874 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:26.848416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b4e584f-4493-4e2d-bb28-cef799e42874 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:26.848851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b4e584f-4493-4e2d-bb28-cef799e42874 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:26.849535 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b4e584f-4493-4e2d-bb28-cef799e42874 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:26.849983 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b4e584f-4493-4e2d-bb28-cef799e42874 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:26.850400 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b4e584f-4493-4e2d-bb28-cef799e42874 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:26.874341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-16621880-66b4-459b-a38b-4dd375d2e20f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:26.883091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-16621880-66b4-459b-a38b-4dd375d2e20f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:26.884600 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-16621880-66b4-459b-a38b-4dd375d2e20f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:26.885764 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-16621880-66b4-459b-a38b-4dd375d2e20f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.158252 Aug 24 12:50:26.886323 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1180/2360] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:26 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:26.890729 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a8f42d3f-c0cc-404b-9929-dbf932bbe654 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:26.891333 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a8f42d3f-c0cc-404b-9929-dbf932bbe654 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:26.897820 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a8f42d3f-c0cc-404b-9929-dbf932bbe654 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:26.898307 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a8f42d3f-c0cc-404b-9929-dbf932bbe654 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:26.898764 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a8f42d3f-c0cc-404b-9929-dbf932bbe654 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:26.899451 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a8f42d3f-c0cc-404b-9929-dbf932bbe654 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:26.899901 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a8f42d3f-c0cc-404b-9929-dbf932bbe654 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:26.900325 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a8f42d3f-c0cc-404b-9929-dbf932bbe654 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:26.979328 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0b4e584f-4493-4e2d-bb28-cef799e42874 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:26.988360 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0b4e584f-4493-4e2d-bb28-cef799e42874 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151052 Aug 24 12:50:26.989208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1181/2361] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:26 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:27.028516 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a8f42d3f-c0cc-404b-9929-dbf932bbe654 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:27.037263 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a8f42d3f-c0cc-404b-9929-dbf932bbe654 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149935 Aug 24 12:50:27.037801 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1181/2362] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:26 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:27.692716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-184e2dc3-fef6-4d9a-ad0c-16069828083f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:27.693249 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-184e2dc3-fef6-4d9a-ad0c-16069828083f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:27.699610 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-184e2dc3-fef6-4d9a-ad0c-16069828083f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:27.700090 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-184e2dc3-fef6-4d9a-ad0c-16069828083f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:27.700520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-184e2dc3-fef6-4d9a-ad0c-16069828083f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:27.701195 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-184e2dc3-fef6-4d9a-ad0c-16069828083f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:27.701898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-184e2dc3-fef6-4d9a-ad0c-16069828083f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:27.702327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-184e2dc3-fef6-4d9a-ad0c-16069828083f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:27.834139 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-184e2dc3-fef6-4d9a-ad0c-16069828083f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:27.842402 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-184e2dc3-fef6-4d9a-ad0c-16069828083f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.154377 Aug 24 12:50:27.842990 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1182/2363] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:27 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:27.909570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-776cbd12-3d2b-4a78-9461-10deab821b91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:27.910170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-776cbd12-3d2b-4a78-9461-10deab821b91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:27.916646 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-776cbd12-3d2b-4a78-9461-10deab821b91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:27.917119 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-776cbd12-3d2b-4a78-9461-10deab821b91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:27.917551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-776cbd12-3d2b-4a78-9461-10deab821b91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:27.918228 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-776cbd12-3d2b-4a78-9461-10deab821b91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:27.918696 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-776cbd12-3d2b-4a78-9461-10deab821b91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:27.919121 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-776cbd12-3d2b-4a78-9461-10deab821b91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:28.009201 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d3a74837-c709-4de7-8b24-c0ae58739f3e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:28.009817 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d3a74837-c709-4de7-8b24-c0ae58739f3e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:28.015749 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3a74837-c709-4de7-8b24-c0ae58739f3e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:28.016235 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3a74837-c709-4de7-8b24-c0ae58739f3e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:28.016666 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3a74837-c709-4de7-8b24-c0ae58739f3e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:28.017359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3a74837-c709-4de7-8b24-c0ae58739f3e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:28.017812 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3a74837-c709-4de7-8b24-c0ae58739f3e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:28.018238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3a74837-c709-4de7-8b24-c0ae58739f3e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:28.055028 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-776cbd12-3d2b-4a78-9461-10deab821b91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:28.063838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-776cbd12-3d2b-4a78-9461-10deab821b91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:28.065345 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-776cbd12-3d2b-4a78-9461-10deab821b91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:28.066520 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-776cbd12-3d2b-4a78-9461-10deab821b91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.161399 Aug 24 12:50:28.067109 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1182/2364] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:27 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:28.071483 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6bab4f17-c387-4137-b0e1-018dd47ddad0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:28.072091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6bab4f17-c387-4137-b0e1-018dd47ddad0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:28.077792 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6bab4f17-c387-4137-b0e1-018dd47ddad0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:28.078280 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6bab4f17-c387-4137-b0e1-018dd47ddad0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:28.078750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6bab4f17-c387-4137-b0e1-018dd47ddad0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:28.079441 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6bab4f17-c387-4137-b0e1-018dd47ddad0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:28.079897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6bab4f17-c387-4137-b0e1-018dd47ddad0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:28.080815 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6bab4f17-c387-4137-b0e1-018dd47ddad0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:28.156165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d3a74837-c709-4de7-8b24-c0ae58739f3e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:28.166161 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d3a74837-c709-4de7-8b24-c0ae58739f3e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.160579 Aug 24 12:50:28.166851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1183/2365] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:28 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:28.209412 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6bab4f17-c387-4137-b0e1-018dd47ddad0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:28.217505 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6bab4f17-c387-4137-b0e1-018dd47ddad0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149462 Aug 24 12:50:28.218055 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1183/2366] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:28 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:28.863066 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-306340b6-e51a-4245-b8ec-ef519830e820 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:28.863701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-306340b6-e51a-4245-b8ec-ef519830e820 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:28.870161 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-306340b6-e51a-4245-b8ec-ef519830e820 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:28.870641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-306340b6-e51a-4245-b8ec-ef519830e820 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:28.871133 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-306340b6-e51a-4245-b8ec-ef519830e820 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:28.871810 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-306340b6-e51a-4245-b8ec-ef519830e820 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:28.872289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-306340b6-e51a-4245-b8ec-ef519830e820 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:28.872712 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-306340b6-e51a-4245-b8ec-ef519830e820 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:29.000860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-306340b6-e51a-4245-b8ec-ef519830e820 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:29.009444 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-306340b6-e51a-4245-b8ec-ef519830e820 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150521 Aug 24 12:50:29.009998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1184/2367] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:28 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:29.089523 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-26bcc846-5646-453d-a9fc-7fc5097e7726 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:29.090125 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-26bcc846-5646-453d-a9fc-7fc5097e7726 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:29.096734 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26bcc846-5646-453d-a9fc-7fc5097e7726 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:29.097209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26bcc846-5646-453d-a9fc-7fc5097e7726 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:29.097641 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26bcc846-5646-453d-a9fc-7fc5097e7726 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:29.098311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26bcc846-5646-453d-a9fc-7fc5097e7726 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:29.098795 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26bcc846-5646-453d-a9fc-7fc5097e7726 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:29.099198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26bcc846-5646-453d-a9fc-7fc5097e7726 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:29.187878 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-534d3f71-f0fd-452c-a3ae-f0bcf12bb363 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:29.188485 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-534d3f71-f0fd-452c-a3ae-f0bcf12bb363 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:29.194998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-534d3f71-f0fd-452c-a3ae-f0bcf12bb363 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:29.195478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-534d3f71-f0fd-452c-a3ae-f0bcf12bb363 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:29.196417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-534d3f71-f0fd-452c-a3ae-f0bcf12bb363 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:29.196628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-534d3f71-f0fd-452c-a3ae-f0bcf12bb363 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:29.197037 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-534d3f71-f0fd-452c-a3ae-f0bcf12bb363 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:29.197455 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-534d3f71-f0fd-452c-a3ae-f0bcf12bb363 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:29.230417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-26bcc846-5646-453d-a9fc-7fc5097e7726 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:29.240586 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-26bcc846-5646-453d-a9fc-7fc5097e7726 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:29.242091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-26bcc846-5646-453d-a9fc-7fc5097e7726 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:29.243326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-26bcc846-5646-453d-a9fc-7fc5097e7726 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.157712 Aug 24 12:50:29.244165 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1184/2368] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:29 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:29.248524 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-937c3be6-81f5-44e5-b0ab-be9300450a9d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:29.249128 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-937c3be6-81f5-44e5-b0ab-be9300450a9d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:29.255583 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-937c3be6-81f5-44e5-b0ab-be9300450a9d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:29.256072 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-937c3be6-81f5-44e5-b0ab-be9300450a9d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:29.256513 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-937c3be6-81f5-44e5-b0ab-be9300450a9d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:29.257203 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-937c3be6-81f5-44e5-b0ab-be9300450a9d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:29.257660 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-937c3be6-81f5-44e5-b0ab-be9300450a9d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:29.258084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-937c3be6-81f5-44e5-b0ab-be9300450a9d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:29.329656 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-534d3f71-f0fd-452c-a3ae-f0bcf12bb363 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:29.338374 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-534d3f71-f0fd-452c-a3ae-f0bcf12bb363 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.154233 Aug 24 12:50:29.338977 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1185/2369] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:29 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:29.390346 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-937c3be6-81f5-44e5-b0ab-be9300450a9d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:29.398756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-937c3be6-81f5-44e5-b0ab-be9300450a9d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153625 Aug 24 12:50:29.400369 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1185/2370] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:29 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:30.031066 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e8eb3d67-100a-4683-b033-5c9385ad63cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:30.031710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e8eb3d67-100a-4683-b033-5c9385ad63cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:30.038617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8eb3d67-100a-4683-b033-5c9385ad63cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:30.039131 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8eb3d67-100a-4683-b033-5c9385ad63cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:30.039571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8eb3d67-100a-4683-b033-5c9385ad63cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:30.040260 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8eb3d67-100a-4683-b033-5c9385ad63cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:30.040716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8eb3d67-100a-4683-b033-5c9385ad63cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:30.041143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8eb3d67-100a-4683-b033-5c9385ad63cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:30.167808 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e8eb3d67-100a-4683-b033-5c9385ad63cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:30.176693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e8eb3d67-100a-4683-b033-5c9385ad63cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149525 Aug 24 12:50:30.177254 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1186/2371] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:30 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:30.267433 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d833adb6-e994-410f-917b-7941a3930b3a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:30.268046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d833adb6-e994-410f-917b-7941a3930b3a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:30.274313 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d833adb6-e994-410f-917b-7941a3930b3a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:30.274930 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d833adb6-e994-410f-917b-7941a3930b3a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:30.275365 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d833adb6-e994-410f-917b-7941a3930b3a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:30.276047 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d833adb6-e994-410f-917b-7941a3930b3a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:30.276497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d833adb6-e994-410f-917b-7941a3930b3a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:30.276918 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d833adb6-e994-410f-917b-7941a3930b3a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:30.359513 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-870e3263-f38f-4f51-b2e0-30349a28524f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:30.360120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-870e3263-f38f-4f51-b2e0-30349a28524f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:30.366878 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-870e3263-f38f-4f51-b2e0-30349a28524f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:30.367437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-870e3263-f38f-4f51-b2e0-30349a28524f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:30.367790 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-870e3263-f38f-4f51-b2e0-30349a28524f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:30.368476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-870e3263-f38f-4f51-b2e0-30349a28524f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:30.368930 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-870e3263-f38f-4f51-b2e0-30349a28524f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:30.369355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-870e3263-f38f-4f51-b2e0-30349a28524f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:30.408248 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d833adb6-e994-410f-917b-7941a3930b3a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:30.418919 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d833adb6-e994-410f-917b-7941a3930b3a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:30.420512 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d833adb6-e994-410f-917b-7941a3930b3a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:30.421703 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d833adb6-e994-410f-917b-7941a3930b3a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.158101 Aug 24 12:50:30.422438 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1186/2372] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:30 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:30.427248 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-88b5802c-6d09-4fe5-9a6c-83d97cab27ce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:30.427847 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-88b5802c-6d09-4fe5-9a6c-83d97cab27ce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:30.433861 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88b5802c-6d09-4fe5-9a6c-83d97cab27ce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:30.434336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88b5802c-6d09-4fe5-9a6c-83d97cab27ce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:30.434796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88b5802c-6d09-4fe5-9a6c-83d97cab27ce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:30.435473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88b5802c-6d09-4fe5-9a6c-83d97cab27ce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:30.435979 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88b5802c-6d09-4fe5-9a6c-83d97cab27ce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:30.436399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88b5802c-6d09-4fe5-9a6c-83d97cab27ce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:30.512732 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-870e3263-f38f-4f51-b2e0-30349a28524f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:30.521583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-870e3263-f38f-4f51-b2e0-30349a28524f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.165836 Aug 24 12:50:30.522248 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1187/2373] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:30 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:30.566690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-88b5802c-6d09-4fe5-9a6c-83d97cab27ce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:30.574777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-88b5802c-6d09-4fe5-9a6c-83d97cab27ce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151547 Aug 24 12:50:30.575326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1187/2374] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:30 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:31.197310 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-81159af4-1a7b-4389-8f87-bdbbad3481dc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:31.197924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-81159af4-1a7b-4389-8f87-bdbbad3481dc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:31.204321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81159af4-1a7b-4389-8f87-bdbbad3481dc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:31.204806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81159af4-1a7b-4389-8f87-bdbbad3481dc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:31.205249 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81159af4-1a7b-4389-8f87-bdbbad3481dc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:31.205933 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81159af4-1a7b-4389-8f87-bdbbad3481dc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:31.206394 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81159af4-1a7b-4389-8f87-bdbbad3481dc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:31.206853 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81159af4-1a7b-4389-8f87-bdbbad3481dc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:31.336868 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-81159af4-1a7b-4389-8f87-bdbbad3481dc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:31.345289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-81159af4-1a7b-4389-8f87-bdbbad3481dc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151528 Aug 24 12:50:31.346380 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1188/2375] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:31 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:31.445053 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8b769723-ed6e-49c8-8327-4713995aca15 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:31.445687 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8b769723-ed6e-49c8-8327-4713995aca15 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:31.452300 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b769723-ed6e-49c8-8327-4713995aca15 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:31.452724 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b769723-ed6e-49c8-8327-4713995aca15 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:31.453152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b769723-ed6e-49c8-8327-4713995aca15 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:31.453821 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b769723-ed6e-49c8-8327-4713995aca15 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:31.454263 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b769723-ed6e-49c8-8327-4713995aca15 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:31.455233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b769723-ed6e-49c8-8327-4713995aca15 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:31.469541 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:50:31.542853 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5b40fcb6-d8e5-46ea-97dc-dada5d308418 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:31.543462 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5b40fcb6-d8e5-46ea-97dc-dada5d308418 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:31.551599 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b40fcb6-d8e5-46ea-97dc-dada5d308418 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:31.552187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b40fcb6-d8e5-46ea-97dc-dada5d308418 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:31.552701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b40fcb6-d8e5-46ea-97dc-dada5d308418 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:31.553401 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b40fcb6-d8e5-46ea-97dc-dada5d308418 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:31.553852 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b40fcb6-d8e5-46ea-97dc-dada5d308418 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:31.554274 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b40fcb6-d8e5-46ea-97dc-dada5d308418 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:31.558358 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:50:31.584711 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8b769723-ed6e-49c8-8327-4713995aca15 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:31.596385 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8b769723-ed6e-49c8-8327-4713995aca15 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:31.597870 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8b769723-ed6e-49c8-8327-4713995aca15 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:31.605860 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8b769723-ed6e-49c8-8327-4713995aca15 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.157953 Aug 24 12:50:31.605860 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1188/2376] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:31 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:31.605860 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-16d416e9-1939-47fd-8511-8b9972d2c4a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:31.605860 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-16d416e9-1939-47fd-8511-8b9972d2c4a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:31.610418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-16d416e9-1939-47fd-8511-8b9972d2c4a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:31.610935 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-16d416e9-1939-47fd-8511-8b9972d2c4a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:31.611375 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-16d416e9-1939-47fd-8511-8b9972d2c4a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:31.612216 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-16d416e9-1939-47fd-8511-8b9972d2c4a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:31.612999 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-16d416e9-1939-47fd-8511-8b9972d2c4a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:31.613428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-16d416e9-1939-47fd-8511-8b9972d2c4a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:31.688658 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5b40fcb6-d8e5-46ea-97dc-dada5d308418 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:31.697684 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5b40fcb6-d8e5-46ea-97dc-dada5d308418 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.158567 Aug 24 12:50:31.698442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1189/2377] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:31 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:31.742258 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-16d416e9-1939-47fd-8511-8b9972d2c4a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:31.750470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-16d416e9-1939-47fd-8511-8b9972d2c4a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149898 Aug 24 12:50:31.751125 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1189/2378] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:31 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:32.367318 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ab9a95ba-0830-43f3-979e-06021a16fb82 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:32.367931 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ab9a95ba-0830-43f3-979e-06021a16fb82 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:32.374907 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab9a95ba-0830-43f3-979e-06021a16fb82 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:32.378520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab9a95ba-0830-43f3-979e-06021a16fb82 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:32.378520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab9a95ba-0830-43f3-979e-06021a16fb82 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:32.378520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab9a95ba-0830-43f3-979e-06021a16fb82 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:32.378520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab9a95ba-0830-43f3-979e-06021a16fb82 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:32.379120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab9a95ba-0830-43f3-979e-06021a16fb82 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:32.506849 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ab9a95ba-0830-43f3-979e-06021a16fb82 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:32.515087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ab9a95ba-0830-43f3-979e-06021a16fb82 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151549 Aug 24 12:50:32.515644 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1190/2379] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:32 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:32.622419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-99715c4b-a882-4a01-a8c0-4e67ae5d0b14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:32.623051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-99715c4b-a882-4a01-a8c0-4e67ae5d0b14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:32.629435 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-99715c4b-a882-4a01-a8c0-4e67ae5d0b14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:32.629922 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-99715c4b-a882-4a01-a8c0-4e67ae5d0b14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:32.630360 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-99715c4b-a882-4a01-a8c0-4e67ae5d0b14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:32.631059 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-99715c4b-a882-4a01-a8c0-4e67ae5d0b14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:32.631515 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-99715c4b-a882-4a01-a8c0-4e67ae5d0b14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:32.631946 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-99715c4b-a882-4a01-a8c0-4e67ae5d0b14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:32.719481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4ea5f937-f434-4066-80a7-20ea3ea51943 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:32.720094 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4ea5f937-f434-4066-80a7-20ea3ea51943 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:32.726733 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4ea5f937-f434-4066-80a7-20ea3ea51943 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:32.727238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4ea5f937-f434-4066-80a7-20ea3ea51943 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:32.727673 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4ea5f937-f434-4066-80a7-20ea3ea51943 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:32.728383 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4ea5f937-f434-4066-80a7-20ea3ea51943 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:32.728833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4ea5f937-f434-4066-80a7-20ea3ea51943 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:32.729253 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4ea5f937-f434-4066-80a7-20ea3ea51943 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:32.763407 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-99715c4b-a882-4a01-a8c0-4e67ae5d0b14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:32.772582 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-99715c4b-a882-4a01-a8c0-4e67ae5d0b14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:32.774052 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-99715c4b-a882-4a01-a8c0-4e67ae5d0b14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:32.775267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-99715c4b-a882-4a01-a8c0-4e67ae5d0b14 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.156756 Aug 24 12:50:32.775817 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1190/2380] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:32 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:32.780218 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-454814a0-d47e-4e34-a5ba-cc32020488de tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:32.780812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-454814a0-d47e-4e34-a5ba-cc32020488de tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:32.787466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-454814a0-d47e-4e34-a5ba-cc32020488de tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:32.787949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-454814a0-d47e-4e34-a5ba-cc32020488de tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:32.788394 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-454814a0-d47e-4e34-a5ba-cc32020488de tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:32.789071 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-454814a0-d47e-4e34-a5ba-cc32020488de tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:32.789518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-454814a0-d47e-4e34-a5ba-cc32020488de tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:32.789937 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-454814a0-d47e-4e34-a5ba-cc32020488de tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:32.863118 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4ea5f937-f434-4066-80a7-20ea3ea51943 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:32.871325 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4ea5f937-f434-4066-80a7-20ea3ea51943 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.155697 Aug 24 12:50:32.871893 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1191/2381] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:32 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:32.923816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-454814a0-d47e-4e34-a5ba-cc32020488de tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:32.932037 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-454814a0-d47e-4e34-a5ba-cc32020488de tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.155295 Aug 24 12:50:32.934233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1191/2382] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:32 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:33.536118 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-554792b8-8476-4ecb-b3e7-46937b6fefc6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:33.536724 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-554792b8-8476-4ecb-b3e7-46937b6fefc6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:33.543190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-554792b8-8476-4ecb-b3e7-46937b6fefc6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:33.543667 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-554792b8-8476-4ecb-b3e7-46937b6fefc6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:33.544096 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-554792b8-8476-4ecb-b3e7-46937b6fefc6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:33.544769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-554792b8-8476-4ecb-b3e7-46937b6fefc6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:33.545218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-554792b8-8476-4ecb-b3e7-46937b6fefc6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:33.545638 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-554792b8-8476-4ecb-b3e7-46937b6fefc6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:33.674283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-554792b8-8476-4ecb-b3e7-46937b6fefc6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:33.682318 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-554792b8-8476-4ecb-b3e7-46937b6fefc6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150644 Aug 24 12:50:33.682897 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1192/2383] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:33 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:33.799771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ebb55c93-bf1c-4c2e-a3d6-b27c8e7a4ecb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:33.800551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ebb55c93-bf1c-4c2e-a3d6-b27c8e7a4ecb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:33.807045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ebb55c93-bf1c-4c2e-a3d6-b27c8e7a4ecb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:33.807531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ebb55c93-bf1c-4c2e-a3d6-b27c8e7a4ecb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:33.807976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ebb55c93-bf1c-4c2e-a3d6-b27c8e7a4ecb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:33.808664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ebb55c93-bf1c-4c2e-a3d6-b27c8e7a4ecb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:33.809118 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ebb55c93-bf1c-4c2e-a3d6-b27c8e7a4ecb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:33.809541 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ebb55c93-bf1c-4c2e-a3d6-b27c8e7a4ecb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:33.892956 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-64a8880b-4bd7-4c19-a40f-a9b5cb4c9ba0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:33.893770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-64a8880b-4bd7-4c19-a40f-a9b5cb4c9ba0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:33.899831 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-64a8880b-4bd7-4c19-a40f-a9b5cb4c9ba0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:33.900320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-64a8880b-4bd7-4c19-a40f-a9b5cb4c9ba0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:33.900751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-64a8880b-4bd7-4c19-a40f-a9b5cb4c9ba0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:33.901435 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-64a8880b-4bd7-4c19-a40f-a9b5cb4c9ba0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:33.901886 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-64a8880b-4bd7-4c19-a40f-a9b5cb4c9ba0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:33.902308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-64a8880b-4bd7-4c19-a40f-a9b5cb4c9ba0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:33.957213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ebb55c93-bf1c-4c2e-a3d6-b27c8e7a4ecb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:33.965955 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ebb55c93-bf1c-4c2e-a3d6-b27c8e7a4ecb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:33.967485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ebb55c93-bf1c-4c2e-a3d6-b27c8e7a4ecb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:33.968649 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ebb55c93-bf1c-4c2e-a3d6-b27c8e7a4ecb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.172812 Aug 24 12:50:33.969201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1192/2384] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:33 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:33.977419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ea1dc625-4284-4ed5-bd5a-36d7fce683a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:33.978040 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ea1dc625-4284-4ed5-bd5a-36d7fce683a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:33.984476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea1dc625-4284-4ed5-bd5a-36d7fce683a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:33.985107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea1dc625-4284-4ed5-bd5a-36d7fce683a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:33.985618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea1dc625-4284-4ed5-bd5a-36d7fce683a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:33.987053 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea1dc625-4284-4ed5-bd5a-36d7fce683a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:33.987737 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea1dc625-4284-4ed5-bd5a-36d7fce683a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:33.988345 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea1dc625-4284-4ed5-bd5a-36d7fce683a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:34.043366 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-64a8880b-4bd7-4c19-a40f-a9b5cb4c9ba0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:34.052418 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-64a8880b-4bd7-4c19-a40f-a9b5cb4c9ba0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.164585 Aug 24 12:50:34.052981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1193/2385] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:33 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:34.124767 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ea1dc625-4284-4ed5-bd5a-36d7fce683a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:34.133002 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ea1dc625-4284-4ed5-bd5a-36d7fce683a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.161185 Aug 24 12:50:34.133559 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1193/2386] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:33 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:34.703537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b928c195-f718-4a62-9f94-e1657dc4f377 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:34.704064 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b928c195-f718-4a62-9f94-e1657dc4f377 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:34.711095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b928c195-f718-4a62-9f94-e1657dc4f377 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:34.711578 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b928c195-f718-4a62-9f94-e1657dc4f377 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:34.712016 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b928c195-f718-4a62-9f94-e1657dc4f377 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:34.712704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b928c195-f718-4a62-9f94-e1657dc4f377 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:34.713162 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b928c195-f718-4a62-9f94-e1657dc4f377 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:34.713589 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b928c195-f718-4a62-9f94-e1657dc4f377 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:34.842679 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b928c195-f718-4a62-9f94-e1657dc4f377 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:34.850868 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b928c195-f718-4a62-9f94-e1657dc4f377 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151502 Aug 24 12:50:34.851424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1194/2387] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:34 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:34.993481 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4d75eb3d-00a2-426d-9737-7e0f6bc32671 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:34.994064 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4d75eb3d-00a2-426d-9737-7e0f6bc32671 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:35.000434 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4d75eb3d-00a2-426d-9737-7e0f6bc32671 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:35.000906 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4d75eb3d-00a2-426d-9737-7e0f6bc32671 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:35.001362 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4d75eb3d-00a2-426d-9737-7e0f6bc32671 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:35.002559 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4d75eb3d-00a2-426d-9737-7e0f6bc32671 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:35.003028 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4d75eb3d-00a2-426d-9737-7e0f6bc32671 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:35.003447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4d75eb3d-00a2-426d-9737-7e0f6bc32671 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:35.073323 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9d1bfd4a-d54f-4cb0-ba60-9eba6762e9dd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:35.073958 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9d1bfd4a-d54f-4cb0-ba60-9eba6762e9dd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:35.080069 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9d1bfd4a-d54f-4cb0-ba60-9eba6762e9dd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:35.080555 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9d1bfd4a-d54f-4cb0-ba60-9eba6762e9dd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:35.080986 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9d1bfd4a-d54f-4cb0-ba60-9eba6762e9dd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:35.081670 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9d1bfd4a-d54f-4cb0-ba60-9eba6762e9dd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:35.082154 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9d1bfd4a-d54f-4cb0-ba60-9eba6762e9dd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:35.082580 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9d1bfd4a-d54f-4cb0-ba60-9eba6762e9dd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:35.138671 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4d75eb3d-00a2-426d-9737-7e0f6bc32671 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:35.147498 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4d75eb3d-00a2-426d-9737-7e0f6bc32671 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:35.148994 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4d75eb3d-00a2-426d-9737-7e0f6bc32671 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:35.150150 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4d75eb3d-00a2-426d-9737-7e0f6bc32671 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.160640 Aug 24 12:50:35.150906 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1194/2388] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:34 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:35.155064 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-38b3010e-1c5c-45e4-a3f3-189f1a0b7fb1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:35.155671 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-38b3010e-1c5c-45e4-a3f3-189f1a0b7fb1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:35.161361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-38b3010e-1c5c-45e4-a3f3-189f1a0b7fb1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:35.161844 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-38b3010e-1c5c-45e4-a3f3-189f1a0b7fb1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:35.162280 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-38b3010e-1c5c-45e4-a3f3-189f1a0b7fb1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:35.162994 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-38b3010e-1c5c-45e4-a3f3-189f1a0b7fb1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:35.163448 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-38b3010e-1c5c-45e4-a3f3-189f1a0b7fb1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:35.163875 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-38b3010e-1c5c-45e4-a3f3-189f1a0b7fb1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:35.212532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9d1bfd4a-d54f-4cb0-ba60-9eba6762e9dd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:35.220813 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9d1bfd4a-d54f-4cb0-ba60-9eba6762e9dd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151322 Aug 24 12:50:35.221364 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1195/2389] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:35 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:35.290983 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-38b3010e-1c5c-45e4-a3f3-189f1a0b7fb1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:35.299628 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-38b3010e-1c5c-45e4-a3f3-189f1a0b7fb1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.147952 Aug 24 12:50:35.300186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1195/2390] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:35 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:35.871912 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f7bdfb2f-07e4-443f-b1fd-5b5e74407d53 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:35.872459 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f7bdfb2f-07e4-443f-b1fd-5b5e74407d53 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:35.878867 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7bdfb2f-07e4-443f-b1fd-5b5e74407d53 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:35.879354 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7bdfb2f-07e4-443f-b1fd-5b5e74407d53 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:35.879791 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7bdfb2f-07e4-443f-b1fd-5b5e74407d53 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:35.880477 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7bdfb2f-07e4-443f-b1fd-5b5e74407d53 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:35.880936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7bdfb2f-07e4-443f-b1fd-5b5e74407d53 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:35.881360 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7bdfb2f-07e4-443f-b1fd-5b5e74407d53 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:36.010984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f7bdfb2f-07e4-443f-b1fd-5b5e74407d53 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:36.019632 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f7bdfb2f-07e4-443f-b1fd-5b5e74407d53 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151700 Aug 24 12:50:36.020182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1196/2391] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:35 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:36.172956 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-81613ef3-fa10-4b2d-b0a2-376162e6b6ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:36.174172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-81613ef3-fa10-4b2d-b0a2-376162e6b6ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:36.180666 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81613ef3-fa10-4b2d-b0a2-376162e6b6ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:36.181143 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81613ef3-fa10-4b2d-b0a2-376162e6b6ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:36.181575 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81613ef3-fa10-4b2d-b0a2-376162e6b6ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:36.182247 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81613ef3-fa10-4b2d-b0a2-376162e6b6ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:36.182726 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81613ef3-fa10-4b2d-b0a2-376162e6b6ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:36.183146 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81613ef3-fa10-4b2d-b0a2-376162e6b6ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:36.242242 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-387536ce-91f5-40a5-a016-ab0321fdcdc0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:36.242993 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-387536ce-91f5-40a5-a016-ab0321fdcdc0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:36.248913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-387536ce-91f5-40a5-a016-ab0321fdcdc0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:36.249470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-387536ce-91f5-40a5-a016-ab0321fdcdc0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:36.249980 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-387536ce-91f5-40a5-a016-ab0321fdcdc0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:36.250768 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-387536ce-91f5-40a5-a016-ab0321fdcdc0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:36.251323 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-387536ce-91f5-40a5-a016-ab0321fdcdc0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:36.251832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-387536ce-91f5-40a5-a016-ab0321fdcdc0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:36.310003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-81613ef3-fa10-4b2d-b0a2-376162e6b6ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:36.318555 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-81613ef3-fa10-4b2d-b0a2-376162e6b6ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:36.320061 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-81613ef3-fa10-4b2d-b0a2-376162e6b6ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:36.321352 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-81613ef3-fa10-4b2d-b0a2-376162e6b6ee tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.152245 Aug 24 12:50:36.322073 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1196/2392] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:36 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:36.326306 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-74a1f607-dc6c-4b1a-a5e3-628267009371 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:36.326916 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-74a1f607-dc6c-4b1a-a5e3-628267009371 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:36.332735 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-74a1f607-dc6c-4b1a-a5e3-628267009371 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:36.333208 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-74a1f607-dc6c-4b1a-a5e3-628267009371 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:36.333758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-74a1f607-dc6c-4b1a-a5e3-628267009371 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:36.334437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-74a1f607-dc6c-4b1a-a5e3-628267009371 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:36.334912 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-74a1f607-dc6c-4b1a-a5e3-628267009371 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:36.335332 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-74a1f607-dc6c-4b1a-a5e3-628267009371 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:36.382144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-387536ce-91f5-40a5-a016-ab0321fdcdc0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:36.390437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-387536ce-91f5-40a5-a016-ab0321fdcdc0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152040 Aug 24 12:50:36.391113 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1197/2393] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:36 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:36.465473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-74a1f607-dc6c-4b1a-a5e3-628267009371 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:36.473809 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-74a1f607-dc6c-4b1a-a5e3-628267009371 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150785 Aug 24 12:50:36.474364 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1197/2394] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:36 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:37.041137 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-401edc8e-e764-4ff4-a9d4-cdca254d8817 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:37.041743 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-401edc8e-e764-4ff4-a9d4-cdca254d8817 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:37.047644 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-401edc8e-e764-4ff4-a9d4-cdca254d8817 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:37.048123 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-401edc8e-e764-4ff4-a9d4-cdca254d8817 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:37.049249 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-401edc8e-e764-4ff4-a9d4-cdca254d8817 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:37.049928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-401edc8e-e764-4ff4-a9d4-cdca254d8817 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:37.050378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-401edc8e-e764-4ff4-a9d4-cdca254d8817 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:37.050834 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-401edc8e-e764-4ff4-a9d4-cdca254d8817 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:37.176226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-401edc8e-e764-4ff4-a9d4-cdca254d8817 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:37.184268 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-401edc8e-e764-4ff4-a9d4-cdca254d8817 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.146989 Aug 24 12:50:37.184828 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1198/2395] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:37 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:37.343404 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-681c269b-b7ea-4d72-a55d-63752713446c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:37.343913 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-681c269b-b7ea-4d72-a55d-63752713446c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:37.350919 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-681c269b-b7ea-4d72-a55d-63752713446c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:37.351397 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-681c269b-b7ea-4d72-a55d-63752713446c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:37.351830 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-681c269b-b7ea-4d72-a55d-63752713446c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:37.352597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-681c269b-b7ea-4d72-a55d-63752713446c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:37.353347 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-681c269b-b7ea-4d72-a55d-63752713446c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:37.354075 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-681c269b-b7ea-4d72-a55d-63752713446c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:37.412164 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f102e337-1141-4957-b5d3-d9ac1eb79bcd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:37.412762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f102e337-1141-4957-b5d3-d9ac1eb79bcd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:37.420210 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f102e337-1141-4957-b5d3-d9ac1eb79bcd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:37.420680 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f102e337-1141-4957-b5d3-d9ac1eb79bcd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:37.421230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f102e337-1141-4957-b5d3-d9ac1eb79bcd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:37.421946 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f102e337-1141-4957-b5d3-d9ac1eb79bcd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:37.422403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f102e337-1141-4957-b5d3-d9ac1eb79bcd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:37.422887 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f102e337-1141-4957-b5d3-d9ac1eb79bcd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:37.493323 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-681c269b-b7ea-4d72-a55d-63752713446c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:37.501830 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-681c269b-b7ea-4d72-a55d-63752713446c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:37.503343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-681c269b-b7ea-4d72-a55d-63752713446c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:37.504493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-681c269b-b7ea-4d72-a55d-63752713446c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.165086 Aug 24 12:50:37.505039 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1198/2396] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:37 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:37.509329 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e0f677c9-6fbc-491a-9dde-785e609b4979 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:37.509958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e0f677c9-6fbc-491a-9dde-785e609b4979 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:37.515906 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0f677c9-6fbc-491a-9dde-785e609b4979 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:37.516341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0f677c9-6fbc-491a-9dde-785e609b4979 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:37.516773 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0f677c9-6fbc-491a-9dde-785e609b4979 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:37.517997 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0f677c9-6fbc-491a-9dde-785e609b4979 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:37.518451 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0f677c9-6fbc-491a-9dde-785e609b4979 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:37.518894 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0f677c9-6fbc-491a-9dde-785e609b4979 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:37.560210 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f102e337-1141-4957-b5d3-d9ac1eb79bcd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:37.568443 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f102e337-1141-4957-b5d3-d9ac1eb79bcd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.160708 Aug 24 12:50:37.569007 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1199/2397] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:37 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:37.648338 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e0f677c9-6fbc-491a-9dde-785e609b4979 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:37.656525 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e0f677c9-6fbc-491a-9dde-785e609b4979 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150557 Aug 24 12:50:37.657085 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1199/2398] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:37 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:38.205326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3c759e3e-346c-494a-9000-3b51d786b25e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:38.205968 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3c759e3e-346c-494a-9000-3b51d786b25e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:38.211908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c759e3e-346c-494a-9000-3b51d786b25e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:38.212388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c759e3e-346c-494a-9000-3b51d786b25e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:38.212826 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c759e3e-346c-494a-9000-3b51d786b25e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:38.213501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c759e3e-346c-494a-9000-3b51d786b25e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:38.213955 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c759e3e-346c-494a-9000-3b51d786b25e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:38.214381 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c759e3e-346c-494a-9000-3b51d786b25e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:38.339910 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3c759e3e-346c-494a-9000-3b51d786b25e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:38.347927 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3c759e3e-346c-494a-9000-3b51d786b25e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.146541 Aug 24 12:50:38.348477 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1200/2399] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:38 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:38.528208 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6371234c-725d-43c3-90cf-7ab33ed8945f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:38.528814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6371234c-725d-43c3-90cf-7ab33ed8945f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:38.535786 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6371234c-725d-43c3-90cf-7ab33ed8945f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:38.536268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6371234c-725d-43c3-90cf-7ab33ed8945f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:38.536701 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6371234c-725d-43c3-90cf-7ab33ed8945f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:38.537375 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6371234c-725d-43c3-90cf-7ab33ed8945f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:38.537826 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6371234c-725d-43c3-90cf-7ab33ed8945f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:38.538249 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6371234c-725d-43c3-90cf-7ab33ed8945f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:38.589965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3459a0ed-36b0-4352-8a2d-ebc64c2f8a40 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:38.590584 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3459a0ed-36b0-4352-8a2d-ebc64c2f8a40 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:38.597523 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3459a0ed-36b0-4352-8a2d-ebc64c2f8a40 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:38.598013 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3459a0ed-36b0-4352-8a2d-ebc64c2f8a40 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:38.598451 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3459a0ed-36b0-4352-8a2d-ebc64c2f8a40 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:38.599179 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3459a0ed-36b0-4352-8a2d-ebc64c2f8a40 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:38.599643 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3459a0ed-36b0-4352-8a2d-ebc64c2f8a40 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:38.600068 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3459a0ed-36b0-4352-8a2d-ebc64c2f8a40 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:38.666428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6371234c-725d-43c3-90cf-7ab33ed8945f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:38.676169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6371234c-725d-43c3-90cf-7ab33ed8945f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:38.677696 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6371234c-725d-43c3-90cf-7ab33ed8945f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:38.678920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6371234c-725d-43c3-90cf-7ab33ed8945f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154543 Aug 24 12:50:38.679471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1200/2400] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:38 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:38.684168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e214374c-6431-4a7a-ac78-3df02e603a80 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:38.684767 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e214374c-6431-4a7a-ac78-3df02e603a80 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:38.690960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e214374c-6431-4a7a-ac78-3df02e603a80 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:38.691426 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e214374c-6431-4a7a-ac78-3df02e603a80 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:38.691867 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e214374c-6431-4a7a-ac78-3df02e603a80 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:38.692554 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e214374c-6431-4a7a-ac78-3df02e603a80 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:38.693007 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e214374c-6431-4a7a-ac78-3df02e603a80 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:38.693430 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e214374c-6431-4a7a-ac78-3df02e603a80 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:38.735542 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3459a0ed-36b0-4352-8a2d-ebc64c2f8a40 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:38.746223 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3459a0ed-36b0-4352-8a2d-ebc64c2f8a40 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.160131 Aug 24 12:50:38.747015 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1201/2401] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:38 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:38.824799 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e214374c-6431-4a7a-ac78-3df02e603a80 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:38.833410 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e214374c-6431-4a7a-ac78-3df02e603a80 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153006 Aug 24 12:50:38.833974 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1201/2402] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:38 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:39.375248 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c9bbdead-abc9-40cc-bddb-b7b9f6c47bf5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:39.375851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c9bbdead-abc9-40cc-bddb-b7b9f6c47bf5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:39.382072 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9bbdead-abc9-40cc-bddb-b7b9f6c47bf5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:39.382741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9bbdead-abc9-40cc-bddb-b7b9f6c47bf5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:39.383253 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9bbdead-abc9-40cc-bddb-b7b9f6c47bf5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:39.384445 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9bbdead-abc9-40cc-bddb-b7b9f6c47bf5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:39.385103 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9bbdead-abc9-40cc-bddb-b7b9f6c47bf5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:39.385626 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c9bbdead-abc9-40cc-bddb-b7b9f6c47bf5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:39.512198 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c9bbdead-abc9-40cc-bddb-b7b9f6c47bf5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:39.520694 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c9bbdead-abc9-40cc-bddb-b7b9f6c47bf5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.155287 Aug 24 12:50:39.521244 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1202/2403] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:39 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:39.702209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-788b0bc9-e502-4502-907a-e0933d71988c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:39.702756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-788b0bc9-e502-4502-907a-e0933d71988c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:39.709616 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-788b0bc9-e502-4502-907a-e0933d71988c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:39.710097 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-788b0bc9-e502-4502-907a-e0933d71988c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:39.710536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-788b0bc9-e502-4502-907a-e0933d71988c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:39.711245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-788b0bc9-e502-4502-907a-e0933d71988c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:39.711698 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-788b0bc9-e502-4502-907a-e0933d71988c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:39.712123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-788b0bc9-e502-4502-907a-e0933d71988c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:39.766193 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-75c0c302-ce04-4a53-a99c-f15f9827af0b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:39.766924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-75c0c302-ce04-4a53-a99c-f15f9827af0b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:39.773515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75c0c302-ce04-4a53-a99c-f15f9827af0b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:39.774076 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75c0c302-ce04-4a53-a99c-f15f9827af0b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:39.774579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75c0c302-ce04-4a53-a99c-f15f9827af0b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:39.775364 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75c0c302-ce04-4a53-a99c-f15f9827af0b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:39.775822 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75c0c302-ce04-4a53-a99c-f15f9827af0b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:39.776244 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75c0c302-ce04-4a53-a99c-f15f9827af0b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:39.849346 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-788b0bc9-e502-4502-907a-e0933d71988c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:39.859157 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-788b0bc9-e502-4502-907a-e0933d71988c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:39.860689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-788b0bc9-e502-4502-907a-e0933d71988c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:39.861982 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-788b0bc9-e502-4502-907a-e0933d71988c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.163700 Aug 24 12:50:39.862884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1202/2404] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:39 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:39.868951 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-41923dc8-db63-4f84-82c4-816453374a77 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:39.869888 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-41923dc8-db63-4f84-82c4-816453374a77 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:39.878945 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41923dc8-db63-4f84-82c4-816453374a77 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:39.879688 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41923dc8-db63-4f84-82c4-816453374a77 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:39.880356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41923dc8-db63-4f84-82c4-816453374a77 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:39.881408 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41923dc8-db63-4f84-82c4-816453374a77 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:39.882096 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41923dc8-db63-4f84-82c4-816453374a77 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:39.882797 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-41923dc8-db63-4f84-82c4-816453374a77 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:39.905392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-75c0c302-ce04-4a53-a99c-f15f9827af0b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:39.913504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-75c0c302-ce04-4a53-a99c-f15f9827af0b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151324 Aug 24 12:50:39.914134 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1203/2405] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:39 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:40.021304 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-41923dc8-db63-4f84-82c4-816453374a77 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:40.029373 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-41923dc8-db63-4f84-82c4-816453374a77 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.165547 Aug 24 12:50:40.029921 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1203/2406] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:39 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:40.542153 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ca8b52c6-625e-419c-bbef-a2306dc0b0ba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:40.543032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ca8b52c6-625e-419c-bbef-a2306dc0b0ba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:40.551361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ca8b52c6-625e-419c-bbef-a2306dc0b0ba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:40.552027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ca8b52c6-625e-419c-bbef-a2306dc0b0ba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:40.552466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ca8b52c6-625e-419c-bbef-a2306dc0b0ba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:40.553149 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ca8b52c6-625e-419c-bbef-a2306dc0b0ba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:40.553602 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ca8b52c6-625e-419c-bbef-a2306dc0b0ba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:40.554028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ca8b52c6-625e-419c-bbef-a2306dc0b0ba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:40.682463 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ca8b52c6-625e-419c-bbef-a2306dc0b0ba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:40.691061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ca8b52c6-625e-419c-bbef-a2306dc0b0ba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.153003 Aug 24 12:50:40.691619 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1204/2407] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:40 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:40.885173 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a348987e-9591-4467-9d6f-a610dec57304 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:40.885789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a348987e-9591-4467-9d6f-a610dec57304 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:40.892105 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a348987e-9591-4467-9d6f-a610dec57304 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:40.892584 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a348987e-9591-4467-9d6f-a610dec57304 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:40.893666 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a348987e-9591-4467-9d6f-a610dec57304 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:40.894348 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a348987e-9591-4467-9d6f-a610dec57304 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:40.894834 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a348987e-9591-4467-9d6f-a610dec57304 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:40.895262 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a348987e-9591-4467-9d6f-a610dec57304 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:40.934529 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6228adc6-5517-4d11-a0e3-afb6c92ced48 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:40.935102 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6228adc6-5517-4d11-a0e3-afb6c92ced48 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:40.941859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6228adc6-5517-4d11-a0e3-afb6c92ced48 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:40.942337 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6228adc6-5517-4d11-a0e3-afb6c92ced48 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:40.942809 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6228adc6-5517-4d11-a0e3-afb6c92ced48 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:40.943496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6228adc6-5517-4d11-a0e3-afb6c92ced48 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:40.943946 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6228adc6-5517-4d11-a0e3-afb6c92ced48 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:40.944368 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6228adc6-5517-4d11-a0e3-afb6c92ced48 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:41.024991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a348987e-9591-4467-9d6f-a610dec57304 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:41.033588 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a348987e-9591-4467-9d6f-a610dec57304 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:41.035093 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a348987e-9591-4467-9d6f-a610dec57304 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:41.036244 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a348987e-9591-4467-9d6f-a610dec57304 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154896 Aug 24 12:50:41.036798 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1204/2408] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:40 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:41.051342 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9cce0979-3ee1-496b-aed8-b812d7de497e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:41.052052 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9cce0979-3ee1-496b-aed8-b812d7de497e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:41.057809 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9cce0979-3ee1-496b-aed8-b812d7de497e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:41.058286 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9cce0979-3ee1-496b-aed8-b812d7de497e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:41.058745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9cce0979-3ee1-496b-aed8-b812d7de497e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:41.059420 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9cce0979-3ee1-496b-aed8-b812d7de497e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:41.059882 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9cce0979-3ee1-496b-aed8-b812d7de497e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:41.060284 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9cce0979-3ee1-496b-aed8-b812d7de497e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:41.064181 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:50:41.072710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6228adc6-5517-4d11-a0e3-afb6c92ced48 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:41.084824 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:50:41.084824 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6228adc6-5517-4d11-a0e3-afb6c92ced48 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150986 Aug 24 12:50:41.084824 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1205/2409] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:40 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:41.185960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9cce0979-3ee1-496b-aed8-b812d7de497e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:41.194485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9cce0979-3ee1-496b-aed8-b812d7de497e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.147343 Aug 24 12:50:41.195065 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1205/2410] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:41 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:41.711793 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-91ea8d66-11e0-4544-9b12-e2cf4b53a1b8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:41.712407 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-91ea8d66-11e0-4544-9b12-e2cf4b53a1b8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:41.718928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-91ea8d66-11e0-4544-9b12-e2cf4b53a1b8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:41.719419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-91ea8d66-11e0-4544-9b12-e2cf4b53a1b8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:41.719861 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-91ea8d66-11e0-4544-9b12-e2cf4b53a1b8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:41.720556 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-91ea8d66-11e0-4544-9b12-e2cf4b53a1b8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:41.721562 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-91ea8d66-11e0-4544-9b12-e2cf4b53a1b8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:41.721996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-91ea8d66-11e0-4544-9b12-e2cf4b53a1b8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:41.852108 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-91ea8d66-11e0-4544-9b12-e2cf4b53a1b8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:41.860650 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-91ea8d66-11e0-4544-9b12-e2cf4b53a1b8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.152733 Aug 24 12:50:41.861211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1206/2411] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:41 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:42.059010 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-38a1c000-eb3c-461d-94aa-cbf5955b7c05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:42.059610 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-38a1c000-eb3c-461d-94aa-cbf5955b7c05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:42.066923 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-38a1c000-eb3c-461d-94aa-cbf5955b7c05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:42.067397 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-38a1c000-eb3c-461d-94aa-cbf5955b7c05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:42.067826 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-38a1c000-eb3c-461d-94aa-cbf5955b7c05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:42.068497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-38a1c000-eb3c-461d-94aa-cbf5955b7c05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:42.068939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-38a1c000-eb3c-461d-94aa-cbf5955b7c05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:42.069356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-38a1c000-eb3c-461d-94aa-cbf5955b7c05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:42.104092 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8f62513e-06a2-4962-a33e-922e83f32cef tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:42.104658 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8f62513e-06a2-4962-a33e-922e83f32cef tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:42.111175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f62513e-06a2-4962-a33e-922e83f32cef tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:42.112182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f62513e-06a2-4962-a33e-922e83f32cef tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:42.112880 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f62513e-06a2-4962-a33e-922e83f32cef tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:42.113577 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f62513e-06a2-4962-a33e-922e83f32cef tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:42.114034 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f62513e-06a2-4962-a33e-922e83f32cef tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:42.114463 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f62513e-06a2-4962-a33e-922e83f32cef tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:42.215973 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-38a1c000-eb3c-461d-94aa-cbf5955b7c05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:42.225244 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-38a1c000-eb3c-461d-94aa-cbf5955b7c05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:42.226845 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-38a1c000-eb3c-461d-94aa-cbf5955b7c05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:42.228031 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-38a1c000-eb3c-461d-94aa-cbf5955b7c05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.172878 Aug 24 12:50:42.228573 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1206/2412] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:42 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:42.233072 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1889ff5b-d5b7-4356-9f69-a76d87f5fe3f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:42.233668 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1889ff5b-d5b7-4356-9f69-a76d87f5fe3f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:42.240425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1889ff5b-d5b7-4356-9f69-a76d87f5fe3f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:42.240901 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1889ff5b-d5b7-4356-9f69-a76d87f5fe3f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:42.241538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1889ff5b-d5b7-4356-9f69-a76d87f5fe3f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:42.242208 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1889ff5b-d5b7-4356-9f69-a76d87f5fe3f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:42.242675 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1889ff5b-d5b7-4356-9f69-a76d87f5fe3f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:42.243174 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1889ff5b-d5b7-4356-9f69-a76d87f5fe3f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:42.246266 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8f62513e-06a2-4962-a33e-922e83f32cef tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:42.254517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8f62513e-06a2-4962-a33e-922e83f32cef tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.154361 Aug 24 12:50:42.255109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1207/2413] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:42 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:42.368298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1889ff5b-d5b7-4356-9f69-a76d87f5fe3f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:42.376267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1889ff5b-d5b7-4356-9f69-a76d87f5fe3f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.146550 Aug 24 12:50:42.376815 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1207/2414] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:42 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:42.884685 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5499008a-4145-48b0-9bec-56ca4b3903c8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:42.885303 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5499008a-4145-48b0-9bec-56ca4b3903c8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:42.891298 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5499008a-4145-48b0-9bec-56ca4b3903c8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:42.900384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5499008a-4145-48b0-9bec-56ca4b3903c8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:42.900384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5499008a-4145-48b0-9bec-56ca4b3903c8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:42.900384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5499008a-4145-48b0-9bec-56ca4b3903c8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:42.900384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5499008a-4145-48b0-9bec-56ca4b3903c8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:42.900874 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5499008a-4145-48b0-9bec-56ca4b3903c8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:43.023802 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5499008a-4145-48b0-9bec-56ca4b3903c8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:43.031998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5499008a-4145-48b0-9bec-56ca4b3903c8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151189 Aug 24 12:50:43.032556 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1208/2415] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:42 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:43.253094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b70b9210-63b4-4744-b405-abc837e9b8dc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:43.253729 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b70b9210-63b4-4744-b405-abc837e9b8dc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:43.260056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b70b9210-63b4-4744-b405-abc837e9b8dc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:43.260531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b70b9210-63b4-4744-b405-abc837e9b8dc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:43.260968 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b70b9210-63b4-4744-b405-abc837e9b8dc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:43.261638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b70b9210-63b4-4744-b405-abc837e9b8dc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:43.262084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b70b9210-63b4-4744-b405-abc837e9b8dc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:43.262503 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b70b9210-63b4-4744-b405-abc837e9b8dc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:43.275551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0959e966-7f50-4bbd-9a68-cf382ac485bd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:43.276156 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0959e966-7f50-4bbd-9a68-cf382ac485bd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:43.282541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0959e966-7f50-4bbd-9a68-cf382ac485bd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:43.283068 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0959e966-7f50-4bbd-9a68-cf382ac485bd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:43.283510 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0959e966-7f50-4bbd-9a68-cf382ac485bd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:43.284350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0959e966-7f50-4bbd-9a68-cf382ac485bd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:43.284851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0959e966-7f50-4bbd-9a68-cf382ac485bd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:43.285284 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0959e966-7f50-4bbd-9a68-cf382ac485bd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:43.394219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b70b9210-63b4-4744-b405-abc837e9b8dc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:43.402739 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b70b9210-63b4-4744-b405-abc837e9b8dc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:43.404222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b70b9210-63b4-4744-b405-abc837e9b8dc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:43.405609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b70b9210-63b4-4744-b405-abc837e9b8dc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.157061 Aug 24 12:50:43.406207 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1208/2416] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:43 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:43.412046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-123bd0c0-e237-4509-9e40-b1180ac407a1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:43.412917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-123bd0c0-e237-4509-9e40-b1180ac407a1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:43.426752 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-123bd0c0-e237-4509-9e40-b1180ac407a1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:43.426752 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-123bd0c0-e237-4509-9e40-b1180ac407a1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:43.426752 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-123bd0c0-e237-4509-9e40-b1180ac407a1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:43.427143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0959e966-7f50-4bbd-9a68-cf382ac485bd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:43.427263 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-123bd0c0-e237-4509-9e40-b1180ac407a1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:43.427263 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-123bd0c0-e237-4509-9e40-b1180ac407a1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:43.427263 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-123bd0c0-e237-4509-9e40-b1180ac407a1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:43.433236 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0959e966-7f50-4bbd-9a68-cf382ac485bd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.161443 Aug 24 12:50:43.434037 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1209/2417] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:43 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:43.576465 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-123bd0c0-e237-4509-9e40-b1180ac407a1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:43.584663 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-123bd0c0-e237-4509-9e40-b1180ac407a1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.177032 Aug 24 12:50:43.585217 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1209/2418] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:43 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:44.053084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9a6469fb-6fa0-481c-9f68-b67913c90f1f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:44.053688 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9a6469fb-6fa0-481c-9f68-b67913c90f1f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:44.059960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a6469fb-6fa0-481c-9f68-b67913c90f1f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:44.060438 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a6469fb-6fa0-481c-9f68-b67913c90f1f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:44.060871 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a6469fb-6fa0-481c-9f68-b67913c90f1f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:44.061546 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a6469fb-6fa0-481c-9f68-b67913c90f1f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:44.062028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a6469fb-6fa0-481c-9f68-b67913c90f1f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:44.062447 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a6469fb-6fa0-481c-9f68-b67913c90f1f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:44.187861 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9a6469fb-6fa0-481c-9f68-b67913c90f1f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:44.196754 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9a6469fb-6fa0-481c-9f68-b67913c90f1f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.148158 Aug 24 12:50:44.197318 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1210/2419] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:44 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:44.436471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1b513680-a5b6-491a-959c-fe2b2185b5d1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:44.437079 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1b513680-a5b6-491a-959c-fe2b2185b5d1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:44.443472 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b513680-a5b6-491a-959c-fe2b2185b5d1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:44.443951 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b513680-a5b6-491a-959c-fe2b2185b5d1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:44.444383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b513680-a5b6-491a-959c-fe2b2185b5d1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:44.445059 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b513680-a5b6-491a-959c-fe2b2185b5d1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:44.445506 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b513680-a5b6-491a-959c-fe2b2185b5d1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:44.445928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b513680-a5b6-491a-959c-fe2b2185b5d1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:44.454242 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dbdc9b0c-620e-4380-98d4-40f5cb8bbe59 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:44.454885 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dbdc9b0c-620e-4380-98d4-40f5cb8bbe59 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:44.461097 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dbdc9b0c-620e-4380-98d4-40f5cb8bbe59 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:44.461578 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dbdc9b0c-620e-4380-98d4-40f5cb8bbe59 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:44.462013 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dbdc9b0c-620e-4380-98d4-40f5cb8bbe59 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:44.462714 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dbdc9b0c-620e-4380-98d4-40f5cb8bbe59 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:44.463174 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dbdc9b0c-620e-4380-98d4-40f5cb8bbe59 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:44.463600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dbdc9b0c-620e-4380-98d4-40f5cb8bbe59 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:44.573010 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1b513680-a5b6-491a-959c-fe2b2185b5d1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:44.581601 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1b513680-a5b6-491a-959c-fe2b2185b5d1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:44.583114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1b513680-a5b6-491a-959c-fe2b2185b5d1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:44.584264 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1b513680-a5b6-491a-959c-fe2b2185b5d1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.151654 Aug 24 12:50:44.584823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1210/2420] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:44 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:44.594390 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-dbdc9b0c-620e-4380-98d4-40f5cb8bbe59 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:44.603439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dbdc9b0c-620e-4380-98d4-40f5cb8bbe59 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.153169 Aug 24 12:50:44.603999 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1211/2421] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:44 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:44.605202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-36c0a43f-852c-4a96-9897-842b3dcf4d79 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:44.605817 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-36c0a43f-852c-4a96-9897-842b3dcf4d79 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:44.612608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36c0a43f-852c-4a96-9897-842b3dcf4d79 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:44.613157 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36c0a43f-852c-4a96-9897-842b3dcf4d79 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:44.613665 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36c0a43f-852c-4a96-9897-842b3dcf4d79 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:44.614425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36c0a43f-852c-4a96-9897-842b3dcf4d79 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:44.614976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36c0a43f-852c-4a96-9897-842b3dcf4d79 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:44.615470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36c0a43f-852c-4a96-9897-842b3dcf4d79 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:44.742227 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-36c0a43f-852c-4a96-9897-842b3dcf4d79 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:44.750277 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-36c0a43f-852c-4a96-9897-842b3dcf4d79 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148963 Aug 24 12:50:44.750860 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1211/2422] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:44 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:45.221109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-455f4f44-f349-4a8a-8cfe-7b5890689a17 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:45.221715 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-455f4f44-f349-4a8a-8cfe-7b5890689a17 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:45.227652 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-455f4f44-f349-4a8a-8cfe-7b5890689a17 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:45.228119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-455f4f44-f349-4a8a-8cfe-7b5890689a17 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:45.228555 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-455f4f44-f349-4a8a-8cfe-7b5890689a17 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:45.229231 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-455f4f44-f349-4a8a-8cfe-7b5890689a17 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:45.229749 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-455f4f44-f349-4a8a-8cfe-7b5890689a17 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:45.230113 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-455f4f44-f349-4a8a-8cfe-7b5890689a17 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:45.356105 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-455f4f44-f349-4a8a-8cfe-7b5890689a17 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:45.364699 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-455f4f44-f349-4a8a-8cfe-7b5890689a17 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147404 Aug 24 12:50:45.365255 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1212/2423] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:45 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:45.607822 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0986874f-a81e-49d2-aaed-60a00b36103d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:45.608367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0986874f-a81e-49d2-aaed-60a00b36103d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:45.615443 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0986874f-a81e-49d2-aaed-60a00b36103d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:45.615914 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0986874f-a81e-49d2-aaed-60a00b36103d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:45.616340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0986874f-a81e-49d2-aaed-60a00b36103d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:45.617013 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0986874f-a81e-49d2-aaed-60a00b36103d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:45.617470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0986874f-a81e-49d2-aaed-60a00b36103d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:45.617977 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0986874f-a81e-49d2-aaed-60a00b36103d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:45.625079 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-86e07ab1-7c4c-4c27-96f6-3fe6b5949a1e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:45.625692 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-86e07ab1-7c4c-4c27-96f6-3fe6b5949a1e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:45.632693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86e07ab1-7c4c-4c27-96f6-3fe6b5949a1e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:45.633175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86e07ab1-7c4c-4c27-96f6-3fe6b5949a1e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:45.633608 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86e07ab1-7c4c-4c27-96f6-3fe6b5949a1e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:45.634294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86e07ab1-7c4c-4c27-96f6-3fe6b5949a1e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:45.634795 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86e07ab1-7c4c-4c27-96f6-3fe6b5949a1e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:45.635213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86e07ab1-7c4c-4c27-96f6-3fe6b5949a1e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:45.746229 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0986874f-a81e-49d2-aaed-60a00b36103d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:45.755421 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0986874f-a81e-49d2-aaed-60a00b36103d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:45.756975 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0986874f-a81e-49d2-aaed-60a00b36103d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:45.758139 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0986874f-a81e-49d2-aaed-60a00b36103d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154396 Aug 24 12:50:45.758712 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1212/2424] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:45 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:45.765800 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-86e07ab1-7c4c-4c27-96f6-3fe6b5949a1e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:45.770821 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f5276ccb-2477-4650-99eb-0225aa806e24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:45.771453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f5276ccb-2477-4650-99eb-0225aa806e24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:45.774315 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-86e07ab1-7c4c-4c27-96f6-3fe6b5949a1e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.153013 Aug 24 12:50:45.774986 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1213/2425] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:45 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:45.777304 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5276ccb-2477-4650-99eb-0225aa806e24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:45.777776 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5276ccb-2477-4650-99eb-0225aa806e24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:45.778204 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5276ccb-2477-4650-99eb-0225aa806e24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:45.778931 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5276ccb-2477-4650-99eb-0225aa806e24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:45.779375 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5276ccb-2477-4650-99eb-0225aa806e24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:45.779792 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5276ccb-2477-4650-99eb-0225aa806e24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:45.906923 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f5276ccb-2477-4650-99eb-0225aa806e24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:45.915642 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f5276ccb-2477-4650-99eb-0225aa806e24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148559 Aug 24 12:50:45.916196 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1213/2426] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:45 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:46.385951 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2a9557e0-9c98-4ca6-8b2c-463c8516dcbb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:46.386497 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2a9557e0-9c98-4ca6-8b2c-463c8516dcbb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:46.392457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a9557e0-9c98-4ca6-8b2c-463c8516dcbb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:46.392940 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a9557e0-9c98-4ca6-8b2c-463c8516dcbb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:46.393375 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a9557e0-9c98-4ca6-8b2c-463c8516dcbb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:46.394053 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a9557e0-9c98-4ca6-8b2c-463c8516dcbb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:46.394508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a9557e0-9c98-4ca6-8b2c-463c8516dcbb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:46.394959 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a9557e0-9c98-4ca6-8b2c-463c8516dcbb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:46.519104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2a9557e0-9c98-4ca6-8b2c-463c8516dcbb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:46.527058 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2a9557e0-9c98-4ca6-8b2c-463c8516dcbb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.144982 Aug 24 12:50:46.527619 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1214/2427] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:46 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:46.781239 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7a5cbabc-bc0f-4898-b9da-2f47632f95c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:46.781845 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7a5cbabc-bc0f-4898-b9da-2f47632f95c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:46.788753 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a5cbabc-bc0f-4898-b9da-2f47632f95c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:46.789232 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a5cbabc-bc0f-4898-b9da-2f47632f95c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:46.789677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a5cbabc-bc0f-4898-b9da-2f47632f95c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:46.790990 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a5cbabc-bc0f-4898-b9da-2f47632f95c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:46.791447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a5cbabc-bc0f-4898-b9da-2f47632f95c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:46.791872 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a5cbabc-bc0f-4898-b9da-2f47632f95c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:46.795052 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-72172822-14af-4331-afa3-ade2d8830b44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:46.795662 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-72172822-14af-4331-afa3-ade2d8830b44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:46.802261 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72172822-14af-4331-afa3-ade2d8830b44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:46.802770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72172822-14af-4331-afa3-ade2d8830b44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:46.803203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72172822-14af-4331-afa3-ade2d8830b44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:46.803889 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72172822-14af-4331-afa3-ade2d8830b44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:46.804341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72172822-14af-4331-afa3-ade2d8830b44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:46.804760 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72172822-14af-4331-afa3-ade2d8830b44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:46.928232 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7a5cbabc-bc0f-4898-b9da-2f47632f95c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:46.931670 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-72172822-14af-4331-afa3-ade2d8830b44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:46.937057 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7a5cbabc-bc0f-4898-b9da-2f47632f95c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:46.938639 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7a5cbabc-bc0f-4898-b9da-2f47632f95c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:46.939814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7a5cbabc-bc0f-4898-b9da-2f47632f95c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.162549 Aug 24 12:50:46.940066 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-72172822-14af-4331-afa3-ade2d8830b44 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.148724 Aug 24 12:50:46.940366 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1214/2428] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:46 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:46.940793 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1215/2429] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:46 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:46.944640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-80d131df-0041-4a7f-971a-03e1f2138072 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:46.945229 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-80d131df-0041-4a7f-971a-03e1f2138072 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:46.950964 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80d131df-0041-4a7f-971a-03e1f2138072 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:46.951506 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80d131df-0041-4a7f-971a-03e1f2138072 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:46.952015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80d131df-0041-4a7f-971a-03e1f2138072 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:46.952756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80d131df-0041-4a7f-971a-03e1f2138072 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:46.953260 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80d131df-0041-4a7f-971a-03e1f2138072 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:46.953683 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80d131df-0041-4a7f-971a-03e1f2138072 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:47.078586 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-80d131df-0041-4a7f-971a-03e1f2138072 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:47.087137 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-80d131df-0041-4a7f-971a-03e1f2138072 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.145857 Aug 24 12:50:47.087687 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1215/2430] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:46 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:47.547366 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d42e4b92-29e9-433e-af84-d1caf2998363 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:47.548107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d42e4b92-29e9-433e-af84-d1caf2998363 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:47.550011 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:50:47.554849 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d42e4b92-29e9-433e-af84-d1caf2998363 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:47.555328 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d42e4b92-29e9-433e-af84-d1caf2998363 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:47.555761 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d42e4b92-29e9-433e-af84-d1caf2998363 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:47.556436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d42e4b92-29e9-433e-af84-d1caf2998363 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:47.556887 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d42e4b92-29e9-433e-af84-d1caf2998363 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:47.557310 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d42e4b92-29e9-433e-af84-d1caf2998363 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:47.687495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d42e4b92-29e9-433e-af84-d1caf2998363 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:47.696067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d42e4b92-29e9-433e-af84-d1caf2998363 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.152807 Aug 24 12:50:47.696623 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1216/2431] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:47 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:47.960767 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-16b33d89-4fd7-4e32-b661-b075d1959aca tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:47.961309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-16b33d89-4fd7-4e32-b661-b075d1959aca tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:47.962561 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2d1c76c8-58c2-45f8-b57f-36196c475ffa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:47.963203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2d1c76c8-58c2-45f8-b57f-36196c475ffa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:47.967408 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-16b33d89-4fd7-4e32-b661-b075d1959aca tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:47.967884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-16b33d89-4fd7-4e32-b661-b075d1959aca tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:47.968315 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-16b33d89-4fd7-4e32-b661-b075d1959aca tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:47.968993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-16b33d89-4fd7-4e32-b661-b075d1959aca tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:47.969439 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-16b33d89-4fd7-4e32-b661-b075d1959aca tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:47.969547 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2d1c76c8-58c2-45f8-b57f-36196c475ffa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:47.969856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-16b33d89-4fd7-4e32-b661-b075d1959aca tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:47.969965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2d1c76c8-58c2-45f8-b57f-36196c475ffa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:47.970343 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2d1c76c8-58c2-45f8-b57f-36196c475ffa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:47.971128 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2d1c76c8-58c2-45f8-b57f-36196c475ffa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:47.971620 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2d1c76c8-58c2-45f8-b57f-36196c475ffa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:47.972051 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2d1c76c8-58c2-45f8-b57f-36196c475ffa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:48.100170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-16b33d89-4fd7-4e32-b661-b075d1959aca tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:48.101098 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2d1c76c8-58c2-45f8-b57f-36196c475ffa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:48.108728 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-16b33d89-4fd7-4e32-b661-b075d1959aca tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151798 Aug 24 12:50:48.109323 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1216/2432] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:47 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:48.109858 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2d1c76c8-58c2-45f8-b57f-36196c475ffa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:48.112010 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2d1c76c8-58c2-45f8-b57f-36196c475ffa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:48.113431 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2d1c76c8-58c2-45f8-b57f-36196c475ffa tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154835 Aug 24 12:50:48.126813 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1217/2433] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:47 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:50:48.127547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-64cc883d-3ab8-49fc-ada3-c07ea700ee7d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:48.127547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-64cc883d-3ab8-49fc-ada3-c07ea700ee7d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:48.127547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64cc883d-3ab8-49fc-ada3-c07ea700ee7d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:48.127547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64cc883d-3ab8-49fc-ada3-c07ea700ee7d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:48.127970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64cc883d-3ab8-49fc-ada3-c07ea700ee7d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:48.127970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64cc883d-3ab8-49fc-ada3-c07ea700ee7d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:48.127970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64cc883d-3ab8-49fc-ada3-c07ea700ee7d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:48.127970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64cc883d-3ab8-49fc-ada3-c07ea700ee7d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:48.253481 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-64cc883d-3ab8-49fc-ada3-c07ea700ee7d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:48.261946 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-64cc883d-3ab8-49fc-ada3-c07ea700ee7d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151030 Aug 24 12:50:48.262630 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1217/2434] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:48 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:48.717448 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d50b7131-30fb-4be9-9722-0b5734364ff6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:48.718063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d50b7131-30fb-4be9-9722-0b5734364ff6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:48.724871 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d50b7131-30fb-4be9-9722-0b5734364ff6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:48.725360 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d50b7131-30fb-4be9-9722-0b5734364ff6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:48.725799 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d50b7131-30fb-4be9-9722-0b5734364ff6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:48.726489 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d50b7131-30fb-4be9-9722-0b5734364ff6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:48.726981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d50b7131-30fb-4be9-9722-0b5734364ff6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:48.727414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d50b7131-30fb-4be9-9722-0b5734364ff6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:48.857584 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d50b7131-30fb-4be9-9722-0b5734364ff6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:48.866003 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d50b7131-30fb-4be9-9722-0b5734364ff6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.152466 Aug 24 12:50:48.866565 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1218/2435] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:48 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:49.130049 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2ae11547-a8d8-4e49-b962-692f2054f9b9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:49.130674 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2ae11547-a8d8-4e49-b962-692f2054f9b9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:49.137049 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ae11547-a8d8-4e49-b962-692f2054f9b9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:49.137339 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-37ac42fc-6c20-4c2a-b39a-0117ed54e65b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:49.137525 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ae11547-a8d8-4e49-b962-692f2054f9b9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:49.137950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-37ac42fc-6c20-4c2a-b39a-0117ed54e65b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:49.138077 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ae11547-a8d8-4e49-b962-692f2054f9b9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:49.138622 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ae11547-a8d8-4e49-b962-692f2054f9b9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:49.139093 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ae11547-a8d8-4e49-b962-692f2054f9b9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:49.139511 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ae11547-a8d8-4e49-b962-692f2054f9b9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:49.144455 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37ac42fc-6c20-4c2a-b39a-0117ed54e65b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:49.145103 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37ac42fc-6c20-4c2a-b39a-0117ed54e65b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:49.145539 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37ac42fc-6c20-4c2a-b39a-0117ed54e65b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:49.146230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37ac42fc-6c20-4c2a-b39a-0117ed54e65b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:49.146709 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37ac42fc-6c20-4c2a-b39a-0117ed54e65b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:49.147157 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37ac42fc-6c20-4c2a-b39a-0117ed54e65b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:49.271899 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2ae11547-a8d8-4e49-b962-692f2054f9b9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:49.280392 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2ae11547-a8d8-4e49-b962-692f2054f9b9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.154651 Aug 24 12:50:49.280970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1218/2436] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:49 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:49.285330 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-37ac42fc-6c20-4c2a-b39a-0117ed54e65b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:49.292381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7803078d-dad1-43bc-8852-2b047c44a0a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:49.292986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7803078d-dad1-43bc-8852-2b047c44a0a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:49.294542 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-37ac42fc-6c20-4c2a-b39a-0117ed54e65b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:49.295956 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-37ac42fc-6c20-4c2a-b39a-0117ed54e65b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:49.297120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-37ac42fc-6c20-4c2a-b39a-0117ed54e65b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.163599 Aug 24 12:50:49.297701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1219/2437] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:49 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:50:49.298961 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7803078d-dad1-43bc-8852-2b047c44a0a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:49.299440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7803078d-dad1-43bc-8852-2b047c44a0a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:49.300058 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7803078d-dad1-43bc-8852-2b047c44a0a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:49.300750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7803078d-dad1-43bc-8852-2b047c44a0a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:49.301201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7803078d-dad1-43bc-8852-2b047c44a0a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:49.301624 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7803078d-dad1-43bc-8852-2b047c44a0a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:49.431446 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7803078d-dad1-43bc-8852-2b047c44a0a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:49.439606 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7803078d-dad1-43bc-8852-2b047c44a0a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.157731 Aug 24 12:50:49.440166 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1219/2438] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:49 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:49.886963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c6719a5a-ae48-48d8-aa6c-1dbcbcc8a5e5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:49.887574 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c6719a5a-ae48-48d8-aa6c-1dbcbcc8a5e5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:49.894091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6719a5a-ae48-48d8-aa6c-1dbcbcc8a5e5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:49.894568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6719a5a-ae48-48d8-aa6c-1dbcbcc8a5e5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:49.895035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6719a5a-ae48-48d8-aa6c-1dbcbcc8a5e5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:49.895712 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6719a5a-ae48-48d8-aa6c-1dbcbcc8a5e5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:49.896159 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6719a5a-ae48-48d8-aa6c-1dbcbcc8a5e5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:49.896581 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c6719a5a-ae48-48d8-aa6c-1dbcbcc8a5e5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:50.023852 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c6719a5a-ae48-48d8-aa6c-1dbcbcc8a5e5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:50.031886 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c6719a5a-ae48-48d8-aa6c-1dbcbcc8a5e5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.148826 Aug 24 12:50:50.032434 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1220/2439] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:49 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:50.301770 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-64d82935-5234-486a-8d5c-04a696cc5aa0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:50.302381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-64d82935-5234-486a-8d5c-04a696cc5aa0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:50.308937 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64d82935-5234-486a-8d5c-04a696cc5aa0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:50.309418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64d82935-5234-486a-8d5c-04a696cc5aa0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:50.309854 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64d82935-5234-486a-8d5c-04a696cc5aa0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:50.310536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64d82935-5234-486a-8d5c-04a696cc5aa0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:50.311014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64d82935-5234-486a-8d5c-04a696cc5aa0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:50.311438 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64d82935-5234-486a-8d5c-04a696cc5aa0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:50.321259 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4dfe42aa-f692-412d-b62b-e451b08728f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:50.321870 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4dfe42aa-f692-412d-b62b-e451b08728f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:50.336237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4dfe42aa-f692-412d-b62b-e451b08728f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:50.336237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4dfe42aa-f692-412d-b62b-e451b08728f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:50.336237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4dfe42aa-f692-412d-b62b-e451b08728f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:50.336237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4dfe42aa-f692-412d-b62b-e451b08728f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:50.336595 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4dfe42aa-f692-412d-b62b-e451b08728f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:50.336595 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4dfe42aa-f692-412d-b62b-e451b08728f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:50.452391 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-64d82935-5234-486a-8d5c-04a696cc5aa0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:50.461207 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-64d82935-5234-486a-8d5c-04a696cc5aa0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.163785 Aug 24 12:50:50.461872 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1220/2440] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:50 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:50.466391 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fafbe0be-2702-44df-ab05-6954280df551 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:50.467145 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fafbe0be-2702-44df-ab05-6954280df551 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:50.471013 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4dfe42aa-f692-412d-b62b-e451b08728f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:50.473016 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fafbe0be-2702-44df-ab05-6954280df551 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:50.473499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fafbe0be-2702-44df-ab05-6954280df551 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:50.473932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fafbe0be-2702-44df-ab05-6954280df551 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:50.474614 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fafbe0be-2702-44df-ab05-6954280df551 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:50.475600 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fafbe0be-2702-44df-ab05-6954280df551 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:50.475600 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fafbe0be-2702-44df-ab05-6954280df551 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:50.480727 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4dfe42aa-f692-412d-b62b-e451b08728f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:50.482213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4dfe42aa-f692-412d-b62b-e451b08728f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:50.483402 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4dfe42aa-f692-412d-b62b-e451b08728f2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.165993 Aug 24 12:50:50.483969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1221/2441] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:50 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:50:50.605187 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fafbe0be-2702-44df-ab05-6954280df551 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:50.607383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:50:50.614299 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fafbe0be-2702-44df-ab05-6954280df551 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151424 Aug 24 12:50:50.624296 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1221/2442] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:50 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:51.053289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3c42a8b7-0a05-44fc-9b14-5cfda2a78072 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:51.053900 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3c42a8b7-0a05-44fc-9b14-5cfda2a78072 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:51.059910 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c42a8b7-0a05-44fc-9b14-5cfda2a78072 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:51.060333 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c42a8b7-0a05-44fc-9b14-5cfda2a78072 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:51.060766 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c42a8b7-0a05-44fc-9b14-5cfda2a78072 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:51.061555 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c42a8b7-0a05-44fc-9b14-5cfda2a78072 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:51.061904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c42a8b7-0a05-44fc-9b14-5cfda2a78072 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:51.062329 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3c42a8b7-0a05-44fc-9b14-5cfda2a78072 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:51.077442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:50:51.190969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3c42a8b7-0a05-44fc-9b14-5cfda2a78072 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:51.199061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3c42a8b7-0a05-44fc-9b14-5cfda2a78072 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150157 Aug 24 12:50:51.199612 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1222/2443] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:51 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:51.482138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c2f2318a-9aab-4fb7-a71e-f13dc6ad3649 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:51.482821 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c2f2318a-9aab-4fb7-a71e-f13dc6ad3649 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:51.490601 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2f2318a-9aab-4fb7-a71e-f13dc6ad3649 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:51.491203 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2f2318a-9aab-4fb7-a71e-f13dc6ad3649 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:51.491643 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2f2318a-9aab-4fb7-a71e-f13dc6ad3649 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:51.492358 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2f2318a-9aab-4fb7-a71e-f13dc6ad3649 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:51.492811 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2f2318a-9aab-4fb7-a71e-f13dc6ad3649 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:51.493296 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c2f2318a-9aab-4fb7-a71e-f13dc6ad3649 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:51.506049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-acf39156-231a-4256-bb8e-e335ac3dbfe7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:51.506836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-acf39156-231a-4256-bb8e-e335ac3dbfe7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:51.513113 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-acf39156-231a-4256-bb8e-e335ac3dbfe7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:51.513623 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-acf39156-231a-4256-bb8e-e335ac3dbfe7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:51.514063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-acf39156-231a-4256-bb8e-e335ac3dbfe7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:51.514785 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-acf39156-231a-4256-bb8e-e335ac3dbfe7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:51.515247 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-acf39156-231a-4256-bb8e-e335ac3dbfe7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:51.515675 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-acf39156-231a-4256-bb8e-e335ac3dbfe7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:51.626452 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c2f2318a-9aab-4fb7-a71e-f13dc6ad3649 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:51.635092 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c2f2318a-9aab-4fb7-a71e-f13dc6ad3649 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.156673 Aug 24 12:50:51.635729 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1222/2444] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:51 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:51.643979 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-289a6470-3a8b-49e6-a6e5-e8f15bda6b43 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:51.644702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-289a6470-3a8b-49e6-a6e5-e8f15bda6b43 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:51.651213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-289a6470-3a8b-49e6-a6e5-e8f15bda6b43 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:51.651789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-289a6470-3a8b-49e6-a6e5-e8f15bda6b43 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:51.652340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-289a6470-3a8b-49e6-a6e5-e8f15bda6b43 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:51.653126 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-289a6470-3a8b-49e6-a6e5-e8f15bda6b43 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:51.653469 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-acf39156-231a-4256-bb8e-e335ac3dbfe7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:51.653754 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-289a6470-3a8b-49e6-a6e5-e8f15bda6b43 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:51.654275 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-289a6470-3a8b-49e6-a6e5-e8f15bda6b43 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:51.663258 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-acf39156-231a-4256-bb8e-e335ac3dbfe7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:51.664854 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-acf39156-231a-4256-bb8e-e335ac3dbfe7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:51.666128 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-acf39156-231a-4256-bb8e-e335ac3dbfe7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.164049 Aug 24 12:50:51.666709 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1223/2445] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:51 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:50:51.843707 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-289a6470-3a8b-49e6-a6e5-e8f15bda6b43 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:51.852348 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-289a6470-3a8b-49e6-a6e5-e8f15bda6b43 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.212914 Aug 24 12:50:51.852910 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1223/2446] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:51 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:52.219999 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c8736383-a08b-4a30-b1b9-d956d0104f7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:52.220636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c8736383-a08b-4a30-b1b9-d956d0104f7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:52.226563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c8736383-a08b-4a30-b1b9-d956d0104f7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:52.227153 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c8736383-a08b-4a30-b1b9-d956d0104f7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:52.227586 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c8736383-a08b-4a30-b1b9-d956d0104f7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:52.228261 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c8736383-a08b-4a30-b1b9-d956d0104f7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:52.228712 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c8736383-a08b-4a30-b1b9-d956d0104f7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:52.229131 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c8736383-a08b-4a30-b1b9-d956d0104f7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:52.355581 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c8736383-a08b-4a30-b1b9-d956d0104f7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:52.364522 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c8736383-a08b-4a30-b1b9-d956d0104f7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.148373 Aug 24 12:50:52.365076 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1224/2447] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:52 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:52.657150 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d8990ed5-a293-4d03-aa88-b8257d661a7f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:52.657766 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d8990ed5-a293-4d03-aa88-b8257d661a7f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:52.660686 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:50:52.665319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8990ed5-a293-4d03-aa88-b8257d661a7f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:52.665801 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8990ed5-a293-4d03-aa88-b8257d661a7f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:52.666238 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8990ed5-a293-4d03-aa88-b8257d661a7f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:52.666948 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8990ed5-a293-4d03-aa88-b8257d661a7f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:52.667405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8990ed5-a293-4d03-aa88-b8257d661a7f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:52.667833 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8990ed5-a293-4d03-aa88-b8257d661a7f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:52.689403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2e9c3be9-4eef-4ac9-8297-9cfde8b795a9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:52.690053 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2e9c3be9-4eef-4ac9-8297-9cfde8b795a9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:52.696346 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2e9c3be9-4eef-4ac9-8297-9cfde8b795a9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:52.696829 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2e9c3be9-4eef-4ac9-8297-9cfde8b795a9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:52.697262 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2e9c3be9-4eef-4ac9-8297-9cfde8b795a9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:52.697939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2e9c3be9-4eef-4ac9-8297-9cfde8b795a9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:52.698387 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2e9c3be9-4eef-4ac9-8297-9cfde8b795a9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:52.698860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2e9c3be9-4eef-4ac9-8297-9cfde8b795a9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:52.797083 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d8990ed5-a293-4d03-aa88-b8257d661a7f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:52.805977 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d8990ed5-a293-4d03-aa88-b8257d661a7f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152637 Aug 24 12:50:52.806544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1224/2448] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:52 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:52.832531 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2e9c3be9-4eef-4ac9-8297-9cfde8b795a9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:52.841075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2e9c3be9-4eef-4ac9-8297-9cfde8b795a9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:52.842574 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2e9c3be9-4eef-4ac9-8297-9cfde8b795a9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:52.843740 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2e9c3be9-4eef-4ac9-8297-9cfde8b795a9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.158385 Aug 24 12:50:52.844311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1225/2449] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:52 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:50:52.872885 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b6c9d17b-d9e8-4dd5-8470-89f652f00671 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:52.873484 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b6c9d17b-d9e8-4dd5-8470-89f652f00671 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:52.879322 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6c9d17b-d9e8-4dd5-8470-89f652f00671 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:52.879796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6c9d17b-d9e8-4dd5-8470-89f652f00671 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:52.880223 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6c9d17b-d9e8-4dd5-8470-89f652f00671 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:52.880896 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6c9d17b-d9e8-4dd5-8470-89f652f00671 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:52.881344 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6c9d17b-d9e8-4dd5-8470-89f652f00671 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:52.881762 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6c9d17b-d9e8-4dd5-8470-89f652f00671 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:53.006497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b6c9d17b-d9e8-4dd5-8470-89f652f00671 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:53.014748 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b6c9d17b-d9e8-4dd5-8470-89f652f00671 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.145548 Aug 24 12:50:53.015310 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1225/2450] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:52 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:53.386214 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f1cc98b8-1103-48dd-b823-26921fc9cd23 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:53.386874 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f1cc98b8-1103-48dd-b823-26921fc9cd23 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:53.392830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1cc98b8-1103-48dd-b823-26921fc9cd23 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:53.397938 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1cc98b8-1103-48dd-b823-26921fc9cd23 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:53.397938 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1cc98b8-1103-48dd-b823-26921fc9cd23 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:53.397938 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1cc98b8-1103-48dd-b823-26921fc9cd23 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:53.397938 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1cc98b8-1103-48dd-b823-26921fc9cd23 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:53.398362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1cc98b8-1103-48dd-b823-26921fc9cd23 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:53.532643 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f1cc98b8-1103-48dd-b823-26921fc9cd23 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:53.541473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f1cc98b8-1103-48dd-b823-26921fc9cd23 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.159374 Aug 24 12:50:53.542035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1226/2451] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:53 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:53.827164 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-752942c5-690a-48b8-b6dd-505c041321d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:53.827774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-752942c5-690a-48b8-b6dd-505c041321d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:53.834783 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-752942c5-690a-48b8-b6dd-505c041321d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:53.835259 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-752942c5-690a-48b8-b6dd-505c041321d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:53.835689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-752942c5-690a-48b8-b6dd-505c041321d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:53.836365 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-752942c5-690a-48b8-b6dd-505c041321d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:53.836816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-752942c5-690a-48b8-b6dd-505c041321d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:53.837238 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-752942c5-690a-48b8-b6dd-505c041321d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:53.868599 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b6a7c443-1d9e-4867-9eaa-d658c572a3cd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:53.869205 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b6a7c443-1d9e-4867-9eaa-d658c572a3cd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:53.876082 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b6a7c443-1d9e-4867-9eaa-d658c572a3cd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:53.876565 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b6a7c443-1d9e-4867-9eaa-d658c572a3cd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:53.876994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b6a7c443-1d9e-4867-9eaa-d658c572a3cd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:53.877677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b6a7c443-1d9e-4867-9eaa-d658c572a3cd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:53.878123 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b6a7c443-1d9e-4867-9eaa-d658c572a3cd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:53.878541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b6a7c443-1d9e-4867-9eaa-d658c572a3cd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:53.968901 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-752942c5-690a-48b8-b6dd-505c041321d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:53.977846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-752942c5-690a-48b8-b6dd-505c041321d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.154546 Aug 24 12:50:53.978515 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1226/2452] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:53 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:54.007922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b6a7c443-1d9e-4867-9eaa-d658c572a3cd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:54.016334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b6a7c443-1d9e-4867-9eaa-d658c572a3cd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:54.017836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b6a7c443-1d9e-4867-9eaa-d658c572a3cd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:54.019630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b6a7c443-1d9e-4867-9eaa-d658c572a3cd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154960 Aug 24 12:50:54.020175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1227/2453] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:53 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:50:54.036401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5d6b34f2-a399-44d8-b18b-ac359a9b6387 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:54.037006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5d6b34f2-a399-44d8-b18b-ac359a9b6387 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:54.042909 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d6b34f2-a399-44d8-b18b-ac359a9b6387 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:54.043390 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d6b34f2-a399-44d8-b18b-ac359a9b6387 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:54.043827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d6b34f2-a399-44d8-b18b-ac359a9b6387 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:54.044503 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d6b34f2-a399-44d8-b18b-ac359a9b6387 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:54.044956 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d6b34f2-a399-44d8-b18b-ac359a9b6387 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:54.045371 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d6b34f2-a399-44d8-b18b-ac359a9b6387 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:54.173057 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5d6b34f2-a399-44d8-b18b-ac359a9b6387 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:54.181524 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5d6b34f2-a399-44d8-b18b-ac359a9b6387 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149508 Aug 24 12:50:54.183892 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1227/2454] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:54 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:54.564728 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bb5c9eb7-0bd3-4ecc-a886-613b2f7e8bdb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:54.565925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bb5c9eb7-0bd3-4ecc-a886-613b2f7e8bdb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:54.572056 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb5c9eb7-0bd3-4ecc-a886-613b2f7e8bdb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:54.572548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb5c9eb7-0bd3-4ecc-a886-613b2f7e8bdb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:54.572990 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb5c9eb7-0bd3-4ecc-a886-613b2f7e8bdb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:54.573684 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb5c9eb7-0bd3-4ecc-a886-613b2f7e8bdb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:54.574147 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb5c9eb7-0bd3-4ecc-a886-613b2f7e8bdb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:54.574595 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb5c9eb7-0bd3-4ecc-a886-613b2f7e8bdb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:54.702912 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bb5c9eb7-0bd3-4ecc-a886-613b2f7e8bdb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:54.711034 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bb5c9eb7-0bd3-4ecc-a886-613b2f7e8bdb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150131 Aug 24 12:50:54.711625 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1228/2455] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:54 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:54.999228 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-dd06bd57-44ad-4459-9c16-1750a9fbe3f4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:54.999835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-dd06bd57-44ad-4459-9c16-1750a9fbe3f4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:55.006105 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd06bd57-44ad-4459-9c16-1750a9fbe3f4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:55.006583 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd06bd57-44ad-4459-9c16-1750a9fbe3f4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:55.007057 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd06bd57-44ad-4459-9c16-1750a9fbe3f4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:55.007717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd06bd57-44ad-4459-9c16-1750a9fbe3f4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:55.008161 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd06bd57-44ad-4459-9c16-1750a9fbe3f4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:55.008585 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd06bd57-44ad-4459-9c16-1750a9fbe3f4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:55.041873 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8ff0fa3d-69c4-43a1-af8e-44f22b8c18cb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:55.042481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8ff0fa3d-69c4-43a1-af8e-44f22b8c18cb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:55.048931 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8ff0fa3d-69c4-43a1-af8e-44f22b8c18cb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:55.050086 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8ff0fa3d-69c4-43a1-af8e-44f22b8c18cb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:55.050529 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8ff0fa3d-69c4-43a1-af8e-44f22b8c18cb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:55.051251 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8ff0fa3d-69c4-43a1-af8e-44f22b8c18cb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:55.051710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8ff0fa3d-69c4-43a1-af8e-44f22b8c18cb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:55.052136 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8ff0fa3d-69c4-43a1-af8e-44f22b8c18cb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:55.186080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8ff0fa3d-69c4-43a1-af8e-44f22b8c18cb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:55.195167 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8ff0fa3d-69c4-43a1-af8e-44f22b8c18cb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:55.198328 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8ff0fa3d-69c4-43a1-af8e-44f22b8c18cb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:55.199579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8ff0fa3d-69c4-43a1-af8e-44f22b8c18cb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.161520 Aug 24 12:50:55.200148 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1229/2456] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:55 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:50:55.204875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0526c8df-9a42-4c20-8007-204943213a87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:55.205488 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0526c8df-9a42-4c20-8007-204943213a87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:55.212183 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0526c8df-9a42-4c20-8007-204943213a87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:55.212680 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0526c8df-9a42-4c20-8007-204943213a87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:55.213122 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0526c8df-9a42-4c20-8007-204943213a87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:55.214025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0526c8df-9a42-4c20-8007-204943213a87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:55.214487 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0526c8df-9a42-4c20-8007-204943213a87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:55.214946 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0526c8df-9a42-4c20-8007-204943213a87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:55.352589 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0526c8df-9a42-4c20-8007-204943213a87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:55.360992 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0526c8df-9a42-4c20-8007-204943213a87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.159856 Aug 24 12:50:55.361654 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1230/2457] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:55 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:55.381370 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-dd06bd57-44ad-4459-9c16-1750a9fbe3f4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:55.389626 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-dd06bd57-44ad-4459-9c16-1750a9fbe3f4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.394177 Aug 24 12:50:55.390184 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1228/2458] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:54 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:55.731903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9582730e-003e-4430-bf50-7d549ba74976 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:55.732519 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9582730e-003e-4430-bf50-7d549ba74976 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:55.738841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9582730e-003e-4430-bf50-7d549ba74976 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:55.739327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9582730e-003e-4430-bf50-7d549ba74976 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:55.739769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9582730e-003e-4430-bf50-7d549ba74976 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:55.740454 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9582730e-003e-4430-bf50-7d549ba74976 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:55.740924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9582730e-003e-4430-bf50-7d549ba74976 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:55.741355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9582730e-003e-4430-bf50-7d549ba74976 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:55.867686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9582730e-003e-4430-bf50-7d549ba74976 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:55.875903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9582730e-003e-4430-bf50-7d549ba74976 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147873 Aug 24 12:50:55.876459 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1231/2459] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:55 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:56.223342 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f23ecd76-5db8-45a8-ad1a-b1f274317ed8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:56.223953 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f23ecd76-5db8-45a8-ad1a-b1f274317ed8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:56.230380 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f23ecd76-5db8-45a8-ad1a-b1f274317ed8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:56.230903 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f23ecd76-5db8-45a8-ad1a-b1f274317ed8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:56.231340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f23ecd76-5db8-45a8-ad1a-b1f274317ed8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:56.232032 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f23ecd76-5db8-45a8-ad1a-b1f274317ed8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:56.232486 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f23ecd76-5db8-45a8-ad1a-b1f274317ed8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:56.232915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f23ecd76-5db8-45a8-ad1a-b1f274317ed8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:56.357253 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f23ecd76-5db8-45a8-ad1a-b1f274317ed8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:56.366134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f23ecd76-5db8-45a8-ad1a-b1f274317ed8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:56.367650 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f23ecd76-5db8-45a8-ad1a-b1f274317ed8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:56.368807 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f23ecd76-5db8-45a8-ad1a-b1f274317ed8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.150070 Aug 24 12:50:56.369360 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1229/2460] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:56 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:56.382487 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c31d9ebf-2b11-4eb9-8c3f-195ff21b0a26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:56.383118 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c31d9ebf-2b11-4eb9-8c3f-195ff21b0a26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:56.389328 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c31d9ebf-2b11-4eb9-8c3f-195ff21b0a26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:56.389808 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c31d9ebf-2b11-4eb9-8c3f-195ff21b0a26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:56.390239 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c31d9ebf-2b11-4eb9-8c3f-195ff21b0a26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:56.390951 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c31d9ebf-2b11-4eb9-8c3f-195ff21b0a26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:56.391403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c31d9ebf-2b11-4eb9-8c3f-195ff21b0a26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:56.391823 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c31d9ebf-2b11-4eb9-8c3f-195ff21b0a26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:56.410907 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-37c24596-ffdb-4fe8-bf85-9176b0c3ddb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:56.411596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-37c24596-ffdb-4fe8-bf85-9176b0c3ddb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:56.417455 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37c24596-ffdb-4fe8-bf85-9176b0c3ddb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:56.417966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37c24596-ffdb-4fe8-bf85-9176b0c3ddb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:56.418403 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37c24596-ffdb-4fe8-bf85-9176b0c3ddb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:56.419188 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37c24596-ffdb-4fe8-bf85-9176b0c3ddb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:56.419640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37c24596-ffdb-4fe8-bf85-9176b0c3ddb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:56.420063 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37c24596-ffdb-4fe8-bf85-9176b0c3ddb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:56.525551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c31d9ebf-2b11-4eb9-8c3f-195ff21b0a26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:56.533792 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c31d9ebf-2b11-4eb9-8c3f-195ff21b0a26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.155110 Aug 24 12:50:56.534350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1232/2461] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:56 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:56.552385 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-37c24596-ffdb-4fe8-bf85-9176b0c3ddb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:56.560450 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-37c24596-ffdb-4fe8-bf85-9176b0c3ddb6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.153387 Aug 24 12:50:56.561004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1230/2462] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:56 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:56.896622 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-886fb9d4-bf6d-487d-81fc-0177788c17f1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:56.897237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-886fb9d4-bf6d-487d-81fc-0177788c17f1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:56.903172 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-886fb9d4-bf6d-487d-81fc-0177788c17f1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:56.903660 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-886fb9d4-bf6d-487d-81fc-0177788c17f1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:56.904106 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-886fb9d4-bf6d-487d-81fc-0177788c17f1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:56.904794 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-886fb9d4-bf6d-487d-81fc-0177788c17f1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:56.905256 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-886fb9d4-bf6d-487d-81fc-0177788c17f1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:56.905686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-886fb9d4-bf6d-487d-81fc-0177788c17f1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:57.030091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-886fb9d4-bf6d-487d-81fc-0177788c17f1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:57.038167 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-886fb9d4-bf6d-487d-81fc-0177788c17f1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.145489 Aug 24 12:50:57.038748 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1233/2463] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:56 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:57.392122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cbdd265e-c86f-4d0d-ae4e-bdd6ef30788a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:57.392725 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cbdd265e-c86f-4d0d-ae4e-bdd6ef30788a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:57.399134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cbdd265e-c86f-4d0d-ae4e-bdd6ef30788a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:57.399605 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cbdd265e-c86f-4d0d-ae4e-bdd6ef30788a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:57.400034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cbdd265e-c86f-4d0d-ae4e-bdd6ef30788a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:57.400698 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cbdd265e-c86f-4d0d-ae4e-bdd6ef30788a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:57.401144 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cbdd265e-c86f-4d0d-ae4e-bdd6ef30788a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:57.401557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cbdd265e-c86f-4d0d-ae4e-bdd6ef30788a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:57.526479 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cbdd265e-c86f-4d0d-ae4e-bdd6ef30788a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:57.535794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cbdd265e-c86f-4d0d-ae4e-bdd6ef30788a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:57.537299 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cbdd265e-c86f-4d0d-ae4e-bdd6ef30788a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:57.538503 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cbdd265e-c86f-4d0d-ae4e-bdd6ef30788a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.150261 Aug 24 12:50:57.539080 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1231/2464] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:57 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:57.554436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2db14533-4777-429d-bd99-b858c4ddb3a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:57.555108 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2db14533-4777-429d-bd99-b858c4ddb3a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:57.561356 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2db14533-4777-429d-bd99-b858c4ddb3a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:57.561830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2db14533-4777-429d-bd99-b858c4ddb3a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:57.562259 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2db14533-4777-429d-bd99-b858c4ddb3a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:57.562981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2db14533-4777-429d-bd99-b858c4ddb3a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:57.563432 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2db14533-4777-429d-bd99-b858c4ddb3a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:57.563851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2db14533-4777-429d-bd99-b858c4ddb3a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:57.581925 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-184b6206-290d-4299-8163-223cc60628c6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:57.582539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-184b6206-290d-4299-8163-223cc60628c6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:57.588540 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-184b6206-290d-4299-8163-223cc60628c6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:57.589026 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-184b6206-290d-4299-8163-223cc60628c6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:57.589466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-184b6206-290d-4299-8163-223cc60628c6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:57.590155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-184b6206-290d-4299-8163-223cc60628c6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:57.590610 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-184b6206-290d-4299-8163-223cc60628c6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:57.591081 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-184b6206-290d-4299-8163-223cc60628c6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:57.704106 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2db14533-4777-429d-bd99-b858c4ddb3a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:57.713497 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2db14533-4777-429d-bd99-b858c4ddb3a8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.162855 Aug 24 12:50:57.714397 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1234/2465] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:57 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:57.734133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-184b6206-290d-4299-8163-223cc60628c6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:57.742705 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-184b6206-290d-4299-8163-223cc60628c6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.165119 Aug 24 12:50:57.743275 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1232/2466] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:57 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:58.059515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3ee4b6fa-7e54-4531-8a88-dade119184f5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:58.060123 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3ee4b6fa-7e54-4531-8a88-dade119184f5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:58.066044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ee4b6fa-7e54-4531-8a88-dade119184f5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:58.066530 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ee4b6fa-7e54-4531-8a88-dade119184f5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:58.067083 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ee4b6fa-7e54-4531-8a88-dade119184f5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:58.067762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ee4b6fa-7e54-4531-8a88-dade119184f5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:58.068212 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ee4b6fa-7e54-4531-8a88-dade119184f5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:58.068684 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ee4b6fa-7e54-4531-8a88-dade119184f5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:58.197285 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3ee4b6fa-7e54-4531-8a88-dade119184f5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:58.205324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3ee4b6fa-7e54-4531-8a88-dade119184f5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149615 Aug 24 12:50:58.205904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1235/2467] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:58 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:58.561346 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c12b08b8-eb74-486c-b198-bbb4e4452adf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:58.561982 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c12b08b8-eb74-486c-b198-bbb4e4452adf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:58.569025 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c12b08b8-eb74-486c-b198-bbb4e4452adf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:58.569499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c12b08b8-eb74-486c-b198-bbb4e4452adf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:58.569935 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c12b08b8-eb74-486c-b198-bbb4e4452adf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:58.570614 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c12b08b8-eb74-486c-b198-bbb4e4452adf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:58.571090 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c12b08b8-eb74-486c-b198-bbb4e4452adf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:58.571511 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c12b08b8-eb74-486c-b198-bbb4e4452adf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:58.695983 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c12b08b8-eb74-486c-b198-bbb4e4452adf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:58.704515 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c12b08b8-eb74-486c-b198-bbb4e4452adf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:58.705996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c12b08b8-eb74-486c-b198-bbb4e4452adf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:58.707175 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c12b08b8-eb74-486c-b198-bbb4e4452adf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.149711 Aug 24 12:50:58.707730 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1233/2468] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:58 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:58.735129 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ba0d8374-e1d5-4037-a63c-5c6f897e00a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:58.735737 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ba0d8374-e1d5-4037-a63c-5c6f897e00a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:58.742918 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba0d8374-e1d5-4037-a63c-5c6f897e00a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:58.743399 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba0d8374-e1d5-4037-a63c-5c6f897e00a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:58.743829 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba0d8374-e1d5-4037-a63c-5c6f897e00a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:58.744508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba0d8374-e1d5-4037-a63c-5c6f897e00a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:58.744956 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba0d8374-e1d5-4037-a63c-5c6f897e00a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:58.745377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba0d8374-e1d5-4037-a63c-5c6f897e00a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:58.763077 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0602f2fa-a2ad-441b-8dca-84bee47f972d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:58.763866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0602f2fa-a2ad-441b-8dca-84bee47f972d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:58.769850 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0602f2fa-a2ad-441b-8dca-84bee47f972d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:58.770327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0602f2fa-a2ad-441b-8dca-84bee47f972d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:58.770780 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0602f2fa-a2ad-441b-8dca-84bee47f972d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:58.771454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0602f2fa-a2ad-441b-8dca-84bee47f972d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:58.771958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0602f2fa-a2ad-441b-8dca-84bee47f972d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:58.772380 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0602f2fa-a2ad-441b-8dca-84bee47f972d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:58.876918 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ba0d8374-e1d5-4037-a63c-5c6f897e00a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:58.885341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ba0d8374-e1d5-4037-a63c-5c6f897e00a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153943 Aug 24 12:50:58.885904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1236/2469] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:58 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:58.913354 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0602f2fa-a2ad-441b-8dca-84bee47f972d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:58.921419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0602f2fa-a2ad-441b-8dca-84bee47f972d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.162350 Aug 24 12:50:58.921974 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1234/2470] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:58 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:50:59.226548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-eaf6ec8e-2323-448e-8a7c-f7fd6a725b2e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:59.227390 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-eaf6ec8e-2323-448e-8a7c-f7fd6a725b2e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:59.233739 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eaf6ec8e-2323-448e-8a7c-f7fd6a725b2e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:59.234321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eaf6ec8e-2323-448e-8a7c-f7fd6a725b2e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:59.234884 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eaf6ec8e-2323-448e-8a7c-f7fd6a725b2e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:59.235575 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eaf6ec8e-2323-448e-8a7c-f7fd6a725b2e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:59.236036 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eaf6ec8e-2323-448e-8a7c-f7fd6a725b2e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:59.236695 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eaf6ec8e-2323-448e-8a7c-f7fd6a725b2e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:59.370845 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-eaf6ec8e-2323-448e-8a7c-f7fd6a725b2e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:59.379389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-eaf6ec8e-2323-448e-8a7c-f7fd6a725b2e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.157131 Aug 24 12:50:59.379942 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1237/2471] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:59 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:50:59.730432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b1c6577e-212c-455c-bfe8-2d8c150a5ab9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:59.731087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b1c6577e-212c-455c-bfe8-2d8c150a5ab9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:59.738272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b1c6577e-212c-455c-bfe8-2d8c150a5ab9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:59.738757 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b1c6577e-212c-455c-bfe8-2d8c150a5ab9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:59.739193 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b1c6577e-212c-455c-bfe8-2d8c150a5ab9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:59.739867 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b1c6577e-212c-455c-bfe8-2d8c150a5ab9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:59.740316 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b1c6577e-212c-455c-bfe8-2d8c150a5ab9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:59.740733 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b1c6577e-212c-455c-bfe8-2d8c150a5ab9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:59.870989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b1c6577e-212c-455c-bfe8-2d8c150a5ab9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:59.879885 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b1c6577e-212c-455c-bfe8-2d8c150a5ab9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:59.881374 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b1c6577e-212c-455c-bfe8-2d8c150a5ab9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:50:59.882532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b1c6577e-212c-455c-bfe8-2d8c150a5ab9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.156004 Aug 24 12:50:59.883118 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1235/2472] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:50:59 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:50:59.905883 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9a509783-c5b8-4f1c-b8c5-3bd48803c615 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:59.906689 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9a509783-c5b8-4f1c-b8c5-3bd48803c615 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:59.913540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a509783-c5b8-4f1c-b8c5-3bd48803c615 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:59.914012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a509783-c5b8-4f1c-b8c5-3bd48803c615 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:59.914441 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a509783-c5b8-4f1c-b8c5-3bd48803c615 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:59.915138 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a509783-c5b8-4f1c-b8c5-3bd48803c615 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:59.915589 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a509783-c5b8-4f1c-b8c5-3bd48803c615 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:59.916010 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9a509783-c5b8-4f1c-b8c5-3bd48803c615 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:59.942591 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e0cd37e0-0ad7-42c1-af2f-c2c8ada36e2f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:50:59.943233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e0cd37e0-0ad7-42c1-af2f-c2c8ada36e2f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:50:59.949186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0cd37e0-0ad7-42c1-af2f-c2c8ada36e2f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:59.949671 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0cd37e0-0ad7-42c1-af2f-c2c8ada36e2f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:59.950109 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0cd37e0-0ad7-42c1-af2f-c2c8ada36e2f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:50:59.950823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0cd37e0-0ad7-42c1-af2f-c2c8ada36e2f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:50:59.951280 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0cd37e0-0ad7-42c1-af2f-c2c8ada36e2f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:50:59.951710 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e0cd37e0-0ad7-42c1-af2f-c2c8ada36e2f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:00.043610 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9a509783-c5b8-4f1c-b8c5-3bd48803c615 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:00.052288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9a509783-c5b8-4f1c-b8c5-3bd48803c615 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150196 Aug 24 12:51:00.052850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1238/2473] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:59 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:00.080496 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e0cd37e0-0ad7-42c1-af2f-c2c8ada36e2f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:00.088611 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e0cd37e0-0ad7-42c1-af2f-c2c8ada36e2f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149827 Aug 24 12:51:00.089159 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1236/2474] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:50:59 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:00.400204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bdf92421-7ed7-458f-8d10-b1625a17a2df tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:00.400765 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bdf92421-7ed7-458f-8d10-b1625a17a2df tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:00.406538 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bdf92421-7ed7-458f-8d10-b1625a17a2df tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:00.407046 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bdf92421-7ed7-458f-8d10-b1625a17a2df tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:00.407479 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bdf92421-7ed7-458f-8d10-b1625a17a2df tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:00.408157 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bdf92421-7ed7-458f-8d10-b1625a17a2df tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:00.408609 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bdf92421-7ed7-458f-8d10-b1625a17a2df tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:00.409028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bdf92421-7ed7-458f-8d10-b1625a17a2df tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:00.411482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:51:00.534339 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bdf92421-7ed7-458f-8d10-b1625a17a2df tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:00.542353 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bdf92421-7ed7-458f-8d10-b1625a17a2df tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.146071 Aug 24 12:51:00.542993 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1239/2475] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:00 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:00.905888 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7bbbc0c4-1251-4d72-a102-0e28bb2bfa05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:00.906509 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7bbbc0c4-1251-4d72-a102-0e28bb2bfa05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:00.913551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7bbbc0c4-1251-4d72-a102-0e28bb2bfa05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:00.914058 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7bbbc0c4-1251-4d72-a102-0e28bb2bfa05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:00.914480 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7bbbc0c4-1251-4d72-a102-0e28bb2bfa05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:00.915197 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7bbbc0c4-1251-4d72-a102-0e28bb2bfa05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:00.915652 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7bbbc0c4-1251-4d72-a102-0e28bb2bfa05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:00.916082 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7bbbc0c4-1251-4d72-a102-0e28bb2bfa05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:01.051248 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7bbbc0c4-1251-4d72-a102-0e28bb2bfa05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:01.059674 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7bbbc0c4-1251-4d72-a102-0e28bb2bfa05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:01.061163 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7bbbc0c4-1251-4d72-a102-0e28bb2bfa05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:01.062310 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7bbbc0c4-1251-4d72-a102-0e28bb2bfa05 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.160378 Aug 24 12:51:01.062909 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1237/2476] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:00 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:01.073177 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2df3e808-0d70-4ac0-8167-17ea57f2b0d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:01.073791 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2df3e808-0d70-4ac0-8167-17ea57f2b0d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:01.080192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2df3e808-0d70-4ac0-8167-17ea57f2b0d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:01.080677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2df3e808-0d70-4ac0-8167-17ea57f2b0d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:01.081120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2df3e808-0d70-4ac0-8167-17ea57f2b0d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:01.081808 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2df3e808-0d70-4ac0-8167-17ea57f2b0d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:01.082269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2df3e808-0d70-4ac0-8167-17ea57f2b0d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:01.082733 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2df3e808-0d70-4ac0-8167-17ea57f2b0d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:01.109515 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d636d296-00ff-41c5-90e5-f02cc22d8f35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:01.110124 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d636d296-00ff-41c5-90e5-f02cc22d8f35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:01.116863 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d636d296-00ff-41c5-90e5-f02cc22d8f35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:01.117344 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d636d296-00ff-41c5-90e5-f02cc22d8f35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:01.117778 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d636d296-00ff-41c5-90e5-f02cc22d8f35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:01.118456 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d636d296-00ff-41c5-90e5-f02cc22d8f35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:01.118927 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d636d296-00ff-41c5-90e5-f02cc22d8f35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:01.119352 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d636d296-00ff-41c5-90e5-f02cc22d8f35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:01.136076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:51:01.214784 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2df3e808-0d70-4ac0-8167-17ea57f2b0d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:01.223825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2df3e808-0d70-4ac0-8167-17ea57f2b0d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.154443 Aug 24 12:51:01.224390 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1240/2477] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:01 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:01.249939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d636d296-00ff-41c5-90e5-f02cc22d8f35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:01.257984 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d636d296-00ff-41c5-90e5-f02cc22d8f35 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152298 Aug 24 12:51:01.258532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1238/2478] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:01 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:01.563285 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-268a3064-4aed-4347-9ad2-cff6a9f3e005 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:01.569937 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-268a3064-4aed-4347-9ad2-cff6a9f3e005 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:01.569937 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-268a3064-4aed-4347-9ad2-cff6a9f3e005 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:01.570187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-268a3064-4aed-4347-9ad2-cff6a9f3e005 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:01.570607 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-268a3064-4aed-4347-9ad2-cff6a9f3e005 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:01.571320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-268a3064-4aed-4347-9ad2-cff6a9f3e005 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:01.571779 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-268a3064-4aed-4347-9ad2-cff6a9f3e005 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:01.572208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-268a3064-4aed-4347-9ad2-cff6a9f3e005 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:01.701897 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-268a3064-4aed-4347-9ad2-cff6a9f3e005 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:01.710582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-268a3064-4aed-4347-9ad2-cff6a9f3e005 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151164 Aug 24 12:51:01.711180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1241/2479] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:01 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:02.084832 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0569e0cd-bad1-48e8-8e9e-ea6db366263c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:02.085435 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0569e0cd-bad1-48e8-8e9e-ea6db366263c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:02.091846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0569e0cd-bad1-48e8-8e9e-ea6db366263c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:02.092323 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0569e0cd-bad1-48e8-8e9e-ea6db366263c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:02.092753 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0569e0cd-bad1-48e8-8e9e-ea6db366263c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:02.093432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0569e0cd-bad1-48e8-8e9e-ea6db366263c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:02.093881 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0569e0cd-bad1-48e8-8e9e-ea6db366263c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:02.094305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0569e0cd-bad1-48e8-8e9e-ea6db366263c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:02.220755 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0569e0cd-bad1-48e8-8e9e-ea6db366263c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:02.229507 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0569e0cd-bad1-48e8-8e9e-ea6db366263c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:02.231051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0569e0cd-bad1-48e8-8e9e-ea6db366263c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:02.232259 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0569e0cd-bad1-48e8-8e9e-ea6db366263c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.151245 Aug 24 12:51:02.232804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1239/2480] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:02 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:02.245109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2d450e92-dbbd-48c7-8408-6eb7ef4c5ef8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:02.245721 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2d450e92-dbbd-48c7-8408-6eb7ef4c5ef8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:02.252089 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2d450e92-dbbd-48c7-8408-6eb7ef4c5ef8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:02.253121 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2d450e92-dbbd-48c7-8408-6eb7ef4c5ef8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:02.253559 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2d450e92-dbbd-48c7-8408-6eb7ef4c5ef8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:02.254241 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2d450e92-dbbd-48c7-8408-6eb7ef4c5ef8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:02.254727 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2d450e92-dbbd-48c7-8408-6eb7ef4c5ef8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:02.255154 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2d450e92-dbbd-48c7-8408-6eb7ef4c5ef8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:02.280031 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ef2a25da-f4ab-4c5d-9105-031633aa329b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:02.280639 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ef2a25da-f4ab-4c5d-9105-031633aa329b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:02.287108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef2a25da-f4ab-4c5d-9105-031633aa329b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:02.287593 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef2a25da-f4ab-4c5d-9105-031633aa329b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:02.288025 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef2a25da-f4ab-4c5d-9105-031633aa329b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:02.288711 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef2a25da-f4ab-4c5d-9105-031633aa329b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:02.289160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef2a25da-f4ab-4c5d-9105-031633aa329b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:02.289582 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef2a25da-f4ab-4c5d-9105-031633aa329b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:02.390553 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2d450e92-dbbd-48c7-8408-6eb7ef4c5ef8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:02.398730 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2d450e92-dbbd-48c7-8408-6eb7ef4c5ef8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.157426 Aug 24 12:51:02.399486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1242/2481] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:02 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:02.425708 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ef2a25da-f4ab-4c5d-9105-031633aa329b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:02.433872 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ef2a25da-f4ab-4c5d-9105-031633aa329b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.157623 Aug 24 12:51:02.434438 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1240/2482] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:02 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:02.731140 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9513e9fc-1f63-4865-8639-777644886572 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:02.731741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9513e9fc-1f63-4865-8639-777644886572 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:02.738676 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9513e9fc-1f63-4865-8639-777644886572 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:02.739157 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9513e9fc-1f63-4865-8639-777644886572 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:02.739617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9513e9fc-1f63-4865-8639-777644886572 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:02.740297 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9513e9fc-1f63-4865-8639-777644886572 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:02.740746 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9513e9fc-1f63-4865-8639-777644886572 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:02.741169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9513e9fc-1f63-4865-8639-777644886572 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:02.870032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9513e9fc-1f63-4865-8639-777644886572 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:02.878974 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9513e9fc-1f63-4865-8639-777644886572 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151783 Aug 24 12:51:02.879533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1243/2483] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:02 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:03.255941 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6a03acbf-bede-402d-8d13-79fb24e18759 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:03.256542 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6a03acbf-bede-402d-8d13-79fb24e18759 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:03.263020 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6a03acbf-bede-402d-8d13-79fb24e18759 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:03.263491 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6a03acbf-bede-402d-8d13-79fb24e18759 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:03.263921 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6a03acbf-bede-402d-8d13-79fb24e18759 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:03.264587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6a03acbf-bede-402d-8d13-79fb24e18759 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:03.265032 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6a03acbf-bede-402d-8d13-79fb24e18759 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:03.265449 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6a03acbf-bede-402d-8d13-79fb24e18759 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:03.391945 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6a03acbf-bede-402d-8d13-79fb24e18759 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:03.400394 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6a03acbf-bede-402d-8d13-79fb24e18759 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:03.401872 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6a03acbf-bede-402d-8d13-79fb24e18759 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:03.403079 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6a03acbf-bede-402d-8d13-79fb24e18759 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.150974 Aug 24 12:51:03.403626 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1241/2484] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:03 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:03.420027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-51d00344-d1f2-488b-bb14-524322d1c5ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:03.424990 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-51d00344-d1f2-488b-bb14-524322d1c5ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:03.427888 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51d00344-d1f2-488b-bb14-524322d1c5ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:03.428382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51d00344-d1f2-488b-bb14-524322d1c5ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:03.428830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51d00344-d1f2-488b-bb14-524322d1c5ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:03.429665 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51d00344-d1f2-488b-bb14-524322d1c5ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:03.429965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51d00344-d1f2-488b-bb14-524322d1c5ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:03.430393 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51d00344-d1f2-488b-bb14-524322d1c5ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:03.454141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-db2ca6b4-8533-40f2-b749-7ecea7e639b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:03.454777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-db2ca6b4-8533-40f2-b749-7ecea7e639b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:03.461012 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-db2ca6b4-8533-40f2-b749-7ecea7e639b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:03.462547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-db2ca6b4-8533-40f2-b749-7ecea7e639b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:03.462547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-db2ca6b4-8533-40f2-b749-7ecea7e639b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:03.462835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-db2ca6b4-8533-40f2-b749-7ecea7e639b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:03.463135 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-db2ca6b4-8533-40f2-b749-7ecea7e639b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:03.463596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-db2ca6b4-8533-40f2-b749-7ecea7e639b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:03.564395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-51d00344-d1f2-488b-bb14-524322d1c5ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:03.572654 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-51d00344-d1f2-488b-bb14-524322d1c5ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.156471 Aug 24 12:51:03.573243 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1244/2485] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:03 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:03.598510 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-db2ca6b4-8533-40f2-b749-7ecea7e639b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:03.615749 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-db2ca6b4-8533-40f2-b749-7ecea7e639b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.165347 Aug 24 12:51:03.616309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1242/2486] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:03 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:03.900103 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5028031d-24fb-49d6-9656-c394bcf617e4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:03.900638 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5028031d-24fb-49d6-9656-c394bcf617e4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:03.906549 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5028031d-24fb-49d6-9656-c394bcf617e4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:03.907180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5028031d-24fb-49d6-9656-c394bcf617e4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:03.907616 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5028031d-24fb-49d6-9656-c394bcf617e4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:03.908326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5028031d-24fb-49d6-9656-c394bcf617e4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:03.908782 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5028031d-24fb-49d6-9656-c394bcf617e4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:03.909211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5028031d-24fb-49d6-9656-c394bcf617e4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:04.034326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5028031d-24fb-49d6-9656-c394bcf617e4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:04.042518 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5028031d-24fb-49d6-9656-c394bcf617e4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.146308 Aug 24 12:51:04.043105 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1245/2487] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:03 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:04.427314 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-04206207-c5d5-493d-b453-1f37dd79d49b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:04.427949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-04206207-c5d5-493d-b453-1f37dd79d49b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:04.434348 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04206207-c5d5-493d-b453-1f37dd79d49b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:04.434812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04206207-c5d5-493d-b453-1f37dd79d49b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:04.435248 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04206207-c5d5-493d-b453-1f37dd79d49b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:04.435922 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04206207-c5d5-493d-b453-1f37dd79d49b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:04.436370 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04206207-c5d5-493d-b453-1f37dd79d49b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:04.436793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04206207-c5d5-493d-b453-1f37dd79d49b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:04.562499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-04206207-c5d5-493d-b453-1f37dd79d49b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:04.571200 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-04206207-c5d5-493d-b453-1f37dd79d49b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:04.572688 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-04206207-c5d5-493d-b453-1f37dd79d49b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:04.573833 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-04206207-c5d5-493d-b453-1f37dd79d49b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.150514 Aug 24 12:51:04.574383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1243/2488] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:04 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:04.593206 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-09941fc8-35fb-48e1-b863-92c70a523f3d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:04.593842 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-09941fc8-35fb-48e1-b863-92c70a523f3d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:04.600933 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09941fc8-35fb-48e1-b863-92c70a523f3d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:04.601412 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09941fc8-35fb-48e1-b863-92c70a523f3d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:04.601846 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09941fc8-35fb-48e1-b863-92c70a523f3d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:04.602522 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09941fc8-35fb-48e1-b863-92c70a523f3d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:04.603009 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09941fc8-35fb-48e1-b863-92c70a523f3d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:04.603435 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09941fc8-35fb-48e1-b863-92c70a523f3d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:04.636467 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b71891bb-ab38-4810-b35b-719daed32fc7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:04.637079 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b71891bb-ab38-4810-b35b-719daed32fc7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:04.643571 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b71891bb-ab38-4810-b35b-719daed32fc7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:04.644052 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b71891bb-ab38-4810-b35b-719daed32fc7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:04.644484 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b71891bb-ab38-4810-b35b-719daed32fc7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:04.645175 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b71891bb-ab38-4810-b35b-719daed32fc7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:04.645622 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b71891bb-ab38-4810-b35b-719daed32fc7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:04.646046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b71891bb-ab38-4810-b35b-719daed32fc7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:04.733992 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-09941fc8-35fb-48e1-b863-92c70a523f3d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:04.742486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-09941fc8-35fb-48e1-b863-92c70a523f3d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153039 Aug 24 12:51:04.743498 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1246/2489] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:04 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:04.776671 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b71891bb-ab38-4810-b35b-719daed32fc7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:04.784924 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b71891bb-ab38-4810-b35b-719daed32fc7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152229 Aug 24 12:51:04.785476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1244/2490] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:04 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:05.064027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c65a0bb5-2453-492c-a378-8df8549db9a6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:05.064670 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c65a0bb5-2453-492c-a378-8df8549db9a6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:05.070568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c65a0bb5-2453-492c-a378-8df8549db9a6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:05.071081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c65a0bb5-2453-492c-a378-8df8549db9a6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:05.071531 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c65a0bb5-2453-492c-a378-8df8549db9a6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:05.072215 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c65a0bb5-2453-492c-a378-8df8549db9a6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:05.072673 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c65a0bb5-2453-492c-a378-8df8549db9a6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:05.073099 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c65a0bb5-2453-492c-a378-8df8549db9a6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:05.203003 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c65a0bb5-2453-492c-a378-8df8549db9a6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:05.211617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c65a0bb5-2453-492c-a378-8df8549db9a6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151485 Aug 24 12:51:05.212178 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1247/2491] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:05 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:05.597574 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d85590a8-a809-4c28-8484-fe56ec04d291 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:05.598173 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d85590a8-a809-4c28-8484-fe56ec04d291 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:05.604553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d85590a8-a809-4c28-8484-fe56ec04d291 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:05.605024 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d85590a8-a809-4c28-8484-fe56ec04d291 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:05.605449 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d85590a8-a809-4c28-8484-fe56ec04d291 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:05.606141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d85590a8-a809-4c28-8484-fe56ec04d291 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:05.606584 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d85590a8-a809-4c28-8484-fe56ec04d291 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:05.607040 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d85590a8-a809-4c28-8484-fe56ec04d291 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:05.744325 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d85590a8-a809-4c28-8484-fe56ec04d291 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:05.753437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d85590a8-a809-4c28-8484-fe56ec04d291 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:05.754946 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d85590a8-a809-4c28-8484-fe56ec04d291 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:05.756085 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d85590a8-a809-4c28-8484-fe56ec04d291 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.162487 Aug 24 12:51:05.756638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1245/2492] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:05 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:05.763881 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e0597fca-283f-4b5a-b1eb-899d6394a8f3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:05.764495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e0597fca-283f-4b5a-b1eb-899d6394a8f3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:05.770866 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0597fca-283f-4b5a-b1eb-899d6394a8f3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:05.771350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0597fca-283f-4b5a-b1eb-899d6394a8f3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:05.771790 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0597fca-283f-4b5a-b1eb-899d6394a8f3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:05.772473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0597fca-283f-4b5a-b1eb-899d6394a8f3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:05.772931 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0597fca-283f-4b5a-b1eb-899d6394a8f3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:05.773362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0597fca-283f-4b5a-b1eb-899d6394a8f3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:05.805689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-be3fdeeb-4fbe-4b78-b686-8df9f15d2a83 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:05.806310 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-be3fdeeb-4fbe-4b78-b686-8df9f15d2a83 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:05.812232 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be3fdeeb-4fbe-4b78-b686-8df9f15d2a83 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:05.812713 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be3fdeeb-4fbe-4b78-b686-8df9f15d2a83 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:05.813150 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be3fdeeb-4fbe-4b78-b686-8df9f15d2a83 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:05.813832 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be3fdeeb-4fbe-4b78-b686-8df9f15d2a83 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:05.814286 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be3fdeeb-4fbe-4b78-b686-8df9f15d2a83 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:05.815309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be3fdeeb-4fbe-4b78-b686-8df9f15d2a83 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:05.902027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e0597fca-283f-4b5a-b1eb-899d6394a8f3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:05.910300 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e0597fca-283f-4b5a-b1eb-899d6394a8f3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150244 Aug 24 12:51:05.913696 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1248/2493] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:05 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:05.945498 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-be3fdeeb-4fbe-4b78-b686-8df9f15d2a83 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:05.953560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-be3fdeeb-4fbe-4b78-b686-8df9f15d2a83 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151698 Aug 24 12:51:05.954117 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1246/2494] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:05 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:06.232982 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-192b519f-2476-42e5-a118-ded358312698 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:06.233590 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-192b519f-2476-42e5-a118-ded358312698 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:06.240207 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-192b519f-2476-42e5-a118-ded358312698 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:06.240687 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-192b519f-2476-42e5-a118-ded358312698 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:06.241155 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-192b519f-2476-42e5-a118-ded358312698 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:06.241830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-192b519f-2476-42e5-a118-ded358312698 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:06.242278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-192b519f-2476-42e5-a118-ded358312698 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:06.242725 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-192b519f-2476-42e5-a118-ded358312698 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:06.374125 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-192b519f-2476-42e5-a118-ded358312698 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:06.382238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-192b519f-2476-42e5-a118-ded358312698 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.153056 Aug 24 12:51:06.382817 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1249/2495] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:06 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:06.778967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-db31cfe0-fa62-4b83-bc7c-3d5230c15691 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:06.779497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-db31cfe0-fa62-4b83-bc7c-3d5230c15691 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:06.785888 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-db31cfe0-fa62-4b83-bc7c-3d5230c15691 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:06.786361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-db31cfe0-fa62-4b83-bc7c-3d5230c15691 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:06.786819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-db31cfe0-fa62-4b83-bc7c-3d5230c15691 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:06.787485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-db31cfe0-fa62-4b83-bc7c-3d5230c15691 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:06.787929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-db31cfe0-fa62-4b83-bc7c-3d5230c15691 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:06.788344 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-db31cfe0-fa62-4b83-bc7c-3d5230c15691 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:06.918488 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-db31cfe0-fa62-4b83-bc7c-3d5230c15691 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:06.928052 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-db31cfe0-fa62-4b83-bc7c-3d5230c15691 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:06.929756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-db31cfe0-fa62-4b83-bc7c-3d5230c15691 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:06.930958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-db31cfe0-fa62-4b83-bc7c-3d5230c15691 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155916 Aug 24 12:51:06.931538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1247/2496] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:06 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:06.932304 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ce43c4ea-98fc-49ba-be0d-084bb5f901d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:06.932945 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ce43c4ea-98fc-49ba-be0d-084bb5f901d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:06.939098 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ce43c4ea-98fc-49ba-be0d-084bb5f901d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:06.939585 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ce43c4ea-98fc-49ba-be0d-084bb5f901d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:06.940022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ce43c4ea-98fc-49ba-be0d-084bb5f901d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:06.940735 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ce43c4ea-98fc-49ba-be0d-084bb5f901d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:06.941186 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ce43c4ea-98fc-49ba-be0d-084bb5f901d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:06.941610 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ce43c4ea-98fc-49ba-be0d-084bb5f901d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:06.974619 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fae811ed-d004-4ed9-8332-ac41a9ff9381 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:06.975249 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fae811ed-d004-4ed9-8332-ac41a9ff9381 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:06.981346 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fae811ed-d004-4ed9-8332-ac41a9ff9381 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:06.981827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fae811ed-d004-4ed9-8332-ac41a9ff9381 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:06.982266 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fae811ed-d004-4ed9-8332-ac41a9ff9381 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:06.982981 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fae811ed-d004-4ed9-8332-ac41a9ff9381 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:06.983466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fae811ed-d004-4ed9-8332-ac41a9ff9381 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:06.983888 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fae811ed-d004-4ed9-8332-ac41a9ff9381 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:07.068187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ce43c4ea-98fc-49ba-be0d-084bb5f901d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:07.076590 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ce43c4ea-98fc-49ba-be0d-084bb5f901d2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148073 Aug 24 12:51:07.077243 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1250/2497] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:06 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:07.113508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fae811ed-d004-4ed9-8332-ac41a9ff9381 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:07.121618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fae811ed-d004-4ed9-8332-ac41a9ff9381 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151268 Aug 24 12:51:07.122181 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1248/2498] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:06 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:07.402815 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6c656b27-c04d-4cd6-8ecc-c1cdbe7b5a70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:07.403392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6c656b27-c04d-4cd6-8ecc-c1cdbe7b5a70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:07.410246 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6c656b27-c04d-4cd6-8ecc-c1cdbe7b5a70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:07.410758 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6c656b27-c04d-4cd6-8ecc-c1cdbe7b5a70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:07.411197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6c656b27-c04d-4cd6-8ecc-c1cdbe7b5a70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:07.411914 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6c656b27-c04d-4cd6-8ecc-c1cdbe7b5a70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:07.412379 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6c656b27-c04d-4cd6-8ecc-c1cdbe7b5a70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:07.412808 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6c656b27-c04d-4cd6-8ecc-c1cdbe7b5a70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:07.538172 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6c656b27-c04d-4cd6-8ecc-c1cdbe7b5a70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:07.546212 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6c656b27-c04d-4cd6-8ecc-c1cdbe7b5a70 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147287 Aug 24 12:51:07.546794 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1251/2499] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:07 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:07.953964 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4c491e0f-f4b4-4b5d-a5bf-44ccfa7dfa07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:07.954598 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4c491e0f-f4b4-4b5d-a5bf-44ccfa7dfa07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:07.961581 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4c491e0f-f4b4-4b5d-a5bf-44ccfa7dfa07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:07.962088 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4c491e0f-f4b4-4b5d-a5bf-44ccfa7dfa07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:07.962521 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4c491e0f-f4b4-4b5d-a5bf-44ccfa7dfa07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:07.963225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4c491e0f-f4b4-4b5d-a5bf-44ccfa7dfa07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:07.963676 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4c491e0f-f4b4-4b5d-a5bf-44ccfa7dfa07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:07.964096 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4c491e0f-f4b4-4b5d-a5bf-44ccfa7dfa07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:08.094214 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4c491e0f-f4b4-4b5d-a5bf-44ccfa7dfa07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:08.097226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ada486e6-4bed-488b-81f0-5754a6175aaf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:08.097839 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ada486e6-4bed-488b-81f0-5754a6175aaf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:08.103015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4c491e0f-f4b4-4b5d-a5bf-44ccfa7dfa07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:08.103659 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ada486e6-4bed-488b-81f0-5754a6175aaf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:08.104140 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ada486e6-4bed-488b-81f0-5754a6175aaf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:08.104606 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ada486e6-4bed-488b-81f0-5754a6175aaf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:08.104786 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4c491e0f-f4b4-4b5d-a5bf-44ccfa7dfa07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:08.105284 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ada486e6-4bed-488b-81f0-5754a6175aaf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:08.105735 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ada486e6-4bed-488b-81f0-5754a6175aaf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:08.105849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4c491e0f-f4b4-4b5d-a5bf-44ccfa7dfa07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155846 Aug 24 12:51:08.106159 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ada486e6-4bed-488b-81f0-5754a6175aaf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:08.106442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1249/2500] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:07 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:51:08.142398 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a1c94261-05ed-42f2-8e20-fd032b8e1301 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:08.143063 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a1c94261-05ed-42f2-8e20-fd032b8e1301 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:08.148984 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1c94261-05ed-42f2-8e20-fd032b8e1301 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:08.149468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1c94261-05ed-42f2-8e20-fd032b8e1301 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:08.149908 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1c94261-05ed-42f2-8e20-fd032b8e1301 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:08.150594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1c94261-05ed-42f2-8e20-fd032b8e1301 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:08.151069 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1c94261-05ed-42f2-8e20-fd032b8e1301 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:08.151492 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1c94261-05ed-42f2-8e20-fd032b8e1301 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:08.239945 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ada486e6-4bed-488b-81f0-5754a6175aaf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:08.248390 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ada486e6-4bed-488b-81f0-5754a6175aaf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.154963 Aug 24 12:51:08.248960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1252/2501] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:08 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:08.280177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a1c94261-05ed-42f2-8e20-fd032b8e1301 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:08.288186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a1c94261-05ed-42f2-8e20-fd032b8e1301 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149527 Aug 24 12:51:08.288736 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1250/2502] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:08 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:08.567165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6be9fcf9-69f5-44d2-bc26-b75a6da8ad25 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:08.567856 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6be9fcf9-69f5-44d2-bc26-b75a6da8ad25 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:08.574159 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6be9fcf9-69f5-44d2-bc26-b75a6da8ad25 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:08.574632 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6be9fcf9-69f5-44d2-bc26-b75a6da8ad25 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:08.575095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6be9fcf9-69f5-44d2-bc26-b75a6da8ad25 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:08.575766 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6be9fcf9-69f5-44d2-bc26-b75a6da8ad25 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:08.576216 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6be9fcf9-69f5-44d2-bc26-b75a6da8ad25 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:08.576635 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6be9fcf9-69f5-44d2-bc26-b75a6da8ad25 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:08.701095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6be9fcf9-69f5-44d2-bc26-b75a6da8ad25 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:08.709179 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6be9fcf9-69f5-44d2-bc26-b75a6da8ad25 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.145819 Aug 24 12:51:08.709717 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1253/2503] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:08 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:09.129414 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b4bac7c1-34cb-4859-be67-1ce784b7ae3d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:09.130024 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b4bac7c1-34cb-4859-be67-1ce784b7ae3d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:09.136409 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b4bac7c1-34cb-4859-be67-1ce784b7ae3d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:09.136887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b4bac7c1-34cb-4859-be67-1ce784b7ae3d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:09.137321 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b4bac7c1-34cb-4859-be67-1ce784b7ae3d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:09.138001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b4bac7c1-34cb-4859-be67-1ce784b7ae3d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:09.138449 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b4bac7c1-34cb-4859-be67-1ce784b7ae3d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:09.138903 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b4bac7c1-34cb-4859-be67-1ce784b7ae3d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:09.264196 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b4bac7c1-34cb-4859-be67-1ce784b7ae3d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:09.271369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5711c5a7-5941-449a-b989-0fad87e8e8f0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:09.271976 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5711c5a7-5941-449a-b989-0fad87e8e8f0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:09.272958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b4bac7c1-34cb-4859-be67-1ce784b7ae3d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:09.274450 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b4bac7c1-34cb-4859-be67-1ce784b7ae3d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:09.275638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b4bac7c1-34cb-4859-be67-1ce784b7ae3d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.150142 Aug 24 12:51:09.276187 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1251/2504] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:09 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:09.277885 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5711c5a7-5941-449a-b989-0fad87e8e8f0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:09.278362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5711c5a7-5941-449a-b989-0fad87e8e8f0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:09.278834 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5711c5a7-5941-449a-b989-0fad87e8e8f0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:09.279515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5711c5a7-5941-449a-b989-0fad87e8e8f0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:09.279969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5711c5a7-5941-449a-b989-0fad87e8e8f0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:09.280390 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5711c5a7-5941-449a-b989-0fad87e8e8f0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:09.309061 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1277374f-1b4d-43b2-baa0-aaecb305201a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:09.309671 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1277374f-1b4d-43b2-baa0-aaecb305201a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:09.315625 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1277374f-1b4d-43b2-baa0-aaecb305201a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:09.316108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1277374f-1b4d-43b2-baa0-aaecb305201a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:09.316544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1277374f-1b4d-43b2-baa0-aaecb305201a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:09.317226 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1277374f-1b4d-43b2-baa0-aaecb305201a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:09.317673 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1277374f-1b4d-43b2-baa0-aaecb305201a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:09.318094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1277374f-1b4d-43b2-baa0-aaecb305201a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:09.424789 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5711c5a7-5941-449a-b989-0fad87e8e8f0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:09.434389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5711c5a7-5941-449a-b989-0fad87e8e8f0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.166806 Aug 24 12:51:09.435022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1254/2505] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:09 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:09.452341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1277374f-1b4d-43b2-baa0-aaecb305201a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:09.460549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1277374f-1b4d-43b2-baa0-aaecb305201a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.155167 Aug 24 12:51:09.461106 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1252/2506] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:09 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:09.729370 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-86f03738-44de-442f-b6b2-6de789115dce tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:09.729910 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-86f03738-44de-442f-b6b2-6de789115dce tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:09.736325 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86f03738-44de-442f-b6b2-6de789115dce tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:09.736984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86f03738-44de-442f-b6b2-6de789115dce tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:09.737578 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86f03738-44de-442f-b6b2-6de789115dce tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:09.738324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86f03738-44de-442f-b6b2-6de789115dce tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:09.738812 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86f03738-44de-442f-b6b2-6de789115dce tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:09.739235 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86f03738-44de-442f-b6b2-6de789115dce tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:09.867956 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-86f03738-44de-442f-b6b2-6de789115dce tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:09.870122 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:51:09.876699 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-86f03738-44de-442f-b6b2-6de789115dce tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151278 Aug 24 12:51:09.877794 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1255/2507] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:09 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:10.299414 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f0677cf1-d1c4-4343-8e1f-e4189f32f6e9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:10.300017 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f0677cf1-d1c4-4343-8e1f-e4189f32f6e9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:10.306279 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0677cf1-d1c4-4343-8e1f-e4189f32f6e9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:10.306782 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0677cf1-d1c4-4343-8e1f-e4189f32f6e9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:10.307214 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0677cf1-d1c4-4343-8e1f-e4189f32f6e9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:10.307885 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0677cf1-d1c4-4343-8e1f-e4189f32f6e9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:10.308326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0677cf1-d1c4-4343-8e1f-e4189f32f6e9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:10.308741 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0677cf1-d1c4-4343-8e1f-e4189f32f6e9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:10.436862 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f0677cf1-d1c4-4343-8e1f-e4189f32f6e9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:10.446669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f0677cf1-d1c4-4343-8e1f-e4189f32f6e9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:10.448195 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f0677cf1-d1c4-4343-8e1f-e4189f32f6e9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:10.449353 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f0677cf1-d1c4-4343-8e1f-e4189f32f6e9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154367 Aug 24 12:51:10.449904 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1253/2508] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:10 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:10.463404 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ea06519b-eb36-4319-9193-822017b79fba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:10.464015 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ea06519b-eb36-4319-9193-822017b79fba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:10.470300 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea06519b-eb36-4319-9193-822017b79fba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:10.470838 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea06519b-eb36-4319-9193-822017b79fba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:10.471274 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea06519b-eb36-4319-9193-822017b79fba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:10.471958 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea06519b-eb36-4319-9193-822017b79fba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:10.472415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea06519b-eb36-4319-9193-822017b79fba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:10.472841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea06519b-eb36-4319-9193-822017b79fba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:10.481195 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a50fea20-c8aa-4470-b2fa-9b9af2484009 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:10.481829 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a50fea20-c8aa-4470-b2fa-9b9af2484009 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:10.488523 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a50fea20-c8aa-4470-b2fa-9b9af2484009 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:10.488996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a50fea20-c8aa-4470-b2fa-9b9af2484009 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:10.489427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a50fea20-c8aa-4470-b2fa-9b9af2484009 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:10.490100 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a50fea20-c8aa-4470-b2fa-9b9af2484009 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:10.490543 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a50fea20-c8aa-4470-b2fa-9b9af2484009 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:10.490996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a50fea20-c8aa-4470-b2fa-9b9af2484009 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:10.603361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ea06519b-eb36-4319-9193-822017b79fba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:10.612505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ea06519b-eb36-4319-9193-822017b79fba tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151987 Aug 24 12:51:10.613073 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1256/2509] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:10 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:10.623984 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a50fea20-c8aa-4470-b2fa-9b9af2484009 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:10.632103 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a50fea20-c8aa-4470-b2fa-9b9af2484009 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.154702 Aug 24 12:51:10.632654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1254/2510] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:10 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:10.898140 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-99023b87-15c9-4bd4-bd1c-3cbf0713acc0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:10.898773 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-99023b87-15c9-4bd4-bd1c-3cbf0713acc0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:10.905094 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-99023b87-15c9-4bd4-bd1c-3cbf0713acc0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:10.905573 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-99023b87-15c9-4bd4-bd1c-3cbf0713acc0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:10.906012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-99023b87-15c9-4bd4-bd1c-3cbf0713acc0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:10.906701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-99023b87-15c9-4bd4-bd1c-3cbf0713acc0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:10.907157 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-99023b87-15c9-4bd4-bd1c-3cbf0713acc0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:10.907576 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-99023b87-15c9-4bd4-bd1c-3cbf0713acc0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:11.032764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-99023b87-15c9-4bd4-bd1c-3cbf0713acc0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:11.041376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-99023b87-15c9-4bd4-bd1c-3cbf0713acc0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147129 Aug 24 12:51:11.041924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1257/2511] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:10 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:11.472703 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-226c6c18-d68a-4551-b07b-b34fb93c79cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:11.473336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-226c6c18-d68a-4551-b07b-b34fb93c79cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:11.479939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-226c6c18-d68a-4551-b07b-b34fb93c79cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:11.480425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-226c6c18-d68a-4551-b07b-b34fb93c79cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:11.481228 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-226c6c18-d68a-4551-b07b-b34fb93c79cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:11.481534 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-226c6c18-d68a-4551-b07b-b34fb93c79cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:11.481987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-226c6c18-d68a-4551-b07b-b34fb93c79cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:11.482409 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-226c6c18-d68a-4551-b07b-b34fb93c79cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:11.485034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:51:11.616704 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-226c6c18-d68a-4551-b07b-b34fb93c79cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:11.625287 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-226c6c18-d68a-4551-b07b-b34fb93c79cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:11.626794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-226c6c18-d68a-4551-b07b-b34fb93c79cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:11.627947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-226c6c18-d68a-4551-b07b-b34fb93c79cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.159660 Aug 24 12:51:11.628489 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1255/2512] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:11 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:11.632777 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-63ee8022-c6c3-4066-b76c-66e0899cb811 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:11.633386 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-63ee8022-c6c3-4066-b76c-66e0899cb811 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:11.639305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63ee8022-c6c3-4066-b76c-66e0899cb811 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:11.639789 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63ee8022-c6c3-4066-b76c-66e0899cb811 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:11.640221 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63ee8022-c6c3-4066-b76c-66e0899cb811 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:11.640896 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63ee8022-c6c3-4066-b76c-66e0899cb811 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:11.641346 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63ee8022-c6c3-4066-b76c-66e0899cb811 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:11.641771 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63ee8022-c6c3-4066-b76c-66e0899cb811 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:11.652857 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e7096506-1a9e-40d4-80b9-d824350a2e82 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:11.653457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e7096506-1a9e-40d4-80b9-d824350a2e82 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:11.660142 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7096506-1a9e-40d4-80b9-d824350a2e82 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:11.660690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7096506-1a9e-40d4-80b9-d824350a2e82 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:11.661187 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7096506-1a9e-40d4-80b9-d824350a2e82 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:11.661866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7096506-1a9e-40d4-80b9-d824350a2e82 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:11.662338 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7096506-1a9e-40d4-80b9-d824350a2e82 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:11.662783 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7096506-1a9e-40d4-80b9-d824350a2e82 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:11.781179 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-63ee8022-c6c3-4066-b76c-66e0899cb811 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:11.789987 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-63ee8022-c6c3-4066-b76c-66e0899cb811 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.160956 Aug 24 12:51:11.790755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1258/2513] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:11 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:11.802212 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e7096506-1a9e-40d4-80b9-d824350a2e82 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:11.810344 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e7096506-1a9e-40d4-80b9-d824350a2e82 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.161296 Aug 24 12:51:11.810929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1256/2514] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:11 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:12.062379 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1cbee00b-7f28-4dc2-9e64-02a0388a9217 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:12.063018 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1cbee00b-7f28-4dc2-9e64-02a0388a9217 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:12.069904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1cbee00b-7f28-4dc2-9e64-02a0388a9217 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:12.070388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1cbee00b-7f28-4dc2-9e64-02a0388a9217 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:12.070871 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1cbee00b-7f28-4dc2-9e64-02a0388a9217 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:12.071559 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1cbee00b-7f28-4dc2-9e64-02a0388a9217 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:12.072018 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1cbee00b-7f28-4dc2-9e64-02a0388a9217 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:12.072447 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1cbee00b-7f28-4dc2-9e64-02a0388a9217 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:12.201074 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1cbee00b-7f28-4dc2-9e64-02a0388a9217 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:12.209842 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1cbee00b-7f28-4dc2-9e64-02a0388a9217 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151342 Aug 24 12:51:12.210386 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1259/2515] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:12 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:12.650437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9b0f4090-405a-4e26-95dc-4701effb00dc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:12.651072 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9b0f4090-405a-4e26-95dc-4701effb00dc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:12.657418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b0f4090-405a-4e26-95dc-4701effb00dc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:12.657895 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b0f4090-405a-4e26-95dc-4701effb00dc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:12.658329 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b0f4090-405a-4e26-95dc-4701effb00dc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:12.659039 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b0f4090-405a-4e26-95dc-4701effb00dc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:12.659490 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b0f4090-405a-4e26-95dc-4701effb00dc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:12.659914 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b0f4090-405a-4e26-95dc-4701effb00dc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:12.798294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9b0f4090-405a-4e26-95dc-4701effb00dc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:12.807005 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9b0f4090-405a-4e26-95dc-4701effb00dc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:12.808294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9b0f4090-405a-4e26-95dc-4701effb00dc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:12.809453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9b0f4090-405a-4e26-95dc-4701effb00dc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.162936 Aug 24 12:51:12.809597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-31e31000-3f03-4c8a-bef4-7dfc5b610792 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:12.810091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-31e31000-3f03-4c8a-bef4-7dfc5b610792 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:12.810362 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1257/2516] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:12 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:12.816741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31e31000-3f03-4c8a-bef4-7dfc5b610792 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:12.820269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31e31000-3f03-4c8a-bef4-7dfc5b610792 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:12.820269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31e31000-3f03-4c8a-bef4-7dfc5b610792 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:12.820269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31e31000-3f03-4c8a-bef4-7dfc5b610792 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:12.820269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31e31000-3f03-4c8a-bef4-7dfc5b610792 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:12.820694 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31e31000-3f03-4c8a-bef4-7dfc5b610792 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:12.831798 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1eb2de15-6268-4c35-9a5b-7fd79fbe6cad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:12.832455 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1eb2de15-6268-4c35-9a5b-7fd79fbe6cad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:12.838251 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1eb2de15-6268-4c35-9a5b-7fd79fbe6cad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:12.838765 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1eb2de15-6268-4c35-9a5b-7fd79fbe6cad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:12.839289 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1eb2de15-6268-4c35-9a5b-7fd79fbe6cad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:12.839985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1eb2de15-6268-4c35-9a5b-7fd79fbe6cad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:12.840430 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1eb2de15-6268-4c35-9a5b-7fd79fbe6cad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:12.841119 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1eb2de15-6268-4c35-9a5b-7fd79fbe6cad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:12.950524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-31e31000-3f03-4c8a-bef4-7dfc5b610792 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:12.959378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-31e31000-3f03-4c8a-bef4-7dfc5b610792 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153606 Aug 24 12:51:12.960147 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1260/2517] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:12 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:12.973499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1eb2de15-6268-4c35-9a5b-7fd79fbe6cad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:12.978510 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1eb2de15-6268-4c35-9a5b-7fd79fbe6cad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151141 Aug 24 12:51:12.979099 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1258/2518] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:12 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:13.229668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d88017a3-77f9-4ee4-af4c-ec6fcde0cf6c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:13.230213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d88017a3-77f9-4ee4-af4c-ec6fcde0cf6c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:13.236620 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d88017a3-77f9-4ee4-af4c-ec6fcde0cf6c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:13.237107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d88017a3-77f9-4ee4-af4c-ec6fcde0cf6c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:13.238325 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d88017a3-77f9-4ee4-af4c-ec6fcde0cf6c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:13.239047 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d88017a3-77f9-4ee4-af4c-ec6fcde0cf6c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:13.239508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d88017a3-77f9-4ee4-af4c-ec6fcde0cf6c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:13.239945 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d88017a3-77f9-4ee4-af4c-ec6fcde0cf6c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:13.370715 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d88017a3-77f9-4ee4-af4c-ec6fcde0cf6c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:13.379496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d88017a3-77f9-4ee4-af4c-ec6fcde0cf6c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.153821 Aug 24 12:51:13.380049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1261/2519] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:13 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:13.833804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6bb05001-8719-4d0c-babd-4bffdcb4e0b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:13.834401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6bb05001-8719-4d0c-babd-4bffdcb4e0b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:13.841114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6bb05001-8719-4d0c-babd-4bffdcb4e0b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:13.841591 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6bb05001-8719-4d0c-babd-4bffdcb4e0b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:13.842074 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6bb05001-8719-4d0c-babd-4bffdcb4e0b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:13.842725 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6bb05001-8719-4d0c-babd-4bffdcb4e0b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:13.843175 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6bb05001-8719-4d0c-babd-4bffdcb4e0b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:13.843597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6bb05001-8719-4d0c-babd-4bffdcb4e0b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:13.972929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6bb05001-8719-4d0c-babd-4bffdcb4e0b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:13.981322 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6bb05001-8719-4d0c-babd-4bffdcb4e0b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:13.982828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6bb05001-8719-4d0c-babd-4bffdcb4e0b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:13.983986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6bb05001-8719-4d0c-babd-4bffdcb4e0b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154668 Aug 24 12:51:13.984538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1259/2520] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:13 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:13.992398 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b46c7d80-cc0c-4b3b-86dd-0ab2539382a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:13.993008 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b46c7d80-cc0c-4b3b-86dd-0ab2539382a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:13.998980 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b46c7d80-cc0c-4b3b-86dd-0ab2539382a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:13.999468 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b46c7d80-cc0c-4b3b-86dd-0ab2539382a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:13.999690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7d1820b6-3192-41b7-8c57-5cc8ec1efd9d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:13.999904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b46c7d80-cc0c-4b3b-86dd-0ab2539382a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:14.000342 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7d1820b6-3192-41b7-8c57-5cc8ec1efd9d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:14.000589 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b46c7d80-cc0c-4b3b-86dd-0ab2539382a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:14.001074 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b46c7d80-cc0c-4b3b-86dd-0ab2539382a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:14.001500 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b46c7d80-cc0c-4b3b-86dd-0ab2539382a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:14.006712 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7d1820b6-3192-41b7-8c57-5cc8ec1efd9d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:14.007205 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7d1820b6-3192-41b7-8c57-5cc8ec1efd9d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:14.007646 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7d1820b6-3192-41b7-8c57-5cc8ec1efd9d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:14.008327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7d1820b6-3192-41b7-8c57-5cc8ec1efd9d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:14.008782 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7d1820b6-3192-41b7-8c57-5cc8ec1efd9d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:14.009205 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7d1820b6-3192-41b7-8c57-5cc8ec1efd9d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:14.146255 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b46c7d80-cc0c-4b3b-86dd-0ab2539382a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:14.150133 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b46c7d80-cc0c-4b3b-86dd-0ab2539382a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.161556 Aug 24 12:51:14.150725 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1262/2521] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:13 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:14.182777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7d1820b6-3192-41b7-8c57-5cc8ec1efd9d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:14.191712 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7d1820b6-3192-41b7-8c57-5cc8ec1efd9d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.195693 Aug 24 12:51:14.192269 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1260/2522] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:13 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:14.400130 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-22b5610a-d338-4585-b745-7f4ea5258994 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:14.400735 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-22b5610a-d338-4585-b745-7f4ea5258994 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:14.407372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-22b5610a-d338-4585-b745-7f4ea5258994 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:14.408033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-22b5610a-d338-4585-b745-7f4ea5258994 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:14.408471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-22b5610a-d338-4585-b745-7f4ea5258994 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:14.409661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-22b5610a-d338-4585-b745-7f4ea5258994 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:14.410113 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-22b5610a-d338-4585-b745-7f4ea5258994 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:14.410535 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-22b5610a-d338-4585-b745-7f4ea5258994 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:14.541292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-22b5610a-d338-4585-b745-7f4ea5258994 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:14.549533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-22b5610a-d338-4585-b745-7f4ea5258994 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.153213 Aug 24 12:51:14.550821 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1263/2523] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:14 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:15.007824 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0ae03917-a20f-4a65-ac0c-2b0726f485da tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:15.008430 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0ae03917-a20f-4a65-ac0c-2b0726f485da tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:15.014678 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ae03917-a20f-4a65-ac0c-2b0726f485da tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:15.015167 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ae03917-a20f-4a65-ac0c-2b0726f485da tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:15.015596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ae03917-a20f-4a65-ac0c-2b0726f485da tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:15.016266 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ae03917-a20f-4a65-ac0c-2b0726f485da tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:15.016709 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ae03917-a20f-4a65-ac0c-2b0726f485da tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:15.017126 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ae03917-a20f-4a65-ac0c-2b0726f485da tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:15.149929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0ae03917-a20f-4a65-ac0c-2b0726f485da tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:15.158462 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0ae03917-a20f-4a65-ac0c-2b0726f485da tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:15.160527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0ae03917-a20f-4a65-ac0c-2b0726f485da tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:15.161698 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0ae03917-a20f-4a65-ac0c-2b0726f485da tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.157717 Aug 24 12:51:15.162247 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1261/2524] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:15 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:15.171113 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4836cfcb-df55-4599-9524-76c17ad994da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:15.171718 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4836cfcb-df55-4599-9524-76c17ad994da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:15.178362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4836cfcb-df55-4599-9524-76c17ad994da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:15.178882 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4836cfcb-df55-4599-9524-76c17ad994da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:15.179323 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4836cfcb-df55-4599-9524-76c17ad994da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:15.179988 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4836cfcb-df55-4599-9524-76c17ad994da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:15.180439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4836cfcb-df55-4599-9524-76c17ad994da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:15.180879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4836cfcb-df55-4599-9524-76c17ad994da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:15.212415 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6a9669e4-6f85-4ac7-9cbf-edf6ee0b6b8d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:15.213130 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6a9669e4-6f85-4ac7-9cbf-edf6ee0b6b8d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:15.219049 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6a9669e4-6f85-4ac7-9cbf-edf6ee0b6b8d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:15.219535 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6a9669e4-6f85-4ac7-9cbf-edf6ee0b6b8d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:15.219964 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6a9669e4-6f85-4ac7-9cbf-edf6ee0b6b8d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:15.220648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6a9669e4-6f85-4ac7-9cbf-edf6ee0b6b8d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:15.221098 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6a9669e4-6f85-4ac7-9cbf-edf6ee0b6b8d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:15.221523 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6a9669e4-6f85-4ac7-9cbf-edf6ee0b6b8d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:15.313620 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4836cfcb-df55-4599-9524-76c17ad994da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:15.323160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4836cfcb-df55-4599-9524-76c17ad994da tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.155733 Aug 24 12:51:15.323771 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1264/2525] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:15 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:15.357715 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6a9669e4-6f85-4ac7-9cbf-edf6ee0b6b8d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:15.366774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6a9669e4-6f85-4ac7-9cbf-edf6ee0b6b8d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.158103 Aug 24 12:51:15.367349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1262/2526] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:15 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:15.571121 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dfe80cec-7514-407c-9789-02682fd0ffeb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:15.571708 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dfe80cec-7514-407c-9789-02682fd0ffeb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:15.577972 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dfe80cec-7514-407c-9789-02682fd0ffeb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:15.578460 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dfe80cec-7514-407c-9789-02682fd0ffeb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:15.578930 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dfe80cec-7514-407c-9789-02682fd0ffeb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:15.579631 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dfe80cec-7514-407c-9789-02682fd0ffeb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:15.580096 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dfe80cec-7514-407c-9789-02682fd0ffeb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:15.580531 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dfe80cec-7514-407c-9789-02682fd0ffeb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:15.705811 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-dfe80cec-7514-407c-9789-02682fd0ffeb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:15.715222 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dfe80cec-7514-407c-9789-02682fd0ffeb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147926 Aug 24 12:51:15.715789 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1265/2527] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:15 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:16.185570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-15066d3a-d228-4897-a7bd-d2625e6d9642 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:16.186175 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-15066d3a-d228-4897-a7bd-d2625e6d9642 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:16.192581 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15066d3a-d228-4897-a7bd-d2625e6d9642 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:16.193060 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15066d3a-d228-4897-a7bd-d2625e6d9642 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:16.193497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15066d3a-d228-4897-a7bd-d2625e6d9642 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:16.194173 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15066d3a-d228-4897-a7bd-d2625e6d9642 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:16.194621 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15066d3a-d228-4897-a7bd-d2625e6d9642 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:16.195065 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15066d3a-d228-4897-a7bd-d2625e6d9642 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:16.323877 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-15066d3a-d228-4897-a7bd-d2625e6d9642 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:16.332338 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-15066d3a-d228-4897-a7bd-d2625e6d9642 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:16.333829 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-15066d3a-d228-4897-a7bd-d2625e6d9642 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:16.335013 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-15066d3a-d228-4897-a7bd-d2625e6d9642 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.153450 Aug 24 12:51:16.335560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1263/2528] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:16 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:16.343319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-81451c60-2036-4b4a-8a0a-950da2767502 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:16.343927 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-81451c60-2036-4b4a-8a0a-950da2767502 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:16.345784 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:51:16.350352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81451c60-2036-4b4a-8a0a-950da2767502 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:16.350873 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81451c60-2036-4b4a-8a0a-950da2767502 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:16.351307 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81451c60-2036-4b4a-8a0a-950da2767502 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:16.351981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81451c60-2036-4b4a-8a0a-950da2767502 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:16.352433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81451c60-2036-4b4a-8a0a-950da2767502 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:16.352854 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81451c60-2036-4b4a-8a0a-950da2767502 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:16.387387 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cda8d349-11e6-40c1-844b-4db6cc99f4da tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:16.388001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cda8d349-11e6-40c1-844b-4db6cc99f4da tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:16.393970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cda8d349-11e6-40c1-844b-4db6cc99f4da tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:16.394451 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cda8d349-11e6-40c1-844b-4db6cc99f4da tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:16.394915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cda8d349-11e6-40c1-844b-4db6cc99f4da tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:16.395605 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cda8d349-11e6-40c1-844b-4db6cc99f4da tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:16.396057 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cda8d349-11e6-40c1-844b-4db6cc99f4da tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:16.396482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cda8d349-11e6-40c1-844b-4db6cc99f4da tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:16.488330 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-81451c60-2036-4b4a-8a0a-950da2767502 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:16.496695 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-81451c60-2036-4b4a-8a0a-950da2767502 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.157215 Aug 24 12:51:16.497253 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1266/2529] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:16 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:16.526557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cda8d349-11e6-40c1-844b-4db6cc99f4da tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:16.534797 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cda8d349-11e6-40c1-844b-4db6cc99f4da tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151181 Aug 24 12:51:16.535355 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1264/2530] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:16 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:16.738218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d85b3953-cc07-439b-9ec7-74137701c27e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:16.739258 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d85b3953-cc07-439b-9ec7-74137701c27e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:16.745460 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d85b3953-cc07-439b-9ec7-74137701c27e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:16.745944 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d85b3953-cc07-439b-9ec7-74137701c27e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:16.746383 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d85b3953-cc07-439b-9ec7-74137701c27e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:16.747105 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d85b3953-cc07-439b-9ec7-74137701c27e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:16.747563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d85b3953-cc07-439b-9ec7-74137701c27e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:16.747986 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d85b3953-cc07-439b-9ec7-74137701c27e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:16.875332 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d85b3953-cc07-439b-9ec7-74137701c27e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:16.883945 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d85b3953-cc07-439b-9ec7-74137701c27e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149875 Aug 24 12:51:16.884492 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1267/2531] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:16 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:17.357264 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6c415fb6-53d4-482a-8554-0d8ec8518afe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:17.357872 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6c415fb6-53d4-482a-8554-0d8ec8518afe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:17.365096 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c415fb6-53d4-482a-8554-0d8ec8518afe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:17.365570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c415fb6-53d4-482a-8554-0d8ec8518afe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:17.366000 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c415fb6-53d4-482a-8554-0d8ec8518afe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:17.366687 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c415fb6-53d4-482a-8554-0d8ec8518afe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:17.367132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c415fb6-53d4-482a-8554-0d8ec8518afe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:17.367550 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c415fb6-53d4-482a-8554-0d8ec8518afe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:17.493466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6c415fb6-53d4-482a-8554-0d8ec8518afe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:17.502027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6c415fb6-53d4-482a-8554-0d8ec8518afe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:17.503569 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6c415fb6-53d4-482a-8554-0d8ec8518afe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:17.504713 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6c415fb6-53d4-482a-8554-0d8ec8518afe tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.151367 Aug 24 12:51:17.505268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1265/2532] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:17 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:17.517200 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d2efc4ba-4425-44e0-9a48-d0deeb327ad4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:17.517809 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d2efc4ba-4425-44e0-9a48-d0deeb327ad4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:17.523689 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d2efc4ba-4425-44e0-9a48-d0deeb327ad4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:17.524169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d2efc4ba-4425-44e0-9a48-d0deeb327ad4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:17.524608 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d2efc4ba-4425-44e0-9a48-d0deeb327ad4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:17.525290 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d2efc4ba-4425-44e0-9a48-d0deeb327ad4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:17.525746 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d2efc4ba-4425-44e0-9a48-d0deeb327ad4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:17.526173 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d2efc4ba-4425-44e0-9a48-d0deeb327ad4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:17.555839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ad1e3669-31c6-4073-ac6d-5ddf02614e25 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:17.556540 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ad1e3669-31c6-4073-ac6d-5ddf02614e25 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:17.562518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ad1e3669-31c6-4073-ac6d-5ddf02614e25 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:17.563113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ad1e3669-31c6-4073-ac6d-5ddf02614e25 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:17.563615 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ad1e3669-31c6-4073-ac6d-5ddf02614e25 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:17.564367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ad1e3669-31c6-4073-ac6d-5ddf02614e25 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:17.564912 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ad1e3669-31c6-4073-ac6d-5ddf02614e25 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:17.565954 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ad1e3669-31c6-4073-ac6d-5ddf02614e25 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:17.657756 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d2efc4ba-4425-44e0-9a48-d0deeb327ad4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:17.666033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d2efc4ba-4425-44e0-9a48-d0deeb327ad4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152724 Aug 24 12:51:17.666787 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1268/2533] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:17 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:17.696592 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ad1e3669-31c6-4073-ac6d-5ddf02614e25 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:17.704686 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ad1e3669-31c6-4073-ac6d-5ddf02614e25 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152566 Aug 24 12:51:17.705247 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1266/2534] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:17 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:17.904117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-596629fc-f268-4730-9c61-4591a64a9584 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:17.904757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-596629fc-f268-4730-9c61-4591a64a9584 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:17.911008 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-596629fc-f268-4730-9c61-4591a64a9584 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:17.911491 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-596629fc-f268-4730-9c61-4591a64a9584 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:17.911923 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-596629fc-f268-4730-9c61-4591a64a9584 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:17.912601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-596629fc-f268-4730-9c61-4591a64a9584 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:17.913051 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-596629fc-f268-4730-9c61-4591a64a9584 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:17.913476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-596629fc-f268-4730-9c61-4591a64a9584 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:18.040169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-596629fc-f268-4730-9c61-4591a64a9584 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:18.048934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-596629fc-f268-4730-9c61-4591a64a9584 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147888 Aug 24 12:51:18.048934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1269/2535] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:17 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:18.527557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0a9f2f06-23bf-4d80-82a2-91a9fc06676c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:18.528159 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0a9f2f06-23bf-4d80-82a2-91a9fc06676c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:18.535176 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a9f2f06-23bf-4d80-82a2-91a9fc06676c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:18.535644 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a9f2f06-23bf-4d80-82a2-91a9fc06676c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:18.536070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a9f2f06-23bf-4d80-82a2-91a9fc06676c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:18.536741 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a9f2f06-23bf-4d80-82a2-91a9fc06676c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:18.537209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a9f2f06-23bf-4d80-82a2-91a9fc06676c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:18.537623 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a9f2f06-23bf-4d80-82a2-91a9fc06676c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:18.663695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0a9f2f06-23bf-4d80-82a2-91a9fc06676c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:18.672191 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0a9f2f06-23bf-4d80-82a2-91a9fc06676c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:18.673658 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0a9f2f06-23bf-4d80-82a2-91a9fc06676c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:18.674822 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0a9f2f06-23bf-4d80-82a2-91a9fc06676c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.151111 Aug 24 12:51:18.675372 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1267/2536] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:18 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:18.686715 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-79884169-6ea4-470a-8f89-2d451e1d59b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:18.687546 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-79884169-6ea4-470a-8f89-2d451e1d59b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:18.693478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-79884169-6ea4-470a-8f89-2d451e1d59b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:18.693955 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-79884169-6ea4-470a-8f89-2d451e1d59b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:18.694385 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-79884169-6ea4-470a-8f89-2d451e1d59b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:18.695091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-79884169-6ea4-470a-8f89-2d451e1d59b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:18.695542 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-79884169-6ea4-470a-8f89-2d451e1d59b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:18.695967 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-79884169-6ea4-470a-8f89-2d451e1d59b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:18.726348 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a9c7edfd-0773-4a7f-badd-38e85216c1b6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:18.727093 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a9c7edfd-0773-4a7f-badd-38e85216c1b6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:18.733202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a9c7edfd-0773-4a7f-badd-38e85216c1b6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:18.733684 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a9c7edfd-0773-4a7f-badd-38e85216c1b6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:18.734120 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a9c7edfd-0773-4a7f-badd-38e85216c1b6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:18.734848 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a9c7edfd-0773-4a7f-badd-38e85216c1b6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:18.735302 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a9c7edfd-0773-4a7f-badd-38e85216c1b6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:18.735723 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a9c7edfd-0773-4a7f-badd-38e85216c1b6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:18.824593 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-79884169-6ea4-470a-8f89-2d451e1d59b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:18.833521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-79884169-6ea4-470a-8f89-2d451e1d59b8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150664 Aug 24 12:51:18.834367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1270/2537] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:18 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:18.868959 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a9c7edfd-0773-4a7f-badd-38e85216c1b6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:18.876913 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a9c7edfd-0773-4a7f-badd-38e85216c1b6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.154337 Aug 24 12:51:18.877466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1268/2538] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:18 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:19.070023 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bccd4d2a-8b6b-470d-9f4a-8a10af15e859 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:19.070637 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bccd4d2a-8b6b-470d-9f4a-8a10af15e859 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:19.076930 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bccd4d2a-8b6b-470d-9f4a-8a10af15e859 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:19.077412 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bccd4d2a-8b6b-470d-9f4a-8a10af15e859 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:19.077853 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bccd4d2a-8b6b-470d-9f4a-8a10af15e859 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:19.078531 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bccd4d2a-8b6b-470d-9f4a-8a10af15e859 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:19.079013 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bccd4d2a-8b6b-470d-9f4a-8a10af15e859 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:19.079443 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bccd4d2a-8b6b-470d-9f4a-8a10af15e859 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:19.409903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bccd4d2a-8b6b-470d-9f4a-8a10af15e859 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:19.418171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bccd4d2a-8b6b-470d-9f4a-8a10af15e859 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.352525 Aug 24 12:51:19.418749 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1271/2539] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:19 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:19.697626 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7f776173-1a8f-4eab-9044-6241f7e62771 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:19.726523 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7f776173-1a8f-4eab-9044-6241f7e62771 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:19.726523 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7f776173-1a8f-4eab-9044-6241f7e62771 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:19.726523 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7f776173-1a8f-4eab-9044-6241f7e62771 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:19.726523 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7f776173-1a8f-4eab-9044-6241f7e62771 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:19.726992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7f776173-1a8f-4eab-9044-6241f7e62771 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:19.726992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7f776173-1a8f-4eab-9044-6241f7e62771 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:19.726992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7f776173-1a8f-4eab-9044-6241f7e62771 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:19.840638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7f776173-1a8f-4eab-9044-6241f7e62771 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:19.850042 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7f776173-1a8f-4eab-9044-6241f7e62771 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:19.851566 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7f776173-1a8f-4eab-9044-6241f7e62771 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:19.852726 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7f776173-1a8f-4eab-9044-6241f7e62771 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.159086 Aug 24 12:51:19.853278 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1269/2540] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:19 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:19.854907 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4e6d4b16-5a51-41bd-bc21-13f9182a6ff8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:19.855544 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4e6d4b16-5a51-41bd-bc21-13f9182a6ff8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:19.861625 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e6d4b16-5a51-41bd-bc21-13f9182a6ff8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:19.862114 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e6d4b16-5a51-41bd-bc21-13f9182a6ff8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:19.862848 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e6d4b16-5a51-41bd-bc21-13f9182a6ff8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:19.864123 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e6d4b16-5a51-41bd-bc21-13f9182a6ff8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:19.864581 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e6d4b16-5a51-41bd-bc21-13f9182a6ff8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:19.865008 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e6d4b16-5a51-41bd-bc21-13f9182a6ff8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:19.879341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:51:19.898406 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f31d60a9-9355-41da-810b-b20c504d763f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:19.899163 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f31d60a9-9355-41da-810b-b20c504d763f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:19.905218 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f31d60a9-9355-41da-810b-b20c504d763f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:19.905700 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f31d60a9-9355-41da-810b-b20c504d763f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:19.906135 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f31d60a9-9355-41da-810b-b20c504d763f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:19.906849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f31d60a9-9355-41da-810b-b20c504d763f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:19.907300 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f31d60a9-9355-41da-810b-b20c504d763f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:19.907728 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f31d60a9-9355-41da-810b-b20c504d763f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:19.992271 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4e6d4b16-5a51-41bd-bc21-13f9182a6ff8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:20.000892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4e6d4b16-5a51-41bd-bc21-13f9182a6ff8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149982 Aug 24 12:51:20.001839 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1272/2541] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:19 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:20.051811 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f31d60a9-9355-41da-810b-b20c504d763f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:20.059919 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f31d60a9-9355-41da-810b-b20c504d763f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.165393 Aug 24 12:51:20.060472 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1270/2542] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:19 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:20.439751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-963eb846-3223-4c57-81f4-409accfe9349 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:20.440362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-963eb846-3223-4c57-81f4-409accfe9349 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:20.446752 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-963eb846-3223-4c57-81f4-409accfe9349 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:20.447231 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-963eb846-3223-4c57-81f4-409accfe9349 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:20.447666 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-963eb846-3223-4c57-81f4-409accfe9349 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:20.448346 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-963eb846-3223-4c57-81f4-409accfe9349 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:20.448801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-963eb846-3223-4c57-81f4-409accfe9349 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:20.449227 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-963eb846-3223-4c57-81f4-409accfe9349 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:20.576018 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-963eb846-3223-4c57-81f4-409accfe9349 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:20.584659 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-963eb846-3223-4c57-81f4-409accfe9349 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.148836 Aug 24 12:51:20.585249 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1273/2543] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:20 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:20.876255 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-629b9829-ad0b-44d3-b008-0f619dd48625 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:20.876852 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-629b9829-ad0b-44d3-b008-0f619dd48625 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:20.883854 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-629b9829-ad0b-44d3-b008-0f619dd48625 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:20.884329 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-629b9829-ad0b-44d3-b008-0f619dd48625 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:20.884758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-629b9829-ad0b-44d3-b008-0f619dd48625 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:20.885427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-629b9829-ad0b-44d3-b008-0f619dd48625 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:20.885875 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-629b9829-ad0b-44d3-b008-0f619dd48625 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:20.886293 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-629b9829-ad0b-44d3-b008-0f619dd48625 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:21.011750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-629b9829-ad0b-44d3-b008-0f619dd48625 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:21.013875 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:51:21.020948 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-629b9829-ad0b-44d3-b008-0f619dd48625 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:21.031508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c375dc7d-c973-405d-9304-281fa2956e62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:21.031508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c375dc7d-c973-405d-9304-281fa2956e62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:21.031774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-629b9829-ad0b-44d3-b008-0f619dd48625 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:21.031774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-629b9829-ad0b-44d3-b008-0f619dd48625 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.151186 Aug 24 12:51:21.031774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1271/2544] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:20 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:21.032080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c375dc7d-c973-405d-9304-281fa2956e62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:21.032080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c375dc7d-c973-405d-9304-281fa2956e62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:21.032080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c375dc7d-c973-405d-9304-281fa2956e62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:21.032080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c375dc7d-c973-405d-9304-281fa2956e62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:21.032432 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c375dc7d-c973-405d-9304-281fa2956e62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:21.032432 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c375dc7d-c973-405d-9304-281fa2956e62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:21.080902 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0e6d1d8d-9803-4322-9527-915849dcc0a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:21.081505 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0e6d1d8d-9803-4322-9527-915849dcc0a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:21.089135 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0e6d1d8d-9803-4322-9527-915849dcc0a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:21.089616 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0e6d1d8d-9803-4322-9527-915849dcc0a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:21.090044 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0e6d1d8d-9803-4322-9527-915849dcc0a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:21.091565 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0e6d1d8d-9803-4322-9527-915849dcc0a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:21.091961 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0e6d1d8d-9803-4322-9527-915849dcc0a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:21.092379 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0e6d1d8d-9803-4322-9527-915849dcc0a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:21.164831 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c375dc7d-c973-405d-9304-281fa2956e62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:21.172989 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c375dc7d-c973-405d-9304-281fa2956e62 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.155586 Aug 24 12:51:21.173558 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1274/2545] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:21 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:21.223970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0e6d1d8d-9803-4322-9527-915849dcc0a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:21.232237 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0e6d1d8d-9803-4322-9527-915849dcc0a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.155308 Aug 24 12:51:21.232802 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1272/2546] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:21 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:21.605551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-79335053-8d06-4424-9ed6-248ad6f28da9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:21.606217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-79335053-8d06-4424-9ed6-248ad6f28da9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:21.613020 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-79335053-8d06-4424-9ed6-248ad6f28da9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:21.613504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-79335053-8d06-4424-9ed6-248ad6f28da9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:21.613941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-79335053-8d06-4424-9ed6-248ad6f28da9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:21.614628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-79335053-8d06-4424-9ed6-248ad6f28da9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:21.615116 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-79335053-8d06-4424-9ed6-248ad6f28da9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:21.615545 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-79335053-8d06-4424-9ed6-248ad6f28da9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:21.749158 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-79335053-8d06-4424-9ed6-248ad6f28da9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:21.757755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-79335053-8d06-4424-9ed6-248ad6f28da9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.156077 Aug 24 12:51:21.759024 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1275/2547] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:21 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:22.053247 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-92437ab9-36b7-4600-afec-0a3f89b093c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:22.053880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-92437ab9-36b7-4600-afec-0a3f89b093c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:22.060247 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92437ab9-36b7-4600-afec-0a3f89b093c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:22.060720 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92437ab9-36b7-4600-afec-0a3f89b093c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:22.061155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92437ab9-36b7-4600-afec-0a3f89b093c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:22.061825 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92437ab9-36b7-4600-afec-0a3f89b093c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:22.062270 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92437ab9-36b7-4600-afec-0a3f89b093c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:22.062717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92437ab9-36b7-4600-afec-0a3f89b093c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:22.194150 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-118dea13-9eac-4900-a512-f734eb9a90a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:22.194798 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-118dea13-9eac-4900-a512-f734eb9a90a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:22.196666 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-92437ab9-36b7-4600-afec-0a3f89b093c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:22.200783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-118dea13-9eac-4900-a512-f734eb9a90a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:22.201267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-118dea13-9eac-4900-a512-f734eb9a90a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:22.201707 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-118dea13-9eac-4900-a512-f734eb9a90a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:22.202399 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-118dea13-9eac-4900-a512-f734eb9a90a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:22.202884 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-118dea13-9eac-4900-a512-f734eb9a90a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:22.203310 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-118dea13-9eac-4900-a512-f734eb9a90a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:22.205437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-92437ab9-36b7-4600-afec-0a3f89b093c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:22.207015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-92437ab9-36b7-4600-afec-0a3f89b093c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:22.208166 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-92437ab9-36b7-4600-afec-0a3f89b093c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.158836 Aug 24 12:51:22.208734 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1273/2548] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:22 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:22.253169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-51cd2e58-79c1-48a4-ad3e-2c9464b27bb1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:22.253775 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-51cd2e58-79c1-48a4-ad3e-2c9464b27bb1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:22.256217 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:51:22.260841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51cd2e58-79c1-48a4-ad3e-2c9464b27bb1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:22.261320 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51cd2e58-79c1-48a4-ad3e-2c9464b27bb1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:22.261749 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51cd2e58-79c1-48a4-ad3e-2c9464b27bb1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:22.262425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51cd2e58-79c1-48a4-ad3e-2c9464b27bb1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:22.262894 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51cd2e58-79c1-48a4-ad3e-2c9464b27bb1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:22.263314 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51cd2e58-79c1-48a4-ad3e-2c9464b27bb1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:22.334730 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-118dea13-9eac-4900-a512-f734eb9a90a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:22.343212 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-118dea13-9eac-4900-a512-f734eb9a90a7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153768 Aug 24 12:51:22.343775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1276/2549] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:22 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:22.390883 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-51cd2e58-79c1-48a4-ad3e-2c9464b27bb1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:22.398969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-51cd2e58-79c1-48a4-ad3e-2c9464b27bb1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149552 Aug 24 12:51:22.399526 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1274/2550] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:22 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:22.779852 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a5c5447d-f5cf-4942-9ed9-27bd0cafc19e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:22.780460 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a5c5447d-f5cf-4942-9ed9-27bd0cafc19e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:22.787365 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a5c5447d-f5cf-4942-9ed9-27bd0cafc19e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:22.787842 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a5c5447d-f5cf-4942-9ed9-27bd0cafc19e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:22.788266 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a5c5447d-f5cf-4942-9ed9-27bd0cafc19e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:22.788940 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a5c5447d-f5cf-4942-9ed9-27bd0cafc19e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:22.789392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a5c5447d-f5cf-4942-9ed9-27bd0cafc19e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:22.789812 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a5c5447d-f5cf-4942-9ed9-27bd0cafc19e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:22.915753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a5c5447d-f5cf-4942-9ed9-27bd0cafc19e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:22.923878 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a5c5447d-f5cf-4942-9ed9-27bd0cafc19e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147888 Aug 24 12:51:22.924428 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1277/2551] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:22 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:23.231312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6676cb33-645a-493b-a674-b1a7ff204ee8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:23.231915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6676cb33-645a-493b-a674-b1a7ff204ee8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:23.238403 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6676cb33-645a-493b-a674-b1a7ff204ee8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:23.238906 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6676cb33-645a-493b-a674-b1a7ff204ee8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:23.239337 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6676cb33-645a-493b-a674-b1a7ff204ee8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:23.240004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6676cb33-645a-493b-a674-b1a7ff204ee8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:23.240446 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6676cb33-645a-493b-a674-b1a7ff204ee8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:23.240864 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6676cb33-645a-493b-a674-b1a7ff204ee8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:23.364588 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8480b3ec-4a93-4b85-b0ad-8f9a51a4f263 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:23.365196 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8480b3ec-4a93-4b85-b0ad-8f9a51a4f263 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:23.371092 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8480b3ec-4a93-4b85-b0ad-8f9a51a4f263 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:23.371376 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6676cb33-645a-493b-a674-b1a7ff204ee8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:23.371572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8480b3ec-4a93-4b85-b0ad-8f9a51a4f263 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:23.372082 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8480b3ec-4a93-4b85-b0ad-8f9a51a4f263 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:23.372772 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8480b3ec-4a93-4b85-b0ad-8f9a51a4f263 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:23.373287 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8480b3ec-4a93-4b85-b0ad-8f9a51a4f263 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:23.373715 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8480b3ec-4a93-4b85-b0ad-8f9a51a4f263 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:23.381343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6676cb33-645a-493b-a674-b1a7ff204ee8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:23.382937 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6676cb33-645a-493b-a674-b1a7ff204ee8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:23.384084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6676cb33-645a-493b-a674-b1a7ff204ee8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.156680 Aug 24 12:51:23.384628 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1275/2552] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:23 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:23.420031 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c0765578-13a5-46de-b96d-2cdc65ef2ff1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:23.420661 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c0765578-13a5-46de-b96d-2cdc65ef2ff1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:23.426809 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0765578-13a5-46de-b96d-2cdc65ef2ff1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:23.427292 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0765578-13a5-46de-b96d-2cdc65ef2ff1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:23.427720 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0765578-13a5-46de-b96d-2cdc65ef2ff1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:23.428405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0765578-13a5-46de-b96d-2cdc65ef2ff1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:23.428884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0765578-13a5-46de-b96d-2cdc65ef2ff1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:23.429302 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0765578-13a5-46de-b96d-2cdc65ef2ff1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:23.508343 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8480b3ec-4a93-4b85-b0ad-8f9a51a4f263 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:23.516856 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8480b3ec-4a93-4b85-b0ad-8f9a51a4f263 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.156426 Aug 24 12:51:23.517419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1278/2553] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:23 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:23.557618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c0765578-13a5-46de-b96d-2cdc65ef2ff1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:23.565822 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c0765578-13a5-46de-b96d-2cdc65ef2ff1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149876 Aug 24 12:51:23.566905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1276/2554] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:23 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:23.945848 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5828ae62-5793-48a7-8407-1d88d1662107 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:23.946397 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5828ae62-5793-48a7-8407-1d88d1662107 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:23.952947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5828ae62-5793-48a7-8407-1d88d1662107 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:23.953422 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5828ae62-5793-48a7-8407-1d88d1662107 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:23.953853 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5828ae62-5793-48a7-8407-1d88d1662107 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:23.954529 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5828ae62-5793-48a7-8407-1d88d1662107 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:23.955004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5828ae62-5793-48a7-8407-1d88d1662107 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:23.955426 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5828ae62-5793-48a7-8407-1d88d1662107 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:24.082045 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5828ae62-5793-48a7-8407-1d88d1662107 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:24.090604 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5828ae62-5793-48a7-8407-1d88d1662107 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149218 Aug 24 12:51:24.091229 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1279/2555] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:23 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:24.407705 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fa57cb4f-c8bf-4b84-9ad1-29a50fb0f8cc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:24.408313 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fa57cb4f-c8bf-4b84-9ad1-29a50fb0f8cc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:24.415382 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa57cb4f-c8bf-4b84-9ad1-29a50fb0f8cc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:24.415863 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa57cb4f-c8bf-4b84-9ad1-29a50fb0f8cc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:24.416302 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa57cb4f-c8bf-4b84-9ad1-29a50fb0f8cc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:24.417023 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa57cb4f-c8bf-4b84-9ad1-29a50fb0f8cc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:24.417475 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa57cb4f-c8bf-4b84-9ad1-29a50fb0f8cc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:24.417903 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa57cb4f-c8bf-4b84-9ad1-29a50fb0f8cc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:24.538216 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1b93d2e1-b681-495b-a841-7de669420d5b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:24.538993 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1b93d2e1-b681-495b-a841-7de669420d5b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:24.545163 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b93d2e1-b681-495b-a841-7de669420d5b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:24.545507 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fa57cb4f-c8bf-4b84-9ad1-29a50fb0f8cc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:24.545666 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b93d2e1-b681-495b-a841-7de669420d5b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:24.546091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b93d2e1-b681-495b-a841-7de669420d5b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:24.546870 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b93d2e1-b681-495b-a841-7de669420d5b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:24.547355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b93d2e1-b681-495b-a841-7de669420d5b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:24.547786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1b93d2e1-b681-495b-a841-7de669420d5b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:24.554547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fa57cb4f-c8bf-4b84-9ad1-29a50fb0f8cc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:24.556097 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fa57cb4f-c8bf-4b84-9ad1-29a50fb0f8cc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:24.557294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fa57cb4f-c8bf-4b84-9ad1-29a50fb0f8cc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.153483 Aug 24 12:51:24.557851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1277/2556] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:24 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:24.588824 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-263b6eb2-7b86-46ec-935c-a7a9f0496cd8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:24.589459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-263b6eb2-7b86-46ec-935c-a7a9f0496cd8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:24.595292 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-263b6eb2-7b86-46ec-935c-a7a9f0496cd8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:24.595773 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-263b6eb2-7b86-46ec-935c-a7a9f0496cd8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:24.596203 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-263b6eb2-7b86-46ec-935c-a7a9f0496cd8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:24.596896 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-263b6eb2-7b86-46ec-935c-a7a9f0496cd8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:24.597347 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-263b6eb2-7b86-46ec-935c-a7a9f0496cd8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:24.598364 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-263b6eb2-7b86-46ec-935c-a7a9f0496cd8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:24.679619 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1b93d2e1-b681-495b-a841-7de669420d5b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:24.687772 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1b93d2e1-b681-495b-a841-7de669420d5b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153953 Aug 24 12:51:24.688334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1280/2557] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:24 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:24.728560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-263b6eb2-7b86-46ec-935c-a7a9f0496cd8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:24.736678 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-263b6eb2-7b86-46ec-935c-a7a9f0496cd8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151632 Aug 24 12:51:24.737484 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1278/2558] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:24 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:25.113189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8d6d05bd-0ec1-4bc4-9beb-f5102c746302 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:25.113806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8d6d05bd-0ec1-4bc4-9beb-f5102c746302 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:25.120237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d6d05bd-0ec1-4bc4-9beb-f5102c746302 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:25.120722 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d6d05bd-0ec1-4bc4-9beb-f5102c746302 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:25.121163 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d6d05bd-0ec1-4bc4-9beb-f5102c746302 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:25.121849 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d6d05bd-0ec1-4bc4-9beb-f5102c746302 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:25.122310 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d6d05bd-0ec1-4bc4-9beb-f5102c746302 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:25.122776 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d6d05bd-0ec1-4bc4-9beb-f5102c746302 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:25.249128 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8d6d05bd-0ec1-4bc4-9beb-f5102c746302 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:25.257775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8d6d05bd-0ec1-4bc4-9beb-f5102c746302 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.148762 Aug 24 12:51:25.258329 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1281/2559] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:25 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:25.580361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ee053b3c-fb68-434d-b7f1-c15c13275ce5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:25.580975 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ee053b3c-fb68-434d-b7f1-c15c13275ce5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:25.587440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee053b3c-fb68-434d-b7f1-c15c13275ce5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:25.587925 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee053b3c-fb68-434d-b7f1-c15c13275ce5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:25.588364 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee053b3c-fb68-434d-b7f1-c15c13275ce5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:25.589048 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee053b3c-fb68-434d-b7f1-c15c13275ce5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:25.589502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee053b3c-fb68-434d-b7f1-c15c13275ce5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:25.589929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee053b3c-fb68-434d-b7f1-c15c13275ce5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:25.708555 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8c770410-9d89-4b4a-9fbd-4112b4f747cc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:25.709173 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8c770410-9d89-4b4a-9fbd-4112b4f747cc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:25.715080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8c770410-9d89-4b4a-9fbd-4112b4f747cc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:25.715572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8c770410-9d89-4b4a-9fbd-4112b4f747cc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:25.716017 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8c770410-9d89-4b4a-9fbd-4112b4f747cc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:25.716718 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8c770410-9d89-4b4a-9fbd-4112b4f747cc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:25.717177 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8c770410-9d89-4b4a-9fbd-4112b4f747cc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:25.717610 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8c770410-9d89-4b4a-9fbd-4112b4f747cc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:25.718884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ee053b3c-fb68-434d-b7f1-c15c13275ce5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:25.728073 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ee053b3c-fb68-434d-b7f1-c15c13275ce5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:25.729571 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ee053b3c-fb68-434d-b7f1-c15c13275ce5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:25.730766 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ee053b3c-fb68-434d-b7f1-c15c13275ce5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154277 Aug 24 12:51:25.731323 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1279/2560] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:25 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:25.766104 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2074a39e-0515-47d6-b728-433e47573708 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:25.766738 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2074a39e-0515-47d6-b728-433e47573708 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:25.772615 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2074a39e-0515-47d6-b728-433e47573708 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:25.773672 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2074a39e-0515-47d6-b728-433e47573708 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:25.773672 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2074a39e-0515-47d6-b728-433e47573708 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:25.774191 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2074a39e-0515-47d6-b728-433e47573708 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:25.774660 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2074a39e-0515-47d6-b728-433e47573708 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:25.775093 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2074a39e-0515-47d6-b728-433e47573708 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:25.852772 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8c770410-9d89-4b4a-9fbd-4112b4f747cc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:25.861038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8c770410-9d89-4b4a-9fbd-4112b4f747cc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.156384 Aug 24 12:51:25.861602 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1282/2561] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:25 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:25.909026 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2074a39e-0515-47d6-b728-433e47573708 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:25.917024 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2074a39e-0515-47d6-b728-433e47573708 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.154896 Aug 24 12:51:25.917630 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1280/2562] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:25 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:26.278883 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6551b814-c497-4c91-b5f5-86b6ce6fa932 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:26.279484 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6551b814-c497-4c91-b5f5-86b6ce6fa932 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:26.286338 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6551b814-c497-4c91-b5f5-86b6ce6fa932 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:26.286854 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6551b814-c497-4c91-b5f5-86b6ce6fa932 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:26.287298 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6551b814-c497-4c91-b5f5-86b6ce6fa932 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:26.287981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6551b814-c497-4c91-b5f5-86b6ce6fa932 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:26.288442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6551b814-c497-4c91-b5f5-86b6ce6fa932 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:26.288868 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6551b814-c497-4c91-b5f5-86b6ce6fa932 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:26.419332 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6551b814-c497-4c91-b5f5-86b6ce6fa932 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:26.428445 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6551b814-c497-4c91-b5f5-86b6ce6fa932 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.153498 Aug 24 12:51:26.429211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1283/2563] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:26 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:26.754351 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fb37a171-c67c-49f2-b3bd-d63043db51d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:26.754972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fb37a171-c67c-49f2-b3bd-d63043db51d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:26.761386 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fb37a171-c67c-49f2-b3bd-d63043db51d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:26.761849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fb37a171-c67c-49f2-b3bd-d63043db51d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:26.762273 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fb37a171-c67c-49f2-b3bd-d63043db51d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:26.762969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fb37a171-c67c-49f2-b3bd-d63043db51d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:26.763413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fb37a171-c67c-49f2-b3bd-d63043db51d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:26.763828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fb37a171-c67c-49f2-b3bd-d63043db51d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:26.882500 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9f82813d-b659-410f-b7c3-f5c7f8009a40 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:26.883137 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9f82813d-b659-410f-b7c3-f5c7f8009a40 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:26.888984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9f82813d-b659-410f-b7c3-f5c7f8009a40 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:26.889486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9f82813d-b659-410f-b7c3-f5c7f8009a40 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:26.889903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9f82813d-b659-410f-b7c3-f5c7f8009a40 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:26.890593 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9f82813d-b659-410f-b7c3-f5c7f8009a40 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:26.891075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9f82813d-b659-410f-b7c3-f5c7f8009a40 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:26.891499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9f82813d-b659-410f-b7c3-f5c7f8009a40 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:26.891942 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fb37a171-c67c-49f2-b3bd-d63043db51d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:26.901116 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fb37a171-c67c-49f2-b3bd-d63043db51d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:26.902743 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fb37a171-c67c-49f2-b3bd-d63043db51d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:26.903893 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fb37a171-c67c-49f2-b3bd-d63043db51d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.153391 Aug 24 12:51:26.904439 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1281/2564] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:26 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:26.938245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-236b168d-44e0-46cc-85e5-460d4fd13ee5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:26.938890 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-236b168d-44e0-46cc-85e5-460d4fd13ee5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:26.944757 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-236b168d-44e0-46cc-85e5-460d4fd13ee5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:26.945233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-236b168d-44e0-46cc-85e5-460d4fd13ee5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:26.945665 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-236b168d-44e0-46cc-85e5-460d4fd13ee5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:26.946343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-236b168d-44e0-46cc-85e5-460d4fd13ee5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:26.946836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-236b168d-44e0-46cc-85e5-460d4fd13ee5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:26.947262 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-236b168d-44e0-46cc-85e5-460d4fd13ee5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:27.021377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9f82813d-b659-410f-b7c3-f5c7f8009a40 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:27.029675 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9f82813d-b659-410f-b7c3-f5c7f8009a40 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150912 Aug 24 12:51:27.030244 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1284/2565] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:26 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:27.076692 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-236b168d-44e0-46cc-85e5-460d4fd13ee5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:27.085417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-236b168d-44e0-46cc-85e5-460d4fd13ee5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150972 Aug 24 12:51:27.085971 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1282/2566] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:26 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:27.449189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-960beb74-23aa-4e33-a6ad-ba8f145322d7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:27.449798 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-960beb74-23aa-4e33-a6ad-ba8f145322d7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:27.456088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-960beb74-23aa-4e33-a6ad-ba8f145322d7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:27.456558 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-960beb74-23aa-4e33-a6ad-ba8f145322d7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:27.457011 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-960beb74-23aa-4e33-a6ad-ba8f145322d7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:27.457682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-960beb74-23aa-4e33-a6ad-ba8f145322d7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:27.458135 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-960beb74-23aa-4e33-a6ad-ba8f145322d7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:27.458578 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-960beb74-23aa-4e33-a6ad-ba8f145322d7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:27.587656 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-960beb74-23aa-4e33-a6ad-ba8f145322d7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:27.595629 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-960beb74-23aa-4e33-a6ad-ba8f145322d7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150253 Aug 24 12:51:27.596180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1285/2567] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:27 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:27.927172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7aca2286-2198-473f-8b01-db2eacdfd8b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:27.928654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7aca2286-2198-473f-8b01-db2eacdfd8b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:27.935050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7aca2286-2198-473f-8b01-db2eacdfd8b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:27.935528 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7aca2286-2198-473f-8b01-db2eacdfd8b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:27.935957 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7aca2286-2198-473f-8b01-db2eacdfd8b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:27.936633 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7aca2286-2198-473f-8b01-db2eacdfd8b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:27.937081 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7aca2286-2198-473f-8b01-db2eacdfd8b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:27.937503 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7aca2286-2198-473f-8b01-db2eacdfd8b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:28.051794 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-50244f26-aba9-413f-82ce-3ef528377d1e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:28.052403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-50244f26-aba9-413f-82ce-3ef528377d1e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:28.058207 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50244f26-aba9-413f-82ce-3ef528377d1e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:28.058710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50244f26-aba9-413f-82ce-3ef528377d1e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:28.059149 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50244f26-aba9-413f-82ce-3ef528377d1e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:28.059828 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50244f26-aba9-413f-82ce-3ef528377d1e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:28.060279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50244f26-aba9-413f-82ce-3ef528377d1e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:28.060972 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50244f26-aba9-413f-82ce-3ef528377d1e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:28.063692 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7aca2286-2198-473f-8b01-db2eacdfd8b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:28.072281 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7aca2286-2198-473f-8b01-db2eacdfd8b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:28.073749 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7aca2286-2198-473f-8b01-db2eacdfd8b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:28.074920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7aca2286-2198-473f-8b01-db2eacdfd8b1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.151681 Aug 24 12:51:28.075470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1283/2568] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:27 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:28.106131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-68bfe695-73f7-4832-9292-a42e49b89b25 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:28.106757 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-68bfe695-73f7-4832-9292-a42e49b89b25 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:28.112836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68bfe695-73f7-4832-9292-a42e49b89b25 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:28.113900 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68bfe695-73f7-4832-9292-a42e49b89b25 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:28.114330 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68bfe695-73f7-4832-9292-a42e49b89b25 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:28.115027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68bfe695-73f7-4832-9292-a42e49b89b25 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:28.115473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68bfe695-73f7-4832-9292-a42e49b89b25 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:28.115888 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68bfe695-73f7-4832-9292-a42e49b89b25 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:28.207912 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-50244f26-aba9-413f-82ce-3ef528377d1e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:28.216620 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-50244f26-aba9-413f-82ce-3ef528377d1e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.169506 Aug 24 12:51:28.217185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1286/2569] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:28 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:28.246239 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-68bfe695-73f7-4832-9292-a42e49b89b25 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:28.254509 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-68bfe695-73f7-4832-9292-a42e49b89b25 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152131 Aug 24 12:51:28.255111 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1284/2570] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:28 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:28.616837 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c3e7af42-5d96-4404-8bcf-c9fa567046b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:28.617468 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c3e7af42-5d96-4404-8bcf-c9fa567046b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:28.623844 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3e7af42-5d96-4404-8bcf-c9fa567046b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:28.624325 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3e7af42-5d96-4404-8bcf-c9fa567046b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:28.624754 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3e7af42-5d96-4404-8bcf-c9fa567046b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:28.625430 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3e7af42-5d96-4404-8bcf-c9fa567046b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:28.625879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3e7af42-5d96-4404-8bcf-c9fa567046b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:28.626300 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3e7af42-5d96-4404-8bcf-c9fa567046b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:28.756497 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c3e7af42-5d96-4404-8bcf-c9fa567046b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:28.764549 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c3e7af42-5d96-4404-8bcf-c9fa567046b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151569 Aug 24 12:51:28.765104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1287/2571] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:28 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:29.098145 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3b2a7dac-96b6-468b-bc68-371a5942dd91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:29.098715 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3b2a7dac-96b6-468b-bc68-371a5942dd91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:29.105162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b2a7dac-96b6-468b-bc68-371a5942dd91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:29.105640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b2a7dac-96b6-468b-bc68-371a5942dd91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:29.106075 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b2a7dac-96b6-468b-bc68-371a5942dd91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:29.106795 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b2a7dac-96b6-468b-bc68-371a5942dd91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:29.107247 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b2a7dac-96b6-468b-bc68-371a5942dd91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:29.107668 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b2a7dac-96b6-468b-bc68-371a5942dd91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:29.238094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3b2a7dac-96b6-468b-bc68-371a5942dd91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:29.238258 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-449e00f3-3e5d-441b-877a-dde97840de47 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:29.238853 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-449e00f3-3e5d-441b-877a-dde97840de47 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:29.244741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-449e00f3-3e5d-441b-877a-dde97840de47 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:29.245256 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-449e00f3-3e5d-441b-877a-dde97840de47 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:29.245696 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-449e00f3-3e5d-441b-877a-dde97840de47 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:29.246387 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-449e00f3-3e5d-441b-877a-dde97840de47 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:29.246705 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3b2a7dac-96b6-468b-bc68-371a5942dd91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:29.246875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-449e00f3-3e5d-441b-877a-dde97840de47 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:29.247302 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-449e00f3-3e5d-441b-877a-dde97840de47 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:29.248221 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3b2a7dac-96b6-468b-bc68-371a5942dd91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:29.249364 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3b2a7dac-96b6-468b-bc68-371a5942dd91 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155884 Aug 24 12:51:29.249906 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1285/2572] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:29 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:29.275586 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e1054a31-ff70-4219-b6b3-896e5945bc5c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:29.276210 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e1054a31-ff70-4219-b6b3-896e5945bc5c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:29.281988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1054a31-ff70-4219-b6b3-896e5945bc5c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:29.282464 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1054a31-ff70-4219-b6b3-896e5945bc5c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:29.283002 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1054a31-ff70-4219-b6b3-896e5945bc5c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:29.283677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1054a31-ff70-4219-b6b3-896e5945bc5c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:29.284121 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1054a31-ff70-4219-b6b3-896e5945bc5c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:29.284542 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1054a31-ff70-4219-b6b3-896e5945bc5c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:29.376027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-449e00f3-3e5d-441b-877a-dde97840de47 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:29.385224 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-449e00f3-3e5d-441b-877a-dde97840de47 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151249 Aug 24 12:51:29.386149 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1288/2573] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:29 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:29.414623 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e1054a31-ff70-4219-b6b3-896e5945bc5c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:29.422888 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e1054a31-ff70-4219-b6b3-896e5945bc5c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150915 Aug 24 12:51:29.423812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1286/2574] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:29 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:29.786789 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9ff93b35-7cda-42c4-b42f-01a71afa382c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:29.787393 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9ff93b35-7cda-42c4-b42f-01a71afa382c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:29.793841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ff93b35-7cda-42c4-b42f-01a71afa382c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:29.794319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ff93b35-7cda-42c4-b42f-01a71afa382c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:29.794772 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ff93b35-7cda-42c4-b42f-01a71afa382c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:29.795444 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ff93b35-7cda-42c4-b42f-01a71afa382c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:29.795898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ff93b35-7cda-42c4-b42f-01a71afa382c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:29.796315 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ff93b35-7cda-42c4-b42f-01a71afa382c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:29.798777 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:51:29.937437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9ff93b35-7cda-42c4-b42f-01a71afa382c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:29.945875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9ff93b35-7cda-42c4-b42f-01a71afa382c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.163517 Aug 24 12:51:29.946443 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1289/2575] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:29 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:30.273059 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c9a972fb-19c7-421a-aab2-b3283d68fcc0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:30.273670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c9a972fb-19c7-421a-aab2-b3283d68fcc0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:30.280151 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c9a972fb-19c7-421a-aab2-b3283d68fcc0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:30.280717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c9a972fb-19c7-421a-aab2-b3283d68fcc0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:30.281081 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c9a972fb-19c7-421a-aab2-b3283d68fcc0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:30.281761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c9a972fb-19c7-421a-aab2-b3283d68fcc0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:30.282203 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c9a972fb-19c7-421a-aab2-b3283d68fcc0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:30.282623 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c9a972fb-19c7-421a-aab2-b3283d68fcc0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:30.407063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6da85351-1b20-405f-89c3-ddaad6c8d2f7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:30.407806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6da85351-1b20-405f-89c3-ddaad6c8d2f7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:30.413728 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6da85351-1b20-405f-89c3-ddaad6c8d2f7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:30.414225 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6da85351-1b20-405f-89c3-ddaad6c8d2f7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:30.414693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6da85351-1b20-405f-89c3-ddaad6c8d2f7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:30.415169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c9a972fb-19c7-421a-aab2-b3283d68fcc0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:30.415551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6da85351-1b20-405f-89c3-ddaad6c8d2f7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:30.415850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6da85351-1b20-405f-89c3-ddaad6c8d2f7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:30.416278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6da85351-1b20-405f-89c3-ddaad6c8d2f7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:30.424531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c9a972fb-19c7-421a-aab2-b3283d68fcc0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:30.426853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c9a972fb-19c7-421a-aab2-b3283d68fcc0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:30.428013 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c9a972fb-19c7-421a-aab2-b3283d68fcc0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.159565 Aug 24 12:51:30.435410 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1287/2576] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:30 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:30.445173 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5d9bad6c-2682-4e1b-b441-3fd35fca7dc8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:30.445710 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5d9bad6c-2682-4e1b-b441-3fd35fca7dc8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:30.451891 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d9bad6c-2682-4e1b-b441-3fd35fca7dc8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:30.452377 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d9bad6c-2682-4e1b-b441-3fd35fca7dc8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:30.452807 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d9bad6c-2682-4e1b-b441-3fd35fca7dc8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:30.453489 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d9bad6c-2682-4e1b-b441-3fd35fca7dc8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:30.454006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d9bad6c-2682-4e1b-b441-3fd35fca7dc8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:30.454431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d9bad6c-2682-4e1b-b441-3fd35fca7dc8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:30.469624 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:51:30.552038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6da85351-1b20-405f-89c3-ddaad6c8d2f7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:30.561331 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6da85351-1b20-405f-89c3-ddaad6c8d2f7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.158094 Aug 24 12:51:30.562185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1290/2577] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:30 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:30.588593 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5d9bad6c-2682-4e1b-b441-3fd35fca7dc8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:30.596844 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5d9bad6c-2682-4e1b-b441-3fd35fca7dc8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.156042 Aug 24 12:51:30.597423 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1288/2578] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:30 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:30.967672 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-90d5709e-9840-401a-acc7-139d3b4b354c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:30.968311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-90d5709e-9840-401a-acc7-139d3b4b354c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:30.975269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-90d5709e-9840-401a-acc7-139d3b4b354c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:30.975755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-90d5709e-9840-401a-acc7-139d3b4b354c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:30.976191 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-90d5709e-9840-401a-acc7-139d3b4b354c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:30.976877 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-90d5709e-9840-401a-acc7-139d3b4b354c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:30.977333 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-90d5709e-9840-401a-acc7-139d3b4b354c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:30.977761 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-90d5709e-9840-401a-acc7-139d3b4b354c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:31.105672 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-90d5709e-9840-401a-acc7-139d3b4b354c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:31.115154 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-90d5709e-9840-401a-acc7-139d3b4b354c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150798 Aug 24 12:51:31.115719 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1291/2579] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:30 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:31.453118 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bbdfb76d-deae-48d6-9e6c-b1792ba467dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:31.453726 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-bbdfb76d-deae-48d6-9e6c-b1792ba467dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:31.460091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bbdfb76d-deae-48d6-9e6c-b1792ba467dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:31.460568 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bbdfb76d-deae-48d6-9e6c-b1792ba467dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:31.461004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bbdfb76d-deae-48d6-9e6c-b1792ba467dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:31.461681 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bbdfb76d-deae-48d6-9e6c-b1792ba467dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:31.462127 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bbdfb76d-deae-48d6-9e6c-b1792ba467dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:31.462552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bbdfb76d-deae-48d6-9e6c-b1792ba467dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:31.583263 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6984b028-7280-431b-ab76-a4172c9cd508 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:31.584206 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6984b028-7280-431b-ab76-a4172c9cd508 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:31.589697 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-bbdfb76d-deae-48d6-9e6c-b1792ba467dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:31.590288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6984b028-7280-431b-ab76-a4172c9cd508 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:31.590819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6984b028-7280-431b-ab76-a4172c9cd508 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:31.591267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6984b028-7280-431b-ab76-a4172c9cd508 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:31.592003 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6984b028-7280-431b-ab76-a4172c9cd508 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:31.592465 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6984b028-7280-431b-ab76-a4172c9cd508 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:31.592897 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6984b028-7280-431b-ab76-a4172c9cd508 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:31.599079 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-bbdfb76d-deae-48d6-9e6c-b1792ba467dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:31.600666 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-bbdfb76d-deae-48d6-9e6c-b1792ba467dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:31.601859 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bbdfb76d-deae-48d6-9e6c-b1792ba467dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.152702 Aug 24 12:51:31.602517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1289/2580] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:31 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:51:31.619011 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-90d36df5-a496-4614-a5b7-8d280b4e5570 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:31.619693 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-90d36df5-a496-4614-a5b7-8d280b4e5570 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:31.625939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-90d36df5-a496-4614-a5b7-8d280b4e5570 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:31.626423 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-90d36df5-a496-4614-a5b7-8d280b4e5570 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:31.627024 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-90d36df5-a496-4614-a5b7-8d280b4e5570 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:31.627790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-90d36df5-a496-4614-a5b7-8d280b4e5570 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:31.628244 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-90d36df5-a496-4614-a5b7-8d280b4e5570 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:31.628670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-90d36df5-a496-4614-a5b7-8d280b4e5570 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:31.741404 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6984b028-7280-431b-ab76-a4172c9cd508 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:31.750059 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6984b028-7280-431b-ab76-a4172c9cd508 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.170816 Aug 24 12:51:31.750939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1292/2581] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:31 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:31.766827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-90d36df5-a496-4614-a5b7-8d280b4e5570 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:31.774886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-90d36df5-a496-4614-a5b7-8d280b4e5570 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.160511 Aug 24 12:51:31.775437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1290/2582] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:31 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:32.135116 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-03b183cc-e81c-4814-a886-8c36c0098165 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:32.135718 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-03b183cc-e81c-4814-a886-8c36c0098165 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:32.142691 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03b183cc-e81c-4814-a886-8c36c0098165 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:32.143183 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03b183cc-e81c-4814-a886-8c36c0098165 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:32.143620 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03b183cc-e81c-4814-a886-8c36c0098165 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:32.144820 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03b183cc-e81c-4814-a886-8c36c0098165 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:32.145277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03b183cc-e81c-4814-a886-8c36c0098165 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:32.145705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03b183cc-e81c-4814-a886-8c36c0098165 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:32.278901 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-03b183cc-e81c-4814-a886-8c36c0098165 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:32.287577 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-03b183cc-e81c-4814-a886-8c36c0098165 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.156396 Aug 24 12:51:32.288137 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1293/2583] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:32 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:32.626009 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2d16d4f2-fab3-4685-b0eb-f897bc66ad86 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:32.626620 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2d16d4f2-fab3-4685-b0eb-f897bc66ad86 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:32.633557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d16d4f2-fab3-4685-b0eb-f897bc66ad86 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:32.634036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d16d4f2-fab3-4685-b0eb-f897bc66ad86 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:32.634475 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d16d4f2-fab3-4685-b0eb-f897bc66ad86 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:32.635186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d16d4f2-fab3-4685-b0eb-f897bc66ad86 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:32.635643 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d16d4f2-fab3-4685-b0eb-f897bc66ad86 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:32.636069 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d16d4f2-fab3-4685-b0eb-f897bc66ad86 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:32.764696 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2d16d4f2-fab3-4685-b0eb-f897bc66ad86 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:32.770682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4444b1ea-0248-4882-9b17-52e3974d3660 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:32.771358 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4444b1ea-0248-4882-9b17-52e3974d3660 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:32.773536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2d16d4f2-fab3-4685-b0eb-f897bc66ad86 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:32.775055 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2d16d4f2-fab3-4685-b0eb-f897bc66ad86 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:32.776250 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2d16d4f2-fab3-4685-b0eb-f897bc66ad86 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154305 Aug 24 12:51:32.776800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1291/2584] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:32 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:32.777425 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4444b1ea-0248-4882-9b17-52e3974d3660 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:32.777906 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4444b1ea-0248-4882-9b17-52e3974d3660 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:32.778341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4444b1ea-0248-4882-9b17-52e3974d3660 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:32.779053 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4444b1ea-0248-4882-9b17-52e3974d3660 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:32.779511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4444b1ea-0248-4882-9b17-52e3974d3660 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:32.779934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4444b1ea-0248-4882-9b17-52e3974d3660 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:32.795976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7246d6cf-cb03-4f7d-a843-017bae557e58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:32.796675 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7246d6cf-cb03-4f7d-a843-017bae557e58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:32.803103 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7246d6cf-cb03-4f7d-a843-017bae557e58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:32.803661 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7246d6cf-cb03-4f7d-a843-017bae557e58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:32.804171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7246d6cf-cb03-4f7d-a843-017bae557e58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:32.804926 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7246d6cf-cb03-4f7d-a843-017bae557e58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:32.805452 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7246d6cf-cb03-4f7d-a843-017bae557e58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:32.805947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7246d6cf-cb03-4f7d-a843-017bae557e58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:32.909498 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4444b1ea-0248-4882-9b17-52e3974d3660 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:32.918104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4444b1ea-0248-4882-9b17-52e3974d3660 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151315 Aug 24 12:51:32.918687 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1294/2585] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:32 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:32.942804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7246d6cf-cb03-4f7d-a843-017bae557e58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:32.950701 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7246d6cf-cb03-4f7d-a843-017bae557e58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.158407 Aug 24 12:51:32.951252 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1292/2586] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:32 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:33.308579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d54d8821-fdcf-4b07-836e-e63fd650a1a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:33.309189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d54d8821-fdcf-4b07-836e-e63fd650a1a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:33.315533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d54d8821-fdcf-4b07-836e-e63fd650a1a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:33.316017 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d54d8821-fdcf-4b07-836e-e63fd650a1a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:33.316448 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d54d8821-fdcf-4b07-836e-e63fd650a1a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:33.317125 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d54d8821-fdcf-4b07-836e-e63fd650a1a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:33.317579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d54d8821-fdcf-4b07-836e-e63fd650a1a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:33.317998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d54d8821-fdcf-4b07-836e-e63fd650a1a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:33.449284 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d54d8821-fdcf-4b07-836e-e63fd650a1a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:33.458235 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d54d8821-fdcf-4b07-836e-e63fd650a1a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.153542 Aug 24 12:51:33.458834 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1295/2587] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:33 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:33.799001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2c1747b2-75e8-4678-b68d-ebd0bde843b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:33.799631 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2c1747b2-75e8-4678-b68d-ebd0bde843b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:33.805945 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c1747b2-75e8-4678-b68d-ebd0bde843b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:33.806419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c1747b2-75e8-4678-b68d-ebd0bde843b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:33.806887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c1747b2-75e8-4678-b68d-ebd0bde843b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:33.807557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c1747b2-75e8-4678-b68d-ebd0bde843b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:33.808002 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c1747b2-75e8-4678-b68d-ebd0bde843b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:33.808419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c1747b2-75e8-4678-b68d-ebd0bde843b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:33.935975 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2c1747b2-75e8-4678-b68d-ebd0bde843b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:33.938897 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-397e6eb7-8b92-47ea-9562-636ab10e2020 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:33.939512 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-397e6eb7-8b92-47ea-9562-636ab10e2020 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:33.945058 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2c1747b2-75e8-4678-b68d-ebd0bde843b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:33.945791 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-397e6eb7-8b92-47ea-9562-636ab10e2020 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:33.946275 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-397e6eb7-8b92-47ea-9562-636ab10e2020 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:33.946531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2c1747b2-75e8-4678-b68d-ebd0bde843b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:33.946735 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-397e6eb7-8b92-47ea-9562-636ab10e2020 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:33.947425 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-397e6eb7-8b92-47ea-9562-636ab10e2020 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:33.947725 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2c1747b2-75e8-4678-b68d-ebd0bde843b4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.152560 Aug 24 12:51:33.947879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-397e6eb7-8b92-47ea-9562-636ab10e2020 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:33.948268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1293/2588] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:33 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:33.948400 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-397e6eb7-8b92-47ea-9562-636ab10e2020 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:33.971323 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7e44eb61-d89c-4424-9c10-4f2167d10f77 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:33.971935 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7e44eb61-d89c-4424-9c10-4f2167d10f77 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:33.978190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7e44eb61-d89c-4424-9c10-4f2167d10f77 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:33.978774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7e44eb61-d89c-4424-9c10-4f2167d10f77 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:33.979270 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7e44eb61-d89c-4424-9c10-4f2167d10f77 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:33.980014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7e44eb61-d89c-4424-9c10-4f2167d10f77 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:33.980530 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7e44eb61-d89c-4424-9c10-4f2167d10f77 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:33.981043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7e44eb61-d89c-4424-9c10-4f2167d10f77 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:34.076391 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-397e6eb7-8b92-47ea-9562-636ab10e2020 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:34.085057 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-397e6eb7-8b92-47ea-9562-636ab10e2020 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149956 Aug 24 12:51:34.085617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1296/2589] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:33 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:34.110879 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7e44eb61-d89c-4424-9c10-4f2167d10f77 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:34.120177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7e44eb61-d89c-4424-9c10-4f2167d10f77 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152523 Aug 24 12:51:34.120750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1294/2590] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:33 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:34.479094 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8fcc1f0e-d5d9-4be7-a5dc-3f03f3a1f4ad tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:34.479699 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8fcc1f0e-d5d9-4be7-a5dc-3f03f3a1f4ad tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:34.486010 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8fcc1f0e-d5d9-4be7-a5dc-3f03f3a1f4ad tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:34.486484 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8fcc1f0e-d5d9-4be7-a5dc-3f03f3a1f4ad tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:34.486945 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8fcc1f0e-d5d9-4be7-a5dc-3f03f3a1f4ad tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:34.488392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8fcc1f0e-d5d9-4be7-a5dc-3f03f3a1f4ad tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:34.488869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8fcc1f0e-d5d9-4be7-a5dc-3f03f3a1f4ad tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:34.489287 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8fcc1f0e-d5d9-4be7-a5dc-3f03f3a1f4ad tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:34.618959 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8fcc1f0e-d5d9-4be7-a5dc-3f03f3a1f4ad tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:34.627098 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8fcc1f0e-d5d9-4be7-a5dc-3f03f3a1f4ad tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151916 Aug 24 12:51:34.627655 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1297/2591] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:34 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:34.971247 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6395c378-654d-4351-93ae-aff1b6737c02 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:34.971853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6395c378-654d-4351-93ae-aff1b6737c02 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:34.978374 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6395c378-654d-4351-93ae-aff1b6737c02 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:34.978888 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6395c378-654d-4351-93ae-aff1b6737c02 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:34.979328 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6395c378-654d-4351-93ae-aff1b6737c02 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:34.980005 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6395c378-654d-4351-93ae-aff1b6737c02 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:34.980454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6395c378-654d-4351-93ae-aff1b6737c02 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:34.980877 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6395c378-654d-4351-93ae-aff1b6737c02 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:35.105903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2f09282d-9080-47d1-afcc-ded43db79afc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:35.106511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2f09282d-9080-47d1-afcc-ded43db79afc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:35.108123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6395c378-654d-4351-93ae-aff1b6737c02 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:35.113422 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f09282d-9080-47d1-afcc-ded43db79afc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:35.113905 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f09282d-9080-47d1-afcc-ded43db79afc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:35.114336 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f09282d-9080-47d1-afcc-ded43db79afc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:35.115087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f09282d-9080-47d1-afcc-ded43db79afc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:35.115588 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f09282d-9080-47d1-afcc-ded43db79afc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:35.116015 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f09282d-9080-47d1-afcc-ded43db79afc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:35.117609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6395c378-654d-4351-93ae-aff1b6737c02 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:35.119499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6395c378-654d-4351-93ae-aff1b6737c02 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:35.120651 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6395c378-654d-4351-93ae-aff1b6737c02 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.153317 Aug 24 12:51:35.121205 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1295/2592] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:34 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:35.140930 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9647c57d-46e5-4c96-b36a-a8b238d04fe2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:35.141531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9647c57d-46e5-4c96-b36a-a8b238d04fe2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:35.147517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9647c57d-46e5-4c96-b36a-a8b238d04fe2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:35.147986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9647c57d-46e5-4c96-b36a-a8b238d04fe2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:35.148413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9647c57d-46e5-4c96-b36a-a8b238d04fe2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:35.149083 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9647c57d-46e5-4c96-b36a-a8b238d04fe2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:35.149525 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9647c57d-46e5-4c96-b36a-a8b238d04fe2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:35.149942 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9647c57d-46e5-4c96-b36a-a8b238d04fe2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:35.244917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2f09282d-9080-47d1-afcc-ded43db79afc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:35.252969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2f09282d-9080-47d1-afcc-ded43db79afc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151065 Aug 24 12:51:35.254211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1298/2593] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:35 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:35.277132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9647c57d-46e5-4c96-b36a-a8b238d04fe2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:35.285658 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9647c57d-46e5-4c96-b36a-a8b238d04fe2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.148415 Aug 24 12:51:35.286210 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1296/2594] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:35 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:35.648856 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3d8175ec-9580-4b13-8921-c598ea13faef tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:35.649464 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3d8175ec-9580-4b13-8921-c598ea13faef tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:35.655747 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d8175ec-9580-4b13-8921-c598ea13faef tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:35.656226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d8175ec-9580-4b13-8921-c598ea13faef tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:35.656654 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d8175ec-9580-4b13-8921-c598ea13faef tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:35.657327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d8175ec-9580-4b13-8921-c598ea13faef tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:35.657784 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d8175ec-9580-4b13-8921-c598ea13faef tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:35.658291 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d8175ec-9580-4b13-8921-c598ea13faef tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:35.786956 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3d8175ec-9580-4b13-8921-c598ea13faef tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:35.794973 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3d8175ec-9580-4b13-8921-c598ea13faef tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149918 Aug 24 12:51:35.795523 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1299/2595] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:35 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:36.144051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5ae894f4-cc7f-4ee6-a8e1-876314016318 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:36.144600 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5ae894f4-cc7f-4ee6-a8e1-876314016318 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:36.150941 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ae894f4-cc7f-4ee6-a8e1-876314016318 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:36.151431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ae894f4-cc7f-4ee6-a8e1-876314016318 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:36.151873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ae894f4-cc7f-4ee6-a8e1-876314016318 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:36.152555 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ae894f4-cc7f-4ee6-a8e1-876314016318 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:36.153009 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ae894f4-cc7f-4ee6-a8e1-876314016318 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:36.153435 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ae894f4-cc7f-4ee6-a8e1-876314016318 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:36.274707 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dfc70b46-7b7d-440c-bea3-e10d07a10ecc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:36.275305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dfc70b46-7b7d-440c-bea3-e10d07a10ecc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:36.281089 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dfc70b46-7b7d-440c-bea3-e10d07a10ecc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:36.281574 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dfc70b46-7b7d-440c-bea3-e10d07a10ecc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:36.282172 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dfc70b46-7b7d-440c-bea3-e10d07a10ecc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:36.282856 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dfc70b46-7b7d-440c-bea3-e10d07a10ecc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:36.283308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dfc70b46-7b7d-440c-bea3-e10d07a10ecc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:36.283735 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dfc70b46-7b7d-440c-bea3-e10d07a10ecc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:36.285458 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5ae894f4-cc7f-4ee6-a8e1-876314016318 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:36.294072 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5ae894f4-cc7f-4ee6-a8e1-876314016318 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:36.295673 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5ae894f4-cc7f-4ee6-a8e1-876314016318 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:36.296899 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5ae894f4-cc7f-4ee6-a8e1-876314016318 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.156873 Aug 24 12:51:36.297527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1297/2596] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:36 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:36.307011 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-beaaed68-17fc-4677-a8d1-e208552ba7c9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:36.307615 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-beaaed68-17fc-4677-a8d1-e208552ba7c9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:36.313512 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-beaaed68-17fc-4677-a8d1-e208552ba7c9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:36.313996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-beaaed68-17fc-4677-a8d1-e208552ba7c9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:36.314428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-beaaed68-17fc-4677-a8d1-e208552ba7c9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:36.315134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-beaaed68-17fc-4677-a8d1-e208552ba7c9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:36.315582 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-beaaed68-17fc-4677-a8d1-e208552ba7c9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:36.316003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-beaaed68-17fc-4677-a8d1-e208552ba7c9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:36.414527 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-dfc70b46-7b7d-440c-bea3-e10d07a10ecc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:36.422877 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dfc70b46-7b7d-440c-bea3-e10d07a10ecc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152063 Aug 24 12:51:36.423727 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1300/2597] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:36 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:36.445363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-beaaed68-17fc-4677-a8d1-e208552ba7c9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:36.453478 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-beaaed68-17fc-4677-a8d1-e208552ba7c9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149987 Aug 24 12:51:36.454029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1298/2598] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:36 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:36.816702 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3db8d54e-9206-42a8-91eb-751b23979ce1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:36.817311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3db8d54e-9206-42a8-91eb-751b23979ce1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:36.823247 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3db8d54e-9206-42a8-91eb-751b23979ce1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:36.823728 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3db8d54e-9206-42a8-91eb-751b23979ce1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:36.824166 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3db8d54e-9206-42a8-91eb-751b23979ce1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:36.824851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3db8d54e-9206-42a8-91eb-751b23979ce1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:36.825307 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3db8d54e-9206-42a8-91eb-751b23979ce1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:36.825734 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3db8d54e-9206-42a8-91eb-751b23979ce1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:36.964018 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3db8d54e-9206-42a8-91eb-751b23979ce1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:36.972096 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3db8d54e-9206-42a8-91eb-751b23979ce1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.159756 Aug 24 12:51:36.972650 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1301/2599] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:36 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:37.321677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-16e316ee-eabe-4de1-83d8-ee895077ed78 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:37.322302 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-16e316ee-eabe-4de1-83d8-ee895077ed78 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:37.328748 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-16e316ee-eabe-4de1-83d8-ee895077ed78 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:37.329224 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-16e316ee-eabe-4de1-83d8-ee895077ed78 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:37.329662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-16e316ee-eabe-4de1-83d8-ee895077ed78 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:37.330335 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-16e316ee-eabe-4de1-83d8-ee895077ed78 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:37.330817 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-16e316ee-eabe-4de1-83d8-ee895077ed78 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:37.331240 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-16e316ee-eabe-4de1-83d8-ee895077ed78 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:37.445069 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4557e458-2a48-46e9-b964-a166be859d6f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:37.446010 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4557e458-2a48-46e9-b964-a166be859d6f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:37.452356 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4557e458-2a48-46e9-b964-a166be859d6f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:37.452846 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4557e458-2a48-46e9-b964-a166be859d6f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:37.453288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4557e458-2a48-46e9-b964-a166be859d6f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:37.453978 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4557e458-2a48-46e9-b964-a166be859d6f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:37.454440 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4557e458-2a48-46e9-b964-a166be859d6f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:37.455018 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4557e458-2a48-46e9-b964-a166be859d6f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:37.461698 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-16e316ee-eabe-4de1-83d8-ee895077ed78 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:37.470202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-16e316ee-eabe-4de1-83d8-ee895077ed78 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:37.471714 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-16e316ee-eabe-4de1-83d8-ee895077ed78 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:37.472919 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-16e316ee-eabe-4de1-83d8-ee895077ed78 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155126 Aug 24 12:51:37.473468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1299/2600] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:37 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:37.477792 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3792df67-0c2c-4365-aa7f-1fa49623c2e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:37.478385 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3792df67-0c2c-4365-aa7f-1fa49623c2e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:37.484191 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3792df67-0c2c-4365-aa7f-1fa49623c2e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:37.484661 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3792df67-0c2c-4365-aa7f-1fa49623c2e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:37.485084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3792df67-0c2c-4365-aa7f-1fa49623c2e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:37.485936 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3792df67-0c2c-4365-aa7f-1fa49623c2e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:37.486384 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3792df67-0c2c-4365-aa7f-1fa49623c2e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:37.486843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3792df67-0c2c-4365-aa7f-1fa49623c2e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:37.590236 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4557e458-2a48-46e9-b964-a166be859d6f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:37.597782 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4557e458-2a48-46e9-b964-a166be859d6f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.156917 Aug 24 12:51:37.598337 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1302/2601] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:37 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:37.617534 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3792df67-0c2c-4365-aa7f-1fa49623c2e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:37.625591 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3792df67-0c2c-4365-aa7f-1fa49623c2e6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151199 Aug 24 12:51:37.626145 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1300/2602] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:37 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:37.993036 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5ee298e8-d9d7-48c4-a7cd-40a8792b72b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:37.993694 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5ee298e8-d9d7-48c4-a7cd-40a8792b72b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:37.999578 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5ee298e8-d9d7-48c4-a7cd-40a8792b72b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:38.000067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5ee298e8-d9d7-48c4-a7cd-40a8792b72b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:38.000505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5ee298e8-d9d7-48c4-a7cd-40a8792b72b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:38.001196 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5ee298e8-d9d7-48c4-a7cd-40a8792b72b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:38.001653 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5ee298e8-d9d7-48c4-a7cd-40a8792b72b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:38.002081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5ee298e8-d9d7-48c4-a7cd-40a8792b72b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:38.129270 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5ee298e8-d9d7-48c4-a7cd-40a8792b72b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:38.138902 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5ee298e8-d9d7-48c4-a7cd-40a8792b72b4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.148361 Aug 24 12:51:38.138902 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1303/2603] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:37 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:38.496532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a90e6081-27af-4273-98eb-d4bf4d819ae1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:38.497132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a90e6081-27af-4273-98eb-d4bf4d819ae1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:38.503460 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a90e6081-27af-4273-98eb-d4bf4d819ae1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:38.503929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a90e6081-27af-4273-98eb-d4bf4d819ae1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:38.504357 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a90e6081-27af-4273-98eb-d4bf4d819ae1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:38.505022 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a90e6081-27af-4273-98eb-d4bf4d819ae1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:38.505467 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a90e6081-27af-4273-98eb-d4bf4d819ae1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:38.505894 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a90e6081-27af-4273-98eb-d4bf4d819ae1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:38.619315 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1fe222f1-ad4a-4983-8c73-2b7699b04468 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:38.619922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1fe222f1-ad4a-4983-8c73-2b7699b04468 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:38.626217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1fe222f1-ad4a-4983-8c73-2b7699b04468 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:38.626740 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1fe222f1-ad4a-4983-8c73-2b7699b04468 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:38.627181 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1fe222f1-ad4a-4983-8c73-2b7699b04468 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:38.627874 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1fe222f1-ad4a-4983-8c73-2b7699b04468 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:38.628338 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1fe222f1-ad4a-4983-8c73-2b7699b04468 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:38.628768 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1fe222f1-ad4a-4983-8c73-2b7699b04468 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:38.631275 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a90e6081-27af-4273-98eb-d4bf4d819ae1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:38.639862 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a90e6081-27af-4273-98eb-d4bf4d819ae1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:38.641357 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a90e6081-27af-4273-98eb-d4bf4d819ae1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:38.642550 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a90e6081-27af-4273-98eb-d4bf4d819ae1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.149894 Aug 24 12:51:38.643135 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1301/2604] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:38 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:38.650018 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-92157045-e766-4ba8-807c-ee73864d2cf5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:38.650618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-92157045-e766-4ba8-807c-ee73864d2cf5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:38.656321 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92157045-e766-4ba8-807c-ee73864d2cf5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:38.656817 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92157045-e766-4ba8-807c-ee73864d2cf5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:38.657255 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92157045-e766-4ba8-807c-ee73864d2cf5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:38.657964 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92157045-e766-4ba8-807c-ee73864d2cf5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:38.658405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92157045-e766-4ba8-807c-ee73864d2cf5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:38.658864 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92157045-e766-4ba8-807c-ee73864d2cf5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:38.761668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1fe222f1-ad4a-4983-8c73-2b7699b04468 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:38.770541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1fe222f1-ad4a-4983-8c73-2b7699b04468 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.155027 Aug 24 12:51:38.771138 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1304/2605] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:38 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:38.790461 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-92157045-e766-4ba8-807c-ee73864d2cf5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:38.798567 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-92157045-e766-4ba8-807c-ee73864d2cf5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.154506 Aug 24 12:51:38.799158 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1302/2606] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:38 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:39.157696 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-06536d16-e3b2-4d0b-ae41-b7482c897028 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:39.158310 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-06536d16-e3b2-4d0b-ae41-b7482c897028 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:39.164195 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06536d16-e3b2-4d0b-ae41-b7482c897028 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:39.164679 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06536d16-e3b2-4d0b-ae41-b7482c897028 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:39.165119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06536d16-e3b2-4d0b-ae41-b7482c897028 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:39.165808 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06536d16-e3b2-4d0b-ae41-b7482c897028 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:39.166269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06536d16-e3b2-4d0b-ae41-b7482c897028 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:39.166732 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06536d16-e3b2-4d0b-ae41-b7482c897028 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:39.293684 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-06536d16-e3b2-4d0b-ae41-b7482c897028 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:39.296207 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:51:39.303575 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-06536d16-e3b2-4d0b-ae41-b7482c897028 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149581 Aug 24 12:51:39.304284 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1305/2607] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:39 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:39.665491 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f6c802e0-ec64-42d8-9717-f54700b3c27a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:39.666039 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f6c802e0-ec64-42d8-9717-f54700b3c27a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:39.672330 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f6c802e0-ec64-42d8-9717-f54700b3c27a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:39.672799 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f6c802e0-ec64-42d8-9717-f54700b3c27a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:39.673222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f6c802e0-ec64-42d8-9717-f54700b3c27a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:39.673891 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f6c802e0-ec64-42d8-9717-f54700b3c27a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:39.674333 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f6c802e0-ec64-42d8-9717-f54700b3c27a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:39.674774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f6c802e0-ec64-42d8-9717-f54700b3c27a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:39.792252 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5fa4e86c-8947-4c14-9886-2420d876b2e9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:39.792873 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5fa4e86c-8947-4c14-9886-2420d876b2e9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:39.799497 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5fa4e86c-8947-4c14-9886-2420d876b2e9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:39.803533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5fa4e86c-8947-4c14-9886-2420d876b2e9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:39.803533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5fa4e86c-8947-4c14-9886-2420d876b2e9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:39.803533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5fa4e86c-8947-4c14-9886-2420d876b2e9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:39.803533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5fa4e86c-8947-4c14-9886-2420d876b2e9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:39.804104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5fa4e86c-8947-4c14-9886-2420d876b2e9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:39.805319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f6c802e0-ec64-42d8-9717-f54700b3c27a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:39.813850 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f6c802e0-ec64-42d8-9717-f54700b3c27a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:39.815773 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f6c802e0-ec64-42d8-9717-f54700b3c27a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:39.816923 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f6c802e0-ec64-42d8-9717-f54700b3c27a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155377 Aug 24 12:51:39.817621 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1303/2608] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:39 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:39.825684 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5385f5bb-5b5b-43f0-a4dc-4125cba6a4d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:39.826485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5385f5bb-5b5b-43f0-a4dc-4125cba6a4d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:39.832463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5385f5bb-5b5b-43f0-a4dc-4125cba6a4d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:39.833017 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5385f5bb-5b5b-43f0-a4dc-4125cba6a4d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:39.833458 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5385f5bb-5b5b-43f0-a4dc-4125cba6a4d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:39.834141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5385f5bb-5b5b-43f0-a4dc-4125cba6a4d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:39.834590 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5385f5bb-5b5b-43f0-a4dc-4125cba6a4d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:39.835037 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5385f5bb-5b5b-43f0-a4dc-4125cba6a4d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:39.936285 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5fa4e86c-8947-4c14-9886-2420d876b2e9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:39.944617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5fa4e86c-8947-4c14-9886-2420d876b2e9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.157065 Aug 24 12:51:39.945279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1306/2609] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:39 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:39.967490 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5385f5bb-5b5b-43f0-a4dc-4125cba6a4d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:39.976043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5385f5bb-5b5b-43f0-a4dc-4125cba6a4d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.153966 Aug 24 12:51:39.976629 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1304/2610] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:39 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:40.334994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c28ecc41-15b3-4e41-acd5-03bece489811 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:40.335606 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c28ecc41-15b3-4e41-acd5-03bece489811 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:40.341686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c28ecc41-15b3-4e41-acd5-03bece489811 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:40.342176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c28ecc41-15b3-4e41-acd5-03bece489811 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:40.342631 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c28ecc41-15b3-4e41-acd5-03bece489811 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:40.343346 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c28ecc41-15b3-4e41-acd5-03bece489811 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:40.343807 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c28ecc41-15b3-4e41-acd5-03bece489811 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:40.344238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c28ecc41-15b3-4e41-acd5-03bece489811 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:40.475424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c28ecc41-15b3-4e41-acd5-03bece489811 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:40.483511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c28ecc41-15b3-4e41-acd5-03bece489811 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.152928 Aug 24 12:51:40.484064 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1307/2611] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:40 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:40.840075 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d2b2cb03-8152-44f3-9d7a-69ae92d4f01a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:40.840681 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d2b2cb03-8152-44f3-9d7a-69ae92d4f01a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:40.847093 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d2b2cb03-8152-44f3-9d7a-69ae92d4f01a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:40.847572 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d2b2cb03-8152-44f3-9d7a-69ae92d4f01a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:40.848003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d2b2cb03-8152-44f3-9d7a-69ae92d4f01a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:40.848685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d2b2cb03-8152-44f3-9d7a-69ae92d4f01a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:40.849156 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d2b2cb03-8152-44f3-9d7a-69ae92d4f01a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:40.849578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d2b2cb03-8152-44f3-9d7a-69ae92d4f01a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:40.853395 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:51:40.965359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b0bf8675-5bb5-4a99-babe-a9cdba421edf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:40.966001 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b0bf8675-5bb5-4a99-babe-a9cdba421edf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:40.972338 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0bf8675-5bb5-4a99-babe-a9cdba421edf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:40.972826 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0bf8675-5bb5-4a99-babe-a9cdba421edf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:40.973266 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0bf8675-5bb5-4a99-babe-a9cdba421edf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:40.973957 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0bf8675-5bb5-4a99-babe-a9cdba421edf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:40.974417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0bf8675-5bb5-4a99-babe-a9cdba421edf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:40.974875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0bf8675-5bb5-4a99-babe-a9cdba421edf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:40.975673 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d2b2cb03-8152-44f3-9d7a-69ae92d4f01a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:40.984673 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d2b2cb03-8152-44f3-9d7a-69ae92d4f01a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:40.986248 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d2b2cb03-8152-44f3-9d7a-69ae92d4f01a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:40.988264 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d2b2cb03-8152-44f3-9d7a-69ae92d4f01a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.151321 Aug 24 12:51:40.989114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1305/2612] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:40 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:40.996865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3b56a71a-3c57-46c1-83c3-ca95d2a991fc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:40.997500 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3b56a71a-3c57-46c1-83c3-ca95d2a991fc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:41.003718 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b56a71a-3c57-46c1-83c3-ca95d2a991fc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:41.004210 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b56a71a-3c57-46c1-83c3-ca95d2a991fc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:41.004646 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b56a71a-3c57-46c1-83c3-ca95d2a991fc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:41.005328 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b56a71a-3c57-46c1-83c3-ca95d2a991fc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:41.005787 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b56a71a-3c57-46c1-83c3-ca95d2a991fc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:41.006208 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b56a71a-3c57-46c1-83c3-ca95d2a991fc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:41.106911 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b0bf8675-5bb5-4a99-babe-a9cdba421edf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:41.115878 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b0bf8675-5bb5-4a99-babe-a9cdba421edf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.154436 Aug 24 12:51:41.116444 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1308/2613] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:40 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:41.137625 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3b56a71a-3c57-46c1-83c3-ca95d2a991fc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:41.145753 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3b56a71a-3c57-46c1-83c3-ca95d2a991fc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152414 Aug 24 12:51:41.146322 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1306/2614] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:40 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:41.504839 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e2f21b31-1980-4b24-8cf9-319b56750ba6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:41.505475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e2f21b31-1980-4b24-8cf9-319b56750ba6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:41.511334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2f21b31-1980-4b24-8cf9-319b56750ba6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:41.511814 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2f21b31-1980-4b24-8cf9-319b56750ba6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:41.512250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2f21b31-1980-4b24-8cf9-319b56750ba6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:41.512932 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2f21b31-1980-4b24-8cf9-319b56750ba6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:41.513388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2f21b31-1980-4b24-8cf9-319b56750ba6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:41.513809 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2f21b31-1980-4b24-8cf9-319b56750ba6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:41.644939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e2f21b31-1980-4b24-8cf9-319b56750ba6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:41.653097 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e2f21b31-1980-4b24-8cf9-319b56750ba6 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.152228 Aug 24 12:51:41.653678 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1309/2615] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:41 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:42.011739 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-525f594b-9677-418a-8f04-3ea6870c3748 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:42.012336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-525f594b-9677-418a-8f04-3ea6870c3748 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:42.019165 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-525f594b-9677-418a-8f04-3ea6870c3748 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:42.019653 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-525f594b-9677-418a-8f04-3ea6870c3748 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:42.020080 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-525f594b-9677-418a-8f04-3ea6870c3748 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:42.020751 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-525f594b-9677-418a-8f04-3ea6870c3748 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:42.021198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-525f594b-9677-418a-8f04-3ea6870c3748 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:42.021617 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-525f594b-9677-418a-8f04-3ea6870c3748 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:42.137218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-35a90a97-6813-480d-b89f-586d44ccbe0a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:42.137827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-35a90a97-6813-480d-b89f-586d44ccbe0a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:42.144729 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35a90a97-6813-480d-b89f-586d44ccbe0a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:42.145244 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35a90a97-6813-480d-b89f-586d44ccbe0a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:42.145629 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35a90a97-6813-480d-b89f-586d44ccbe0a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:42.146319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35a90a97-6813-480d-b89f-586d44ccbe0a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:42.146799 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35a90a97-6813-480d-b89f-586d44ccbe0a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:42.147223 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35a90a97-6813-480d-b89f-586d44ccbe0a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:42.147609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-525f594b-9677-418a-8f04-3ea6870c3748 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:42.156388 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-525f594b-9677-418a-8f04-3ea6870c3748 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:42.157906 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-525f594b-9677-418a-8f04-3ea6870c3748 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:42.159131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-525f594b-9677-418a-8f04-3ea6870c3748 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.151264 Aug 24 12:51:42.159729 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1307/2616] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:42 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:42.166256 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0ade97da-bdde-47bf-bf47-081106f0b135 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:42.166883 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0ade97da-bdde-47bf-bf47-081106f0b135 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:42.173891 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ade97da-bdde-47bf-bf47-081106f0b135 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:42.173891 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ade97da-bdde-47bf-bf47-081106f0b135 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:42.173891 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ade97da-bdde-47bf-bf47-081106f0b135 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:42.174982 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ade97da-bdde-47bf-bf47-081106f0b135 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:42.175479 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ade97da-bdde-47bf-bf47-081106f0b135 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:42.176141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ade97da-bdde-47bf-bf47-081106f0b135 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:42.285119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-35a90a97-6813-480d-b89f-586d44ccbe0a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:42.294029 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-35a90a97-6813-480d-b89f-586d44ccbe0a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.160489 Aug 24 12:51:42.299946 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1310/2617] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:42 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:42.319767 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0ade97da-bdde-47bf-bf47-081106f0b135 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:42.328237 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0ade97da-bdde-47bf-bf47-081106f0b135 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.165407 Aug 24 12:51:42.328800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1308/2618] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:42 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:42.673956 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5b0cbe62-fb64-455b-a29b-264c174425cd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:42.674581 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5b0cbe62-fb64-455b-a29b-264c174425cd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:42.680989 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b0cbe62-fb64-455b-a29b-264c174425cd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:42.681464 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b0cbe62-fb64-455b-a29b-264c174425cd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:42.681897 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b0cbe62-fb64-455b-a29b-264c174425cd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:42.682572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b0cbe62-fb64-455b-a29b-264c174425cd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:42.683046 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b0cbe62-fb64-455b-a29b-264c174425cd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:42.683463 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b0cbe62-fb64-455b-a29b-264c174425cd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:42.811457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5b0cbe62-fb64-455b-a29b-264c174425cd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:42.819493 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5b0cbe62-fb64-455b-a29b-264c174425cd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149490 Aug 24 12:51:42.820064 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1311/2619] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:42 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:43.181889 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-010a29f2-584d-4c71-a6d9-332072f47e30 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:43.182501 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-010a29f2-584d-4c71-a6d9-332072f47e30 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:43.188932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-010a29f2-584d-4c71-a6d9-332072f47e30 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:43.189413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-010a29f2-584d-4c71-a6d9-332072f47e30 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:43.189847 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-010a29f2-584d-4c71-a6d9-332072f47e30 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:43.191135 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-010a29f2-584d-4c71-a6d9-332072f47e30 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:43.191599 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-010a29f2-584d-4c71-a6d9-332072f47e30 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:43.192024 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-010a29f2-584d-4c71-a6d9-332072f47e30 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:43.315291 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4d559469-3070-4e4f-840d-b7eef529cd51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:43.316491 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4d559469-3070-4e4f-840d-b7eef529cd51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:43.322874 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4d559469-3070-4e4f-840d-b7eef529cd51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:43.323081 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-010a29f2-584d-4c71-a6d9-332072f47e30 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:43.323360 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4d559469-3070-4e4f-840d-b7eef529cd51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:43.323793 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4d559469-3070-4e4f-840d-b7eef529cd51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:43.324474 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4d559469-3070-4e4f-840d-b7eef529cd51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:43.325052 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4d559469-3070-4e4f-840d-b7eef529cd51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:43.325480 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4d559469-3070-4e4f-840d-b7eef529cd51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:43.331850 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-010a29f2-584d-4c71-a6d9-332072f47e30 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:43.333334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-010a29f2-584d-4c71-a6d9-332072f47e30 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:43.334485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-010a29f2-584d-4c71-a6d9-332072f47e30 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.156444 Aug 24 12:51:43.335098 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1309/2620] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:43 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:43.349875 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-aebe94fb-971b-42ff-bde1-788b51aceb87 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:43.350609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-aebe94fb-971b-42ff-bde1-788b51aceb87 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:43.356527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aebe94fb-971b-42ff-bde1-788b51aceb87 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:43.357096 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aebe94fb-971b-42ff-bde1-788b51aceb87 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:43.357532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aebe94fb-971b-42ff-bde1-788b51aceb87 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:43.358213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aebe94fb-971b-42ff-bde1-788b51aceb87 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:43.358671 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aebe94fb-971b-42ff-bde1-788b51aceb87 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:43.359103 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aebe94fb-971b-42ff-bde1-788b51aceb87 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:43.456751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4d559469-3070-4e4f-840d-b7eef529cd51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:43.465526 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4d559469-3070-4e4f-840d-b7eef529cd51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.154203 Aug 24 12:51:43.474140 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1312/2621] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:43 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:43.489272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-aebe94fb-971b-42ff-bde1-788b51aceb87 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:43.497625 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-aebe94fb-971b-42ff-bde1-788b51aceb87 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151721 Aug 24 12:51:43.498182 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1310/2622] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:43 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:43.840170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5ed6e7e2-f48e-45e7-862e-1c3aea702f7e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:43.840788 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5ed6e7e2-f48e-45e7-862e-1c3aea702f7e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:43.846921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5ed6e7e2-f48e-45e7-862e-1c3aea702f7e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:43.847411 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5ed6e7e2-f48e-45e7-862e-1c3aea702f7e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:43.847857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5ed6e7e2-f48e-45e7-862e-1c3aea702f7e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:43.848542 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5ed6e7e2-f48e-45e7-862e-1c3aea702f7e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:43.848998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5ed6e7e2-f48e-45e7-862e-1c3aea702f7e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:43.849428 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5ed6e7e2-f48e-45e7-862e-1c3aea702f7e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:43.978455 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5ed6e7e2-f48e-45e7-862e-1c3aea702f7e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:43.986791 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5ed6e7e2-f48e-45e7-862e-1c3aea702f7e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150404 Aug 24 12:51:43.987722 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1313/2623] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:43 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:44.356776 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8a17d75c-a1fe-4687-b462-c0751ab7d625 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:44.357385 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8a17d75c-a1fe-4687-b462-c0751ab7d625 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:44.363954 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8a17d75c-a1fe-4687-b462-c0751ab7d625 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:44.364432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8a17d75c-a1fe-4687-b462-c0751ab7d625 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:44.364868 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8a17d75c-a1fe-4687-b462-c0751ab7d625 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:44.365544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8a17d75c-a1fe-4687-b462-c0751ab7d625 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:44.365993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8a17d75c-a1fe-4687-b462-c0751ab7d625 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:44.366414 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8a17d75c-a1fe-4687-b462-c0751ab7d625 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:44.486330 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d8ab047e-b08c-4066-b165-76fc4f82b1d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:44.486959 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d8ab047e-b08c-4066-b165-76fc4f82b1d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:44.493510 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d8ab047e-b08c-4066-b165-76fc4f82b1d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:44.493994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d8ab047e-b08c-4066-b165-76fc4f82b1d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:44.494427 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d8ab047e-b08c-4066-b165-76fc4f82b1d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:44.495281 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d8ab047e-b08c-4066-b165-76fc4f82b1d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:44.495593 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d8ab047e-b08c-4066-b165-76fc4f82b1d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:44.496037 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d8ab047e-b08c-4066-b165-76fc4f82b1d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:44.497587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8a17d75c-a1fe-4687-b462-c0751ab7d625 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:44.506597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8a17d75c-a1fe-4687-b462-c0751ab7d625 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:44.508119 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8a17d75c-a1fe-4687-b462-c0751ab7d625 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:44.509274 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8a17d75c-a1fe-4687-b462-c0751ab7d625 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.156337 Aug 24 12:51:44.509822 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1311/2624] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:44 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:44.529900 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0a0ba7ab-ce49-4b6b-8890-06730c953234 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:44.530523 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0a0ba7ab-ce49-4b6b-8890-06730c953234 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:44.536561 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a0ba7ab-ce49-4b6b-8890-06730c953234 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:44.537043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a0ba7ab-ce49-4b6b-8890-06730c953234 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:44.537478 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a0ba7ab-ce49-4b6b-8890-06730c953234 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:44.538161 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a0ba7ab-ce49-4b6b-8890-06730c953234 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:44.538606 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a0ba7ab-ce49-4b6b-8890-06730c953234 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:44.539079 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a0ba7ab-ce49-4b6b-8890-06730c953234 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:44.629867 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d8ab047e-b08c-4066-b165-76fc4f82b1d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:44.638044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d8ab047e-b08c-4066-b165-76fc4f82b1d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.155537 Aug 24 12:51:44.638601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1314/2625] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:44 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:44.667629 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0a0ba7ab-ce49-4b6b-8890-06730c953234 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:44.676091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0a0ba7ab-ce49-4b6b-8890-06730c953234 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149776 Aug 24 12:51:44.676639 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1312/2626] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:44 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:45.008509 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5e26d998-1df6-4d42-aff4-8464d2f10f98 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:45.009121 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5e26d998-1df6-4d42-aff4-8464d2f10f98 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:45.015082 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e26d998-1df6-4d42-aff4-8464d2f10f98 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:45.015568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e26d998-1df6-4d42-aff4-8464d2f10f98 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:45.016007 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e26d998-1df6-4d42-aff4-8464d2f10f98 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:45.017866 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e26d998-1df6-4d42-aff4-8464d2f10f98 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:45.017866 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e26d998-1df6-4d42-aff4-8464d2f10f98 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:45.017866 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e26d998-1df6-4d42-aff4-8464d2f10f98 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:45.142798 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5e26d998-1df6-4d42-aff4-8464d2f10f98 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:45.150993 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5e26d998-1df6-4d42-aff4-8464d2f10f98 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.146378 Aug 24 12:51:45.151555 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1315/2627] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:45 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:45.532853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-88cfc9a8-5e99-41a2-bd56-e66be2593db8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:45.533457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-88cfc9a8-5e99-41a2-bd56-e66be2593db8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:45.541439 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88cfc9a8-5e99-41a2-bd56-e66be2593db8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:45.541914 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88cfc9a8-5e99-41a2-bd56-e66be2593db8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:45.542350 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88cfc9a8-5e99-41a2-bd56-e66be2593db8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:45.543168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88cfc9a8-5e99-41a2-bd56-e66be2593db8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:45.543661 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88cfc9a8-5e99-41a2-bd56-e66be2593db8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:45.544079 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88cfc9a8-5e99-41a2-bd56-e66be2593db8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:45.659979 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9dce0ed9-8519-4610-81ff-a0449937fdcc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:45.660589 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9dce0ed9-8519-4610-81ff-a0449937fdcc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:45.663035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:51:45.667632 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9dce0ed9-8519-4610-81ff-a0449937fdcc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:45.668116 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9dce0ed9-8519-4610-81ff-a0449937fdcc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:45.668546 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9dce0ed9-8519-4610-81ff-a0449937fdcc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:45.669231 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9dce0ed9-8519-4610-81ff-a0449937fdcc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:45.669679 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9dce0ed9-8519-4610-81ff-a0449937fdcc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:45.670102 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9dce0ed9-8519-4610-81ff-a0449937fdcc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:45.672536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-88cfc9a8-5e99-41a2-bd56-e66be2593db8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:45.681217 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-88cfc9a8-5e99-41a2-bd56-e66be2593db8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:45.682634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-88cfc9a8-5e99-41a2-bd56-e66be2593db8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:45.683815 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-88cfc9a8-5e99-41a2-bd56-e66be2593db8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154924 Aug 24 12:51:45.684360 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1313/2628] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:45 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:45.696461 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-be1c6d43-ee7f-42e9-8ffc-978c7752cc83 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:45.697254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-be1c6d43-ee7f-42e9-8ffc-978c7752cc83 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:45.703444 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be1c6d43-ee7f-42e9-8ffc-978c7752cc83 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:45.703924 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be1c6d43-ee7f-42e9-8ffc-978c7752cc83 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:45.704351 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be1c6d43-ee7f-42e9-8ffc-978c7752cc83 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:45.705027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be1c6d43-ee7f-42e9-8ffc-978c7752cc83 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:45.705474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be1c6d43-ee7f-42e9-8ffc-978c7752cc83 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:45.705894 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be1c6d43-ee7f-42e9-8ffc-978c7752cc83 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:45.804505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9dce0ed9-8519-4610-81ff-a0449937fdcc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:45.812686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9dce0ed9-8519-4610-81ff-a0449937fdcc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.157184 Aug 24 12:51:45.813249 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1316/2629] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:45 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:45.836753 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-be1c6d43-ee7f-42e9-8ffc-978c7752cc83 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:45.844802 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-be1c6d43-ee7f-42e9-8ffc-978c7752cc83 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152013 Aug 24 12:51:45.845348 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1314/2630] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:45 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:46.173252 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0f6bfe87-e43a-429d-821f-d05bcdbcca60 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:46.173863 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0f6bfe87-e43a-429d-821f-d05bcdbcca60 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:46.180304 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f6bfe87-e43a-429d-821f-d05bcdbcca60 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:46.180812 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f6bfe87-e43a-429d-821f-d05bcdbcca60 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:46.181246 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f6bfe87-e43a-429d-821f-d05bcdbcca60 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:46.181927 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f6bfe87-e43a-429d-821f-d05bcdbcca60 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:46.182383 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f6bfe87-e43a-429d-821f-d05bcdbcca60 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:46.182840 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f6bfe87-e43a-429d-821f-d05bcdbcca60 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:46.313050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0f6bfe87-e43a-429d-821f-d05bcdbcca60 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:46.321135 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0f6bfe87-e43a-429d-821f-d05bcdbcca60 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151708 Aug 24 12:51:46.321693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1317/2631] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:46 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:46.707685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fcf9edc7-fb5f-4f51-9870-c22bfca336cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:46.708220 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fcf9edc7-fb5f-4f51-9870-c22bfca336cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:46.714690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fcf9edc7-fb5f-4f51-9870-c22bfca336cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:46.715166 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fcf9edc7-fb5f-4f51-9870-c22bfca336cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:46.715601 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fcf9edc7-fb5f-4f51-9870-c22bfca336cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:46.716268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fcf9edc7-fb5f-4f51-9870-c22bfca336cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:46.716710 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fcf9edc7-fb5f-4f51-9870-c22bfca336cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:46.717127 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fcf9edc7-fb5f-4f51-9870-c22bfca336cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:46.834579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e5861dc6-21b4-4680-b130-b529a942263d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:46.835246 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e5861dc6-21b4-4680-b130-b529a942263d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:46.841540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e5861dc6-21b4-4680-b130-b529a942263d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:46.842027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e5861dc6-21b4-4680-b130-b529a942263d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:46.842466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e5861dc6-21b4-4680-b130-b529a942263d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:46.843183 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e5861dc6-21b4-4680-b130-b529a942263d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:46.843642 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e5861dc6-21b4-4680-b130-b529a942263d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:46.843753 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fcf9edc7-fb5f-4f51-9870-c22bfca336cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:46.844069 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e5861dc6-21b4-4680-b130-b529a942263d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:46.852482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fcf9edc7-fb5f-4f51-9870-c22bfca336cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:46.853968 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fcf9edc7-fb5f-4f51-9870-c22bfca336cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:46.855157 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fcf9edc7-fb5f-4f51-9870-c22bfca336cf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.152020 Aug 24 12:51:46.855708 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1315/2632] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:46 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:46.865986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-57f66a5e-3994-458f-b863-ce2f9cfa2d7d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:46.866873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-57f66a5e-3994-458f-b863-ce2f9cfa2d7d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:46.873167 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-57f66a5e-3994-458f-b863-ce2f9cfa2d7d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:46.873643 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-57f66a5e-3994-458f-b863-ce2f9cfa2d7d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:46.874066 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-57f66a5e-3994-458f-b863-ce2f9cfa2d7d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:46.874785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-57f66a5e-3994-458f-b863-ce2f9cfa2d7d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:46.875231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-57f66a5e-3994-458f-b863-ce2f9cfa2d7d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:46.875649 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-57f66a5e-3994-458f-b863-ce2f9cfa2d7d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:46.974081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e5861dc6-21b4-4680-b130-b529a942263d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:46.982303 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e5861dc6-21b4-4680-b130-b529a942263d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152094 Aug 24 12:51:46.982891 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1318/2633] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:46 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:47.006452 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-57f66a5e-3994-458f-b863-ce2f9cfa2d7d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:47.014807 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-57f66a5e-3994-458f-b863-ce2f9cfa2d7d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.153509 Aug 24 12:51:47.015373 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1316/2634] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:46 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:47.341358 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8f6a6a86-39fe-444a-aed1-f1ef9ac74ad2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:47.341972 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8f6a6a86-39fe-444a-aed1-f1ef9ac74ad2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:47.348670 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f6a6a86-39fe-444a-aed1-f1ef9ac74ad2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:47.349159 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f6a6a86-39fe-444a-aed1-f1ef9ac74ad2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:47.349597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f6a6a86-39fe-444a-aed1-f1ef9ac74ad2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:47.350286 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f6a6a86-39fe-444a-aed1-f1ef9ac74ad2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:47.350776 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f6a6a86-39fe-444a-aed1-f1ef9ac74ad2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:47.351205 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f6a6a86-39fe-444a-aed1-f1ef9ac74ad2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:47.479863 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8f6a6a86-39fe-444a-aed1-f1ef9ac74ad2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:47.488826 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8f6a6a86-39fe-444a-aed1-f1ef9ac74ad2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151415 Aug 24 12:51:47.489479 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1319/2635] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:47 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:47.878429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c5a036b6-474b-425f-aad3-37550da39bf3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:47.879077 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c5a036b6-474b-425f-aad3-37550da39bf3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:47.885467 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5a036b6-474b-425f-aad3-37550da39bf3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:47.885947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5a036b6-474b-425f-aad3-37550da39bf3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:47.886381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5a036b6-474b-425f-aad3-37550da39bf3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:47.887107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5a036b6-474b-425f-aad3-37550da39bf3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:47.887563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5a036b6-474b-425f-aad3-37550da39bf3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:47.887988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5a036b6-474b-425f-aad3-37550da39bf3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:48.004070 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-db7798b8-ea29-4c39-acce-feed83e9febb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:48.004699 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-db7798b8-ea29-4c39-acce-feed83e9febb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:48.011208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db7798b8-ea29-4c39-acce-feed83e9febb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:48.011704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db7798b8-ea29-4c39-acce-feed83e9febb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:48.012147 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db7798b8-ea29-4c39-acce-feed83e9febb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:48.012848 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db7798b8-ea29-4c39-acce-feed83e9febb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:48.013313 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db7798b8-ea29-4c39-acce-feed83e9febb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:48.013745 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db7798b8-ea29-4c39-acce-feed83e9febb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:48.023086 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c5a036b6-474b-425f-aad3-37550da39bf3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:48.033131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c5a036b6-474b-425f-aad3-37550da39bf3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:48.035298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c5a036b6-474b-425f-aad3-37550da39bf3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:48.036463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c5a036b6-474b-425f-aad3-37550da39bf3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.161951 Aug 24 12:51:48.037015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1317/2636] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:47 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:48.041502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4a077830-e138-48a7-8f65-0b25e3351bfb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:48.042109 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4a077830-e138-48a7-8f65-0b25e3351bfb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:48.048023 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a077830-e138-48a7-8f65-0b25e3351bfb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:48.048510 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a077830-e138-48a7-8f65-0b25e3351bfb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:48.048949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a077830-e138-48a7-8f65-0b25e3351bfb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:48.049687 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a077830-e138-48a7-8f65-0b25e3351bfb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:48.050118 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a077830-e138-48a7-8f65-0b25e3351bfb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:48.050550 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a077830-e138-48a7-8f65-0b25e3351bfb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:48.145100 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-db7798b8-ea29-4c39-acce-feed83e9febb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:48.153333 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-db7798b8-ea29-4c39-acce-feed83e9febb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153623 Aug 24 12:51:48.153902 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1320/2637] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:47 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:48.183939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4a077830-e138-48a7-8f65-0b25e3351bfb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:48.192698 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4a077830-e138-48a7-8f65-0b25e3351bfb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.154761 Aug 24 12:51:48.193249 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1318/2638] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:48 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:48.510092 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8cc534ee-a9ad-4131-8ad8-2c031ccb1566 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:48.510730 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8cc534ee-a9ad-4131-8ad8-2c031ccb1566 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:48.516748 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8cc534ee-a9ad-4131-8ad8-2c031ccb1566 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:48.517244 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8cc534ee-a9ad-4131-8ad8-2c031ccb1566 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:48.517685 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8cc534ee-a9ad-4131-8ad8-2c031ccb1566 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:48.518371 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8cc534ee-a9ad-4131-8ad8-2c031ccb1566 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:48.518863 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8cc534ee-a9ad-4131-8ad8-2c031ccb1566 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:48.519295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8cc534ee-a9ad-4131-8ad8-2c031ccb1566 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:48.651480 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8cc534ee-a9ad-4131-8ad8-2c031ccb1566 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:48.659636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8cc534ee-a9ad-4131-8ad8-2c031ccb1566 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.153426 Aug 24 12:51:48.660190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1321/2639] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:48 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:49.059078 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c644bece-bc70-4e42-9434-bfd07b2f8df4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:49.059680 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c644bece-bc70-4e42-9434-bfd07b2f8df4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:49.066541 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c644bece-bc70-4e42-9434-bfd07b2f8df4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:49.067043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c644bece-bc70-4e42-9434-bfd07b2f8df4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:49.067474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c644bece-bc70-4e42-9434-bfd07b2f8df4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:49.068143 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c644bece-bc70-4e42-9434-bfd07b2f8df4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:49.068587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c644bece-bc70-4e42-9434-bfd07b2f8df4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:49.069005 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c644bece-bc70-4e42-9434-bfd07b2f8df4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:49.174033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-faf5d157-106e-4249-a2a6-df4b479290e6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:49.175345 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-faf5d157-106e-4249-a2a6-df4b479290e6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:49.181705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-faf5d157-106e-4249-a2a6-df4b479290e6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:49.182271 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-faf5d157-106e-4249-a2a6-df4b479290e6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:49.182769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-faf5d157-106e-4249-a2a6-df4b479290e6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:49.183476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-faf5d157-106e-4249-a2a6-df4b479290e6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:49.183938 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-faf5d157-106e-4249-a2a6-df4b479290e6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:49.184369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-faf5d157-106e-4249-a2a6-df4b479290e6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:49.198043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c644bece-bc70-4e42-9434-bfd07b2f8df4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:49.199984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:51:49.206787 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c644bece-bc70-4e42-9434-bfd07b2f8df4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:49.208283 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c644bece-bc70-4e42-9434-bfd07b2f8df4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:49.209436 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c644bece-bc70-4e42-9434-bfd07b2f8df4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154269 Aug 24 12:51:49.209987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1319/2640] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:49 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:49.215043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-59d62848-ac23-46e7-87d0-0e5e4714c33f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:49.215637 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-59d62848-ac23-46e7-87d0-0e5e4714c33f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:49.221541 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59d62848-ac23-46e7-87d0-0e5e4714c33f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:49.222023 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59d62848-ac23-46e7-87d0-0e5e4714c33f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:49.222451 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59d62848-ac23-46e7-87d0-0e5e4714c33f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:49.223182 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59d62848-ac23-46e7-87d0-0e5e4714c33f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:49.223778 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59d62848-ac23-46e7-87d0-0e5e4714c33f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:49.224122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59d62848-ac23-46e7-87d0-0e5e4714c33f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:49.327419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-faf5d157-106e-4249-a2a6-df4b479290e6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:49.335754 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-faf5d157-106e-4249-a2a6-df4b479290e6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.165558 Aug 24 12:51:49.336872 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1322/2641] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:49 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:49.354154 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-59d62848-ac23-46e7-87d0-0e5e4714c33f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:49.362960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-59d62848-ac23-46e7-87d0-0e5e4714c33f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151265 Aug 24 12:51:49.363506 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1320/2642] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:49 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:49.680888 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c12497ce-264c-4363-944f-ecfe8803e1b3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:49.681430 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c12497ce-264c-4363-944f-ecfe8803e1b3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:49.687426 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c12497ce-264c-4363-944f-ecfe8803e1b3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:49.687908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c12497ce-264c-4363-944f-ecfe8803e1b3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:49.688343 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c12497ce-264c-4363-944f-ecfe8803e1b3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:49.689054 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c12497ce-264c-4363-944f-ecfe8803e1b3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:49.689506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c12497ce-264c-4363-944f-ecfe8803e1b3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:49.689935 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c12497ce-264c-4363-944f-ecfe8803e1b3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:49.820523 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c12497ce-264c-4363-944f-ecfe8803e1b3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:49.828638 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c12497ce-264c-4363-944f-ecfe8803e1b3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151657 Aug 24 12:51:49.829203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1323/2643] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:49 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:50.233134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6e07cbf8-ae16-4bc3-b191-cc50ea096395 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:50.233745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6e07cbf8-ae16-4bc3-b191-cc50ea096395 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:50.240444 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e07cbf8-ae16-4bc3-b191-cc50ea096395 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:50.240929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e07cbf8-ae16-4bc3-b191-cc50ea096395 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:50.241368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e07cbf8-ae16-4bc3-b191-cc50ea096395 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:50.242059 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e07cbf8-ae16-4bc3-b191-cc50ea096395 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:50.242512 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e07cbf8-ae16-4bc3-b191-cc50ea096395 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:50.242966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e07cbf8-ae16-4bc3-b191-cc50ea096395 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:50.356462 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b34a19a1-ac7c-4bd7-8d93-602c8b398ac4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:50.357387 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b34a19a1-ac7c-4bd7-8d93-602c8b398ac4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:50.364349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b34a19a1-ac7c-4bd7-8d93-602c8b398ac4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:50.364864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b34a19a1-ac7c-4bd7-8d93-602c8b398ac4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:50.365300 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b34a19a1-ac7c-4bd7-8d93-602c8b398ac4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:50.365983 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b34a19a1-ac7c-4bd7-8d93-602c8b398ac4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:50.366437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b34a19a1-ac7c-4bd7-8d93-602c8b398ac4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:50.366890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b34a19a1-ac7c-4bd7-8d93-602c8b398ac4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:50.375486 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6e07cbf8-ae16-4bc3-b191-cc50ea096395 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:50.378679 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:51:50.385763 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6e07cbf8-ae16-4bc3-b191-cc50ea096395 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:50.387288 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6e07cbf8-ae16-4bc3-b191-cc50ea096395 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:50.388490 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6e07cbf8-ae16-4bc3-b191-cc50ea096395 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.159288 Aug 24 12:51:50.389045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1321/2644] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:50 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:50.402944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4df76f12-d413-4af7-84e9-ee56c705e1d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:50.402944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4df76f12-d413-4af7-84e9-ee56c705e1d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:50.402944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4df76f12-d413-4af7-84e9-ee56c705e1d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:50.402944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4df76f12-d413-4af7-84e9-ee56c705e1d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:50.403352 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4df76f12-d413-4af7-84e9-ee56c705e1d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:50.403352 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4df76f12-d413-4af7-84e9-ee56c705e1d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:50.403352 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4df76f12-d413-4af7-84e9-ee56c705e1d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:50.403352 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4df76f12-d413-4af7-84e9-ee56c705e1d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:50.497516 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b34a19a1-ac7c-4bd7-8d93-602c8b398ac4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:50.506115 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b34a19a1-ac7c-4bd7-8d93-602c8b398ac4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153537 Aug 24 12:51:50.506698 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1324/2645] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:50 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:50.532333 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4df76f12-d413-4af7-84e9-ee56c705e1d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:50.540886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4df76f12-d413-4af7-84e9-ee56c705e1d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150860 Aug 24 12:51:50.541444 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1322/2646] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:50 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:50.849188 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4bc13794-5f33-4516-bb94-7797b70166cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:50.849794 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4bc13794-5f33-4516-bb94-7797b70166cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:50.855996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4bc13794-5f33-4516-bb94-7797b70166cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:50.856480 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4bc13794-5f33-4516-bb94-7797b70166cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:50.856913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4bc13794-5f33-4516-bb94-7797b70166cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:50.857586 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4bc13794-5f33-4516-bb94-7797b70166cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:50.858044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4bc13794-5f33-4516-bb94-7797b70166cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:50.858463 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4bc13794-5f33-4516-bb94-7797b70166cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:50.984879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4bc13794-5f33-4516-bb94-7797b70166cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:50.993466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4bc13794-5f33-4516-bb94-7797b70166cb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.148809 Aug 24 12:51:50.994032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1325/2647] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:50 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:51.413357 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8d1eab7f-4453-4a33-a61a-bfc381e4b9a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:51.413962 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8d1eab7f-4453-4a33-a61a-bfc381e4b9a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:51.420408 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8d1eab7f-4453-4a33-a61a-bfc381e4b9a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:51.420885 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8d1eab7f-4453-4a33-a61a-bfc381e4b9a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:51.421316 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8d1eab7f-4453-4a33-a61a-bfc381e4b9a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:51.422027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8d1eab7f-4453-4a33-a61a-bfc381e4b9a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:51.422483 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8d1eab7f-4453-4a33-a61a-bfc381e4b9a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:51.422929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8d1eab7f-4453-4a33-a61a-bfc381e4b9a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:51.528290 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-50baabbf-3f56-4db2-a769-7fc1a0431821 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:51.528901 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-50baabbf-3f56-4db2-a769-7fc1a0431821 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:51.535456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50baabbf-3f56-4db2-a769-7fc1a0431821 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:51.535933 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50baabbf-3f56-4db2-a769-7fc1a0431821 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:51.536371 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50baabbf-3f56-4db2-a769-7fc1a0431821 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:51.537059 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50baabbf-3f56-4db2-a769-7fc1a0431821 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:51.537518 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50baabbf-3f56-4db2-a769-7fc1a0431821 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:51.537949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50baabbf-3f56-4db2-a769-7fc1a0431821 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:51.553108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8d1eab7f-4453-4a33-a61a-bfc381e4b9a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:51.562603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8d1eab7f-4453-4a33-a61a-bfc381e4b9a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:51.564139 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8d1eab7f-4453-4a33-a61a-bfc381e4b9a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:51.565907 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8d1eab7f-4453-4a33-a61a-bfc381e4b9a1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155908 Aug 24 12:51:51.566499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1323/2648] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:51 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:51.570969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-839b3c4f-663a-4b72-a624-73cd21b92580 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:51.571572 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-839b3c4f-663a-4b72-a624-73cd21b92580 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:51.573358 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:51:51.578062 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-839b3c4f-663a-4b72-a624-73cd21b92580 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:51.578546 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-839b3c4f-663a-4b72-a624-73cd21b92580 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:51.579207 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-839b3c4f-663a-4b72-a624-73cd21b92580 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:51.580094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-839b3c4f-663a-4b72-a624-73cd21b92580 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:51.580730 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-839b3c4f-663a-4b72-a624-73cd21b92580 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:51.581161 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-839b3c4f-663a-4b72-a624-73cd21b92580 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:51.677313 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-50baabbf-3f56-4db2-a769-7fc1a0431821 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:51.686525 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-50baabbf-3f56-4db2-a769-7fc1a0431821 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.162046 Aug 24 12:51:51.687298 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1326/2649] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:51 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:51.715411 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-839b3c4f-663a-4b72-a624-73cd21b92580 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:51.723841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-839b3c4f-663a-4b72-a624-73cd21b92580 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.156393 Aug 24 12:51:51.724630 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1324/2650] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:51 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:52.013743 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-aa63331d-1e53-4375-a35c-3c75be0b0224 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:52.014371 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-aa63331d-1e53-4375-a35c-3c75be0b0224 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:52.020499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aa63331d-1e53-4375-a35c-3c75be0b0224 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:52.020979 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aa63331d-1e53-4375-a35c-3c75be0b0224 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:52.021412 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aa63331d-1e53-4375-a35c-3c75be0b0224 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:52.022178 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aa63331d-1e53-4375-a35c-3c75be0b0224 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:52.022631 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aa63331d-1e53-4375-a35c-3c75be0b0224 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:52.023076 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aa63331d-1e53-4375-a35c-3c75be0b0224 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:52.152533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-aa63331d-1e53-4375-a35c-3c75be0b0224 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:52.161203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-aa63331d-1e53-4375-a35c-3c75be0b0224 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151607 Aug 24 12:51:52.161770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1327/2651] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:52 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:52.588809 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1324952d-d8f6-4d74-aa15-d6939fd446d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:52.589416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1324952d-d8f6-4d74-aa15-d6939fd446d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:52.595742 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1324952d-d8f6-4d74-aa15-d6939fd446d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:52.596219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1324952d-d8f6-4d74-aa15-d6939fd446d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:52.596680 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1324952d-d8f6-4d74-aa15-d6939fd446d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:52.597363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1324952d-d8f6-4d74-aa15-d6939fd446d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:52.598360 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1324952d-d8f6-4d74-aa15-d6939fd446d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:52.598910 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1324952d-d8f6-4d74-aa15-d6939fd446d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:52.707402 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f9ef9dea-f3a9-44a0-b098-2d09524ab16f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:52.708006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f9ef9dea-f3a9-44a0-b098-2d09524ab16f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:52.714307 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9ef9dea-f3a9-44a0-b098-2d09524ab16f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:52.714833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9ef9dea-f3a9-44a0-b098-2d09524ab16f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:52.715273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9ef9dea-f3a9-44a0-b098-2d09524ab16f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:52.715964 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9ef9dea-f3a9-44a0-b098-2d09524ab16f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:52.716416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9ef9dea-f3a9-44a0-b098-2d09524ab16f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:52.716837 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9ef9dea-f3a9-44a0-b098-2d09524ab16f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:52.732324 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1324952d-d8f6-4d74-aa15-d6939fd446d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:52.743825 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1324952d-d8f6-4d74-aa15-d6939fd446d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:52.745401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1324952d-d8f6-4d74-aa15-d6939fd446d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:52.746590 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1324952d-d8f6-4d74-aa15-d6939fd446d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.161706 Aug 24 12:51:52.754556 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1325/2652] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:52 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:52.760269 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-be544635-9fe3-4cab-a041-dbd064d3e5b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:52.761229 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-be544635-9fe3-4cab-a041-dbd064d3e5b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:52.767820 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be544635-9fe3-4cab-a041-dbd064d3e5b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:52.769163 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be544635-9fe3-4cab-a041-dbd064d3e5b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:52.769727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be544635-9fe3-4cab-a041-dbd064d3e5b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:52.770459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be544635-9fe3-4cab-a041-dbd064d3e5b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:52.771130 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be544635-9fe3-4cab-a041-dbd064d3e5b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:52.771558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be544635-9fe3-4cab-a041-dbd064d3e5b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:52.857120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f9ef9dea-f3a9-44a0-b098-2d09524ab16f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:52.865830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f9ef9dea-f3a9-44a0-b098-2d09524ab16f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.162940 Aug 24 12:51:52.866472 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1328/2653] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:52 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:52.903669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-be544635-9fe3-4cab-a041-dbd064d3e5b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:52.911835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-be544635-9fe3-4cab-a041-dbd064d3e5b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.155958 Aug 24 12:51:52.912395 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1326/2654] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:52 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:53.181911 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f6a4fcfd-3eea-4f6b-8807-f1fa08a05e25 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:53.182527 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f6a4fcfd-3eea-4f6b-8807-f1fa08a05e25 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:53.188459 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6a4fcfd-3eea-4f6b-8807-f1fa08a05e25 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:53.188948 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6a4fcfd-3eea-4f6b-8807-f1fa08a05e25 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:53.189392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6a4fcfd-3eea-4f6b-8807-f1fa08a05e25 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:53.190193 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6a4fcfd-3eea-4f6b-8807-f1fa08a05e25 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:53.191197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6a4fcfd-3eea-4f6b-8807-f1fa08a05e25 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:53.191630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6a4fcfd-3eea-4f6b-8807-f1fa08a05e25 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:53.317076 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f6a4fcfd-3eea-4f6b-8807-f1fa08a05e25 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:53.325224 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f6a4fcfd-3eea-4f6b-8807-f1fa08a05e25 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147143 Aug 24 12:51:53.325790 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1329/2655] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:53 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:53.769879 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-01faf9fe-0132-4761-bf56-222d43ef72d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:53.770522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-01faf9fe-0132-4761-bf56-222d43ef72d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:53.776819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01faf9fe-0132-4761-bf56-222d43ef72d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:53.777290 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01faf9fe-0132-4761-bf56-222d43ef72d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:53.777747 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01faf9fe-0132-4761-bf56-222d43ef72d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:53.778416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01faf9fe-0132-4761-bf56-222d43ef72d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:53.778888 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01faf9fe-0132-4761-bf56-222d43ef72d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:53.779305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01faf9fe-0132-4761-bf56-222d43ef72d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:53.886904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-96c7cd7c-fc02-4181-9b47-4539c79c296b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:53.887517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-96c7cd7c-fc02-4181-9b47-4539c79c296b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:53.895696 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96c7cd7c-fc02-4181-9b47-4539c79c296b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:53.895696 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96c7cd7c-fc02-4181-9b47-4539c79c296b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:53.895696 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96c7cd7c-fc02-4181-9b47-4539c79c296b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:53.896316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96c7cd7c-fc02-4181-9b47-4539c79c296b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:53.896905 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96c7cd7c-fc02-4181-9b47-4539c79c296b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:53.897306 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96c7cd7c-fc02-4181-9b47-4539c79c296b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:53.909466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-01faf9fe-0132-4761-bf56-222d43ef72d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:53.918165 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-01faf9fe-0132-4761-bf56-222d43ef72d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:53.919682 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-01faf9fe-0132-4761-bf56-222d43ef72d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:53.920842 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-01faf9fe-0132-4761-bf56-222d43ef72d5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155407 Aug 24 12:51:53.921406 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1327/2656] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:53 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:53.933031 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c3cd8af1-45ff-44b6-bf11-d34a529e39ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:53.933629 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c3cd8af1-45ff-44b6-bf11-d34a529e39ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:53.939602 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c3cd8af1-45ff-44b6-bf11-d34a529e39ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:53.940191 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c3cd8af1-45ff-44b6-bf11-d34a529e39ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:53.940622 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c3cd8af1-45ff-44b6-bf11-d34a529e39ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:53.941305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c3cd8af1-45ff-44b6-bf11-d34a529e39ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:53.941923 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c3cd8af1-45ff-44b6-bf11-d34a529e39ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:53.942372 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c3cd8af1-45ff-44b6-bf11-d34a529e39ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:54.025199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-96c7cd7c-fc02-4181-9b47-4539c79c296b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:54.033710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-96c7cd7c-fc02-4181-9b47-4539c79c296b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150735 Aug 24 12:51:54.035029 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1330/2657] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:53 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:54.074447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c3cd8af1-45ff-44b6-bf11-d34a529e39ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:54.083489 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c3cd8af1-45ff-44b6-bf11-d34a529e39ce tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.154086 Aug 24 12:51:54.084062 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1328/2658] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:53 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:54.345378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bac52f22-afea-4e13-8fba-787f62d97cdd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:54.345915 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bac52f22-afea-4e13-8fba-787f62d97cdd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:54.351790 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bac52f22-afea-4e13-8fba-787f62d97cdd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:54.352266 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bac52f22-afea-4e13-8fba-787f62d97cdd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:54.352696 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bac52f22-afea-4e13-8fba-787f62d97cdd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:54.353369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bac52f22-afea-4e13-8fba-787f62d97cdd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:54.353819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bac52f22-afea-4e13-8fba-787f62d97cdd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:54.354238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bac52f22-afea-4e13-8fba-787f62d97cdd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:54.482783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bac52f22-afea-4e13-8fba-787f62d97cdd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:54.491449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bac52f22-afea-4e13-8fba-787f62d97cdd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150075 Aug 24 12:51:54.492004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1331/2659] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:54 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:54.943357 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-01766248-88b7-41c4-a875-36736af2d695 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:54.943966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-01766248-88b7-41c4-a875-36736af2d695 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:54.950463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01766248-88b7-41c4-a875-36736af2d695 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:54.951002 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01766248-88b7-41c4-a875-36736af2d695 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:54.951443 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01766248-88b7-41c4-a875-36736af2d695 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:54.952128 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01766248-88b7-41c4-a875-36736af2d695 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:54.952582 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01766248-88b7-41c4-a875-36736af2d695 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:54.953011 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01766248-88b7-41c4-a875-36736af2d695 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:55.055722 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-58deeefc-880e-4ce6-a8df-692d556d91a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:55.056334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-58deeefc-880e-4ce6-a8df-692d556d91a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:55.062858 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58deeefc-880e-4ce6-a8df-692d556d91a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:55.063357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58deeefc-880e-4ce6-a8df-692d556d91a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:55.063792 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58deeefc-880e-4ce6-a8df-692d556d91a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:55.064486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58deeefc-880e-4ce6-a8df-692d556d91a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:55.064946 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58deeefc-880e-4ce6-a8df-692d556d91a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:55.065378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58deeefc-880e-4ce6-a8df-692d556d91a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:55.091219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-01766248-88b7-41c4-a875-36736af2d695 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:55.100549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-01766248-88b7-41c4-a875-36736af2d695 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:55.102195 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-01766248-88b7-41c4-a875-36736af2d695 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:55.103379 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-01766248-88b7-41c4-a875-36736af2d695 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.163942 Aug 24 12:51:55.103931 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1329/2660] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:54 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:55.108273 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8bf5e595-affe-456b-a765-7136f6545b2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:55.108881 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8bf5e595-affe-456b-a765-7136f6545b2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:55.116065 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8bf5e595-affe-456b-a765-7136f6545b2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:55.116481 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8bf5e595-affe-456b-a765-7136f6545b2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:55.116916 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8bf5e595-affe-456b-a765-7136f6545b2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:55.117599 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8bf5e595-affe-456b-a765-7136f6545b2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:55.118050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8bf5e595-affe-456b-a765-7136f6545b2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:55.118473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8bf5e595-affe-456b-a765-7136f6545b2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:55.211350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-58deeefc-880e-4ce6-a8df-692d556d91a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:55.220186 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-58deeefc-880e-4ce6-a8df-692d556d91a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.168237 Aug 24 12:51:55.220760 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1332/2661] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:55 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:55.251840 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8bf5e595-affe-456b-a765-7136f6545b2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:55.260168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8bf5e595-affe-456b-a765-7136f6545b2d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.155292 Aug 24 12:51:55.260734 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1330/2662] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:55 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:55.513160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d6348fc7-f79c-4f01-a526-f190133a7771 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:55.513767 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d6348fc7-f79c-4f01-a526-f190133a7771 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:55.520249 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d6348fc7-f79c-4f01-a526-f190133a7771 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:55.520729 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d6348fc7-f79c-4f01-a526-f190133a7771 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:55.521217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d6348fc7-f79c-4f01-a526-f190133a7771 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:55.521914 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d6348fc7-f79c-4f01-a526-f190133a7771 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:55.522368 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d6348fc7-f79c-4f01-a526-f190133a7771 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:55.523063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d6348fc7-f79c-4f01-a526-f190133a7771 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:55.657390 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d6348fc7-f79c-4f01-a526-f190133a7771 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:55.665644 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d6348fc7-f79c-4f01-a526-f190133a7771 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.156349 Aug 24 12:51:55.666201 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1333/2663] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:55 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:56.126464 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5ab74c9a-a5cb-4081-9c0d-8bddd17a5348 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:56.127111 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5ab74c9a-a5cb-4081-9c0d-8bddd17a5348 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:56.134127 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ab74c9a-a5cb-4081-9c0d-8bddd17a5348 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:56.134599 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ab74c9a-a5cb-4081-9c0d-8bddd17a5348 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:56.135058 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ab74c9a-a5cb-4081-9c0d-8bddd17a5348 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:56.135726 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ab74c9a-a5cb-4081-9c0d-8bddd17a5348 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:56.136175 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ab74c9a-a5cb-4081-9c0d-8bddd17a5348 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:56.136596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ab74c9a-a5cb-4081-9c0d-8bddd17a5348 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:56.241930 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0a19e87d-b729-453c-83f9-ad1650e5e843 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:56.242566 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0a19e87d-b729-453c-83f9-ad1650e5e843 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:56.248784 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a19e87d-b729-453c-83f9-ad1650e5e843 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:56.249262 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a19e87d-b729-453c-83f9-ad1650e5e843 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:56.249713 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a19e87d-b729-453c-83f9-ad1650e5e843 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:56.250381 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a19e87d-b729-453c-83f9-ad1650e5e843 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:56.250860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a19e87d-b729-453c-83f9-ad1650e5e843 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:56.251285 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0a19e87d-b729-453c-83f9-ad1650e5e843 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:56.262786 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5ab74c9a-a5cb-4081-9c0d-8bddd17a5348 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:56.271368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5ab74c9a-a5cb-4081-9c0d-8bddd17a5348 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:56.272853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5ab74c9a-a5cb-4081-9c0d-8bddd17a5348 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:56.274040 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5ab74c9a-a5cb-4081-9c0d-8bddd17a5348 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.151479 Aug 24 12:51:56.274906 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1331/2664] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:56 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:56.286308 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7e09bbe1-a835-448e-b2b4-4b7bb7661791 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:56.287146 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7e09bbe1-a835-448e-b2b4-4b7bb7661791 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:56.293099 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7e09bbe1-a835-448e-b2b4-4b7bb7661791 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:56.293661 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7e09bbe1-a835-448e-b2b4-4b7bb7661791 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:56.294169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7e09bbe1-a835-448e-b2b4-4b7bb7661791 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:56.294885 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7e09bbe1-a835-448e-b2b4-4b7bb7661791 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:56.295338 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7e09bbe1-a835-448e-b2b4-4b7bb7661791 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:56.295762 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7e09bbe1-a835-448e-b2b4-4b7bb7661791 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:56.382187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0a19e87d-b729-453c-83f9-ad1650e5e843 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:56.390374 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0a19e87d-b729-453c-83f9-ad1650e5e843 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152226 Aug 24 12:51:56.390954 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1334/2665] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:56 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:56.423160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7e09bbe1-a835-448e-b2b4-4b7bb7661791 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:56.432027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7e09bbe1-a835-448e-b2b4-4b7bb7661791 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.154744 Aug 24 12:51:56.432579 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1332/2666] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:56 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:56.686954 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1c076ff4-3fd2-42b8-8475-33871fb63424 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:56.687569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1c076ff4-3fd2-42b8-8475-33871fb63424 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:56.693475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1c076ff4-3fd2-42b8-8475-33871fb63424 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:56.693957 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1c076ff4-3fd2-42b8-8475-33871fb63424 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:56.694394 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1c076ff4-3fd2-42b8-8475-33871fb63424 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:56.695104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1c076ff4-3fd2-42b8-8475-33871fb63424 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:56.695563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1c076ff4-3fd2-42b8-8475-33871fb63424 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:56.695989 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1c076ff4-3fd2-42b8-8475-33871fb63424 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:56.822792 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1c076ff4-3fd2-42b8-8475-33871fb63424 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:56.831347 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1c076ff4-3fd2-42b8-8475-33871fb63424 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147779 Aug 24 12:51:56.831898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1335/2667] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:56 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:57.297207 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-25ae7bd5-bed8-4ca7-8edc-3549c39b8fdc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:57.297810 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-25ae7bd5-bed8-4ca7-8edc-3549c39b8fdc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:57.304171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-25ae7bd5-bed8-4ca7-8edc-3549c39b8fdc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:57.304641 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-25ae7bd5-bed8-4ca7-8edc-3549c39b8fdc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:57.305068 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-25ae7bd5-bed8-4ca7-8edc-3549c39b8fdc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:57.305738 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-25ae7bd5-bed8-4ca7-8edc-3549c39b8fdc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:57.306184 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-25ae7bd5-bed8-4ca7-8edc-3549c39b8fdc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:57.306602 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-25ae7bd5-bed8-4ca7-8edc-3549c39b8fdc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:57.411507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e8804196-d791-47c9-a466-330d4d20cb90 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:57.412122 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e8804196-d791-47c9-a466-330d4d20cb90 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:57.418762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8804196-d791-47c9-a466-330d4d20cb90 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:57.419273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8804196-d791-47c9-a466-330d4d20cb90 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:57.419700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8804196-d791-47c9-a466-330d4d20cb90 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:57.420401 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8804196-d791-47c9-a466-330d4d20cb90 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:57.420858 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8804196-d791-47c9-a466-330d4d20cb90 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:57.421290 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e8804196-d791-47c9-a466-330d4d20cb90 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:57.441672 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-25ae7bd5-bed8-4ca7-8edc-3549c39b8fdc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:57.450481 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-25ae7bd5-bed8-4ca7-8edc-3549c39b8fdc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:57.452061 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-25ae7bd5-bed8-4ca7-8edc-3549c39b8fdc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:57.453217 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-25ae7bd5-bed8-4ca7-8edc-3549c39b8fdc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.159908 Aug 24 12:51:57.453761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1333/2668] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:57 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:57.458045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1c002346-a50f-416c-bb6b-a37a01f45db6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:57.458636 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1c002346-a50f-416c-bb6b-a37a01f45db6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:57.464624 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c002346-a50f-416c-bb6b-a37a01f45db6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:57.465344 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c002346-a50f-416c-bb6b-a37a01f45db6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:57.465779 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c002346-a50f-416c-bb6b-a37a01f45db6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:57.466455 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c002346-a50f-416c-bb6b-a37a01f45db6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:57.466930 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c002346-a50f-416c-bb6b-a37a01f45db6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:57.467351 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c002346-a50f-416c-bb6b-a37a01f45db6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:57.556138 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e8804196-d791-47c9-a466-330d4d20cb90 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:57.561227 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e8804196-d791-47c9-a466-330d4d20cb90 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153536 Aug 24 12:51:57.561790 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1336/2669] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:57 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:57.595879 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1c002346-a50f-416c-bb6b-a37a01f45db6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:57.603930 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1c002346-a50f-416c-bb6b-a37a01f45db6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149257 Aug 24 12:51:57.604495 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1334/2670] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:57 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:57.852596 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a9a5c887-ca4e-48c6-82a6-368bf2814d5f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:57.853142 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a9a5c887-ca4e-48c6-82a6-368bf2814d5f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:57.858964 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a9a5c887-ca4e-48c6-82a6-368bf2814d5f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:57.859443 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a9a5c887-ca4e-48c6-82a6-368bf2814d5f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:57.859873 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a9a5c887-ca4e-48c6-82a6-368bf2814d5f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:57.860549 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a9a5c887-ca4e-48c6-82a6-368bf2814d5f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:57.861001 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a9a5c887-ca4e-48c6-82a6-368bf2814d5f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:57.861423 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a9a5c887-ca4e-48c6-82a6-368bf2814d5f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:57.987992 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a9a5c887-ca4e-48c6-82a6-368bf2814d5f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:57.996395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a9a5c887-ca4e-48c6-82a6-368bf2814d5f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147858 Aug 24 12:51:57.996960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1337/2671] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:57 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:58.476406 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-259f47e1-2ab8-422e-b1b5-9303d40f53a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:58.476961 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-259f47e1-2ab8-422e-b1b5-9303d40f53a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:58.483392 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-259f47e1-2ab8-422e-b1b5-9303d40f53a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:58.483874 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-259f47e1-2ab8-422e-b1b5-9303d40f53a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:58.484312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-259f47e1-2ab8-422e-b1b5-9303d40f53a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:58.484993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-259f47e1-2ab8-422e-b1b5-9303d40f53a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:58.485448 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-259f47e1-2ab8-422e-b1b5-9303d40f53a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:58.485883 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-259f47e1-2ab8-422e-b1b5-9303d40f53a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:58.582578 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7881aa27-92ad-4fdb-99ad-97a003aa9b8d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:58.583320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7881aa27-92ad-4fdb-99ad-97a003aa9b8d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:58.589710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7881aa27-92ad-4fdb-99ad-97a003aa9b8d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:58.590275 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7881aa27-92ad-4fdb-99ad-97a003aa9b8d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:58.590756 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7881aa27-92ad-4fdb-99ad-97a003aa9b8d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:58.591452 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7881aa27-92ad-4fdb-99ad-97a003aa9b8d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:58.591908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7881aa27-92ad-4fdb-99ad-97a003aa9b8d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:58.592334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7881aa27-92ad-4fdb-99ad-97a003aa9b8d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:58.616268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-259f47e1-2ab8-422e-b1b5-9303d40f53a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:58.624913 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-259f47e1-2ab8-422e-b1b5-9303d40f53a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:58.626390 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-259f47e1-2ab8-422e-b1b5-9303d40f53a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:58.628117 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-259f47e1-2ab8-422e-b1b5-9303d40f53a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155153 Aug 24 12:51:58.628674 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1335/2672] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:58 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:58.632970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-96307819-d74c-4b73-8dc7-3f0fddf10aca tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:58.634168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-96307819-d74c-4b73-8dc7-3f0fddf10aca tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:58.640176 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96307819-d74c-4b73-8dc7-3f0fddf10aca tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:58.640653 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96307819-d74c-4b73-8dc7-3f0fddf10aca tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:58.641080 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96307819-d74c-4b73-8dc7-3f0fddf10aca tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:58.641758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96307819-d74c-4b73-8dc7-3f0fddf10aca tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:58.642204 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96307819-d74c-4b73-8dc7-3f0fddf10aca tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:58.642621 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96307819-d74c-4b73-8dc7-3f0fddf10aca tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:58.725334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7881aa27-92ad-4fdb-99ad-97a003aa9b8d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:58.733908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7881aa27-92ad-4fdb-99ad-97a003aa9b8d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.155745 Aug 24 12:51:58.734564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1338/2673] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:58 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:58.770373 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-96307819-d74c-4b73-8dc7-3f0fddf10aca tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:58.778479 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-96307819-d74c-4b73-8dc7-3f0fddf10aca tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.148888 Aug 24 12:51:58.779068 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1336/2674] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:58 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:59.016687 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d2c8a836-b2f6-4ca1-8d8e-6676364b73a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:59.017226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d2c8a836-b2f6-4ca1-8d8e-6676364b73a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:59.024301 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d2c8a836-b2f6-4ca1-8d8e-6676364b73a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:59.025063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d2c8a836-b2f6-4ca1-8d8e-6676364b73a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:59.025752 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d2c8a836-b2f6-4ca1-8d8e-6676364b73a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:59.026863 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d2c8a836-b2f6-4ca1-8d8e-6676364b73a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:59.027581 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d2c8a836-b2f6-4ca1-8d8e-6676364b73a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:59.028309 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d2c8a836-b2f6-4ca1-8d8e-6676364b73a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:59.034245 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:51:59.169450 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d2c8a836-b2f6-4ca1-8d8e-6676364b73a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:59.178034 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d2c8a836-b2f6-4ca1-8d8e-6676364b73a3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.165298 Aug 24 12:51:59.178589 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1339/2675] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:59 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:51:59.652863 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-67b64a6c-6823-48ee-927b-03fc889a5e1b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:59.653525 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-67b64a6c-6823-48ee-927b-03fc889a5e1b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:59.660593 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-67b64a6c-6823-48ee-927b-03fc889a5e1b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:59.661079 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-67b64a6c-6823-48ee-927b-03fc889a5e1b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:59.661519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-67b64a6c-6823-48ee-927b-03fc889a5e1b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:59.662202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-67b64a6c-6823-48ee-927b-03fc889a5e1b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:59.662679 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-67b64a6c-6823-48ee-927b-03fc889a5e1b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:59.663106 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-67b64a6c-6823-48ee-927b-03fc889a5e1b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:59.754872 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-03893f92-a2c6-4efc-ad9d-a71bb96a5140 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:59.755484 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-03893f92-a2c6-4efc-ad9d-a71bb96a5140 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:59.761826 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03893f92-a2c6-4efc-ad9d-a71bb96a5140 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:59.762316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03893f92-a2c6-4efc-ad9d-a71bb96a5140 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:59.762779 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03893f92-a2c6-4efc-ad9d-a71bb96a5140 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:59.763471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03893f92-a2c6-4efc-ad9d-a71bb96a5140 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:59.763929 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03893f92-a2c6-4efc-ad9d-a71bb96a5140 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:59.764357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03893f92-a2c6-4efc-ad9d-a71bb96a5140 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:59.796361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-67b64a6c-6823-48ee-927b-03fc889a5e1b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:59.805164 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-67b64a6c-6823-48ee-927b-03fc889a5e1b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:59.806675 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-67b64a6c-6823-48ee-927b-03fc889a5e1b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:59.807835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-67b64a6c-6823-48ee-927b-03fc889a5e1b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.159016 Aug 24 12:51:59.808393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1337/2676] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:51:59 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:51:59.812751 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2214808d-8ed8-4a21-918e-b9dd371fbe72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:51:59.813356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2214808d-8ed8-4a21-918e-b9dd371fbe72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:51:59.819245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2214808d-8ed8-4a21-918e-b9dd371fbe72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:59.819727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2214808d-8ed8-4a21-918e-b9dd371fbe72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:59.820162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2214808d-8ed8-4a21-918e-b9dd371fbe72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:59.820838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2214808d-8ed8-4a21-918e-b9dd371fbe72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:51:59.821290 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2214808d-8ed8-4a21-918e-b9dd371fbe72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:51:59.821712 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2214808d-8ed8-4a21-918e-b9dd371fbe72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:51:59.836612 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:51:59.898275 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-03893f92-a2c6-4efc-ad9d-a71bb96a5140 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:59.906834 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-03893f92-a2c6-4efc-ad9d-a71bb96a5140 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.155747 Aug 24 12:51:59.907409 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1340/2677] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:59 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:51:59.953470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2214808d-8ed8-4a21-918e-b9dd371fbe72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:51:59.962071 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2214808d-8ed8-4a21-918e-b9dd371fbe72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152741 Aug 24 12:51:59.962624 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1338/2678] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:51:59 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:00.199135 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e7476b87-b752-43ae-8583-60a84182515b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:00.199754 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e7476b87-b752-43ae-8583-60a84182515b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:00.206327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e7476b87-b752-43ae-8583-60a84182515b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:00.206848 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e7476b87-b752-43ae-8583-60a84182515b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:00.207291 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e7476b87-b752-43ae-8583-60a84182515b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:00.207975 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e7476b87-b752-43ae-8583-60a84182515b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:00.208436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e7476b87-b752-43ae-8583-60a84182515b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:00.208865 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e7476b87-b752-43ae-8583-60a84182515b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:00.335663 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e7476b87-b752-43ae-8583-60a84182515b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:00.343891 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e7476b87-b752-43ae-8583-60a84182515b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.148600 Aug 24 12:52:00.344450 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1341/2679] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:00 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:00.830543 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d443e6fa-738b-4a0c-a4d4-de8691b31680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:00.831274 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d443e6fa-738b-4a0c-a4d4-de8691b31680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:00.837578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d443e6fa-738b-4a0c-a4d4-de8691b31680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:00.838056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d443e6fa-738b-4a0c-a4d4-de8691b31680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:00.838491 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d443e6fa-738b-4a0c-a4d4-de8691b31680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:00.839197 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d443e6fa-738b-4a0c-a4d4-de8691b31680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:00.839648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d443e6fa-738b-4a0c-a4d4-de8691b31680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:00.840071 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d443e6fa-738b-4a0c-a4d4-de8691b31680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:00.929528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4f3fbced-94d9-4140-bc06-0c711da5dc24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:00.930138 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4f3fbced-94d9-4140-bc06-0c711da5dc24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:00.936476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4f3fbced-94d9-4140-bc06-0c711da5dc24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:00.936962 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4f3fbced-94d9-4140-bc06-0c711da5dc24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:00.937401 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4f3fbced-94d9-4140-bc06-0c711da5dc24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:00.938086 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4f3fbced-94d9-4140-bc06-0c711da5dc24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:00.938544 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4f3fbced-94d9-4140-bc06-0c711da5dc24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:00.938998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4f3fbced-94d9-4140-bc06-0c711da5dc24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:00.967966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d443e6fa-738b-4a0c-a4d4-de8691b31680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:00.977474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d443e6fa-738b-4a0c-a4d4-de8691b31680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:00.978992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d443e6fa-738b-4a0c-a4d4-de8691b31680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:00.980149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d443e6fa-738b-4a0c-a4d4-de8691b31680 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.153501 Aug 24 12:52:00.980947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1339/2680] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:00 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:00.985317 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cf73d61f-bb88-433b-ad2a-9103968823bb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:00.985912 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cf73d61f-bb88-433b-ad2a-9103968823bb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:00.992729 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf73d61f-bb88-433b-ad2a-9103968823bb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:00.993205 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf73d61f-bb88-433b-ad2a-9103968823bb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:00.993635 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf73d61f-bb88-433b-ad2a-9103968823bb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:00.994307 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf73d61f-bb88-433b-ad2a-9103968823bb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:00.994785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf73d61f-bb88-433b-ad2a-9103968823bb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:00.995342 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf73d61f-bb88-433b-ad2a-9103968823bb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:01.075338 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4f3fbced-94d9-4140-bc06-0c711da5dc24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:01.083846 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4f3fbced-94d9-4140-bc06-0c711da5dc24 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.158015 Aug 24 12:52:01.084493 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1342/2681] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:00 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:01.365382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-eb2f6a6c-2ea5-4ecf-9885-48b733509575 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:01.366027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-eb2f6a6c-2ea5-4ecf-9885-48b733509575 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:01.373954 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eb2f6a6c-2ea5-4ecf-9885-48b733509575 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:01.374851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eb2f6a6c-2ea5-4ecf-9885-48b733509575 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:01.375743 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eb2f6a6c-2ea5-4ecf-9885-48b733509575 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:01.376439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eb2f6a6c-2ea5-4ecf-9885-48b733509575 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:01.376891 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eb2f6a6c-2ea5-4ecf-9885-48b733509575 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:01.377057 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cf73d61f-bb88-433b-ad2a-9103968823bb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:01.377332 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eb2f6a6c-2ea5-4ecf-9885-48b733509575 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:01.385641 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cf73d61f-bb88-433b-ad2a-9103968823bb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.403758 Aug 24 12:52:01.386404 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1340/2682] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:00 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:01.507728 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-eb2f6a6c-2ea5-4ecf-9885-48b733509575 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:01.515920 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-eb2f6a6c-2ea5-4ecf-9885-48b733509575 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.155058 Aug 24 12:52:01.516482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1343/2683] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:01 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:02.004849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d659917a-dc32-4006-8715-919c6ad67335 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:02.005490 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d659917a-dc32-4006-8715-919c6ad67335 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:02.011777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d659917a-dc32-4006-8715-919c6ad67335 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:02.012252 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d659917a-dc32-4006-8715-919c6ad67335 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:02.012690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d659917a-dc32-4006-8715-919c6ad67335 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:02.013360 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d659917a-dc32-4006-8715-919c6ad67335 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:02.013802 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d659917a-dc32-4006-8715-919c6ad67335 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:02.014219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d659917a-dc32-4006-8715-919c6ad67335 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:02.105133 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9f96a1ec-2c7a-4a03-b0ee-7bee0dd4f5ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:02.105772 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9f96a1ec-2c7a-4a03-b0ee-7bee0dd4f5ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:02.112780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9f96a1ec-2c7a-4a03-b0ee-7bee0dd4f5ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:02.113256 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9f96a1ec-2c7a-4a03-b0ee-7bee0dd4f5ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:02.113685 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9f96a1ec-2c7a-4a03-b0ee-7bee0dd4f5ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:02.114368 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9f96a1ec-2c7a-4a03-b0ee-7bee0dd4f5ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:02.114855 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9f96a1ec-2c7a-4a03-b0ee-7bee0dd4f5ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:02.115280 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9f96a1ec-2c7a-4a03-b0ee-7bee0dd4f5ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:02.141225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d659917a-dc32-4006-8715-919c6ad67335 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:02.157557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d659917a-dc32-4006-8715-919c6ad67335 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:02.159858 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d659917a-dc32-4006-8715-919c6ad67335 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:02.161062 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d659917a-dc32-4006-8715-919c6ad67335 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.160790 Aug 24 12:52:02.161620 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1341/2684] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:01 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:02.244671 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9f96a1ec-2c7a-4a03-b0ee-7bee0dd4f5ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:02.253405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9f96a1ec-2c7a-4a03-b0ee-7bee0dd4f5ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152039 Aug 24 12:52:02.253958 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1344/2685] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:02 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:02.407102 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e7c846c8-dde1-475f-ad68-8b4f89f99836 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:02.407718 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e7c846c8-dde1-475f-ad68-8b4f89f99836 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:02.414317 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7c846c8-dde1-475f-ad68-8b4f89f99836 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:02.414950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7c846c8-dde1-475f-ad68-8b4f89f99836 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:02.415388 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7c846c8-dde1-475f-ad68-8b4f89f99836 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:02.416077 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7c846c8-dde1-475f-ad68-8b4f89f99836 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:02.416531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7c846c8-dde1-475f-ad68-8b4f89f99836 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:02.416954 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7c846c8-dde1-475f-ad68-8b4f89f99836 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:02.537668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c7ee7df3-0a54-443d-b46e-6da138c09a27 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:02.538211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c7ee7df3-0a54-443d-b46e-6da138c09a27 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:02.544210 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7ee7df3-0a54-443d-b46e-6da138c09a27 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:02.544549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e7c846c8-dde1-475f-ad68-8b4f89f99836 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:02.544707 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7ee7df3-0a54-443d-b46e-6da138c09a27 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:02.545116 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7ee7df3-0a54-443d-b46e-6da138c09a27 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:02.545804 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7ee7df3-0a54-443d-b46e-6da138c09a27 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:02.546393 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7ee7df3-0a54-443d-b46e-6da138c09a27 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:02.546707 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7ee7df3-0a54-443d-b46e-6da138c09a27 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:02.553396 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e7c846c8-dde1-475f-ad68-8b4f89f99836 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150154 Aug 24 12:52:02.553961 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1342/2686] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:02 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:02.675027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c7ee7df3-0a54-443d-b46e-6da138c09a27 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:02.683071 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c7ee7df3-0a54-443d-b46e-6da138c09a27 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149771 Aug 24 12:52:02.683643 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1345/2687] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:02 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:03.184576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e2d0971f-32c5-4e7a-b6b5-355688b9a35e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:03.185132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e2d0971f-32c5-4e7a-b6b5-355688b9a35e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:03.192017 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2d0971f-32c5-4e7a-b6b5-355688b9a35e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:03.192496 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2d0971f-32c5-4e7a-b6b5-355688b9a35e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:03.192927 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2d0971f-32c5-4e7a-b6b5-355688b9a35e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:03.193604 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2d0971f-32c5-4e7a-b6b5-355688b9a35e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:03.194056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2d0971f-32c5-4e7a-b6b5-355688b9a35e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:03.194480 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2d0971f-32c5-4e7a-b6b5-355688b9a35e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:03.274011 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-23bff6ac-4d94-4fcc-8f52-60770d01d840 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:03.274631 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-23bff6ac-4d94-4fcc-8f52-60770d01d840 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:03.281050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-23bff6ac-4d94-4fcc-8f52-60770d01d840 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:03.281544 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-23bff6ac-4d94-4fcc-8f52-60770d01d840 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:03.281988 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-23bff6ac-4d94-4fcc-8f52-60770d01d840 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:03.282703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-23bff6ac-4d94-4fcc-8f52-60770d01d840 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:03.283172 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-23bff6ac-4d94-4fcc-8f52-60770d01d840 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:03.283607 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-23bff6ac-4d94-4fcc-8f52-60770d01d840 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:03.326944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e2d0971f-32c5-4e7a-b6b5-355688b9a35e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:03.336295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e2d0971f-32c5-4e7a-b6b5-355688b9a35e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:03.337763 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e2d0971f-32c5-4e7a-b6b5-355688b9a35e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:03.338966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e2d0971f-32c5-4e7a-b6b5-355688b9a35e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.158375 Aug 24 12:52:03.339706 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1343/2688] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:03 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:03.428279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-23bff6ac-4d94-4fcc-8f52-60770d01d840 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:03.428279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-23bff6ac-4d94-4fcc-8f52-60770d01d840 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153542 Aug 24 12:52:03.428279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1346/2689] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:03 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:03.573248 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b82d3461-966f-4d8d-8e4a-4b1067535c7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:03.573928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b82d3461-966f-4d8d-8e4a-4b1067535c7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:03.579681 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b82d3461-966f-4d8d-8e4a-4b1067535c7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:03.580155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b82d3461-966f-4d8d-8e4a-4b1067535c7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:03.580609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b82d3461-966f-4d8d-8e4a-4b1067535c7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:03.581278 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b82d3461-966f-4d8d-8e4a-4b1067535c7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:03.581720 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b82d3461-966f-4d8d-8e4a-4b1067535c7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:03.582139 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b82d3461-966f-4d8d-8e4a-4b1067535c7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:03.703952 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-289fafcc-e7a1-481d-82da-c61f4c5f5279 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:03.704663 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-289fafcc-e7a1-481d-82da-c61f4c5f5279 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:03.710404 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b82d3461-966f-4d8d-8e4a-4b1067535c7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:03.711089 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-289fafcc-e7a1-481d-82da-c61f4c5f5279 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:03.711631 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-289fafcc-e7a1-481d-82da-c61f4c5f5279 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:03.712070 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-289fafcc-e7a1-481d-82da-c61f4c5f5279 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:03.712769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-289fafcc-e7a1-481d-82da-c61f4c5f5279 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:03.713227 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-289fafcc-e7a1-481d-82da-c61f4c5f5279 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:03.713712 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-289fafcc-e7a1-481d-82da-c61f4c5f5279 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:03.718504 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b82d3461-966f-4d8d-8e4a-4b1067535c7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149122 Aug 24 12:52:03.719101 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1344/2690] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:03 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:03.843441 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-289fafcc-e7a1-481d-82da-c61f4c5f5279 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:03.852110 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-289fafcc-e7a1-481d-82da-c61f4c5f5279 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.152102 Aug 24 12:52:03.852672 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1347/2691] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:03 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:04.361310 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-82be6e97-2b8e-4cfb-970c-713679e161c9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:04.362699 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-82be6e97-2b8e-4cfb-970c-713679e161c9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:04.369082 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82be6e97-2b8e-4cfb-970c-713679e161c9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:04.369555 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82be6e97-2b8e-4cfb-970c-713679e161c9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:04.369995 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82be6e97-2b8e-4cfb-970c-713679e161c9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:04.370689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82be6e97-2b8e-4cfb-970c-713679e161c9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:04.371143 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82be6e97-2b8e-4cfb-970c-713679e161c9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:04.371567 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82be6e97-2b8e-4cfb-970c-713679e161c9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:04.446032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9fb88283-42e6-4350-b96d-babfefeb223b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:04.446816 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9fb88283-42e6-4350-b96d-babfefeb223b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:04.453544 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9fb88283-42e6-4350-b96d-babfefeb223b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:04.454040 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9fb88283-42e6-4350-b96d-babfefeb223b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:04.454482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9fb88283-42e6-4350-b96d-babfefeb223b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:04.455223 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9fb88283-42e6-4350-b96d-babfefeb223b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:04.455688 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9fb88283-42e6-4350-b96d-babfefeb223b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:04.456120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9fb88283-42e6-4350-b96d-babfefeb223b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:04.500144 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-82be6e97-2b8e-4cfb-970c-713679e161c9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:04.509368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-82be6e97-2b8e-4cfb-970c-713679e161c9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:04.510891 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-82be6e97-2b8e-4cfb-970c-713679e161c9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:04.512053 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-82be6e97-2b8e-4cfb-970c-713679e161c9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154673 Aug 24 12:52:04.512608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1345/2692] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:04 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:04.588326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9fb88283-42e6-4350-b96d-babfefeb223b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:04.593238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9fb88283-42e6-4350-b96d-babfefeb223b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151255 Aug 24 12:52:04.593803 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1348/2693] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:04 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:04.739557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-03f2255b-8273-4b8f-b4c1-3e29fe7b2eb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:04.740180 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-03f2255b-8273-4b8f-b4c1-3e29fe7b2eb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:04.745976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-03f2255b-8273-4b8f-b4c1-3e29fe7b2eb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:04.746459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-03f2255b-8273-4b8f-b4c1-3e29fe7b2eb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:04.746920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-03f2255b-8273-4b8f-b4c1-3e29fe7b2eb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:04.747592 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-03f2255b-8273-4b8f-b4c1-3e29fe7b2eb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:04.748037 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-03f2255b-8273-4b8f-b4c1-3e29fe7b2eb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:04.748457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-03f2255b-8273-4b8f-b4c1-3e29fe7b2eb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:04.873288 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-03f2255b-8273-4b8f-b4c1-3e29fe7b2eb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:04.874080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1f333ec5-5edf-4ff1-9b0c-1d1e03c02836 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:04.874727 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1f333ec5-5edf-4ff1-9b0c-1d1e03c02836 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:04.881440 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1f333ec5-5edf-4ff1-9b0c-1d1e03c02836 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:04.881933 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1f333ec5-5edf-4ff1-9b0c-1d1e03c02836 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:04.882372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1f333ec5-5edf-4ff1-9b0c-1d1e03c02836 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:04.882776 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-03f2255b-8273-4b8f-b4c1-3e29fe7b2eb2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.147228 Aug 24 12:52:04.883093 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1f333ec5-5edf-4ff1-9b0c-1d1e03c02836 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:04.883348 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1346/2694] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:04 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:04.883532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1f333ec5-5edf-4ff1-9b0c-1d1e03c02836 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:04.883964 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1f333ec5-5edf-4ff1-9b0c-1d1e03c02836 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:05.010549 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1f333ec5-5edf-4ff1-9b0c-1d1e03c02836 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:05.018719 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1f333ec5-5edf-4ff1-9b0c-1d1e03c02836 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.148473 Aug 24 12:52:05.019277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1349/2695] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:04 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:05.535299 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8732b7a1-b9a6-461b-8d27-89b6b989a8e3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:05.535931 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8732b7a1-b9a6-461b-8d27-89b6b989a8e3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:05.542251 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8732b7a1-b9a6-461b-8d27-89b6b989a8e3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:05.542760 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8732b7a1-b9a6-461b-8d27-89b6b989a8e3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:05.543197 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8732b7a1-b9a6-461b-8d27-89b6b989a8e3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:05.543875 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8732b7a1-b9a6-461b-8d27-89b6b989a8e3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:05.544326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8732b7a1-b9a6-461b-8d27-89b6b989a8e3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:05.544749 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8732b7a1-b9a6-461b-8d27-89b6b989a8e3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:05.615431 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7b51aefe-6fda-409b-83b5-1f5353ab465c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:05.616280 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7b51aefe-6fda-409b-83b5-1f5353ab465c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:05.622719 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b51aefe-6fda-409b-83b5-1f5353ab465c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:05.623316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b51aefe-6fda-409b-83b5-1f5353ab465c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:05.624152 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b51aefe-6fda-409b-83b5-1f5353ab465c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:05.624633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b51aefe-6fda-409b-83b5-1f5353ab465c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:05.625168 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b51aefe-6fda-409b-83b5-1f5353ab465c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:05.625606 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b51aefe-6fda-409b-83b5-1f5353ab465c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:05.675640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8732b7a1-b9a6-461b-8d27-89b6b989a8e3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:05.684393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8732b7a1-b9a6-461b-8d27-89b6b989a8e3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:05.685850 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8732b7a1-b9a6-461b-8d27-89b6b989a8e3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:05.687042 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8732b7a1-b9a6-461b-8d27-89b6b989a8e3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.156152 Aug 24 12:52:05.687604 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1347/2696] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:05 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:05.756658 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7b51aefe-6fda-409b-83b5-1f5353ab465c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:05.764827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7b51aefe-6fda-409b-83b5-1f5353ab465c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.154206 Aug 24 12:52:05.765385 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1350/2697] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:05 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:05.903627 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-eada9c39-45d3-4472-aa5b-0b9fea484c4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:05.904241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-eada9c39-45d3-4472-aa5b-0b9fea484c4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:05.910832 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eada9c39-45d3-4472-aa5b-0b9fea484c4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:05.911315 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eada9c39-45d3-4472-aa5b-0b9fea484c4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:05.911756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eada9c39-45d3-4472-aa5b-0b9fea484c4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:05.912437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eada9c39-45d3-4472-aa5b-0b9fea484c4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:05.912893 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eada9c39-45d3-4472-aa5b-0b9fea484c4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:05.913319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eada9c39-45d3-4472-aa5b-0b9fea484c4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:06.040477 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-01a33e4e-1318-4d75-8988-85254da6ef6d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:06.045947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-eada9c39-45d3-4472-aa5b-0b9fea484c4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:06.046119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-01a33e4e-1318-4d75-8988-85254da6ef6d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:06.047075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01a33e4e-1318-4d75-8988-85254da6ef6d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:06.047561 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01a33e4e-1318-4d75-8988-85254da6ef6d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:06.047994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01a33e4e-1318-4d75-8988-85254da6ef6d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:06.048692 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01a33e4e-1318-4d75-8988-85254da6ef6d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:06.049192 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-eada9c39-45d3-4472-aa5b-0b9fea484c4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149390 Aug 24 12:52:06.049332 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01a33e4e-1318-4d75-8988-85254da6ef6d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:06.049621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01a33e4e-1318-4d75-8988-85254da6ef6d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:06.053539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1348/2698] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:05 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:06.176584 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-01a33e4e-1318-4d75-8988-85254da6ef6d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:06.187964 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-01a33e4e-1318-4d75-8988-85254da6ef6d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.152258 Aug 24 12:52:06.188529 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1351/2699] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:06 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:06.709884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-93a6cf5a-6ba0-4752-be85-d043d03f93d8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:06.710419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-93a6cf5a-6ba0-4752-be85-d043d03f93d8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:06.716878 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-93a6cf5a-6ba0-4752-be85-d043d03f93d8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:06.717349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-93a6cf5a-6ba0-4752-be85-d043d03f93d8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:06.717777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-93a6cf5a-6ba0-4752-be85-d043d03f93d8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:06.718440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-93a6cf5a-6ba0-4752-be85-d043d03f93d8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:06.718908 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-93a6cf5a-6ba0-4752-be85-d043d03f93d8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:06.719325 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-93a6cf5a-6ba0-4752-be85-d043d03f93d8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:06.785764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-55a58c88-4eba-42ae-bc04-4a47dfa1d0e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:06.786481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-55a58c88-4eba-42ae-bc04-4a47dfa1d0e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:06.792543 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55a58c88-4eba-42ae-bc04-4a47dfa1d0e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:06.793028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55a58c88-4eba-42ae-bc04-4a47dfa1d0e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:06.793464 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55a58c88-4eba-42ae-bc04-4a47dfa1d0e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:06.794175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55a58c88-4eba-42ae-bc04-4a47dfa1d0e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:06.794614 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55a58c88-4eba-42ae-bc04-4a47dfa1d0e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:06.795547 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-55a58c88-4eba-42ae-bc04-4a47dfa1d0e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:06.851150 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-93a6cf5a-6ba0-4752-be85-d043d03f93d8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:06.859712 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-93a6cf5a-6ba0-4752-be85-d043d03f93d8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:06.861195 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-93a6cf5a-6ba0-4752-be85-d043d03f93d8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:06.863237 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-93a6cf5a-6ba0-4752-be85-d043d03f93d8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.157334 Aug 24 12:52:06.863790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1349/2700] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:06 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:06.925444 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-55a58c88-4eba-42ae-bc04-4a47dfa1d0e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:06.933577 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-55a58c88-4eba-42ae-bc04-4a47dfa1d0e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152187 Aug 24 12:52:06.934133 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1352/2701] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:06 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:07.070127 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fea3f781-1955-4550-a826-56359ef8928c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:07.070778 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fea3f781-1955-4550-a826-56359ef8928c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:07.076606 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fea3f781-1955-4550-a826-56359ef8928c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:07.077081 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fea3f781-1955-4550-a826-56359ef8928c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:07.077514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fea3f781-1955-4550-a826-56359ef8928c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:07.078189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fea3f781-1955-4550-a826-56359ef8928c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:07.078638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fea3f781-1955-4550-a826-56359ef8928c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:07.079086 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fea3f781-1955-4550-a826-56359ef8928c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:07.203113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fea3f781-1955-4550-a826-56359ef8928c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:07.209713 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a740d643-5775-49e0-add7-cf3d6ef45721 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:07.210320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a740d643-5775-49e0-add7-cf3d6ef45721 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:07.211764 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fea3f781-1955-4550-a826-56359ef8928c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.145369 Aug 24 12:52:07.216786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a740d643-5775-49e0-add7-cf3d6ef45721 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:07.217528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a740d643-5775-49e0-add7-cf3d6ef45721 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:07.218221 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a740d643-5775-49e0-add7-cf3d6ef45721 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:07.219215 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a740d643-5775-49e0-add7-cf3d6ef45721 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:07.219780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a740d643-5775-49e0-add7-cf3d6ef45721 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:07.220330 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a740d643-5775-49e0-add7-cf3d6ef45721 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:07.225949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1350/2702] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:07 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:07.345324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a740d643-5775-49e0-add7-cf3d6ef45721 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:07.354028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a740d643-5775-49e0-add7-cf3d6ef45721 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.148630 Aug 24 12:52:07.354592 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1353/2703] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:07 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:07.879607 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:52:07.879850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 12:52:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:52:07.885442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9786b8c7-38f8-4fdf-bc6a-94a4da58b332 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:07.886043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9786b8c7-38f8-4fdf-bc6a-94a4da58b332 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:07.892418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9786b8c7-38f8-4fdf-bc6a-94a4da58b332 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:07.893580 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9786b8c7-38f8-4fdf-bc6a-94a4da58b332 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:07.894009 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9786b8c7-38f8-4fdf-bc6a-94a4da58b332 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:07.894700 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9786b8c7-38f8-4fdf-bc6a-94a4da58b332 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:07.895148 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9786b8c7-38f8-4fdf-bc6a-94a4da58b332 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:07.895564 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9786b8c7-38f8-4fdf-bc6a-94a4da58b332 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:07.953388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0b538571-d9f8-4848-b620-40f89d21c058 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:07.954005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0b538571-d9f8-4848-b620-40f89d21c058 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:07.960420 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b538571-d9f8-4848-b620-40f89d21c058 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:07.960903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b538571-d9f8-4848-b620-40f89d21c058 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:07.961342 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b538571-d9f8-4848-b620-40f89d21c058 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:07.962028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b538571-d9f8-4848-b620-40f89d21c058 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:07.962483 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b538571-d9f8-4848-b620-40f89d21c058 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:07.962935 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b538571-d9f8-4848-b620-40f89d21c058 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:08.024507 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9786b8c7-38f8-4fdf-bc6a-94a4da58b332 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:08.033168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9786b8c7-38f8-4fdf-bc6a-94a4da58b332 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:08.034680 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9786b8c7-38f8-4fdf-bc6a-94a4da58b332 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:08.035900 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9786b8c7-38f8-4fdf-bc6a-94a4da58b332 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154329 Aug 24 12:52:08.036450 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1351/2704] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:07 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:08.091625 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0b538571-d9f8-4848-b620-40f89d21c058 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:08.100452 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0b538571-d9f8-4848-b620-40f89d21c058 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150847 Aug 24 12:52:08.101011 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1354/2705] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:07 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:08.233273 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-04cfa10a-dbf6-44a4-8025-04ea887cc43a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:08.233925 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-04cfa10a-dbf6-44a4-8025-04ea887cc43a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:08.240610 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04cfa10a-dbf6-44a4-8025-04ea887cc43a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:08.241091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04cfa10a-dbf6-44a4-8025-04ea887cc43a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:08.241529 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04cfa10a-dbf6-44a4-8025-04ea887cc43a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:08.242211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04cfa10a-dbf6-44a4-8025-04ea887cc43a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:08.242675 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04cfa10a-dbf6-44a4-8025-04ea887cc43a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:08.243105 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04cfa10a-dbf6-44a4-8025-04ea887cc43a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:08.372522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-04cfa10a-dbf6-44a4-8025-04ea887cc43a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:08.375718 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b90765e4-5d84-4c69-8108-4bc7f736cdf8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:08.376334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b90765e4-5d84-4c69-8108-4bc7f736cdf8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:08.380711 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-04cfa10a-dbf6-44a4-8025-04ea887cc43a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151215 Aug 24 12:52:08.381272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1352/2706] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:08 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:08.382295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b90765e4-5d84-4c69-8108-4bc7f736cdf8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:08.382813 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b90765e4-5d84-4c69-8108-4bc7f736cdf8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:08.383255 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b90765e4-5d84-4c69-8108-4bc7f736cdf8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:08.383948 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b90765e4-5d84-4c69-8108-4bc7f736cdf8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:08.384403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b90765e4-5d84-4c69-8108-4bc7f736cdf8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:08.384828 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b90765e4-5d84-4c69-8108-4bc7f736cdf8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:08.513197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b90765e4-5d84-4c69-8108-4bc7f736cdf8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:08.515393 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:52:08.521881 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b90765e4-5d84-4c69-8108-4bc7f736cdf8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149968 Aug 24 12:52:08.522439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1355/2707] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:08 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:09.059779 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-349306c1-f410-4952-ab3e-76e273acf466 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:09.060395 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-349306c1-f410-4952-ab3e-76e273acf466 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:09.067265 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-349306c1-f410-4952-ab3e-76e273acf466 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:09.067744 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-349306c1-f410-4952-ab3e-76e273acf466 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:09.068179 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-349306c1-f410-4952-ab3e-76e273acf466 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:09.068853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-349306c1-f410-4952-ab3e-76e273acf466 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:09.069301 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-349306c1-f410-4952-ab3e-76e273acf466 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:09.069725 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-349306c1-f410-4952-ab3e-76e273acf466 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:09.121635 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-aeb977b3-3bb8-40ce-b568-5f3d4d1e2bf1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:09.122243 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-aeb977b3-3bb8-40ce-b568-5f3d4d1e2bf1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:09.129432 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aeb977b3-3bb8-40ce-b568-5f3d4d1e2bf1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:09.129925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aeb977b3-3bb8-40ce-b568-5f3d4d1e2bf1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:09.130367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aeb977b3-3bb8-40ce-b568-5f3d4d1e2bf1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:09.131085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aeb977b3-3bb8-40ce-b568-5f3d4d1e2bf1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:09.131544 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aeb977b3-3bb8-40ce-b568-5f3d4d1e2bf1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:09.131971 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aeb977b3-3bb8-40ce-b568-5f3d4d1e2bf1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:09.198578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-349306c1-f410-4952-ab3e-76e273acf466 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:09.207635 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-349306c1-f410-4952-ab3e-76e273acf466 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:09.209268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-349306c1-f410-4952-ab3e-76e273acf466 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:09.210420 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-349306c1-f410-4952-ab3e-76e273acf466 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154419 Aug 24 12:52:09.210873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1353/2708] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:09 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:52:09.260264 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-aeb977b3-3bb8-40ce-b568-5f3d4d1e2bf1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:09.268453 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-aeb977b3-3bb8-40ce-b568-5f3d4d1e2bf1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150970 Aug 24 12:52:09.269595 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1356/2709] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:09 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:09.401641 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-18c71680-0827-4efb-8b25-0bac8774fdaa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:09.402178 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-18c71680-0827-4efb-8b25-0bac8774fdaa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:09.408043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18c71680-0827-4efb-8b25-0bac8774fdaa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:09.412348 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18c71680-0827-4efb-8b25-0bac8774fdaa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:09.412348 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18c71680-0827-4efb-8b25-0bac8774fdaa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:09.412348 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18c71680-0827-4efb-8b25-0bac8774fdaa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:09.412348 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18c71680-0827-4efb-8b25-0bac8774fdaa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:09.412745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-18c71680-0827-4efb-8b25-0bac8774fdaa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:09.540595 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-18c71680-0827-4efb-8b25-0bac8774fdaa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:09.548682 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-18c71680-0827-4efb-8b25-0bac8774fdaa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151003 Aug 24 12:52:09.549259 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1354/2710] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:09 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:09.551774 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-96748717-8223-48e5-b8e2-95c8d8b2cbdb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:09.552413 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-96748717-8223-48e5-b8e2-95c8d8b2cbdb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:09.558171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96748717-8223-48e5-b8e2-95c8d8b2cbdb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:09.558664 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96748717-8223-48e5-b8e2-95c8d8b2cbdb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:09.559113 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96748717-8223-48e5-b8e2-95c8d8b2cbdb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:09.559784 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96748717-8223-48e5-b8e2-95c8d8b2cbdb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:09.560237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96748717-8223-48e5-b8e2-95c8d8b2cbdb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:09.560659 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96748717-8223-48e5-b8e2-95c8d8b2cbdb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:09.690088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-96748717-8223-48e5-b8e2-95c8d8b2cbdb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:09.699144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-96748717-8223-48e5-b8e2-95c8d8b2cbdb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151600 Aug 24 12:52:09.699714 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1357/2711] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:09 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:10.233409 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7dafb395-8c23-4ab9-be42-5698a0b1a4b6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:10.234034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7dafb395-8c23-4ab9-be42-5698a0b1a4b6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:10.241902 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7dafb395-8c23-4ab9-be42-5698a0b1a4b6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:10.242388 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7dafb395-8c23-4ab9-be42-5698a0b1a4b6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:10.242863 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7dafb395-8c23-4ab9-be42-5698a0b1a4b6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:10.252230 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7dafb395-8c23-4ab9-be42-5698a0b1a4b6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:10.252230 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7dafb395-8c23-4ab9-be42-5698a0b1a4b6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:10.252230 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7dafb395-8c23-4ab9-be42-5698a0b1a4b6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:10.252230 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:52:10.289292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a930f7ab-38fe-40de-b33d-7af0ad0c16ab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:10.289894 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a930f7ab-38fe-40de-b33d-7af0ad0c16ab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:10.296430 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a930f7ab-38fe-40de-b33d-7af0ad0c16ab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:10.296911 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a930f7ab-38fe-40de-b33d-7af0ad0c16ab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:10.297339 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a930f7ab-38fe-40de-b33d-7af0ad0c16ab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:10.298025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a930f7ab-38fe-40de-b33d-7af0ad0c16ab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:10.298474 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a930f7ab-38fe-40de-b33d-7af0ad0c16ab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:10.298924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a930f7ab-38fe-40de-b33d-7af0ad0c16ab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:10.376111 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7dafb395-8c23-4ab9-be42-5698a0b1a4b6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:10.385398 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7dafb395-8c23-4ab9-be42-5698a0b1a4b6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:10.386910 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7dafb395-8c23-4ab9-be42-5698a0b1a4b6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:10.388061 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7dafb395-8c23-4ab9-be42-5698a0b1a4b6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.158754 Aug 24 12:52:10.388611 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1355/2712] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:10 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:10.428231 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a930f7ab-38fe-40de-b33d-7af0ad0c16ab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:10.436394 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a930f7ab-38fe-40de-b33d-7af0ad0c16ab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151011 Aug 24 12:52:10.436944 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1358/2713] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:10 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:10.569960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7276c605-50be-4343-b590-d68e50b6045b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:10.570562 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7276c605-50be-4343-b590-d68e50b6045b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:10.576430 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7276c605-50be-4343-b590-d68e50b6045b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:10.576900 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7276c605-50be-4343-b590-d68e50b6045b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:10.577326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7276c605-50be-4343-b590-d68e50b6045b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:10.577994 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7276c605-50be-4343-b590-d68e50b6045b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:10.578437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7276c605-50be-4343-b590-d68e50b6045b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:10.578884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7276c605-50be-4343-b590-d68e50b6045b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:10.706233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7276c605-50be-4343-b590-d68e50b6045b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:10.714258 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7276c605-50be-4343-b590-d68e50b6045b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.148095 Aug 24 12:52:10.714827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1356/2714] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:10 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:10.719012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a9a12396-1473-47b3-884a-86884100f2d7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:10.719629 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a9a12396-1473-47b3-884a-86884100f2d7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:10.726331 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a9a12396-1473-47b3-884a-86884100f2d7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:10.726860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a9a12396-1473-47b3-884a-86884100f2d7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:10.727517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a9a12396-1473-47b3-884a-86884100f2d7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:10.728207 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a9a12396-1473-47b3-884a-86884100f2d7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:10.728657 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a9a12396-1473-47b3-884a-86884100f2d7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:10.729078 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a9a12396-1473-47b3-884a-86884100f2d7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:10.859528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a9a12396-1473-47b3-884a-86884100f2d7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:10.868696 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a9a12396-1473-47b3-884a-86884100f2d7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.153475 Aug 24 12:52:10.870386 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1359/2715] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:10 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:11.411170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-618a004d-124f-4ec4-a712-8bcbd72ffd64 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:11.411762 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-618a004d-124f-4ec4-a712-8bcbd72ffd64 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:11.418168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-618a004d-124f-4ec4-a712-8bcbd72ffd64 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:11.418665 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-618a004d-124f-4ec4-a712-8bcbd72ffd64 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:11.419109 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-618a004d-124f-4ec4-a712-8bcbd72ffd64 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:11.419788 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-618a004d-124f-4ec4-a712-8bcbd72ffd64 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:11.420231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-618a004d-124f-4ec4-a712-8bcbd72ffd64 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:11.420648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-618a004d-124f-4ec4-a712-8bcbd72ffd64 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:11.457241 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f04d21e7-0ee3-4dc0-810d-e55e60105ed8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:11.457851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f04d21e7-0ee3-4dc0-810d-e55e60105ed8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:11.464529 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f04d21e7-0ee3-4dc0-810d-e55e60105ed8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:11.465015 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f04d21e7-0ee3-4dc0-810d-e55e60105ed8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:11.465450 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f04d21e7-0ee3-4dc0-810d-e55e60105ed8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:11.466173 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f04d21e7-0ee3-4dc0-810d-e55e60105ed8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:11.466682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f04d21e7-0ee3-4dc0-810d-e55e60105ed8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:11.467107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f04d21e7-0ee3-4dc0-810d-e55e60105ed8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:11.548572 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-618a004d-124f-4ec4-a712-8bcbd72ffd64 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:11.558370 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-618a004d-124f-4ec4-a712-8bcbd72ffd64 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:11.559898 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-618a004d-124f-4ec4-a712-8bcbd72ffd64 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:11.561058 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-618a004d-124f-4ec4-a712-8bcbd72ffd64 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154269 Aug 24 12:52:11.561616 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1357/2716] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:11 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:11.607357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f04d21e7-0ee3-4dc0-810d-e55e60105ed8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:11.616496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f04d21e7-0ee3-4dc0-810d-e55e60105ed8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.163153 Aug 24 12:52:11.617113 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1360/2717] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:11 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:11.735437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8080a9e3-bbac-42a9-baf5-a1285c8b6e99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:11.736046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8080a9e3-bbac-42a9-baf5-a1285c8b6e99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:11.742665 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8080a9e3-bbac-42a9-baf5-a1285c8b6e99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:11.743155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8080a9e3-bbac-42a9-baf5-a1285c8b6e99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:11.743589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8080a9e3-bbac-42a9-baf5-a1285c8b6e99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:11.744262 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8080a9e3-bbac-42a9-baf5-a1285c8b6e99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:11.744711 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8080a9e3-bbac-42a9-baf5-a1285c8b6e99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:11.745132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8080a9e3-bbac-42a9-baf5-a1285c8b6e99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:11.874525 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8080a9e3-bbac-42a9-baf5-a1285c8b6e99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:11.883406 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8080a9e3-bbac-42a9-baf5-a1285c8b6e99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151828 Aug 24 12:52:11.883973 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1358/2718] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:11 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:11.889249 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-814d31a7-7cab-4eab-8bd9-42e5e51b3733 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:11.889858 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-814d31a7-7cab-4eab-8bd9-42e5e51b3733 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:11.895821 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-814d31a7-7cab-4eab-8bd9-42e5e51b3733 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:11.896302 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-814d31a7-7cab-4eab-8bd9-42e5e51b3733 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:11.896733 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-814d31a7-7cab-4eab-8bd9-42e5e51b3733 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:11.897410 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-814d31a7-7cab-4eab-8bd9-42e5e51b3733 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:11.897859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-814d31a7-7cab-4eab-8bd9-42e5e51b3733 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:11.898281 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-814d31a7-7cab-4eab-8bd9-42e5e51b3733 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:12.022568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-814d31a7-7cab-4eab-8bd9-42e5e51b3733 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:12.030554 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-814d31a7-7cab-4eab-8bd9-42e5e51b3733 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.145075 Aug 24 12:52:12.031142 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1361/2719] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:11 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:12.584035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6540c258-3578-4299-9be4-a2a5c163623b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:12.584671 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6540c258-3578-4299-9be4-a2a5c163623b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:12.591073 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6540c258-3578-4299-9be4-a2a5c163623b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:12.591557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6540c258-3578-4299-9be4-a2a5c163623b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:12.591988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6540c258-3578-4299-9be4-a2a5c163623b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:12.592667 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6540c258-3578-4299-9be4-a2a5c163623b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:12.593133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6540c258-3578-4299-9be4-a2a5c163623b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:12.593560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6540c258-3578-4299-9be4-a2a5c163623b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:12.637241 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7560433d-da8a-460d-bc3f-d8b029b8b3d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:12.637893 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7560433d-da8a-460d-bc3f-d8b029b8b3d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:12.644327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7560433d-da8a-460d-bc3f-d8b029b8b3d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:12.644817 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7560433d-da8a-460d-bc3f-d8b029b8b3d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:12.645264 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7560433d-da8a-460d-bc3f-d8b029b8b3d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:12.645968 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7560433d-da8a-460d-bc3f-d8b029b8b3d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:12.646422 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7560433d-da8a-460d-bc3f-d8b029b8b3d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:12.646883 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7560433d-da8a-460d-bc3f-d8b029b8b3d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:12.727086 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6540c258-3578-4299-9be4-a2a5c163623b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:12.735895 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6540c258-3578-4299-9be4-a2a5c163623b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:12.738169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6540c258-3578-4299-9be4-a2a5c163623b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:12.739354 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6540c258-3578-4299-9be4-a2a5c163623b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.159235 Aug 24 12:52:12.739908 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1359/2720] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:12 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:12.779106 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7560433d-da8a-460d-bc3f-d8b029b8b3d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:12.787719 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7560433d-da8a-460d-bc3f-d8b029b8b3d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.154338 Aug 24 12:52:12.788351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1362/2721] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:12 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:12.904617 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-14a8e504-6774-45a5-88e1-fa125c9624cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:12.905252 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-14a8e504-6774-45a5-88e1-fa125c9624cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:12.911707 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14a8e504-6774-45a5-88e1-fa125c9624cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:12.914413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14a8e504-6774-45a5-88e1-fa125c9624cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:12.914413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14a8e504-6774-45a5-88e1-fa125c9624cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:12.914413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14a8e504-6774-45a5-88e1-fa125c9624cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:12.914413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14a8e504-6774-45a5-88e1-fa125c9624cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:12.914849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14a8e504-6774-45a5-88e1-fa125c9624cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:13.039269 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-14a8e504-6774-45a5-88e1-fa125c9624cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:13.047232 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-14a8e504-6774-45a5-88e1-fa125c9624cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.146495 Aug 24 12:52:13.047879 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1360/2722] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:12 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:13.053203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8f1d7935-fa6f-4e49-bcec-2ebbf7dc28fc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:13.053818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8f1d7935-fa6f-4e49-bcec-2ebbf7dc28fc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:13.059663 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f1d7935-fa6f-4e49-bcec-2ebbf7dc28fc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:13.060141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f1d7935-fa6f-4e49-bcec-2ebbf7dc28fc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:13.060574 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f1d7935-fa6f-4e49-bcec-2ebbf7dc28fc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:13.061249 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f1d7935-fa6f-4e49-bcec-2ebbf7dc28fc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:13.061702 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f1d7935-fa6f-4e49-bcec-2ebbf7dc28fc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:13.062121 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f1d7935-fa6f-4e49-bcec-2ebbf7dc28fc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:13.195897 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8f1d7935-fa6f-4e49-bcec-2ebbf7dc28fc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:13.203929 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8f1d7935-fa6f-4e49-bcec-2ebbf7dc28fc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.155150 Aug 24 12:52:13.204478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1363/2723] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:13 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:13.763101 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d43466e2-21c7-43c7-b4d1-ab00c3891eaf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:13.763735 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d43466e2-21c7-43c7-b4d1-ab00c3891eaf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:13.770087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d43466e2-21c7-43c7-b4d1-ab00c3891eaf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:13.770563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d43466e2-21c7-43c7-b4d1-ab00c3891eaf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:13.771039 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d43466e2-21c7-43c7-b4d1-ab00c3891eaf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:13.771718 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d43466e2-21c7-43c7-b4d1-ab00c3891eaf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:13.772169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d43466e2-21c7-43c7-b4d1-ab00c3891eaf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:13.772589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d43466e2-21c7-43c7-b4d1-ab00c3891eaf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:13.808341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-362a6e0f-a1ad-48bf-bcab-85fa96cc72c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:13.809089 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-362a6e0f-a1ad-48bf-bcab-85fa96cc72c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:13.815819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-362a6e0f-a1ad-48bf-bcab-85fa96cc72c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:13.816303 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-362a6e0f-a1ad-48bf-bcab-85fa96cc72c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:13.816950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-362a6e0f-a1ad-48bf-bcab-85fa96cc72c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:13.817644 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-362a6e0f-a1ad-48bf-bcab-85fa96cc72c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:13.818129 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-362a6e0f-a1ad-48bf-bcab-85fa96cc72c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:13.818552 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-362a6e0f-a1ad-48bf-bcab-85fa96cc72c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:13.905012 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d43466e2-21c7-43c7-b4d1-ab00c3891eaf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:13.914402 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d43466e2-21c7-43c7-b4d1-ab00c3891eaf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:13.916037 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d43466e2-21c7-43c7-b4d1-ab00c3891eaf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:13.917953 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d43466e2-21c7-43c7-b4d1-ab00c3891eaf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.158694 Aug 24 12:52:13.918624 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1361/2724] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:13 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:13.952508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-362a6e0f-a1ad-48bf-bcab-85fa96cc72c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:13.961171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-362a6e0f-a1ad-48bf-bcab-85fa96cc72c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.156625 Aug 24 12:52:13.961718 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1364/2725] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:13 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:14.068763 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-44320983-dea5-45bd-b81d-dce281a54990 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:14.069287 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-44320983-dea5-45bd-b81d-dce281a54990 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:14.075098 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-44320983-dea5-45bd-b81d-dce281a54990 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:14.075573 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-44320983-dea5-45bd-b81d-dce281a54990 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:14.076007 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-44320983-dea5-45bd-b81d-dce281a54990 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:14.076676 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-44320983-dea5-45bd-b81d-dce281a54990 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:14.077125 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-44320983-dea5-45bd-b81d-dce281a54990 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:14.077543 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-44320983-dea5-45bd-b81d-dce281a54990 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:14.225760 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1d89c66f-135c-4396-9b07-55f9a1f9b7b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:14.226376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1d89c66f-135c-4396-9b07-55f9a1f9b7b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:14.232500 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1d89c66f-135c-4396-9b07-55f9a1f9b7b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:14.232974 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1d89c66f-135c-4396-9b07-55f9a1f9b7b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:14.233412 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1d89c66f-135c-4396-9b07-55f9a1f9b7b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:14.234151 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1d89c66f-135c-4396-9b07-55f9a1f9b7b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:14.234608 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1d89c66f-135c-4396-9b07-55f9a1f9b7b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:14.235062 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1d89c66f-135c-4396-9b07-55f9a1f9b7b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:14.263715 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-44320983-dea5-45bd-b81d-dce281a54990 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:14.273669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-44320983-dea5-45bd-b81d-dce281a54990 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.208800 Aug 24 12:52:14.274245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1362/2726] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:14 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:14.373610 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1d89c66f-135c-4396-9b07-55f9a1f9b7b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:14.382493 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1d89c66f-135c-4396-9b07-55f9a1f9b7b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.161198 Aug 24 12:52:14.383099 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1365/2727] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:14 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:14.941667 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-94248c4a-08d3-400c-968a-79c407a14146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:14.942233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-94248c4a-08d3-400c-968a-79c407a14146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:14.948643 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94248c4a-08d3-400c-968a-79c407a14146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:14.949114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94248c4a-08d3-400c-968a-79c407a14146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:14.949544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94248c4a-08d3-400c-968a-79c407a14146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:14.950221 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94248c4a-08d3-400c-968a-79c407a14146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:14.950684 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94248c4a-08d3-400c-968a-79c407a14146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:14.951108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94248c4a-08d3-400c-968a-79c407a14146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:14.981555 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f78f36f9-70b1-42b6-9a63-b06459eacd2c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:14.982169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f78f36f9-70b1-42b6-9a63-b06459eacd2c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:14.984646 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:52:14.990531 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f78f36f9-70b1-42b6-9a63-b06459eacd2c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:14.991047 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f78f36f9-70b1-42b6-9a63-b06459eacd2c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:14.991589 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f78f36f9-70b1-42b6-9a63-b06459eacd2c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:14.992661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f78f36f9-70b1-42b6-9a63-b06459eacd2c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:14.993124 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f78f36f9-70b1-42b6-9a63-b06459eacd2c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:14.993546 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f78f36f9-70b1-42b6-9a63-b06459eacd2c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:15.102815 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-94248c4a-08d3-400c-968a-79c407a14146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:15.111648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-94248c4a-08d3-400c-968a-79c407a14146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:15.113607 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-94248c4a-08d3-400c-968a-79c407a14146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:15.114932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-94248c4a-08d3-400c-968a-79c407a14146 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.177957 Aug 24 12:52:15.115487 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1363/2728] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:14 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:15.131485 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f78f36f9-70b1-42b6-9a63-b06459eacd2c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:15.139616 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f78f36f9-70b1-42b6-9a63-b06459eacd2c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.161916 Aug 24 12:52:15.140180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1366/2729] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:14 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:15.296890 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5008306f-7644-4e49-9154-f725454d4bfc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:15.297493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5008306f-7644-4e49-9154-f725454d4bfc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:15.303559 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5008306f-7644-4e49-9154-f725454d4bfc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:15.304033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5008306f-7644-4e49-9154-f725454d4bfc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:15.304457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5008306f-7644-4e49-9154-f725454d4bfc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:15.305128 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5008306f-7644-4e49-9154-f725454d4bfc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:15.305575 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5008306f-7644-4e49-9154-f725454d4bfc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:15.306008 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5008306f-7644-4e49-9154-f725454d4bfc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:15.404063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-29d8d296-a4d1-4f8b-9eb8-0d866224a8d1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:15.404791 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-29d8d296-a4d1-4f8b-9eb8-0d866224a8d1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:15.411151 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29d8d296-a4d1-4f8b-9eb8-0d866224a8d1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:15.411765 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29d8d296-a4d1-4f8b-9eb8-0d866224a8d1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:15.412297 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29d8d296-a4d1-4f8b-9eb8-0d866224a8d1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:15.413318 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29d8d296-a4d1-4f8b-9eb8-0d866224a8d1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:15.413988 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29d8d296-a4d1-4f8b-9eb8-0d866224a8d1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:15.414476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29d8d296-a4d1-4f8b-9eb8-0d866224a8d1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:15.439039 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5008306f-7644-4e49-9154-f725454d4bfc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:15.447740 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5008306f-7644-4e49-9154-f725454d4bfc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.154701 Aug 24 12:52:15.448359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1364/2730] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:15 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:15.548605 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-29d8d296-a4d1-4f8b-9eb8-0d866224a8d1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:15.557251 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-29d8d296-a4d1-4f8b-9eb8-0d866224a8d1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.157197 Aug 24 12:52:15.557814 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1367/2731] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:15 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:16.137334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e86e99d6-7354-4833-a638-fcc360212dd1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:16.137856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e86e99d6-7354-4833-a638-fcc360212dd1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:16.144418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e86e99d6-7354-4833-a638-fcc360212dd1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:16.144893 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e86e99d6-7354-4833-a638-fcc360212dd1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:16.145319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e86e99d6-7354-4833-a638-fcc360212dd1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:16.145985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e86e99d6-7354-4833-a638-fcc360212dd1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:16.146428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e86e99d6-7354-4833-a638-fcc360212dd1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:16.146895 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e86e99d6-7354-4833-a638-fcc360212dd1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:16.160386 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bc27d304-dabb-4f47-9d6d-c1d28d213c51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:16.160990 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bc27d304-dabb-4f47-9d6d-c1d28d213c51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:16.167947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc27d304-dabb-4f47-9d6d-c1d28d213c51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:16.168424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc27d304-dabb-4f47-9d6d-c1d28d213c51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:16.168857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc27d304-dabb-4f47-9d6d-c1d28d213c51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:16.169538 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc27d304-dabb-4f47-9d6d-c1d28d213c51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:16.169995 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc27d304-dabb-4f47-9d6d-c1d28d213c51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:16.170420 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc27d304-dabb-4f47-9d6d-c1d28d213c51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:16.280355 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e86e99d6-7354-4833-a638-fcc360212dd1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:16.289705 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e86e99d6-7354-4833-a638-fcc360212dd1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:16.291221 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e86e99d6-7354-4833-a638-fcc360212dd1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:16.292406 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e86e99d6-7354-4833-a638-fcc360212dd1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.158990 Aug 24 12:52:16.292970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1365/2732] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:16 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:16.300146 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bc27d304-dabb-4f47-9d6d-c1d28d213c51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:16.310266 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bc27d304-dabb-4f47-9d6d-c1d28d213c51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153970 Aug 24 12:52:16.311316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1368/2733] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:16 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:16.468754 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-59ea0c0f-6f19-4eb9-a445-2783bb84f999 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:16.469360 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-59ea0c0f-6f19-4eb9-a445-2783bb84f999 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:16.476268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59ea0c0f-6f19-4eb9-a445-2783bb84f999 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:16.476741 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59ea0c0f-6f19-4eb9-a445-2783bb84f999 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:16.477171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59ea0c0f-6f19-4eb9-a445-2783bb84f999 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:16.477846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59ea0c0f-6f19-4eb9-a445-2783bb84f999 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:16.478294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59ea0c0f-6f19-4eb9-a445-2783bb84f999 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:16.478742 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59ea0c0f-6f19-4eb9-a445-2783bb84f999 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:16.578931 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fd5f1da4-9e30-403d-b8c9-bbc7393b0672 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:16.579551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fd5f1da4-9e30-403d-b8c9-bbc7393b0672 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:16.585903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fd5f1da4-9e30-403d-b8c9-bbc7393b0672 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:16.586390 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fd5f1da4-9e30-403d-b8c9-bbc7393b0672 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:16.586883 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fd5f1da4-9e30-403d-b8c9-bbc7393b0672 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:16.587572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fd5f1da4-9e30-403d-b8c9-bbc7393b0672 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:16.588029 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fd5f1da4-9e30-403d-b8c9-bbc7393b0672 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:16.588476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fd5f1da4-9e30-403d-b8c9-bbc7393b0672 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:16.604600 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-59ea0c0f-6f19-4eb9-a445-2783bb84f999 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:16.613132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-59ea0c0f-6f19-4eb9-a445-2783bb84f999 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.148291 Aug 24 12:52:16.613783 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1366/2734] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:16 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:16.717057 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fd5f1da4-9e30-403d-b8c9-bbc7393b0672 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:16.725092 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fd5f1da4-9e30-403d-b8c9-bbc7393b0672 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150173 Aug 24 12:52:16.725645 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1369/2735] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:16 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:17.324648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-946be203-aa0d-4a4e-a4fb-7c34efbe4e70 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:17.325230 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-946be203-aa0d-4a4e-a4fb-7c34efbe4e70 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:17.331311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9ec9fe09-1027-4226-a2e5-854d318b15d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:17.331759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-946be203-aa0d-4a4e-a4fb-7c34efbe4e70 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:17.331906 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9ec9fe09-1027-4226-a2e5-854d318b15d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:17.332238 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-946be203-aa0d-4a4e-a4fb-7c34efbe4e70 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:17.332662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-946be203-aa0d-4a4e-a4fb-7c34efbe4e70 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:17.333387 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-946be203-aa0d-4a4e-a4fb-7c34efbe4e70 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:17.333777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-946be203-aa0d-4a4e-a4fb-7c34efbe4e70 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:17.334198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-946be203-aa0d-4a4e-a4fb-7c34efbe4e70 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:17.338125 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ec9fe09-1027-4226-a2e5-854d318b15d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:17.338610 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ec9fe09-1027-4226-a2e5-854d318b15d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:17.339083 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ec9fe09-1027-4226-a2e5-854d318b15d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:17.339778 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ec9fe09-1027-4226-a2e5-854d318b15d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:17.340239 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ec9fe09-1027-4226-a2e5-854d318b15d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:17.340668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9ec9fe09-1027-4226-a2e5-854d318b15d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:17.466070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-946be203-aa0d-4a4e-a4fb-7c34efbe4e70 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:17.467766 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9ec9fe09-1027-4226-a2e5-854d318b15d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:17.475508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-946be203-aa0d-4a4e-a4fb-7c34efbe4e70 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:17.477033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-946be203-aa0d-4a4e-a4fb-7c34efbe4e70 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:17.478208 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-946be203-aa0d-4a4e-a4fb-7c34efbe4e70 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.157382 Aug 24 12:52:17.478789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1367/2736] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:17 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:17.480762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9ec9fe09-1027-4226-a2e5-854d318b15d5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153300 Aug 24 12:52:17.481329 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1370/2737] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:17 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:17.632965 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-168d18b3-31cb-46d9-bb3f-041fba46d9c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:17.633503 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-168d18b3-31cb-46d9-bb3f-041fba46d9c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:17.639437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-168d18b3-31cb-46d9-bb3f-041fba46d9c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:17.639920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-168d18b3-31cb-46d9-bb3f-041fba46d9c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:17.640352 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-168d18b3-31cb-46d9-bb3f-041fba46d9c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:17.641025 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-168d18b3-31cb-46d9-bb3f-041fba46d9c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:17.641476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-168d18b3-31cb-46d9-bb3f-041fba46d9c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:17.641900 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-168d18b3-31cb-46d9-bb3f-041fba46d9c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:17.746382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-696bba41-8bc7-42fe-a203-1eec41b12023 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:17.747021 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-696bba41-8bc7-42fe-a203-1eec41b12023 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:17.752808 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-696bba41-8bc7-42fe-a203-1eec41b12023 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:17.753289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-696bba41-8bc7-42fe-a203-1eec41b12023 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:17.753730 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-696bba41-8bc7-42fe-a203-1eec41b12023 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:17.754411 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-696bba41-8bc7-42fe-a203-1eec41b12023 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:17.754923 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-696bba41-8bc7-42fe-a203-1eec41b12023 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:17.755351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-696bba41-8bc7-42fe-a203-1eec41b12023 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:17.771303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-168d18b3-31cb-46d9-bb3f-041fba46d9c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:17.779428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-168d18b3-31cb-46d9-bb3f-041fba46d9c3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150148 Aug 24 12:52:17.779995 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1368/2738] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:17 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:17.883699 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-696bba41-8bc7-42fe-a203-1eec41b12023 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:17.891918 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-696bba41-8bc7-42fe-a203-1eec41b12023 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149327 Aug 24 12:52:17.892475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1371/2739] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:17 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:18.501833 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-50e4a1fc-727c-44b7-b12c-eadf474cb0b5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:18.502386 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bb489129-4e6e-4071-9af3-a25807738b3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:18.502513 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-50e4a1fc-727c-44b7-b12c-eadf474cb0b5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:18.502619 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bb489129-4e6e-4071-9af3-a25807738b3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:18.509500 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-50e4a1fc-727c-44b7-b12c-eadf474cb0b5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:18.509671 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb489129-4e6e-4071-9af3-a25807738b3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:18.509981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb489129-4e6e-4071-9af3-a25807738b3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:18.510102 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-50e4a1fc-727c-44b7-b12c-eadf474cb0b5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:18.510414 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-50e4a1fc-727c-44b7-b12c-eadf474cb0b5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:18.510537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb489129-4e6e-4071-9af3-a25807738b3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:18.511125 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb489129-4e6e-4071-9af3-a25807738b3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:18.511242 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-50e4a1fc-727c-44b7-b12c-eadf474cb0b5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:18.511580 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-50e4a1fc-727c-44b7-b12c-eadf474cb0b5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:18.511752 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb489129-4e6e-4071-9af3-a25807738b3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:18.512001 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb489129-4e6e-4071-9af3-a25807738b3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:18.512142 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-50e4a1fc-727c-44b7-b12c-eadf474cb0b5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:18.526594 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:52:18.639986 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bb489129-4e6e-4071-9af3-a25807738b3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:18.640448 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-50e4a1fc-727c-44b7-b12c-eadf474cb0b5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:18.648523 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-50e4a1fc-727c-44b7-b12c-eadf474cb0b5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150584 Aug 24 12:52:18.648697 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bb489129-4e6e-4071-9af3-a25807738b3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:18.649087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1369/2740] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:18 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:18.650024 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bb489129-4e6e-4071-9af3-a25807738b3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:18.651214 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bb489129-4e6e-4071-9af3-a25807738b3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.153017 Aug 24 12:52:18.651753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1372/2741] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:18 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:52:18.801990 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-61ae4d40-b1d6-46c8-981c-1e73de926123 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:18.802606 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-61ae4d40-b1d6-46c8-981c-1e73de926123 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:18.808494 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61ae4d40-b1d6-46c8-981c-1e73de926123 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:18.808970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61ae4d40-b1d6-46c8-981c-1e73de926123 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:18.809403 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61ae4d40-b1d6-46c8-981c-1e73de926123 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:18.810079 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61ae4d40-b1d6-46c8-981c-1e73de926123 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:18.810535 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61ae4d40-b1d6-46c8-981c-1e73de926123 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:18.811003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61ae4d40-b1d6-46c8-981c-1e73de926123 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:18.913469 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a7df6eaf-462e-4a37-a318-fddc05a3e76a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:18.914156 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a7df6eaf-462e-4a37-a318-fddc05a3e76a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:18.920243 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7df6eaf-462e-4a37-a318-fddc05a3e76a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:18.920805 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7df6eaf-462e-4a37-a318-fddc05a3e76a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:18.921442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7df6eaf-462e-4a37-a318-fddc05a3e76a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:18.922244 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7df6eaf-462e-4a37-a318-fddc05a3e76a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:18.922816 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7df6eaf-462e-4a37-a318-fddc05a3e76a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:18.923314 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7df6eaf-462e-4a37-a318-fddc05a3e76a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:18.942412 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-61ae4d40-b1d6-46c8-981c-1e73de926123 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:18.951075 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-61ae4d40-b1d6-46c8-981c-1e73de926123 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.153529 Aug 24 12:52:18.951648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1370/2742] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:18 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:19.057652 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a7df6eaf-462e-4a37-a318-fddc05a3e76a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:19.065852 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a7df6eaf-462e-4a37-a318-fddc05a3e76a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.156736 Aug 24 12:52:19.066410 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1373/2743] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:18 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:19.669356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ba5126bb-9620-4c66-9f02-08b2ee4b5ea5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:19.670000 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ba5126bb-9620-4c66-9f02-08b2ee4b5ea5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:19.673168 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-763d1a42-7b24-4b53-9c4b-9118846dab5f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:19.673810 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-763d1a42-7b24-4b53-9c4b-9118846dab5f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:19.676517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ba5126bb-9620-4c66-9f02-08b2ee4b5ea5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:19.677015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ba5126bb-9620-4c66-9f02-08b2ee4b5ea5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:19.677453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ba5126bb-9620-4c66-9f02-08b2ee4b5ea5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:19.678201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ba5126bb-9620-4c66-9f02-08b2ee4b5ea5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:19.678599 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ba5126bb-9620-4c66-9f02-08b2ee4b5ea5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:19.679056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ba5126bb-9620-4c66-9f02-08b2ee4b5ea5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:19.680189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-763d1a42-7b24-4b53-9c4b-9118846dab5f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:19.680674 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-763d1a42-7b24-4b53-9c4b-9118846dab5f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:19.681109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-763d1a42-7b24-4b53-9c4b-9118846dab5f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:19.681794 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-763d1a42-7b24-4b53-9c4b-9118846dab5f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:19.682248 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-763d1a42-7b24-4b53-9c4b-9118846dab5f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:19.684016 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-763d1a42-7b24-4b53-9c4b-9118846dab5f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:19.807955 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ba5126bb-9620-4c66-9f02-08b2ee4b5ea5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:19.810104 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:52:19.811890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-763d1a42-7b24-4b53-9c4b-9118846dab5f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:19.817401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ba5126bb-9620-4c66-9f02-08b2ee4b5ea5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151894 Aug 24 12:52:19.817970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1371/2744] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:19 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:19.821107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-763d1a42-7b24-4b53-9c4b-9118846dab5f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:19.822599 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-763d1a42-7b24-4b53-9c4b-9118846dab5f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:19.823773 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-763d1a42-7b24-4b53-9c4b-9118846dab5f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154512 Aug 24 12:52:19.824318 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1374/2745] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:19 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:52:19.972020 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4e2d6908-85a4-4b15-8926-13d516f84d50 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:19.972670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4e2d6908-85a4-4b15-8926-13d516f84d50 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:19.979002 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4e2d6908-85a4-4b15-8926-13d516f84d50 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:19.979485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4e2d6908-85a4-4b15-8926-13d516f84d50 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:19.979915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4e2d6908-85a4-4b15-8926-13d516f84d50 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:19.980587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4e2d6908-85a4-4b15-8926-13d516f84d50 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:19.981033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4e2d6908-85a4-4b15-8926-13d516f84d50 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:19.981457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4e2d6908-85a4-4b15-8926-13d516f84d50 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:20.085801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-311409b4-84ed-4bb0-813e-e3e324d50bb7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:20.086526 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-311409b4-84ed-4bb0-813e-e3e324d50bb7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:20.092448 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-311409b4-84ed-4bb0-813e-e3e324d50bb7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:20.093018 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-311409b4-84ed-4bb0-813e-e3e324d50bb7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:20.093521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-311409b4-84ed-4bb0-813e-e3e324d50bb7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:20.094270 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-311409b4-84ed-4bb0-813e-e3e324d50bb7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:20.094827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-311409b4-84ed-4bb0-813e-e3e324d50bb7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:20.095317 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-311409b4-84ed-4bb0-813e-e3e324d50bb7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:20.107766 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4e2d6908-85a4-4b15-8926-13d516f84d50 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:20.116862 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4e2d6908-85a4-4b15-8926-13d516f84d50 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.148696 Aug 24 12:52:20.117425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1372/2746] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:19 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:20.223072 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-311409b4-84ed-4bb0-813e-e3e324d50bb7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:20.231120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-311409b4-84ed-4bb0-813e-e3e324d50bb7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149390 Aug 24 12:52:20.231686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1375/2747] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:20 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:20.837720 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bf6a4092-b337-4d14-9649-a3d4b37519f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:20.838324 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-bf6a4092-b337-4d14-9649-a3d4b37519f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:20.844854 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf6a4092-b337-4d14-9649-a3d4b37519f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:20.845330 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf6a4092-b337-4d14-9649-a3d4b37519f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:20.845760 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf6a4092-b337-4d14-9649-a3d4b37519f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:20.847140 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf6a4092-b337-4d14-9649-a3d4b37519f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:20.847598 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf6a4092-b337-4d14-9649-a3d4b37519f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:20.847841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fe66d8c2-19d0-4dc0-b04a-64e0e818ddfd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:20.848017 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf6a4092-b337-4d14-9649-a3d4b37519f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:20.848328 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fe66d8c2-19d0-4dc0-b04a-64e0e818ddfd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:20.855580 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe66d8c2-19d0-4dc0-b04a-64e0e818ddfd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:20.856065 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe66d8c2-19d0-4dc0-b04a-64e0e818ddfd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:20.856498 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe66d8c2-19d0-4dc0-b04a-64e0e818ddfd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:20.857180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe66d8c2-19d0-4dc0-b04a-64e0e818ddfd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:20.857633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe66d8c2-19d0-4dc0-b04a-64e0e818ddfd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:20.858078 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe66d8c2-19d0-4dc0-b04a-64e0e818ddfd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:20.979958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-bf6a4092-b337-4d14-9649-a3d4b37519f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:20.989016 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bf6a4092-b337-4d14-9649-a3d4b37519f2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.155059 Aug 24 12:52:20.989604 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1373/2748] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:20 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:21.138822 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f8841b4c-9f02-4e8f-a558-fe7247aced3a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:21.139998 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f8841b4c-9f02-4e8f-a558-fe7247aced3a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:21.142904 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:52:21.146935 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f8841b4c-9f02-4e8f-a558-fe7247aced3a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:21.148493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f8841b4c-9f02-4e8f-a558-fe7247aced3a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:21.148493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f8841b4c-9f02-4e8f-a558-fe7247aced3a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:21.148764 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f8841b4c-9f02-4e8f-a558-fe7247aced3a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:21.149187 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f8841b4c-9f02-4e8f-a558-fe7247aced3a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:21.149777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f8841b4c-9f02-4e8f-a558-fe7247aced3a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:21.191537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fe66d8c2-19d0-4dc0-b04a-64e0e818ddfd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:21.201331 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fe66d8c2-19d0-4dc0-b04a-64e0e818ddfd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:21.202854 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fe66d8c2-19d0-4dc0-b04a-64e0e818ddfd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:21.204053 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fe66d8c2-19d0-4dc0-b04a-64e0e818ddfd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.360895 Aug 24 12:52:21.204603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1376/2749] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:20 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:52:21.252092 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1e8694b0-2860-4fff-95fb-2dadb4988465 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:21.253283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1e8694b0-2860-4fff-95fb-2dadb4988465 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:21.259182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e8694b0-2860-4fff-95fb-2dadb4988465 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:21.259667 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e8694b0-2860-4fff-95fb-2dadb4988465 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:21.260106 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e8694b0-2860-4fff-95fb-2dadb4988465 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:21.260795 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e8694b0-2860-4fff-95fb-2dadb4988465 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:21.261251 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e8694b0-2860-4fff-95fb-2dadb4988465 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:21.261674 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e8694b0-2860-4fff-95fb-2dadb4988465 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:21.282411 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f8841b4c-9f02-4e8f-a558-fe7247aced3a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:21.290703 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f8841b4c-9f02-4e8f-a558-fe7247aced3a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.156026 Aug 24 12:52:21.291470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1374/2750] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:21 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:21.390608 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1e8694b0-2860-4fff-95fb-2dadb4988465 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:21.399265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1e8694b0-2860-4fff-95fb-2dadb4988465 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151062 Aug 24 12:52:21.399812 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1377/2751] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:21 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:22.010027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-79b133d2-b1a1-4860-9a6b-2bd41cb09818 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:22.010709 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-79b133d2-b1a1-4860-9a6b-2bd41cb09818 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:22.017360 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-79b133d2-b1a1-4860-9a6b-2bd41cb09818 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:22.017835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-79b133d2-b1a1-4860-9a6b-2bd41cb09818 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:22.018263 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-79b133d2-b1a1-4860-9a6b-2bd41cb09818 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:22.018967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-79b133d2-b1a1-4860-9a6b-2bd41cb09818 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:22.019414 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-79b133d2-b1a1-4860-9a6b-2bd41cb09818 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:22.019832 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-79b133d2-b1a1-4860-9a6b-2bd41cb09818 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:22.149977 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-79b133d2-b1a1-4860-9a6b-2bd41cb09818 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:22.158019 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-79b133d2-b1a1-4860-9a6b-2bd41cb09818 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152017 Aug 24 12:52:22.158583 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1375/2752] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:22 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:22.227535 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ae759be4-eccb-4d3a-979b-a98d43803856 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:22.228714 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ae759be4-eccb-4d3a-979b-a98d43803856 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:22.236178 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae759be4-eccb-4d3a-979b-a98d43803856 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:22.236660 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae759be4-eccb-4d3a-979b-a98d43803856 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:22.237610 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae759be4-eccb-4d3a-979b-a98d43803856 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:22.238296 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae759be4-eccb-4d3a-979b-a98d43803856 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:22.238926 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae759be4-eccb-4d3a-979b-a98d43803856 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:22.239361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae759be4-eccb-4d3a-979b-a98d43803856 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:22.311638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e6430c6d-b1f4-4a9f-9f5a-aeda9423725c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:22.312156 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e6430c6d-b1f4-4a9f-9f5a-aeda9423725c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:22.318618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e6430c6d-b1f4-4a9f-9f5a-aeda9423725c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:22.319135 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e6430c6d-b1f4-4a9f-9f5a-aeda9423725c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:22.319566 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e6430c6d-b1f4-4a9f-9f5a-aeda9423725c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:22.320250 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e6430c6d-b1f4-4a9f-9f5a-aeda9423725c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:22.320698 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e6430c6d-b1f4-4a9f-9f5a-aeda9423725c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:22.321122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e6430c6d-b1f4-4a9f-9f5a-aeda9423725c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:22.372056 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ae759be4-eccb-4d3a-979b-a98d43803856 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:22.382095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ae759be4-eccb-4d3a-979b-a98d43803856 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:22.383682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ae759be4-eccb-4d3a-979b-a98d43803856 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:22.384861 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ae759be4-eccb-4d3a-979b-a98d43803856 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.161109 Aug 24 12:52:22.385420 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1378/2753] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:22 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:22.423277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8b27d70b-227f-47d0-a8c9-8ffc013328d5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:22.424224 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8b27d70b-227f-47d0-a8c9-8ffc013328d5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:22.430815 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b27d70b-227f-47d0-a8c9-8ffc013328d5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:22.431298 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b27d70b-227f-47d0-a8c9-8ffc013328d5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:22.431732 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b27d70b-227f-47d0-a8c9-8ffc013328d5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:22.432419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b27d70b-227f-47d0-a8c9-8ffc013328d5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:22.432872 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b27d70b-227f-47d0-a8c9-8ffc013328d5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:22.433634 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b27d70b-227f-47d0-a8c9-8ffc013328d5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:22.454936 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e6430c6d-b1f4-4a9f-9f5a-aeda9423725c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:22.463218 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e6430c6d-b1f4-4a9f-9f5a-aeda9423725c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.155496 Aug 24 12:52:22.463785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1376/2754] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:22 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:22.565171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8b27d70b-227f-47d0-a8c9-8ffc013328d5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:22.573310 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8b27d70b-227f-47d0-a8c9-8ffc013328d5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.156960 Aug 24 12:52:22.573857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1379/2755] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:22 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:23.179539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-eb194d91-ed58-404c-a42c-2c220e4c6ee2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:23.180146 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-eb194d91-ed58-404c-a42c-2c220e4c6ee2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:23.186508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb194d91-ed58-404c-a42c-2c220e4c6ee2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:23.187011 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb194d91-ed58-404c-a42c-2c220e4c6ee2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:23.187444 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb194d91-ed58-404c-a42c-2c220e4c6ee2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:23.188122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb194d91-ed58-404c-a42c-2c220e4c6ee2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:23.188576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb194d91-ed58-404c-a42c-2c220e4c6ee2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:23.188997 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb194d91-ed58-404c-a42c-2c220e4c6ee2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:23.319732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-eb194d91-ed58-404c-a42c-2c220e4c6ee2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:23.327674 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-eb194d91-ed58-404c-a42c-2c220e4c6ee2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152112 Aug 24 12:52:23.328224 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1377/2756] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:23 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:23.407869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a84bea64-9ba9-4fca-b6c2-756b2c7cff03 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:23.408507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a84bea64-9ba9-4fca-b6c2-756b2c7cff03 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:23.415538 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a84bea64-9ba9-4fca-b6c2-756b2c7cff03 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:23.416005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a84bea64-9ba9-4fca-b6c2-756b2c7cff03 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:23.416437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a84bea64-9ba9-4fca-b6c2-756b2c7cff03 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:23.417125 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a84bea64-9ba9-4fca-b6c2-756b2c7cff03 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:23.417579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a84bea64-9ba9-4fca-b6c2-756b2c7cff03 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:23.418005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a84bea64-9ba9-4fca-b6c2-756b2c7cff03 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:23.484244 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c3319655-e3ed-47c9-956c-29a8c3423a64 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:23.484855 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c3319655-e3ed-47c9-956c-29a8c3423a64 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:23.491689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c3319655-e3ed-47c9-956c-29a8c3423a64 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:23.498761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c3319655-e3ed-47c9-956c-29a8c3423a64 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:23.498761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c3319655-e3ed-47c9-956c-29a8c3423a64 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:23.498761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c3319655-e3ed-47c9-956c-29a8c3423a64 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:23.498761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c3319655-e3ed-47c9-956c-29a8c3423a64 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:23.499194 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c3319655-e3ed-47c9-956c-29a8c3423a64 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:23.557970 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a84bea64-9ba9-4fca-b6c2-756b2c7cff03 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:23.566600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a84bea64-9ba9-4fca-b6c2-756b2c7cff03 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:23.568099 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a84bea64-9ba9-4fca-b6c2-756b2c7cff03 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:23.569246 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a84bea64-9ba9-4fca-b6c2-756b2c7cff03 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.165293 Aug 24 12:52:23.570429 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1380/2757] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:23 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:23.593298 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-edb931c8-60c5-46fd-8047-423c33dd7ce0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:23.594081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-edb931c8-60c5-46fd-8047-423c33dd7ce0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:23.600703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edb931c8-60c5-46fd-8047-423c33dd7ce0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:23.601196 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edb931c8-60c5-46fd-8047-423c33dd7ce0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:23.601637 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edb931c8-60c5-46fd-8047-423c33dd7ce0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:23.602326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edb931c8-60c5-46fd-8047-423c33dd7ce0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:23.602813 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edb931c8-60c5-46fd-8047-423c33dd7ce0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:23.603516 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edb931c8-60c5-46fd-8047-423c33dd7ce0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:23.632227 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c3319655-e3ed-47c9-956c-29a8c3423a64 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:23.641049 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c3319655-e3ed-47c9-956c-29a8c3423a64 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.160604 Aug 24 12:52:23.641621 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1378/2758] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:23 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:23.734843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-edb931c8-60c5-46fd-8047-423c33dd7ce0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:23.744261 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-edb931c8-60c5-46fd-8047-423c33dd7ce0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.154747 Aug 24 12:52:23.748394 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1381/2759] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:23 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:24.348661 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-98aba1b2-80bb-4d1d-a9de-8780b2221e51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:24.349206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-98aba1b2-80bb-4d1d-a9de-8780b2221e51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:24.366324 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98aba1b2-80bb-4d1d-a9de-8780b2221e51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:24.366851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98aba1b2-80bb-4d1d-a9de-8780b2221e51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:24.367287 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98aba1b2-80bb-4d1d-a9de-8780b2221e51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:24.367969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98aba1b2-80bb-4d1d-a9de-8780b2221e51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:24.368409 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98aba1b2-80bb-4d1d-a9de-8780b2221e51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:24.368831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98aba1b2-80bb-4d1d-a9de-8780b2221e51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:24.497261 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-98aba1b2-80bb-4d1d-a9de-8780b2221e51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:24.505293 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-98aba1b2-80bb-4d1d-a9de-8780b2221e51 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.161052 Aug 24 12:52:24.505844 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1379/2760] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:24 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:24.592255 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f1522f3f-0f7c-40ad-ab97-a379a409434c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:24.592865 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f1522f3f-0f7c-40ad-ab97-a379a409434c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:24.599963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1522f3f-0f7c-40ad-ab97-a379a409434c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:24.600386 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1522f3f-0f7c-40ad-ab97-a379a409434c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:24.600827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1522f3f-0f7c-40ad-ab97-a379a409434c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:24.601508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1522f3f-0f7c-40ad-ab97-a379a409434c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:24.601963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1522f3f-0f7c-40ad-ab97-a379a409434c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:24.602390 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1522f3f-0f7c-40ad-ab97-a379a409434c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:24.663410 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-96710a52-3520-4d7b-b8e4-b2bdf274b35e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:24.664010 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-96710a52-3520-4d7b-b8e4-b2bdf274b35e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:24.669963 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96710a52-3520-4d7b-b8e4-b2bdf274b35e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:24.670431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96710a52-3520-4d7b-b8e4-b2bdf274b35e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:24.670893 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96710a52-3520-4d7b-b8e4-b2bdf274b35e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:24.671562 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96710a52-3520-4d7b-b8e4-b2bdf274b35e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:24.672011 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96710a52-3520-4d7b-b8e4-b2bdf274b35e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:24.672426 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96710a52-3520-4d7b-b8e4-b2bdf274b35e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:24.730868 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f1522f3f-0f7c-40ad-ab97-a379a409434c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:24.739754 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f1522f3f-0f7c-40ad-ab97-a379a409434c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:24.741257 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f1522f3f-0f7c-40ad-ab97-a379a409434c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:24.742422 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f1522f3f-0f7c-40ad-ab97-a379a409434c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154091 Aug 24 12:52:24.743001 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1382/2761] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:24 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:24.764988 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5e09a9a0-9652-4c7e-a487-bdf709b3c10c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:24.765598 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5e09a9a0-9652-4c7e-a487-bdf709b3c10c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:24.772042 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e09a9a0-9652-4c7e-a487-bdf709b3c10c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:24.772524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e09a9a0-9652-4c7e-a487-bdf709b3c10c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:24.772989 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e09a9a0-9652-4c7e-a487-bdf709b3c10c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:24.773679 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e09a9a0-9652-4c7e-a487-bdf709b3c10c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:24.774130 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e09a9a0-9652-4c7e-a487-bdf709b3c10c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:24.774554 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e09a9a0-9652-4c7e-a487-bdf709b3c10c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:24.806327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-96710a52-3520-4d7b-b8e4-b2bdf274b35e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:24.814557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-96710a52-3520-4d7b-b8e4-b2bdf274b35e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.155534 Aug 24 12:52:24.815686 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1380/2762] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:24 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:24.904830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5e09a9a0-9652-4c7e-a487-bdf709b3c10c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:24.912888 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5e09a9a0-9652-4c7e-a487-bdf709b3c10c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151608 Aug 24 12:52:24.913442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1383/2763] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:24 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:25.526433 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5672bd8a-6866-478b-9b8d-df20c9171a4d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:25.527086 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5672bd8a-6866-478b-9b8d-df20c9171a4d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:25.533440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5672bd8a-6866-478b-9b8d-df20c9171a4d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:25.534421 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5672bd8a-6866-478b-9b8d-df20c9171a4d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:25.534872 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5672bd8a-6866-478b-9b8d-df20c9171a4d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:25.535687 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5672bd8a-6866-478b-9b8d-df20c9171a4d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:25.536083 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5672bd8a-6866-478b-9b8d-df20c9171a4d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:25.536499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5672bd8a-6866-478b-9b8d-df20c9171a4d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:25.667294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5672bd8a-6866-478b-9b8d-df20c9171a4d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:25.675946 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5672bd8a-6866-478b-9b8d-df20c9171a4d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153326 Aug 24 12:52:25.676553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1381/2764] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:25 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:25.765211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ebdf52d6-d4d7-4cb1-a2c6-175f840a0830 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:25.765817 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ebdf52d6-d4d7-4cb1-a2c6-175f840a0830 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:25.772200 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ebdf52d6-d4d7-4cb1-a2c6-175f840a0830 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:25.772675 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ebdf52d6-d4d7-4cb1-a2c6-175f840a0830 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:25.773106 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ebdf52d6-d4d7-4cb1-a2c6-175f840a0830 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:25.773780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ebdf52d6-d4d7-4cb1-a2c6-175f840a0830 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:25.774235 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ebdf52d6-d4d7-4cb1-a2c6-175f840a0830 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:25.774671 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ebdf52d6-d4d7-4cb1-a2c6-175f840a0830 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:25.836109 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b21cac4b-9d5f-4af1-b380-555b1369eb53 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:25.836749 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b21cac4b-9d5f-4af1-b380-555b1369eb53 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:25.842559 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b21cac4b-9d5f-4af1-b380-555b1369eb53 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:25.843097 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b21cac4b-9d5f-4af1-b380-555b1369eb53 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:25.843527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b21cac4b-9d5f-4af1-b380-555b1369eb53 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:25.844209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b21cac4b-9d5f-4af1-b380-555b1369eb53 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:25.844658 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b21cac4b-9d5f-4af1-b380-555b1369eb53 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:25.845080 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b21cac4b-9d5f-4af1-b380-555b1369eb53 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:25.904458 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ebdf52d6-d4d7-4cb1-a2c6-175f840a0830 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:25.913688 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ebdf52d6-d4d7-4cb1-a2c6-175f840a0830 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:25.915199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ebdf52d6-d4d7-4cb1-a2c6-175f840a0830 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:25.916349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ebdf52d6-d4d7-4cb1-a2c6-175f840a0830 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155047 Aug 24 12:52:25.916896 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1384/2765] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:25 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:25.933693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d3a16dd8-1468-4235-94a9-81609712d858 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:25.934236 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d3a16dd8-1468-4235-94a9-81609712d858 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:25.940262 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3a16dd8-1468-4235-94a9-81609712d858 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:25.940741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3a16dd8-1468-4235-94a9-81609712d858 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:25.941177 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3a16dd8-1468-4235-94a9-81609712d858 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:25.941993 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3a16dd8-1468-4235-94a9-81609712d858 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:25.942450 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3a16dd8-1468-4235-94a9-81609712d858 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:25.942909 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d3a16dd8-1468-4235-94a9-81609712d858 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:25.988174 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b21cac4b-9d5f-4af1-b380-555b1369eb53 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:25.996151 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b21cac4b-9d5f-4af1-b380-555b1369eb53 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.163887 Aug 24 12:52:25.996708 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1382/2766] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:25 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:26.071697 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d3a16dd8-1468-4235-94a9-81609712d858 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:26.079808 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d3a16dd8-1468-4235-94a9-81609712d858 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150380 Aug 24 12:52:26.080361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1385/2767] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:25 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:26.696403 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e54440e7-d0aa-4156-bfdb-af914c63daae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:26.697015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e54440e7-d0aa-4156-bfdb-af914c63daae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:26.703482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e54440e7-d0aa-4156-bfdb-af914c63daae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:26.703962 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e54440e7-d0aa-4156-bfdb-af914c63daae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:26.704401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e54440e7-d0aa-4156-bfdb-af914c63daae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:26.705206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e54440e7-d0aa-4156-bfdb-af914c63daae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:26.705700 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e54440e7-d0aa-4156-bfdb-af914c63daae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:26.706125 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e54440e7-d0aa-4156-bfdb-af914c63daae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:26.833895 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e54440e7-d0aa-4156-bfdb-af914c63daae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:26.841945 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e54440e7-d0aa-4156-bfdb-af914c63daae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149431 Aug 24 12:52:26.842538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1383/2768] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:26 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:26.938407 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8eeba0a3-d7db-4ae1-a696-27e635b115e6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:26.938968 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8eeba0a3-d7db-4ae1-a696-27e635b115e6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:26.946143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8eeba0a3-d7db-4ae1-a696-27e635b115e6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:26.946620 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8eeba0a3-d7db-4ae1-a696-27e635b115e6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:26.947084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8eeba0a3-d7db-4ae1-a696-27e635b115e6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:26.947783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8eeba0a3-d7db-4ae1-a696-27e635b115e6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:26.948231 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8eeba0a3-d7db-4ae1-a696-27e635b115e6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:26.948651 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8eeba0a3-d7db-4ae1-a696-27e635b115e6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:27.019391 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5059c53c-c12e-4f3b-8eee-d249adaf184b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:27.019994 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5059c53c-c12e-4f3b-8eee-d249adaf184b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:27.025763 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5059c53c-c12e-4f3b-8eee-d249adaf184b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:27.026240 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5059c53c-c12e-4f3b-8eee-d249adaf184b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:27.026700 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5059c53c-c12e-4f3b-8eee-d249adaf184b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:27.027389 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5059c53c-c12e-4f3b-8eee-d249adaf184b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:27.027831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5059c53c-c12e-4f3b-8eee-d249adaf184b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:27.028886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5059c53c-c12e-4f3b-8eee-d249adaf184b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:27.078663 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8eeba0a3-d7db-4ae1-a696-27e635b115e6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:27.087367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8eeba0a3-d7db-4ae1-a696-27e635b115e6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:27.088922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8eeba0a3-d7db-4ae1-a696-27e635b115e6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:27.090070 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8eeba0a3-d7db-4ae1-a696-27e635b115e6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155656 Aug 24 12:52:27.090619 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1386/2769] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:26 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:27.101131 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7cd41abb-e116-418f-91a1-5bbac1d6c734 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:27.101879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7cd41abb-e116-418f-91a1-5bbac1d6c734 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:27.107946 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7cd41abb-e116-418f-91a1-5bbac1d6c734 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:27.108495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7cd41abb-e116-418f-91a1-5bbac1d6c734 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:27.108995 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7cd41abb-e116-418f-91a1-5bbac1d6c734 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:27.109758 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7cd41abb-e116-418f-91a1-5bbac1d6c734 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:27.110268 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7cd41abb-e116-418f-91a1-5bbac1d6c734 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:27.110799 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7cd41abb-e116-418f-91a1-5bbac1d6c734 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:27.157775 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5059c53c-c12e-4f3b-8eee-d249adaf184b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:27.166334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5059c53c-c12e-4f3b-8eee-d249adaf184b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150820 Aug 24 12:52:27.166920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1384/2770] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:27 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:27.240268 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7cd41abb-e116-418f-91a1-5bbac1d6c734 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:27.248627 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7cd41abb-e116-418f-91a1-5bbac1d6c734 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150955 Aug 24 12:52:27.249208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1387/2771] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:27 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:27.862835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-036b3f23-6666-4585-9851-bd8ccc0a1f09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:27.863439 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-036b3f23-6666-4585-9851-bd8ccc0a1f09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:27.869869 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-036b3f23-6666-4585-9851-bd8ccc0a1f09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:27.870341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-036b3f23-6666-4585-9851-bd8ccc0a1f09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:27.870797 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-036b3f23-6666-4585-9851-bd8ccc0a1f09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:27.871471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-036b3f23-6666-4585-9851-bd8ccc0a1f09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:27.871917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-036b3f23-6666-4585-9851-bd8ccc0a1f09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:27.872335 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-036b3f23-6666-4585-9851-bd8ccc0a1f09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:28.003739 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-036b3f23-6666-4585-9851-bd8ccc0a1f09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:28.011782 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-036b3f23-6666-4585-9851-bd8ccc0a1f09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153038 Aug 24 12:52:28.012326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1385/2772] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:27 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:28.113485 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-733aac95-272c-46f0-b7b0-080efb9c72f4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:28.114089 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-733aac95-272c-46f0-b7b0-080efb9c72f4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:28.120423 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-733aac95-272c-46f0-b7b0-080efb9c72f4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:28.120907 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-733aac95-272c-46f0-b7b0-080efb9c72f4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:28.121338 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-733aac95-272c-46f0-b7b0-080efb9c72f4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:28.122017 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-733aac95-272c-46f0-b7b0-080efb9c72f4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:28.122465 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-733aac95-272c-46f0-b7b0-080efb9c72f4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:28.122912 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-733aac95-272c-46f0-b7b0-080efb9c72f4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:28.187110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2cb45b87-a2fc-49a0-8cfa-286c5f0706b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:28.187710 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2cb45b87-a2fc-49a0-8cfa-286c5f0706b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:28.194132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2cb45b87-a2fc-49a0-8cfa-286c5f0706b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:28.194608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2cb45b87-a2fc-49a0-8cfa-286c5f0706b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:28.195067 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2cb45b87-a2fc-49a0-8cfa-286c5f0706b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:28.195733 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2cb45b87-a2fc-49a0-8cfa-286c5f0706b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:28.196178 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2cb45b87-a2fc-49a0-8cfa-286c5f0706b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:28.196598 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2cb45b87-a2fc-49a0-8cfa-286c5f0706b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:28.255410 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-733aac95-272c-46f0-b7b0-080efb9c72f4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:28.264286 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-733aac95-272c-46f0-b7b0-080efb9c72f4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:28.265962 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-733aac95-272c-46f0-b7b0-080efb9c72f4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:28.267254 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-733aac95-272c-46f0-b7b0-080efb9c72f4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.157880 Aug 24 12:52:28.268137 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1388/2773] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:28 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:28.272420 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4668c1e0-2dac-4115-99a2-c3803075a01f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:28.273093 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4668c1e0-2dac-4115-99a2-c3803075a01f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:28.279063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4668c1e0-2dac-4115-99a2-c3803075a01f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:28.279618 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4668c1e0-2dac-4115-99a2-c3803075a01f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:28.280134 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4668c1e0-2dac-4115-99a2-c3803075a01f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:28.280912 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4668c1e0-2dac-4115-99a2-c3803075a01f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:28.281434 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4668c1e0-2dac-4115-99a2-c3803075a01f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:28.281939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4668c1e0-2dac-4115-99a2-c3803075a01f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:28.284623 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:52:28.327489 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2cb45b87-a2fc-49a0-8cfa-286c5f0706b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:28.335678 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2cb45b87-a2fc-49a0-8cfa-286c5f0706b4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152352 Aug 24 12:52:28.336245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1386/2774] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:28 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:28.417658 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4668c1e0-2dac-4115-99a2-c3803075a01f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:28.426423 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4668c1e0-2dac-4115-99a2-c3803075a01f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.157436 Aug 24 12:52:28.427019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1389/2775] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:28 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:29.032270 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a21d4933-2409-43a3-bc75-819bae219c87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:29.032875 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a21d4933-2409-43a3-bc75-819bae219c87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:29.039775 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a21d4933-2409-43a3-bc75-819bae219c87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:29.040248 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a21d4933-2409-43a3-bc75-819bae219c87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:29.040677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a21d4933-2409-43a3-bc75-819bae219c87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:29.041345 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a21d4933-2409-43a3-bc75-819bae219c87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:29.041791 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a21d4933-2409-43a3-bc75-819bae219c87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:29.042209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a21d4933-2409-43a3-bc75-819bae219c87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:29.171305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a21d4933-2409-43a3-bc75-819bae219c87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:29.179423 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a21d4933-2409-43a3-bc75-819bae219c87 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151051 Aug 24 12:52:29.179979 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1387/2776] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:29 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:29.290004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d29b39da-8900-45fe-bc24-95b016131ee6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:29.290535 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d29b39da-8900-45fe-bc24-95b016131ee6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:29.296895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d29b39da-8900-45fe-bc24-95b016131ee6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:29.297372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d29b39da-8900-45fe-bc24-95b016131ee6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:29.297804 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d29b39da-8900-45fe-bc24-95b016131ee6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:29.298488 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d29b39da-8900-45fe-bc24-95b016131ee6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:29.298968 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d29b39da-8900-45fe-bc24-95b016131ee6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:29.299392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d29b39da-8900-45fe-bc24-95b016131ee6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:29.356848 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c84c183e-3aa1-43d2-8a0e-bcfd8013f7e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:29.357456 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c84c183e-3aa1-43d2-8a0e-bcfd8013f7e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:29.363713 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c84c183e-3aa1-43d2-8a0e-bcfd8013f7e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:29.364194 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c84c183e-3aa1-43d2-8a0e-bcfd8013f7e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:29.364627 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c84c183e-3aa1-43d2-8a0e-bcfd8013f7e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:29.365306 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c84c183e-3aa1-43d2-8a0e-bcfd8013f7e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:29.365755 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c84c183e-3aa1-43d2-8a0e-bcfd8013f7e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:29.366176 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c84c183e-3aa1-43d2-8a0e-bcfd8013f7e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:29.380964 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:52:29.431729 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d29b39da-8900-45fe-bc24-95b016131ee6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:29.441317 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d29b39da-8900-45fe-bc24-95b016131ee6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:29.444869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d29b39da-8900-45fe-bc24-95b016131ee6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:29.444869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d29b39da-8900-45fe-bc24-95b016131ee6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.158117 Aug 24 12:52:29.444869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1390/2777] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:29 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:29.449170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1be1adf2-0f16-4276-81af-7d43350cb92a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:29.449767 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1be1adf2-0f16-4276-81af-7d43350cb92a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:29.456372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1be1adf2-0f16-4276-81af-7d43350cb92a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:29.456851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1be1adf2-0f16-4276-81af-7d43350cb92a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:29.457283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1be1adf2-0f16-4276-81af-7d43350cb92a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:29.457960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1be1adf2-0f16-4276-81af-7d43350cb92a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:29.458410 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1be1adf2-0f16-4276-81af-7d43350cb92a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:29.458859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1be1adf2-0f16-4276-81af-7d43350cb92a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:29.498461 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c84c183e-3aa1-43d2-8a0e-bcfd8013f7e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:29.507369 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c84c183e-3aa1-43d2-8a0e-bcfd8013f7e3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.154329 Aug 24 12:52:29.507947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1388/2778] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:29 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:29.592367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1be1adf2-0f16-4276-81af-7d43350cb92a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:29.600581 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1be1adf2-0f16-4276-81af-7d43350cb92a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.154817 Aug 24 12:52:29.601140 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1391/2779] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:29 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:30.200090 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-10486d22-a8f9-41cd-af0b-321391a7d07c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:30.200634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-10486d22-a8f9-41cd-af0b-321391a7d07c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:30.207528 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-10486d22-a8f9-41cd-af0b-321391a7d07c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:30.207997 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-10486d22-a8f9-41cd-af0b-321391a7d07c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:30.208453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-10486d22-a8f9-41cd-af0b-321391a7d07c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:30.209095 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-10486d22-a8f9-41cd-af0b-321391a7d07c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:30.209544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-10486d22-a8f9-41cd-af0b-321391a7d07c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:30.209961 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-10486d22-a8f9-41cd-af0b-321391a7d07c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:30.352279 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-10486d22-a8f9-41cd-af0b-321391a7d07c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:30.360444 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-10486d22-a8f9-41cd-af0b-321391a7d07c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.164315 Aug 24 12:52:30.361000 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1389/2780] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:30 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:30.467475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-db660587-80d7-4f14-ad9a-20ce5a73d56c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:30.468024 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-db660587-80d7-4f14-ad9a-20ce5a73d56c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:30.474481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db660587-80d7-4f14-ad9a-20ce5a73d56c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:30.474998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db660587-80d7-4f14-ad9a-20ce5a73d56c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:30.475440 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db660587-80d7-4f14-ad9a-20ce5a73d56c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:30.476128 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db660587-80d7-4f14-ad9a-20ce5a73d56c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:30.476588 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db660587-80d7-4f14-ad9a-20ce5a73d56c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:30.477020 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db660587-80d7-4f14-ad9a-20ce5a73d56c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:30.528993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bf3efae1-de3e-49e4-a401-41ceb13dc5b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:30.529741 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-bf3efae1-de3e-49e4-a401-41ceb13dc5b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:30.535878 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf3efae1-de3e-49e4-a401-41ceb13dc5b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:30.536431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf3efae1-de3e-49e4-a401-41ceb13dc5b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:30.537225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf3efae1-de3e-49e4-a401-41ceb13dc5b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:30.538014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf3efae1-de3e-49e4-a401-41ceb13dc5b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:30.538540 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf3efae1-de3e-49e4-a401-41ceb13dc5b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:30.539052 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf3efae1-de3e-49e4-a401-41ceb13dc5b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:30.605920 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-db660587-80d7-4f14-ad9a-20ce5a73d56c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:30.615296 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-db660587-80d7-4f14-ad9a-20ce5a73d56c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:30.616811 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-db660587-80d7-4f14-ad9a-20ce5a73d56c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:30.617988 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-db660587-80d7-4f14-ad9a-20ce5a73d56c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154519 Aug 24 12:52:30.618546 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1392/2781] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:30 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:30.622944 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-62ea9a79-75b3-48ba-b87c-95c9e93c4664 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:30.623558 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-62ea9a79-75b3-48ba-b87c-95c9e93c4664 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:30.630151 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-62ea9a79-75b3-48ba-b87c-95c9e93c4664 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:30.630644 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-62ea9a79-75b3-48ba-b87c-95c9e93c4664 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:30.631110 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-62ea9a79-75b3-48ba-b87c-95c9e93c4664 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:30.631804 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-62ea9a79-75b3-48ba-b87c-95c9e93c4664 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:30.632273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-62ea9a79-75b3-48ba-b87c-95c9e93c4664 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:30.632714 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-62ea9a79-75b3-48ba-b87c-95c9e93c4664 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:30.672064 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-bf3efae1-de3e-49e4-a401-41ceb13dc5b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:30.680819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bf3efae1-de3e-49e4-a401-41ceb13dc5b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.155834 Aug 24 12:52:30.681584 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1390/2782] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:30 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:30.764185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-62ea9a79-75b3-48ba-b87c-95c9e93c4664 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:30.772297 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-62ea9a79-75b3-48ba-b87c-95c9e93c4664 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.152788 Aug 24 12:52:30.772857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1393/2783] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:30 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:31.381754 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-008b43be-f56c-4468-9fb8-0ec7547a5d14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:31.382424 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-008b43be-f56c-4468-9fb8-0ec7547a5d14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:31.389500 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-008b43be-f56c-4468-9fb8-0ec7547a5d14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:31.389958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-008b43be-f56c-4468-9fb8-0ec7547a5d14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:31.390532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-008b43be-f56c-4468-9fb8-0ec7547a5d14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:31.391282 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-008b43be-f56c-4468-9fb8-0ec7547a5d14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:31.391728 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-008b43be-f56c-4468-9fb8-0ec7547a5d14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:31.392153 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-008b43be-f56c-4468-9fb8-0ec7547a5d14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:31.524267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-008b43be-f56c-4468-9fb8-0ec7547a5d14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:31.532395 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-008b43be-f56c-4468-9fb8-0ec7547a5d14 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.154797 Aug 24 12:52:31.532961 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1391/2784] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:31 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:31.641420 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-31cdec62-6221-4c08-a613-20dc6c97917c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:31.642022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-31cdec62-6221-4c08-a613-20dc6c97917c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:31.649051 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31cdec62-6221-4c08-a613-20dc6c97917c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:31.649536 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31cdec62-6221-4c08-a613-20dc6c97917c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:31.649977 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31cdec62-6221-4c08-a613-20dc6c97917c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:31.650687 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31cdec62-6221-4c08-a613-20dc6c97917c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:31.651151 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31cdec62-6221-4c08-a613-20dc6c97917c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:31.651581 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-31cdec62-6221-4c08-a613-20dc6c97917c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:31.701397 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b7e8b2a9-bf84-4bc0-acdf-6c086391d273 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:31.701988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b7e8b2a9-bf84-4bc0-acdf-6c086391d273 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:31.708768 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b7e8b2a9-bf84-4bc0-acdf-6c086391d273 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:31.709233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b7e8b2a9-bf84-4bc0-acdf-6c086391d273 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:31.709674 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b7e8b2a9-bf84-4bc0-acdf-6c086391d273 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:31.710392 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b7e8b2a9-bf84-4bc0-acdf-6c086391d273 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:31.710897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b7e8b2a9-bf84-4bc0-acdf-6c086391d273 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:31.711325 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b7e8b2a9-bf84-4bc0-acdf-6c086391d273 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:31.781439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-31cdec62-6221-4c08-a613-20dc6c97917c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:31.790457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-31cdec62-6221-4c08-a613-20dc6c97917c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:31.792000 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-31cdec62-6221-4c08-a613-20dc6c97917c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:31.793178 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-31cdec62-6221-4c08-a613-20dc6c97917c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155714 Aug 24 12:52:31.793766 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1394/2785] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:31 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:31.798101 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a977c0d7-5110-4567-af84-ed705a79e410 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:31.798734 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a977c0d7-5110-4567-af84-ed705a79e410 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:31.804962 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a977c0d7-5110-4567-af84-ed705a79e410 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:31.805134 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a977c0d7-5110-4567-af84-ed705a79e410 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:31.805515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a977c0d7-5110-4567-af84-ed705a79e410 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:31.806442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a977c0d7-5110-4567-af84-ed705a79e410 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:31.806931 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a977c0d7-5110-4567-af84-ed705a79e410 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:31.807365 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a977c0d7-5110-4567-af84-ed705a79e410 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:31.843706 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b7e8b2a9-bf84-4bc0-acdf-6c086391d273 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:31.852238 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b7e8b2a9-bf84-4bc0-acdf-6c086391d273 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.154693 Aug 24 12:52:31.852803 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1392/2786] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:31 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:31.941933 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a977c0d7-5110-4567-af84-ed705a79e410 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:31.949954 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a977c0d7-5110-4567-af84-ed705a79e410 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.155267 Aug 24 12:52:31.950534 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1395/2787] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:31 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:32.552976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ee419fcc-d5fc-44a6-9784-70ef6e9200c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:32.553575 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ee419fcc-d5fc-44a6-9784-70ef6e9200c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:32.560932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee419fcc-d5fc-44a6-9784-70ef6e9200c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:32.561407 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee419fcc-d5fc-44a6-9784-70ef6e9200c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:32.561844 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee419fcc-d5fc-44a6-9784-70ef6e9200c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:32.562519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee419fcc-d5fc-44a6-9784-70ef6e9200c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:32.562999 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee419fcc-d5fc-44a6-9784-70ef6e9200c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:32.563419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee419fcc-d5fc-44a6-9784-70ef6e9200c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:32.688107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ee419fcc-d5fc-44a6-9784-70ef6e9200c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:32.696169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ee419fcc-d5fc-44a6-9784-70ef6e9200c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.147048 Aug 24 12:52:32.696720 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1393/2788] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:32 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:32.817156 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0d8f688e-edd4-4fe9-a159-c9f6f6a9e41a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:32.817781 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0d8f688e-edd4-4fe9-a159-c9f6f6a9e41a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:32.824177 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0d8f688e-edd4-4fe9-a159-c9f6f6a9e41a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:32.824653 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0d8f688e-edd4-4fe9-a159-c9f6f6a9e41a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:32.825083 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0d8f688e-edd4-4fe9-a159-c9f6f6a9e41a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:32.825757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0d8f688e-edd4-4fe9-a159-c9f6f6a9e41a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:32.826216 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0d8f688e-edd4-4fe9-a159-c9f6f6a9e41a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:32.826717 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0d8f688e-edd4-4fe9-a159-c9f6f6a9e41a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:32.873288 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-47670464-a563-48dd-b500-c30368b9e1b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:32.873938 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-47670464-a563-48dd-b500-c30368b9e1b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:32.879962 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-47670464-a563-48dd-b500-c30368b9e1b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:32.880443 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-47670464-a563-48dd-b500-c30368b9e1b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:32.880878 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-47670464-a563-48dd-b500-c30368b9e1b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:32.881561 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-47670464-a563-48dd-b500-c30368b9e1b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:32.882011 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-47670464-a563-48dd-b500-c30368b9e1b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:32.882475 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-47670464-a563-48dd-b500-c30368b9e1b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:32.959981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0d8f688e-edd4-4fe9-a159-c9f6f6a9e41a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:32.970174 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0d8f688e-edd4-4fe9-a159-c9f6f6a9e41a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:32.979443 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0d8f688e-edd4-4fe9-a159-c9f6f6a9e41a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:32.980650 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0d8f688e-edd4-4fe9-a159-c9f6f6a9e41a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.167344 Aug 24 12:52:32.985258 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1396/2789] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:32 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:32.986068 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-144a7075-6d7c-4c57-b995-a1d7742ea0ad tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:32.986365 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-144a7075-6d7c-4c57-b995-a1d7742ea0ad tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:32.992970 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-144a7075-6d7c-4c57-b995-a1d7742ea0ad tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:32.993582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-144a7075-6d7c-4c57-b995-a1d7742ea0ad tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:32.994021 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-144a7075-6d7c-4c57-b995-a1d7742ea0ad tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:32.994731 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-144a7075-6d7c-4c57-b995-a1d7742ea0ad tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:32.995184 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-144a7075-6d7c-4c57-b995-a1d7742ea0ad tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:32.995604 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-144a7075-6d7c-4c57-b995-a1d7742ea0ad tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:33.017022 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-47670464-a563-48dd-b500-c30368b9e1b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:33.025700 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-47670464-a563-48dd-b500-c30368b9e1b7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.156284 Aug 24 12:52:33.026272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1394/2790] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:32 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:33.122823 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-144a7075-6d7c-4c57-b995-a1d7742ea0ad tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:33.131475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-144a7075-6d7c-4c57-b995-a1d7742ea0ad tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149281 Aug 24 12:52:33.132031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1397/2791] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:32 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:33.716995 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a5c3e801-dee8-49d4-bb7e-79def5c68dc8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:33.717554 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a5c3e801-dee8-49d4-bb7e-79def5c68dc8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:33.724428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5c3e801-dee8-49d4-bb7e-79def5c68dc8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:33.731410 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5c3e801-dee8-49d4-bb7e-79def5c68dc8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:33.731410 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5c3e801-dee8-49d4-bb7e-79def5c68dc8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:33.731410 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5c3e801-dee8-49d4-bb7e-79def5c68dc8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:33.731410 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5c3e801-dee8-49d4-bb7e-79def5c68dc8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:33.731864 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a5c3e801-dee8-49d4-bb7e-79def5c68dc8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:33.855016 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a5c3e801-dee8-49d4-bb7e-79def5c68dc8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:33.863681 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a5c3e801-dee8-49d4-bb7e-79def5c68dc8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150634 Aug 24 12:52:33.864236 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1395/2792] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:33 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:34.004737 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-029bfced-43ca-474e-919f-0cf477843f81 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:34.005384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-029bfced-43ca-474e-919f-0cf477843f81 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:34.011735 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-029bfced-43ca-474e-919f-0cf477843f81 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:34.012220 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-029bfced-43ca-474e-919f-0cf477843f81 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:34.012661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-029bfced-43ca-474e-919f-0cf477843f81 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:34.013357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-029bfced-43ca-474e-919f-0cf477843f81 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:34.013816 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-029bfced-43ca-474e-919f-0cf477843f81 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:34.014255 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-029bfced-43ca-474e-919f-0cf477843f81 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:34.045191 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ed4537f7-86b9-4b90-a119-ea8ee6c06236 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:34.045947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ed4537f7-86b9-4b90-a119-ea8ee6c06236 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:34.052033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ed4537f7-86b9-4b90-a119-ea8ee6c06236 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:34.052591 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ed4537f7-86b9-4b90-a119-ea8ee6c06236 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:34.053092 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ed4537f7-86b9-4b90-a119-ea8ee6c06236 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:34.053832 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ed4537f7-86b9-4b90-a119-ea8ee6c06236 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:34.054355 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ed4537f7-86b9-4b90-a119-ea8ee6c06236 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:34.054883 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ed4537f7-86b9-4b90-a119-ea8ee6c06236 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:34.151037 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-029bfced-43ca-474e-919f-0cf477843f81 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:34.159942 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-029bfced-43ca-474e-919f-0cf477843f81 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:34.161438 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-029bfced-43ca-474e-919f-0cf477843f81 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:34.162603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-029bfced-43ca-474e-919f-0cf477843f81 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.162664 Aug 24 12:52:34.163300 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1398/2793] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:33 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:34.175664 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-57ed8adf-d4c9-4339-95c6-015620860ae1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:34.176270 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-57ed8adf-d4c9-4339-95c6-015620860ae1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:34.182225 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57ed8adf-d4c9-4339-95c6-015620860ae1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:34.182742 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57ed8adf-d4c9-4339-95c6-015620860ae1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:34.183201 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57ed8adf-d4c9-4339-95c6-015620860ae1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:34.183890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57ed8adf-d4c9-4339-95c6-015620860ae1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:34.184340 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57ed8adf-d4c9-4339-95c6-015620860ae1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:34.184762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-57ed8adf-d4c9-4339-95c6-015620860ae1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:34.192849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ed4537f7-86b9-4b90-a119-ea8ee6c06236 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:34.200948 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ed4537f7-86b9-4b90-a119-ea8ee6c06236 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.159535 Aug 24 12:52:34.201603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1396/2794] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:34 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:34.310639 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-57ed8adf-d4c9-4339-95c6-015620860ae1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:34.319198 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-57ed8adf-d4c9-4339-95c6-015620860ae1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147522 Aug 24 12:52:34.319755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1399/2795] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:34 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:34.884424 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-15268b63-30cd-4273-8019-655019bfb58f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:34.885032 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-15268b63-30cd-4273-8019-655019bfb58f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:34.891417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15268b63-30cd-4273-8019-655019bfb58f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:34.891898 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15268b63-30cd-4273-8019-655019bfb58f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:34.892326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15268b63-30cd-4273-8019-655019bfb58f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:34.893005 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15268b63-30cd-4273-8019-655019bfb58f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:34.893446 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15268b63-30cd-4273-8019-655019bfb58f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:34.893865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-15268b63-30cd-4273-8019-655019bfb58f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:35.023462 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-15268b63-30cd-4273-8019-655019bfb58f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:35.031496 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-15268b63-30cd-4273-8019-655019bfb58f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150888 Aug 24 12:52:35.032050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1397/2796] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:34 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:35.185520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9628a0f9-2152-4d0c-8408-8b5d2650d0f6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:35.186062 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9628a0f9-2152-4d0c-8408-8b5d2650d0f6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:35.192429 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9628a0f9-2152-4d0c-8408-8b5d2650d0f6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:35.192907 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9628a0f9-2152-4d0c-8408-8b5d2650d0f6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:35.193382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9628a0f9-2152-4d0c-8408-8b5d2650d0f6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:35.194063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9628a0f9-2152-4d0c-8408-8b5d2650d0f6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:35.194518 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9628a0f9-2152-4d0c-8408-8b5d2650d0f6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:35.194975 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9628a0f9-2152-4d0c-8408-8b5d2650d0f6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:35.223988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-773d0def-83d7-40cd-a6eb-07bc623c5475 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:35.224596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-773d0def-83d7-40cd-a6eb-07bc623c5475 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:35.230406 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-773d0def-83d7-40cd-a6eb-07bc623c5475 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:35.230911 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-773d0def-83d7-40cd-a6eb-07bc623c5475 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:35.231340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-773d0def-83d7-40cd-a6eb-07bc623c5475 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:35.232017 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-773d0def-83d7-40cd-a6eb-07bc623c5475 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:35.232515 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-773d0def-83d7-40cd-a6eb-07bc623c5475 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:35.232967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-773d0def-83d7-40cd-a6eb-07bc623c5475 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:35.326403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9628a0f9-2152-4d0c-8408-8b5d2650d0f6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:35.335575 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9628a0f9-2152-4d0c-8408-8b5d2650d0f6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:35.337058 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9628a0f9-2152-4d0c-8408-8b5d2650d0f6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:35.338222 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9628a0f9-2152-4d0c-8408-8b5d2650d0f6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.156675 Aug 24 12:52:35.338782 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1400/2797] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:35 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:35.343549 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-18463026-4220-4162-8efe-5da052e10a1a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:35.343695 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-18463026-4220-4162-8efe-5da052e10a1a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:35.350145 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-18463026-4220-4162-8efe-5da052e10a1a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:35.350634 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-18463026-4220-4162-8efe-5da052e10a1a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:35.351123 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-18463026-4220-4162-8efe-5da052e10a1a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:35.352354 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-18463026-4220-4162-8efe-5da052e10a1a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:35.352840 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-18463026-4220-4162-8efe-5da052e10a1a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:35.353271 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-18463026-4220-4162-8efe-5da052e10a1a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:35.361091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-773d0def-83d7-40cd-a6eb-07bc623c5475 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:35.369545 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-773d0def-83d7-40cd-a6eb-07bc623c5475 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149835 Aug 24 12:52:35.370114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1398/2798] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:35 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:35.480042 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-18463026-4220-4162-8efe-5da052e10a1a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:35.488828 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-18463026-4220-4162-8efe-5da052e10a1a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149117 Aug 24 12:52:35.489382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1401/2799] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:35 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:36.052716 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-feda2f73-8efb-49bf-987d-a17692586618 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:36.053314 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-feda2f73-8efb-49bf-987d-a17692586618 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:36.059566 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-feda2f73-8efb-49bf-987d-a17692586618 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:36.060042 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-feda2f73-8efb-49bf-987d-a17692586618 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:36.060469 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-feda2f73-8efb-49bf-987d-a17692586618 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:36.061134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-feda2f73-8efb-49bf-987d-a17692586618 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:36.061614 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-feda2f73-8efb-49bf-987d-a17692586618 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:36.062026 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-feda2f73-8efb-49bf-987d-a17692586618 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:36.195955 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-feda2f73-8efb-49bf-987d-a17692586618 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:36.204222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-feda2f73-8efb-49bf-987d-a17692586618 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.155411 Aug 24 12:52:36.204790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1399/2800] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:36 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:36.362796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ae407425-10fb-4bee-884f-f8b8adc7e226 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:36.363440 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ae407425-10fb-4bee-884f-f8b8adc7e226 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:36.369405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae407425-10fb-4bee-884f-f8b8adc7e226 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:36.369889 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae407425-10fb-4bee-884f-f8b8adc7e226 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:36.370326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae407425-10fb-4bee-884f-f8b8adc7e226 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:36.371036 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae407425-10fb-4bee-884f-f8b8adc7e226 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:36.371496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae407425-10fb-4bee-884f-f8b8adc7e226 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:36.371923 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae407425-10fb-4bee-884f-f8b8adc7e226 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:36.390779 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-602ee77a-5c79-4f02-b8c5-9a5f495bf9b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:36.391394 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-602ee77a-5c79-4f02-b8c5-9a5f495bf9b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:36.397701 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-602ee77a-5c79-4f02-b8c5-9a5f495bf9b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:36.398186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-602ee77a-5c79-4f02-b8c5-9a5f495bf9b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:36.398623 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-602ee77a-5c79-4f02-b8c5-9a5f495bf9b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:36.399336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-602ee77a-5c79-4f02-b8c5-9a5f495bf9b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:36.399819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-602ee77a-5c79-4f02-b8c5-9a5f495bf9b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:36.400250 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-602ee77a-5c79-4f02-b8c5-9a5f495bf9b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:36.504519 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ae407425-10fb-4bee-884f-f8b8adc7e226 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:36.513235 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ae407425-10fb-4bee-884f-f8b8adc7e226 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:36.514788 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ae407425-10fb-4bee-884f-f8b8adc7e226 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:36.515956 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ae407425-10fb-4bee-884f-f8b8adc7e226 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.157506 Aug 24 12:52:36.516512 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1402/2801] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:36 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:36.521096 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-366b8ee3-23de-42d7-9461-db414d35048e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:36.521707 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-366b8ee3-23de-42d7-9461-db414d35048e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:36.527344 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-366b8ee3-23de-42d7-9461-db414d35048e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:36.527836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-366b8ee3-23de-42d7-9461-db414d35048e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:36.528276 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-366b8ee3-23de-42d7-9461-db414d35048e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:36.528972 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-366b8ee3-23de-42d7-9461-db414d35048e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:36.529461 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-366b8ee3-23de-42d7-9461-db414d35048e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:36.529891 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-366b8ee3-23de-42d7-9461-db414d35048e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:36.531111 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-602ee77a-5c79-4f02-b8c5-9a5f495bf9b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:36.539846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-602ee77a-5c79-4f02-b8c5-9a5f495bf9b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152958 Aug 24 12:52:36.540413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1400/2802] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:36 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:36.659729 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-366b8ee3-23de-42d7-9461-db414d35048e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:36.667964 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-366b8ee3-23de-42d7-9461-db414d35048e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150340 Aug 24 12:52:36.668550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1403/2803] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:36 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:37.225193 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-61c0bf10-df52-4af9-afe7-00e1382a567e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:37.225838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-61c0bf10-df52-4af9-afe7-00e1382a567e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:37.232433 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61c0bf10-df52-4af9-afe7-00e1382a567e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:37.232905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61c0bf10-df52-4af9-afe7-00e1382a567e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:37.233335 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61c0bf10-df52-4af9-afe7-00e1382a567e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:37.234043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61c0bf10-df52-4af9-afe7-00e1382a567e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:37.234494 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61c0bf10-df52-4af9-afe7-00e1382a567e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:37.234944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61c0bf10-df52-4af9-afe7-00e1382a567e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:37.365536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-61c0bf10-df52-4af9-afe7-00e1382a567e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:37.373558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-61c0bf10-df52-4af9-afe7-00e1382a567e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152198 Aug 24 12:52:37.374108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1401/2804] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:37 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:37.539400 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4fa450c1-2dd9-4954-8820-331b5a0a0392 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:37.540012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4fa450c1-2dd9-4954-8820-331b5a0a0392 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:37.546500 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4fa450c1-2dd9-4954-8820-331b5a0a0392 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:37.547018 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4fa450c1-2dd9-4954-8820-331b5a0a0392 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:37.547460 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4fa450c1-2dd9-4954-8820-331b5a0a0392 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:37.548151 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4fa450c1-2dd9-4954-8820-331b5a0a0392 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:37.548640 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4fa450c1-2dd9-4954-8820-331b5a0a0392 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:37.549577 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4fa450c1-2dd9-4954-8820-331b5a0a0392 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:37.561236 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9629ef86-29d8-4aea-9b37-301dfe700b68 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:37.561841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9629ef86-29d8-4aea-9b37-301dfe700b68 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:37.568279 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9629ef86-29d8-4aea-9b37-301dfe700b68 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:37.568751 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9629ef86-29d8-4aea-9b37-301dfe700b68 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:37.569181 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9629ef86-29d8-4aea-9b37-301dfe700b68 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:37.569849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9629ef86-29d8-4aea-9b37-301dfe700b68 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:37.570291 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9629ef86-29d8-4aea-9b37-301dfe700b68 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:37.570730 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9629ef86-29d8-4aea-9b37-301dfe700b68 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:37.685627 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4fa450c1-2dd9-4954-8820-331b5a0a0392 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:37.689720 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4fa450c1-2dd9-4954-8820-331b5a0a0392 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:37.691757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4fa450c1-2dd9-4954-8820-331b5a0a0392 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:37.692926 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4fa450c1-2dd9-4954-8820-331b5a0a0392 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.157405 Aug 24 12:52:37.693493 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1404/2805] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:37 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:37.697933 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-47329044-2035-4bde-ba0a-96347dd8a0a5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:37.698543 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-47329044-2035-4bde-ba0a-96347dd8a0a5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:37.701353 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9629ef86-29d8-4aea-9b37-301dfe700b68 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:37.705477 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-47329044-2035-4bde-ba0a-96347dd8a0a5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:37.706059 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-47329044-2035-4bde-ba0a-96347dd8a0a5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:37.706572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-47329044-2035-4bde-ba0a-96347dd8a0a5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:37.707369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-47329044-2035-4bde-ba0a-96347dd8a0a5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:37.707978 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-47329044-2035-4bde-ba0a-96347dd8a0a5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:37.708336 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-47329044-2035-4bde-ba0a-96347dd8a0a5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:37.710357 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9629ef86-29d8-4aea-9b37-301dfe700b68 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152876 Aug 24 12:52:37.710977 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1402/2806] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:37 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:37.839295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-47329044-2035-4bde-ba0a-96347dd8a0a5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:37.841428 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:52:37.847961 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-47329044-2035-4bde-ba0a-96347dd8a0a5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.153540 Aug 24 12:52:37.853079 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1405/2807] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:37 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:38.395150 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f88101c8-5358-49cb-8247-6b503c2c69f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:38.395746 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f88101c8-5358-49cb-8247-6b503c2c69f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:38.402322 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f88101c8-5358-49cb-8247-6b503c2c69f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:38.402835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f88101c8-5358-49cb-8247-6b503c2c69f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:38.403273 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f88101c8-5358-49cb-8247-6b503c2c69f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:38.403952 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f88101c8-5358-49cb-8247-6b503c2c69f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:38.404403 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f88101c8-5358-49cb-8247-6b503c2c69f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:38.404823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f88101c8-5358-49cb-8247-6b503c2c69f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:38.530673 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f88101c8-5358-49cb-8247-6b503c2c69f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:38.538751 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f88101c8-5358-49cb-8247-6b503c2c69f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.147467 Aug 24 12:52:38.539309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1403/2808] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:38 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:38.716148 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bd9ea97d-1e82-4f42-87cc-f9ed4145d750 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:38.716846 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bd9ea97d-1e82-4f42-87cc-f9ed4145d750 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:38.723819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd9ea97d-1e82-4f42-87cc-f9ed4145d750 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:38.724297 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd9ea97d-1e82-4f42-87cc-f9ed4145d750 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:38.724731 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd9ea97d-1e82-4f42-87cc-f9ed4145d750 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:38.725418 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd9ea97d-1e82-4f42-87cc-f9ed4145d750 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:38.725871 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd9ea97d-1e82-4f42-87cc-f9ed4145d750 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:38.726372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bd9ea97d-1e82-4f42-87cc-f9ed4145d750 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:38.733531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3f276105-3d08-44c1-a210-a0244c805d2a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:38.734144 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3f276105-3d08-44c1-a210-a0244c805d2a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:38.742810 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f276105-3d08-44c1-a210-a0244c805d2a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:38.743538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f276105-3d08-44c1-a210-a0244c805d2a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:38.744242 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f276105-3d08-44c1-a210-a0244c805d2a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:38.745113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f276105-3d08-44c1-a210-a0244c805d2a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:38.745566 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f276105-3d08-44c1-a210-a0244c805d2a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:38.745993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f276105-3d08-44c1-a210-a0244c805d2a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:38.861328 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bd9ea97d-1e82-4f42-87cc-f9ed4145d750 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:38.871008 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bd9ea97d-1e82-4f42-87cc-f9ed4145d750 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:38.872511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bd9ea97d-1e82-4f42-87cc-f9ed4145d750 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:38.873650 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bd9ea97d-1e82-4f42-87cc-f9ed4145d750 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.161747 Aug 24 12:52:38.874364 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1406/2809] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:38 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:52:38.878673 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-67f684a6-6ae6-4a55-b769-a146117b3e9e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:38.879275 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-67f684a6-6ae6-4a55-b769-a146117b3e9e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:38.880421 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3f276105-3d08-44c1-a210-a0244c805d2a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:38.885018 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67f684a6-6ae6-4a55-b769-a146117b3e9e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:38.885501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67f684a6-6ae6-4a55-b769-a146117b3e9e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:38.885928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67f684a6-6ae6-4a55-b769-a146117b3e9e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:38.886607 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67f684a6-6ae6-4a55-b769-a146117b3e9e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:38.887069 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67f684a6-6ae6-4a55-b769-a146117b3e9e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:38.887493 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67f684a6-6ae6-4a55-b769-a146117b3e9e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:38.889094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3f276105-3d08-44c1-a210-a0244c805d2a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.161348 Aug 24 12:52:38.889745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1404/2810] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:38 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:39.016290 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-67f684a6-6ae6-4a55-b769-a146117b3e9e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:39.024938 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-67f684a6-6ae6-4a55-b769-a146117b3e9e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149717 Aug 24 12:52:39.025505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1407/2811] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:38 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:39.560065 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1bf12f47-6945-499c-b3cd-c77ef1298d9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:39.560586 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1bf12f47-6945-499c-b3cd-c77ef1298d9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:39.566972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1bf12f47-6945-499c-b3cd-c77ef1298d9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:39.567451 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1bf12f47-6945-499c-b3cd-c77ef1298d9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:39.567886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1bf12f47-6945-499c-b3cd-c77ef1298d9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:39.568553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1bf12f47-6945-499c-b3cd-c77ef1298d9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:39.569007 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1bf12f47-6945-499c-b3cd-c77ef1298d9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:39.569428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1bf12f47-6945-499c-b3cd-c77ef1298d9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:39.573233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:52:39.696469 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1bf12f47-6945-499c-b3cd-c77ef1298d9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:39.704553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1bf12f47-6945-499c-b3cd-c77ef1298d9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148461 Aug 24 12:52:39.705112 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1405/2812] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:39 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:39.897519 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-af8120bc-9423-4b3a-a6cb-31323602d46e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:39.898114 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-af8120bc-9423-4b3a-a6cb-31323602d46e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:39.904616 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af8120bc-9423-4b3a-a6cb-31323602d46e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:39.905104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af8120bc-9423-4b3a-a6cb-31323602d46e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:39.905550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af8120bc-9423-4b3a-a6cb-31323602d46e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:39.906241 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af8120bc-9423-4b3a-a6cb-31323602d46e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:39.906728 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af8120bc-9423-4b3a-a6cb-31323602d46e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:39.907160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af8120bc-9423-4b3a-a6cb-31323602d46e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:39.910719 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-12e40967-4ece-4119-8231-34baad9e07cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:39.911333 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-12e40967-4ece-4119-8231-34baad9e07cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:39.917211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12e40967-4ece-4119-8231-34baad9e07cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:39.917694 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12e40967-4ece-4119-8231-34baad9e07cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:39.918130 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12e40967-4ece-4119-8231-34baad9e07cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:39.918846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12e40967-4ece-4119-8231-34baad9e07cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:39.919297 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12e40967-4ece-4119-8231-34baad9e07cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:39.919721 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12e40967-4ece-4119-8231-34baad9e07cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:40.038666 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-af8120bc-9423-4b3a-a6cb-31323602d46e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:40.047671 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-af8120bc-9423-4b3a-a6cb-31323602d46e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:40.049171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-af8120bc-9423-4b3a-a6cb-31323602d46e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:40.050903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-af8120bc-9423-4b3a-a6cb-31323602d46e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.157821 Aug 24 12:52:40.051466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1408/2813] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:39 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:40.051892 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-12e40967-4ece-4119-8231-34baad9e07cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:40.055985 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a0c24c25-6cd2-4fe4-8abb-39c24a856b77 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:40.056601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a0c24c25-6cd2-4fe4-8abb-39c24a856b77 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:40.060305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-12e40967-4ece-4119-8231-34baad9e07cb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.153960 Aug 24 12:52:40.061014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1406/2814] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:39 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:40.062503 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0c24c25-6cd2-4fe4-8abb-39c24a856b77 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:40.063027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0c24c25-6cd2-4fe4-8abb-39c24a856b77 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:40.063467 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0c24c25-6cd2-4fe4-8abb-39c24a856b77 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:40.064154 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0c24c25-6cd2-4fe4-8abb-39c24a856b77 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:40.064612 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0c24c25-6cd2-4fe4-8abb-39c24a856b77 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:40.065606 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0c24c25-6cd2-4fe4-8abb-39c24a856b77 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:40.191794 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a0c24c25-6cd2-4fe4-8abb-39c24a856b77 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:40.199969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a0c24c25-6cd2-4fe4-8abb-39c24a856b77 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147566 Aug 24 12:52:40.200525 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1409/2815] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:40 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:40.725795 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-dd61da44-2142-45ed-984e-ad1c7d1c8092 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:40.726388 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-dd61da44-2142-45ed-984e-ad1c7d1c8092 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:40.732886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd61da44-2142-45ed-984e-ad1c7d1c8092 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:40.733366 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd61da44-2142-45ed-984e-ad1c7d1c8092 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:40.733804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd61da44-2142-45ed-984e-ad1c7d1c8092 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:40.734485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd61da44-2142-45ed-984e-ad1c7d1c8092 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:40.734974 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd61da44-2142-45ed-984e-ad1c7d1c8092 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:40.735399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd61da44-2142-45ed-984e-ad1c7d1c8092 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:40.863195 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-dd61da44-2142-45ed-984e-ad1c7d1c8092 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:40.871319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-dd61da44-2142-45ed-984e-ad1c7d1c8092 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149998 Aug 24 12:52:40.871885 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1407/2816] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:40 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:41.081522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-24b44112-f9c1-4139-8c40-a64bf66c4052 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:41.081771 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7af15569-f581-406f-9724-032829b31c89 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:41.082239 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-24b44112-f9c1-4139-8c40-a64bf66c4052 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:41.082357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7af15569-f581-406f-9724-032829b31c89 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:41.088074 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-24b44112-f9c1-4139-8c40-a64bf66c4052 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:41.088554 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-24b44112-f9c1-4139-8c40-a64bf66c4052 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:41.088803 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7af15569-f581-406f-9724-032829b31c89 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:41.088985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-24b44112-f9c1-4139-8c40-a64bf66c4052 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:41.089322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7af15569-f581-406f-9724-032829b31c89 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:41.089666 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-24b44112-f9c1-4139-8c40-a64bf66c4052 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:41.089787 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7af15569-f581-406f-9724-032829b31c89 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:41.090114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-24b44112-f9c1-4139-8c40-a64bf66c4052 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:41.090510 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7af15569-f581-406f-9724-032829b31c89 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:41.090628 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-24b44112-f9c1-4139-8c40-a64bf66c4052 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:41.090998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7af15569-f581-406f-9724-032829b31c89 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:41.091424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7af15569-f581-406f-9724-032829b31c89 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:41.217315 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-24b44112-f9c1-4139-8c40-a64bf66c4052 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:41.222553 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7af15569-f581-406f-9724-032829b31c89 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:41.226089 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-24b44112-f9c1-4139-8c40-a64bf66c4052 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.148806 Aug 24 12:52:41.226676 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1408/2817] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:41 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:41.231190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c25788ca-3991-4941-9abd-99c5378735f7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:41.231362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7af15569-f581-406f-9724-032829b31c89 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:41.231787 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c25788ca-3991-4941-9abd-99c5378735f7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:41.232764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7af15569-f581-406f-9724-032829b31c89 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:41.233930 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7af15569-f581-406f-9724-032829b31c89 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.156838 Aug 24 12:52:41.234705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1410/2818] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:41 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:41.237803 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c25788ca-3991-4941-9abd-99c5378735f7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:41.238284 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c25788ca-3991-4941-9abd-99c5378735f7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:41.238804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c25788ca-3991-4941-9abd-99c5378735f7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:41.239428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c25788ca-3991-4941-9abd-99c5378735f7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:41.239876 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c25788ca-3991-4941-9abd-99c5378735f7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:41.240295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c25788ca-3991-4941-9abd-99c5378735f7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:41.369601 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c25788ca-3991-4941-9abd-99c5378735f7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:41.378313 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c25788ca-3991-4941-9abd-99c5378735f7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150683 Aug 24 12:52:41.378907 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1409/2819] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:41 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:41.892503 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bb378337-5b6f-4074-ad12-9b6ebed273e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:41.893170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bb378337-5b6f-4074-ad12-9b6ebed273e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:41.899598 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb378337-5b6f-4074-ad12-9b6ebed273e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:41.900076 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb378337-5b6f-4074-ad12-9b6ebed273e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:41.900512 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb378337-5b6f-4074-ad12-9b6ebed273e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:41.901336 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb378337-5b6f-4074-ad12-9b6ebed273e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:41.901802 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb378337-5b6f-4074-ad12-9b6ebed273e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:41.902227 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb378337-5b6f-4074-ad12-9b6ebed273e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:42.028621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bb378337-5b6f-4074-ad12-9b6ebed273e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:42.037434 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bb378337-5b6f-4074-ad12-9b6ebed273e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148903 Aug 24 12:52:42.037991 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1411/2820] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:41 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:42.247946 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-308be283-4fb9-42d8-a3fa-dfbd927f422c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:42.248560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-308be283-4fb9-42d8-a3fa-dfbd927f422c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:42.255393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-308be283-4fb9-42d8-a3fa-dfbd927f422c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:42.255986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-308be283-4fb9-42d8-a3fa-dfbd927f422c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:42.256491 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-308be283-4fb9-42d8-a3fa-dfbd927f422c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:42.256664 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f70322be-668e-4958-ab45-3526f1f1d55b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:42.257247 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-308be283-4fb9-42d8-a3fa-dfbd927f422c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:42.257363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f70322be-668e-4958-ab45-3526f1f1d55b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:42.257708 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-308be283-4fb9-42d8-a3fa-dfbd927f422c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:42.258132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-308be283-4fb9-42d8-a3fa-dfbd927f422c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:42.263539 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f70322be-668e-4958-ab45-3526f1f1d55b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:42.264022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f70322be-668e-4958-ab45-3526f1f1d55b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:42.264464 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f70322be-668e-4958-ab45-3526f1f1d55b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:42.265156 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f70322be-668e-4958-ab45-3526f1f1d55b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:42.265617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f70322be-668e-4958-ab45-3526f1f1d55b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:42.266049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f70322be-668e-4958-ab45-3526f1f1d55b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:42.387245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-308be283-4fb9-42d8-a3fa-dfbd927f422c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:42.397345 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-308be283-4fb9-42d8-a3fa-dfbd927f422c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.153178 Aug 24 12:52:42.410908 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1410/2821] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:42 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:42.411278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f70322be-668e-4958-ab45-3526f1f1d55b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:42.411405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-daf12364-c8f9-491f-906a-bd822221f0dc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:42.411405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-daf12364-c8f9-491f-906a-bd822221f0dc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:42.411405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-daf12364-c8f9-491f-906a-bd822221f0dc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:42.411701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f70322be-668e-4958-ab45-3526f1f1d55b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:42.411814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-daf12364-c8f9-491f-906a-bd822221f0dc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:42.411814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-daf12364-c8f9-491f-906a-bd822221f0dc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:42.411814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-daf12364-c8f9-491f-906a-bd822221f0dc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:42.412081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f70322be-668e-4958-ab45-3526f1f1d55b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:42.412184 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-daf12364-c8f9-491f-906a-bd822221f0dc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:42.412184 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-daf12364-c8f9-491f-906a-bd822221f0dc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:42.412745 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f70322be-668e-4958-ab45-3526f1f1d55b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.159882 Aug 24 12:52:42.413764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1412/2822] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:42 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:52:42.550924 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-daf12364-c8f9-491f-906a-bd822221f0dc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:42.559013 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-daf12364-c8f9-491f-906a-bd822221f0dc tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.159872 Aug 24 12:52:42.559575 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1411/2823] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:42 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:43.057248 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0ddbda1b-120e-4525-8383-0344b4423a36 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:43.057855 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0ddbda1b-120e-4525-8383-0344b4423a36 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:43.063746 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0ddbda1b-120e-4525-8383-0344b4423a36 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:43.064226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0ddbda1b-120e-4525-8383-0344b4423a36 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:43.064677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0ddbda1b-120e-4525-8383-0344b4423a36 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:43.065990 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0ddbda1b-120e-4525-8383-0344b4423a36 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:43.066442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0ddbda1b-120e-4525-8383-0344b4423a36 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:43.066890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0ddbda1b-120e-4525-8383-0344b4423a36 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:43.193877 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0ddbda1b-120e-4525-8383-0344b4423a36 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:43.201969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0ddbda1b-120e-4525-8383-0344b4423a36 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148550 Aug 24 12:52:43.202536 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1413/2824] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:43 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:43.418451 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-dd3b4f02-2a9a-43f5-badc-b21acb674ba1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:43.419005 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-dd3b4f02-2a9a-43f5-badc-b21acb674ba1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:43.425428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd3b4f02-2a9a-43f5-badc-b21acb674ba1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:43.426490 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd3b4f02-2a9a-43f5-badc-b21acb674ba1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:43.427017 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd3b4f02-2a9a-43f5-badc-b21acb674ba1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:43.427700 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd3b4f02-2a9a-43f5-badc-b21acb674ba1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:43.428148 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd3b4f02-2a9a-43f5-badc-b21acb674ba1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:43.428571 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd3b4f02-2a9a-43f5-badc-b21acb674ba1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:43.435938 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-967bbae3-7800-48be-b7c0-8f4416055f17 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:43.436539 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-967bbae3-7800-48be-b7c0-8f4416055f17 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:43.442818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-967bbae3-7800-48be-b7c0-8f4416055f17 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:43.443282 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-967bbae3-7800-48be-b7c0-8f4416055f17 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:43.443714 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-967bbae3-7800-48be-b7c0-8f4416055f17 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:43.444391 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-967bbae3-7800-48be-b7c0-8f4416055f17 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:43.444860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-967bbae3-7800-48be-b7c0-8f4416055f17 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:43.445264 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-967bbae3-7800-48be-b7c0-8f4416055f17 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:43.573721 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-dd3b4f02-2a9a-43f5-badc-b21acb674ba1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:43.579028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-967bbae3-7800-48be-b7c0-8f4416055f17 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:43.582908 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-dd3b4f02-2a9a-43f5-badc-b21acb674ba1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.168332 Aug 24 12:52:43.583469 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1412/2825] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:43 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:43.587896 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a533f667-7523-44b2-a62a-8a0ef681d7e1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:43.588495 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a533f667-7523-44b2-a62a-8a0ef681d7e1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:43.588689 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-967bbae3-7800-48be-b7c0-8f4416055f17 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:43.590207 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-967bbae3-7800-48be-b7c0-8f4416055f17 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:43.591568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-967bbae3-7800-48be-b7c0-8f4416055f17 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.159424 Aug 24 12:52:43.598542 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1414/2826] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:43 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:52:43.598709 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a533f667-7523-44b2-a62a-8a0ef681d7e1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:43.598709 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a533f667-7523-44b2-a62a-8a0ef681d7e1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:43.598709 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a533f667-7523-44b2-a62a-8a0ef681d7e1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:43.598709 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a533f667-7523-44b2-a62a-8a0ef681d7e1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:43.599154 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a533f667-7523-44b2-a62a-8a0ef681d7e1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:43.599154 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a533f667-7523-44b2-a62a-8a0ef681d7e1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:43.729683 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a533f667-7523-44b2-a62a-8a0ef681d7e1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:43.738162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a533f667-7523-44b2-a62a-8a0ef681d7e1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.153761 Aug 24 12:52:43.738735 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1413/2827] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:43 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:44.222480 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8e15002b-ba94-4556-a369-7e8c6457c2e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:44.223109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8e15002b-ba94-4556-a369-7e8c6457c2e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:44.229073 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8e15002b-ba94-4556-a369-7e8c6457c2e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:44.229600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8e15002b-ba94-4556-a369-7e8c6457c2e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:44.230102 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8e15002b-ba94-4556-a369-7e8c6457c2e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:44.230819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8e15002b-ba94-4556-a369-7e8c6457c2e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:44.231273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8e15002b-ba94-4556-a369-7e8c6457c2e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:44.231693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8e15002b-ba94-4556-a369-7e8c6457c2e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:44.361887 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8e15002b-ba94-4556-a369-7e8c6457c2e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:44.370860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8e15002b-ba94-4556-a369-7e8c6457c2e1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152238 Aug 24 12:52:44.391779 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1415/2828] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:44 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:44.604401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2ea3e293-8751-489b-a859-cadc4f226fd6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:44.605009 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2ea3e293-8751-489b-a859-cadc4f226fd6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:44.611781 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ea3e293-8751-489b-a859-cadc4f226fd6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:44.612514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ea3e293-8751-489b-a859-cadc4f226fd6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:44.612945 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ea3e293-8751-489b-a859-cadc4f226fd6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:44.614237 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ea3e293-8751-489b-a859-cadc4f226fd6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:44.614700 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ea3e293-8751-489b-a859-cadc4f226fd6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:44.615120 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ea3e293-8751-489b-a859-cadc4f226fd6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:44.619419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7a03b4c9-d56f-4fc3-86fa-772325807d07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:44.620039 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7a03b4c9-d56f-4fc3-86fa-772325807d07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:44.622336 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:52:44.626957 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a03b4c9-d56f-4fc3-86fa-772325807d07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:44.627449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a03b4c9-d56f-4fc3-86fa-772325807d07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:44.627892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a03b4c9-d56f-4fc3-86fa-772325807d07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:44.628588 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a03b4c9-d56f-4fc3-86fa-772325807d07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:44.629050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a03b4c9-d56f-4fc3-86fa-772325807d07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:44.629500 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a03b4c9-d56f-4fc3-86fa-772325807d07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:44.742568 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2ea3e293-8751-489b-a859-cadc4f226fd6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:44.750644 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2ea3e293-8751-489b-a859-cadc4f226fd6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150007 Aug 24 12:52:44.751229 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1414/2829] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:44 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:44.759002 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-94216fb0-75b2-4be4-9934-fe99699f2e29 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:44.759675 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-94216fb0-75b2-4be4-9934-fe99699f2e29 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:44.761293 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7a03b4c9-d56f-4fc3-86fa-772325807d07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:44.765599 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94216fb0-75b2-4be4-9934-fe99699f2e29 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:44.766147 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94216fb0-75b2-4be4-9934-fe99699f2e29 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:44.766582 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94216fb0-75b2-4be4-9934-fe99699f2e29 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:44.767286 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94216fb0-75b2-4be4-9934-fe99699f2e29 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:44.767731 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94216fb0-75b2-4be4-9934-fe99699f2e29 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:44.768146 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94216fb0-75b2-4be4-9934-fe99699f2e29 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:44.770796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7a03b4c9-d56f-4fc3-86fa-772325807d07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:44.772295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7a03b4c9-d56f-4fc3-86fa-772325807d07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:44.773459 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7a03b4c9-d56f-4fc3-86fa-772325807d07 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.157872 Aug 24 12:52:44.774084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1416/2830] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:44 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:44.895242 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-94216fb0-75b2-4be4-9934-fe99699f2e29 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:44.903479 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-94216fb0-75b2-4be4-9934-fe99699f2e29 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.148086 Aug 24 12:52:44.904039 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1415/2831] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:44 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:45.414272 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-832ea81f-daae-4786-a6de-a83b91daf240 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:45.414937 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-832ea81f-daae-4786-a6de-a83b91daf240 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:45.421016 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-832ea81f-daae-4786-a6de-a83b91daf240 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:45.421498 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-832ea81f-daae-4786-a6de-a83b91daf240 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:45.421937 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-832ea81f-daae-4786-a6de-a83b91daf240 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:45.422630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-832ea81f-daae-4786-a6de-a83b91daf240 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:45.423108 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-832ea81f-daae-4786-a6de-a83b91daf240 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:45.423534 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-832ea81f-daae-4786-a6de-a83b91daf240 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:45.553125 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-832ea81f-daae-4786-a6de-a83b91daf240 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:45.561194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-832ea81f-daae-4786-a6de-a83b91daf240 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151254 Aug 24 12:52:45.561754 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1417/2832] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:45 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:45.772827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f2a5969f-5908-42f7-a686-1f52aa5b148a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:45.773413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f2a5969f-5908-42f7-a686-1f52aa5b148a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:45.779354 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f2a5969f-5908-42f7-a686-1f52aa5b148a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:45.779825 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f2a5969f-5908-42f7-a686-1f52aa5b148a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:45.780250 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f2a5969f-5908-42f7-a686-1f52aa5b148a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:45.780920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f2a5969f-5908-42f7-a686-1f52aa5b148a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:45.781359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f2a5969f-5908-42f7-a686-1f52aa5b148a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:45.781775 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f2a5969f-5908-42f7-a686-1f52aa5b148a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:45.796185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-46b12347-8f24-4ed9-98ba-da96e319fd6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:45.796882 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-46b12347-8f24-4ed9-98ba-da96e319fd6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:45.803345 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46b12347-8f24-4ed9-98ba-da96e319fd6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:45.803831 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46b12347-8f24-4ed9-98ba-da96e319fd6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:45.804272 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46b12347-8f24-4ed9-98ba-da96e319fd6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:45.804961 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46b12347-8f24-4ed9-98ba-da96e319fd6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:45.805415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46b12347-8f24-4ed9-98ba-da96e319fd6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:45.805840 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46b12347-8f24-4ed9-98ba-da96e319fd6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:45.914329 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f2a5969f-5908-42f7-a686-1f52aa5b148a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:45.922376 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f2a5969f-5908-42f7-a686-1f52aa5b148a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.154052 Aug 24 12:52:45.922966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1416/2833] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:45 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:45.927368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2123bd0f-3ebf-4037-8869-9bdf1de8a6bb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:45.927991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2123bd0f-3ebf-4037-8869-9bdf1de8a6bb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:45.933874 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2123bd0f-3ebf-4037-8869-9bdf1de8a6bb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:45.934349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2123bd0f-3ebf-4037-8869-9bdf1de8a6bb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:45.934847 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2123bd0f-3ebf-4037-8869-9bdf1de8a6bb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:45.935526 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2123bd0f-3ebf-4037-8869-9bdf1de8a6bb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:45.936094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2123bd0f-3ebf-4037-8869-9bdf1de8a6bb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:45.939606 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-46b12347-8f24-4ed9-98ba-da96e319fd6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:45.942497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2123bd0f-3ebf-4037-8869-9bdf1de8a6bb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:45.948950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-46b12347-8f24-4ed9-98ba-da96e319fd6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:45.950580 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-46b12347-8f24-4ed9-98ba-da96e319fd6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:45.961382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-46b12347-8f24-4ed9-98ba-da96e319fd6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.159629 Aug 24 12:52:45.961382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1418/2834] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:45 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:52:46.077531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2123bd0f-3ebf-4037-8869-9bdf1de8a6bb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:46.086252 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2123bd0f-3ebf-4037-8869-9bdf1de8a6bb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.162333 Aug 24 12:52:46.086849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1417/2835] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:45 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:46.581320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ce534b27-034b-4818-aff4-d80fb18b1f48 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:46.581934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ce534b27-034b-4818-aff4-d80fb18b1f48 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:46.587929 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ce534b27-034b-4818-aff4-d80fb18b1f48 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:46.588405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ce534b27-034b-4818-aff4-d80fb18b1f48 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:46.588840 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ce534b27-034b-4818-aff4-d80fb18b1f48 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:46.589515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ce534b27-034b-4818-aff4-d80fb18b1f48 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:46.589968 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ce534b27-034b-4818-aff4-d80fb18b1f48 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:46.590392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ce534b27-034b-4818-aff4-d80fb18b1f48 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:46.720850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ce534b27-034b-4818-aff4-d80fb18b1f48 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:46.729009 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ce534b27-034b-4818-aff4-d80fb18b1f48 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151533 Aug 24 12:52:46.729562 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1419/2836] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:46 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:46.944001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f05bd168-c19c-4b65-8e88-54a02353cd72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:46.944656 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f05bd168-c19c-4b65-8e88-54a02353cd72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:46.951137 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f05bd168-c19c-4b65-8e88-54a02353cd72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:46.951555 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f05bd168-c19c-4b65-8e88-54a02353cd72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:46.951992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f05bd168-c19c-4b65-8e88-54a02353cd72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:46.952672 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f05bd168-c19c-4b65-8e88-54a02353cd72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:46.953127 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f05bd168-c19c-4b65-8e88-54a02353cd72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:46.953553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f05bd168-c19c-4b65-8e88-54a02353cd72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:46.983458 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1da8625e-1808-4b1d-bde6-d6699a54ba98 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:46.984063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1da8625e-1808-4b1d-bde6-d6699a54ba98 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:46.990719 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1da8625e-1808-4b1d-bde6-d6699a54ba98 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:46.991199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1da8625e-1808-4b1d-bde6-d6699a54ba98 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:46.991639 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1da8625e-1808-4b1d-bde6-d6699a54ba98 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:46.992318 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1da8625e-1808-4b1d-bde6-d6699a54ba98 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:46.992765 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1da8625e-1808-4b1d-bde6-d6699a54ba98 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:46.993178 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1da8625e-1808-4b1d-bde6-d6699a54ba98 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:47.084351 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f05bd168-c19c-4b65-8e88-54a02353cd72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:47.092880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f05bd168-c19c-4b65-8e88-54a02353cd72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.153239 Aug 24 12:52:47.093721 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1418/2837] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:46 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:47.107462 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ca44a36e-080b-4f7b-b972-444648748f95 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:47.108094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ca44a36e-080b-4f7b-b972-444648748f95 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:47.114086 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca44a36e-080b-4f7b-b972-444648748f95 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:47.114561 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca44a36e-080b-4f7b-b972-444648748f95 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:47.115020 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca44a36e-080b-4f7b-b972-444648748f95 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:47.115693 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca44a36e-080b-4f7b-b972-444648748f95 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:47.116138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca44a36e-080b-4f7b-b972-444648748f95 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:47.116550 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca44a36e-080b-4f7b-b972-444648748f95 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:47.123190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1da8625e-1808-4b1d-bde6-d6699a54ba98 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:47.132377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1da8625e-1808-4b1d-bde6-d6699a54ba98 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:47.133874 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1da8625e-1808-4b1d-bde6-d6699a54ba98 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:47.135088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1da8625e-1808-4b1d-bde6-d6699a54ba98 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155479 Aug 24 12:52:47.135639 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1420/2838] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:46 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:52:47.244991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ca44a36e-080b-4f7b-b972-444648748f95 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:47.253385 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ca44a36e-080b-4f7b-b972-444648748f95 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149550 Aug 24 12:52:47.254590 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1419/2839] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:47 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:47.750794 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f685dc1c-e6ff-49bd-92aa-a7686ebff309 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:47.751402 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f685dc1c-e6ff-49bd-92aa-a7686ebff309 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:47.757403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f685dc1c-e6ff-49bd-92aa-a7686ebff309 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:47.757881 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f685dc1c-e6ff-49bd-92aa-a7686ebff309 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:47.758329 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f685dc1c-e6ff-49bd-92aa-a7686ebff309 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:47.759185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f685dc1c-e6ff-49bd-92aa-a7686ebff309 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:47.759589 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f685dc1c-e6ff-49bd-92aa-a7686ebff309 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:47.760012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f685dc1c-e6ff-49bd-92aa-a7686ebff309 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:47.887811 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f685dc1c-e6ff-49bd-92aa-a7686ebff309 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:47.896091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f685dc1c-e6ff-49bd-92aa-a7686ebff309 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149113 Aug 24 12:52:47.896646 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1421/2840] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:47 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:48.114731 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-951e05d7-1b88-4664-a41d-4d731adb8168 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:48.121854 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-951e05d7-1b88-4664-a41d-4d731adb8168 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:48.121854 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-951e05d7-1b88-4664-a41d-4d731adb8168 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:48.122172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-951e05d7-1b88-4664-a41d-4d731adb8168 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:48.122610 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-951e05d7-1b88-4664-a41d-4d731adb8168 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:48.123310 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-951e05d7-1b88-4664-a41d-4d731adb8168 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:48.123761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-951e05d7-1b88-4664-a41d-4d731adb8168 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:48.124186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-951e05d7-1b88-4664-a41d-4d731adb8168 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:48.158704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e28c445b-bca9-4f77-a5c4-8bffb1346450 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:48.159311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e28c445b-bca9-4f77-a5c4-8bffb1346450 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:48.165754 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e28c445b-bca9-4f77-a5c4-8bffb1346450 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:48.166242 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e28c445b-bca9-4f77-a5c4-8bffb1346450 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:48.166691 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e28c445b-bca9-4f77-a5c4-8bffb1346450 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:48.167387 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e28c445b-bca9-4f77-a5c4-8bffb1346450 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:48.167842 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e28c445b-bca9-4f77-a5c4-8bffb1346450 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:48.168270 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e28c445b-bca9-4f77-a5c4-8bffb1346450 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:48.183624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:52:48.253210 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-951e05d7-1b88-4664-a41d-4d731adb8168 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:48.262215 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-951e05d7-1b88-4664-a41d-4d731adb8168 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152059 Aug 24 12:52:48.262837 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1420/2841] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:48 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:48.274323 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ea85e0e4-276d-4361-a0fb-f2280086182e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:48.275063 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ea85e0e4-276d-4361-a0fb-f2280086182e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:48.280724 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea85e0e4-276d-4361-a0fb-f2280086182e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:48.281201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea85e0e4-276d-4361-a0fb-f2280086182e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:48.281629 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea85e0e4-276d-4361-a0fb-f2280086182e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:48.282302 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea85e0e4-276d-4361-a0fb-f2280086182e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:48.282771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea85e0e4-276d-4361-a0fb-f2280086182e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:48.283188 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea85e0e4-276d-4361-a0fb-f2280086182e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:48.301414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e28c445b-bca9-4f77-a5c4-8bffb1346450 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:48.310005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e28c445b-bca9-4f77-a5c4-8bffb1346450 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:48.311523 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e28c445b-bca9-4f77-a5c4-8bffb1346450 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:48.312682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e28c445b-bca9-4f77-a5c4-8bffb1346450 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.157851 Aug 24 12:52:48.313237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1422/2842] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:48 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:52:48.414161 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ea85e0e4-276d-4361-a0fb-f2280086182e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:48.416437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:52:48.423207 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ea85e0e4-276d-4361-a0fb-f2280086182e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.152513 Aug 24 12:52:48.423778 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1421/2843] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:48 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:48.917152 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-40f78fae-8a20-48be-a2d5-67bb0ee89e5e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:48.917761 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-40f78fae-8a20-48be-a2d5-67bb0ee89e5e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:48.923746 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40f78fae-8a20-48be-a2d5-67bb0ee89e5e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:48.924231 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40f78fae-8a20-48be-a2d5-67bb0ee89e5e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:48.924668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40f78fae-8a20-48be-a2d5-67bb0ee89e5e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:48.925387 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40f78fae-8a20-48be-a2d5-67bb0ee89e5e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:48.925850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40f78fae-8a20-48be-a2d5-67bb0ee89e5e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:48.926276 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40f78fae-8a20-48be-a2d5-67bb0ee89e5e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:49.054023 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-40f78fae-8a20-48be-a2d5-67bb0ee89e5e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:49.062228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-40f78fae-8a20-48be-a2d5-67bb0ee89e5e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148994 Aug 24 12:52:49.062812 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1423/2844] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:48 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:49.283617 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ec2f02ff-dc42-4227-8538-a274557ac57e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:49.284198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ec2f02ff-dc42-4227-8538-a274557ac57e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:49.290667 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ec2f02ff-dc42-4227-8538-a274557ac57e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:49.291148 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ec2f02ff-dc42-4227-8538-a274557ac57e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:49.291575 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ec2f02ff-dc42-4227-8538-a274557ac57e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:49.292245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ec2f02ff-dc42-4227-8538-a274557ac57e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:49.292691 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ec2f02ff-dc42-4227-8538-a274557ac57e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:49.293109 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ec2f02ff-dc42-4227-8538-a274557ac57e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:49.336969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0ffe0368-0074-4c89-8c77-41975698a4c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:49.337510 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0ffe0368-0074-4c89-8c77-41975698a4c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:49.343809 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0ffe0368-0074-4c89-8c77-41975698a4c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:49.344289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0ffe0368-0074-4c89-8c77-41975698a4c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:49.344726 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0ffe0368-0074-4c89-8c77-41975698a4c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:49.345410 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0ffe0368-0074-4c89-8c77-41975698a4c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:49.345865 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0ffe0368-0074-4c89-8c77-41975698a4c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:49.346289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0ffe0368-0074-4c89-8c77-41975698a4c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:49.423879 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ec2f02ff-dc42-4227-8538-a274557ac57e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:49.431517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ec2f02ff-dc42-4227-8538-a274557ac57e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152040 Aug 24 12:52:49.432152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1422/2845] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:49 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:49.455429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3fffea99-1937-480a-a364-606772f2f51c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:49.458268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3fffea99-1937-480a-a364-606772f2f51c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:49.463149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3fffea99-1937-480a-a364-606772f2f51c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:49.463685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3fffea99-1937-480a-a364-606772f2f51c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:49.464114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3fffea99-1937-480a-a364-606772f2f51c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:49.464896 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3fffea99-1937-480a-a364-606772f2f51c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:49.465436 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3fffea99-1937-480a-a364-606772f2f51c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:49.466032 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3fffea99-1937-480a-a364-606772f2f51c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:49.492632 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0ffe0368-0074-4c89-8c77-41975698a4c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:49.500565 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0ffe0368-0074-4c89-8c77-41975698a4c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:49.502063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0ffe0368-0074-4c89-8c77-41975698a4c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:49.503464 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0ffe0368-0074-4c89-8c77-41975698a4c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.171055 Aug 24 12:52:49.504769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1424/2846] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:49 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:52:49.599974 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3fffea99-1937-480a-a364-606772f2f51c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:49.608153 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3fffea99-1937-480a-a364-606772f2f51c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.156763 Aug 24 12:52:49.608709 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1423/2847] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:49 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:50.083053 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3887b2dc-709c-481c-befa-272746e97399 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:50.083660 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3887b2dc-709c-481c-befa-272746e97399 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:50.089533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3887b2dc-709c-481c-befa-272746e97399 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:50.090014 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3887b2dc-709c-481c-befa-272746e97399 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:50.090452 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3887b2dc-709c-481c-befa-272746e97399 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:50.091160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3887b2dc-709c-481c-befa-272746e97399 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:50.091619 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3887b2dc-709c-481c-befa-272746e97399 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:50.092071 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3887b2dc-709c-481c-befa-272746e97399 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:50.217111 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3887b2dc-709c-481c-befa-272746e97399 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:50.225814 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3887b2dc-709c-481c-befa-272746e97399 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.146580 Aug 24 12:52:50.226365 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1425/2848] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:50 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:50.453382 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f0e4d164-fb55-4d8a-8662-c4746cb7058f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:50.454038 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f0e4d164-fb55-4d8a-8662-c4746cb7058f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:50.456335 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:52:50.461503 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0e4d164-fb55-4d8a-8662-c4746cb7058f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:50.461977 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0e4d164-fb55-4d8a-8662-c4746cb7058f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:50.462408 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0e4d164-fb55-4d8a-8662-c4746cb7058f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:50.463120 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0e4d164-fb55-4d8a-8662-c4746cb7058f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:50.463566 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0e4d164-fb55-4d8a-8662-c4746cb7058f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:50.468205 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0e4d164-fb55-4d8a-8662-c4746cb7058f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:50.528135 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3f25411b-9644-4e32-b467-caa71bd7f5e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:50.528508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3f25411b-9644-4e32-b467-caa71bd7f5e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:50.535621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3f25411b-9644-4e32-b467-caa71bd7f5e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:50.536104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3f25411b-9644-4e32-b467-caa71bd7f5e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:50.542704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3f25411b-9644-4e32-b467-caa71bd7f5e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:50.542704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3f25411b-9644-4e32-b467-caa71bd7f5e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:50.542704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3f25411b-9644-4e32-b467-caa71bd7f5e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:50.542704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3f25411b-9644-4e32-b467-caa71bd7f5e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:50.601457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f0e4d164-fb55-4d8a-8662-c4746cb7058f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:50.609735 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f0e4d164-fb55-4d8a-8662-c4746cb7058f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.160238 Aug 24 12:52:50.611321 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1424/2849] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:50 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:50.629796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-af962513-e528-4369-95ac-fdeea9400ca9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:50.630589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-af962513-e528-4369-95ac-fdeea9400ca9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:50.636511 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af962513-e528-4369-95ac-fdeea9400ca9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:50.636988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af962513-e528-4369-95ac-fdeea9400ca9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:50.637422 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af962513-e528-4369-95ac-fdeea9400ca9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:50.638106 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af962513-e528-4369-95ac-fdeea9400ca9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:50.638557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af962513-e528-4369-95ac-fdeea9400ca9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:50.639001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af962513-e528-4369-95ac-fdeea9400ca9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:50.670269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3f25411b-9644-4e32-b467-caa71bd7f5e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:50.679245 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3f25411b-9644-4e32-b467-caa71bd7f5e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:50.680706 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3f25411b-9644-4e32-b467-caa71bd7f5e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:50.681857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3f25411b-9644-4e32-b467-caa71bd7f5e1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.158332 Aug 24 12:52:50.682407 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1426/2850] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:50 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:52:50.768130 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-af962513-e528-4369-95ac-fdeea9400ca9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:50.776849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-af962513-e528-4369-95ac-fdeea9400ca9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151480 Aug 24 12:52:50.777413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1425/2851] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:50 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:51.246899 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-af453891-6d46-49e7-a935-70e47d4f6832 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:51.247506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-af453891-6d46-49e7-a935-70e47d4f6832 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:51.254285 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af453891-6d46-49e7-a935-70e47d4f6832 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:51.254820 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af453891-6d46-49e7-a935-70e47d4f6832 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:51.255271 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af453891-6d46-49e7-a935-70e47d4f6832 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:51.256020 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af453891-6d46-49e7-a935-70e47d4f6832 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:51.256479 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af453891-6d46-49e7-a935-70e47d4f6832 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:51.256911 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af453891-6d46-49e7-a935-70e47d4f6832 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:51.384088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-af453891-6d46-49e7-a935-70e47d4f6832 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:51.392201 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-af453891-6d46-49e7-a935-70e47d4f6832 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149264 Aug 24 12:52:51.392798 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1427/2852] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:51 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:51.631102 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1507be99-d0db-4154-8426-c8706277ace6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:51.631715 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1507be99-d0db-4154-8426-c8706277ace6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:51.638199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1507be99-d0db-4154-8426-c8706277ace6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:51.638718 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1507be99-d0db-4154-8426-c8706277ace6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:51.639160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1507be99-d0db-4154-8426-c8706277ace6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:51.639843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1507be99-d0db-4154-8426-c8706277ace6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:51.640304 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1507be99-d0db-4154-8426-c8706277ace6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:51.640749 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1507be99-d0db-4154-8426-c8706277ace6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:51.705088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7a01a607-8dac-4331-8a04-757bec11a94b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:51.705718 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7a01a607-8dac-4331-8a04-757bec11a94b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:51.712556 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a01a607-8dac-4331-8a04-757bec11a94b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:51.713309 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a01a607-8dac-4331-8a04-757bec11a94b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:51.713463 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a01a607-8dac-4331-8a04-757bec11a94b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:51.714154 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a01a607-8dac-4331-8a04-757bec11a94b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:51.714612 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a01a607-8dac-4331-8a04-757bec11a94b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:51.715066 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a01a607-8dac-4331-8a04-757bec11a94b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:51.767727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1507be99-d0db-4154-8426-c8706277ace6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:51.776448 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1507be99-d0db-4154-8426-c8706277ace6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149289 Aug 24 12:52:51.777022 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1426/2853] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:51 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:51.797270 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b0a4fd74-9c6f-4ef3-860b-4614851d5681 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:51.797874 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b0a4fd74-9c6f-4ef3-860b-4614851d5681 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:51.803972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b0a4fd74-9c6f-4ef3-860b-4614851d5681 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:51.804553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b0a4fd74-9c6f-4ef3-860b-4614851d5681 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:51.804985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b0a4fd74-9c6f-4ef3-860b-4614851d5681 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:51.805659 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b0a4fd74-9c6f-4ef3-860b-4614851d5681 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:51.806104 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b0a4fd74-9c6f-4ef3-860b-4614851d5681 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:51.806519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b0a4fd74-9c6f-4ef3-860b-4614851d5681 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:51.845351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7a01a607-8dac-4331-8a04-757bec11a94b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:51.854674 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7a01a607-8dac-4331-8a04-757bec11a94b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:51.856165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7a01a607-8dac-4331-8a04-757bec11a94b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:51.857328 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7a01a607-8dac-4331-8a04-757bec11a94b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.156176 Aug 24 12:52:51.857884 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1428/2854] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:51 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:52:51.933446 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b0a4fd74-9c6f-4ef3-860b-4614851d5681 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:51.941461 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b0a4fd74-9c6f-4ef3-860b-4614851d5681 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.148087 Aug 24 12:52:51.942069 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1427/2855] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:51 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:52.413334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e098fbdd-b914-4188-8319-2125f9c383dd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:52.413985 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e098fbdd-b914-4188-8319-2125f9c383dd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:52.419964 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e098fbdd-b914-4188-8319-2125f9c383dd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:52.420450 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e098fbdd-b914-4188-8319-2125f9c383dd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:52.420887 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e098fbdd-b914-4188-8319-2125f9c383dd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:52.421583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e098fbdd-b914-4188-8319-2125f9c383dd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:52.422513 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e098fbdd-b914-4188-8319-2125f9c383dd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:52.422968 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e098fbdd-b914-4188-8319-2125f9c383dd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:52.554564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e098fbdd-b914-4188-8319-2125f9c383dd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:52.563302 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e098fbdd-b914-4188-8319-2125f9c383dd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.154229 Aug 24 12:52:52.563864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1429/2856] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:52 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:52.798477 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fd0404e8-0e0f-4017-8f0d-77ec4990603e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:52.799019 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fd0404e8-0e0f-4017-8f0d-77ec4990603e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:52.805522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd0404e8-0e0f-4017-8f0d-77ec4990603e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:52.806003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd0404e8-0e0f-4017-8f0d-77ec4990603e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:52.806452 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd0404e8-0e0f-4017-8f0d-77ec4990603e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:52.807154 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd0404e8-0e0f-4017-8f0d-77ec4990603e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:52.807609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd0404e8-0e0f-4017-8f0d-77ec4990603e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:52.808054 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd0404e8-0e0f-4017-8f0d-77ec4990603e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:52.881213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c2dc8605-dcaf-454f-999a-c2891862cf52 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:52.881827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c2dc8605-dcaf-454f-999a-c2891862cf52 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:52.888205 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c2dc8605-dcaf-454f-999a-c2891862cf52 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:52.888698 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c2dc8605-dcaf-454f-999a-c2891862cf52 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:52.889146 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c2dc8605-dcaf-454f-999a-c2891862cf52 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:52.889845 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c2dc8605-dcaf-454f-999a-c2891862cf52 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:52.890306 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c2dc8605-dcaf-454f-999a-c2891862cf52 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:52.890760 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c2dc8605-dcaf-454f-999a-c2891862cf52 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:52.937985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fd0404e8-0e0f-4017-8f0d-77ec4990603e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:52.946588 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fd0404e8-0e0f-4017-8f0d-77ec4990603e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152062 Aug 24 12:52:52.947786 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1428/2857] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:52 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:52.963205 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e31ac946-6319-4991-8cf8-bab650b4e15f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:52.963850 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e31ac946-6319-4991-8cf8-bab650b4e15f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:52.969656 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e31ac946-6319-4991-8cf8-bab650b4e15f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:52.970204 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e31ac946-6319-4991-8cf8-bab650b4e15f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:52.970645 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e31ac946-6319-4991-8cf8-bab650b4e15f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:52.971383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e31ac946-6319-4991-8cf8-bab650b4e15f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:52.971834 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e31ac946-6319-4991-8cf8-bab650b4e15f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:52.972257 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e31ac946-6319-4991-8cf8-bab650b4e15f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:53.024619 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c2dc8605-dcaf-454f-999a-c2891862cf52 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:53.034075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c2dc8605-dcaf-454f-999a-c2891862cf52 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:53.035770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c2dc8605-dcaf-454f-999a-c2891862cf52 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:53.036968 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c2dc8605-dcaf-454f-999a-c2891862cf52 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.160182 Aug 24 12:52:53.038131 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1430/2858] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:52 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:52:53.102429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e31ac946-6319-4991-8cf8-bab650b4e15f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:53.110561 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e31ac946-6319-4991-8cf8-bab650b4e15f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151442 Aug 24 12:52:53.111149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1429/2859] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:52 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:53.583928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-29e50c48-9da7-48e5-aca6-0691b125729f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:53.584535 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-29e50c48-9da7-48e5-aca6-0691b125729f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:53.590413 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29e50c48-9da7-48e5-aca6-0691b125729f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:53.590936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29e50c48-9da7-48e5-aca6-0691b125729f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:53.591364 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29e50c48-9da7-48e5-aca6-0691b125729f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:53.594217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29e50c48-9da7-48e5-aca6-0691b125729f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:53.594217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29e50c48-9da7-48e5-aca6-0691b125729f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:53.594217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29e50c48-9da7-48e5-aca6-0691b125729f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:53.727028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-29e50c48-9da7-48e5-aca6-0691b125729f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:53.735320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-29e50c48-9da7-48e5-aca6-0691b125729f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.155604 Aug 24 12:52:53.735872 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1431/2860] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:53 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:53.968947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-950ea708-e28a-4d43-8fcb-e849d1dbc899 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:53.969545 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-950ea708-e28a-4d43-8fcb-e849d1dbc899 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:53.976630 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-950ea708-e28a-4d43-8fcb-e849d1dbc899 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:53.977055 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-950ea708-e28a-4d43-8fcb-e849d1dbc899 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:53.977486 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-950ea708-e28a-4d43-8fcb-e849d1dbc899 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:53.978162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-950ea708-e28a-4d43-8fcb-e849d1dbc899 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:53.978611 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-950ea708-e28a-4d43-8fcb-e849d1dbc899 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:53.979060 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-950ea708-e28a-4d43-8fcb-e849d1dbc899 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:54.059019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-70488b7a-5604-43d2-9183-1909e78b90d4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:54.060171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-70488b7a-5604-43d2-9183-1909e78b90d4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:54.067777 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70488b7a-5604-43d2-9183-1909e78b90d4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:54.068368 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70488b7a-5604-43d2-9183-1909e78b90d4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:54.068907 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70488b7a-5604-43d2-9183-1909e78b90d4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:54.070086 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70488b7a-5604-43d2-9183-1909e78b90d4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:54.070852 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70488b7a-5604-43d2-9183-1909e78b90d4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:54.071671 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-70488b7a-5604-43d2-9183-1909e78b90d4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:54.122271 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-950ea708-e28a-4d43-8fcb-e849d1dbc899 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:54.130849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-950ea708-e28a-4d43-8fcb-e849d1dbc899 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.165679 Aug 24 12:52:54.133708 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1430/2861] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:53 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:54.136032 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cb29ee8f-6def-4cbb-91a4-cbaddb16081e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:54.136639 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cb29ee8f-6def-4cbb-91a4-cbaddb16081e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:54.142771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cb29ee8f-6def-4cbb-91a4-cbaddb16081e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:54.143254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cb29ee8f-6def-4cbb-91a4-cbaddb16081e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:54.143897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cb29ee8f-6def-4cbb-91a4-cbaddb16081e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:54.144617 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cb29ee8f-6def-4cbb-91a4-cbaddb16081e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:54.145654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cb29ee8f-6def-4cbb-91a4-cbaddb16081e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:54.146086 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cb29ee8f-6def-4cbb-91a4-cbaddb16081e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:54.234964 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-70488b7a-5604-43d2-9183-1909e78b90d4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:54.244222 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-70488b7a-5604-43d2-9183-1909e78b90d4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:54.245640 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-70488b7a-5604-43d2-9183-1909e78b90d4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:54.246849 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-70488b7a-5604-43d2-9183-1909e78b90d4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.191704 Aug 24 12:52:54.247403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1432/2862] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:54 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:52:54.277163 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cb29ee8f-6def-4cbb-91a4-cbaddb16081e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:54.285288 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cb29ee8f-6def-4cbb-91a4-cbaddb16081e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.152930 Aug 24 12:52:54.286415 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1431/2863] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:54 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:54.757535 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2120a55d-9f63-4587-b110-687eb02df83c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:54.758140 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2120a55d-9f63-4587-b110-687eb02df83c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:54.764035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2120a55d-9f63-4587-b110-687eb02df83c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:54.764512 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2120a55d-9f63-4587-b110-687eb02df83c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:54.764947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2120a55d-9f63-4587-b110-687eb02df83c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:54.765616 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2120a55d-9f63-4587-b110-687eb02df83c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:54.766090 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2120a55d-9f63-4587-b110-687eb02df83c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:54.766486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2120a55d-9f63-4587-b110-687eb02df83c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:54.891737 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2120a55d-9f63-4587-b110-687eb02df83c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:54.900472 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2120a55d-9f63-4587-b110-687eb02df83c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.147325 Aug 24 12:52:54.901039 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1433/2864] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:54 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:55.152485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c5e033e3-cf85-4f25-9acd-6809379b13f2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:55.153113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c5e033e3-cf85-4f25-9acd-6809379b13f2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:55.159479 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5e033e3-cf85-4f25-9acd-6809379b13f2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:55.163013 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5e033e3-cf85-4f25-9acd-6809379b13f2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:55.163013 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5e033e3-cf85-4f25-9acd-6809379b13f2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:55.163013 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5e033e3-cf85-4f25-9acd-6809379b13f2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:55.163013 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5e033e3-cf85-4f25-9acd-6809379b13f2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:55.163479 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5e033e3-cf85-4f25-9acd-6809379b13f2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:55.269373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-13e013a8-9039-4ce3-82bc-bdbdeea55301 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:55.270009 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-13e013a8-9039-4ce3-82bc-bdbdeea55301 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:55.276926 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13e013a8-9039-4ce3-82bc-bdbdeea55301 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:55.277411 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13e013a8-9039-4ce3-82bc-bdbdeea55301 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:55.277846 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13e013a8-9039-4ce3-82bc-bdbdeea55301 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:55.278533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13e013a8-9039-4ce3-82bc-bdbdeea55301 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:55.279011 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13e013a8-9039-4ce3-82bc-bdbdeea55301 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:55.279432 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13e013a8-9039-4ce3-82bc-bdbdeea55301 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:55.292180 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c5e033e3-cf85-4f25-9acd-6809379b13f2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:55.301705 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c5e033e3-cf85-4f25-9acd-6809379b13f2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152374 Aug 24 12:52:55.302613 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1432/2865] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:55 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:55.314592 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3ce371b7-67d1-4031-9a47-53409749964b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:55.315310 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3ce371b7-67d1-4031-9a47-53409749964b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:55.321297 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ce371b7-67d1-4031-9a47-53409749964b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:55.321786 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ce371b7-67d1-4031-9a47-53409749964b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:55.322235 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ce371b7-67d1-4031-9a47-53409749964b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:55.322977 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ce371b7-67d1-4031-9a47-53409749964b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:55.323435 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ce371b7-67d1-4031-9a47-53409749964b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:55.323863 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ce371b7-67d1-4031-9a47-53409749964b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:55.416042 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-13e013a8-9039-4ce3-82bc-bdbdeea55301 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:55.436712 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-13e013a8-9039-4ce3-82bc-bdbdeea55301 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:55.438201 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-13e013a8-9039-4ce3-82bc-bdbdeea55301 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:55.439416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-13e013a8-9039-4ce3-82bc-bdbdeea55301 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.173963 Aug 24 12:52:55.439969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1434/2866] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:55 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:52:55.464663 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3ce371b7-67d1-4031-9a47-53409749964b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:55.472811 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3ce371b7-67d1-4031-9a47-53409749964b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.169141 Aug 24 12:52:55.473859 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1433/2867] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:55 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:55.921539 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a701a25b-b748-407e-8e02-a760ce7e36d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:55.922143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a701a25b-b748-407e-8e02-a760ce7e36d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:55.928055 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a701a25b-b748-407e-8e02-a760ce7e36d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:55.928532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a701a25b-b748-407e-8e02-a760ce7e36d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:55.928963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a701a25b-b748-407e-8e02-a760ce7e36d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:55.929646 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a701a25b-b748-407e-8e02-a760ce7e36d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:55.930094 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a701a25b-b748-407e-8e02-a760ce7e36d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:55.930515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a701a25b-b748-407e-8e02-a760ce7e36d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:56.059664 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a701a25b-b748-407e-8e02-a760ce7e36d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:56.068366 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a701a25b-b748-407e-8e02-a760ce7e36d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150683 Aug 24 12:52:56.068925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1435/2868] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:55 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:56.322960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ce829803-d276-459d-9c73-5832de526233 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:56.323595 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ce829803-d276-459d-9c73-5832de526233 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:56.329966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce829803-d276-459d-9c73-5832de526233 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:56.330450 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce829803-d276-459d-9c73-5832de526233 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:56.330922 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce829803-d276-459d-9c73-5832de526233 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:56.331604 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce829803-d276-459d-9c73-5832de526233 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:56.332559 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce829803-d276-459d-9c73-5832de526233 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:56.332989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce829803-d276-459d-9c73-5832de526233 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:56.458517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ce829803-d276-459d-9c73-5832de526233 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:56.463712 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-094a0911-cf46-441c-a62f-3cbdf86e207b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:56.464327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-094a0911-cf46-441c-a62f-3cbdf86e207b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:56.466934 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ce829803-d276-459d-9c73-5832de526233 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.147546 Aug 24 12:52:56.467670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1434/2869] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:56 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:56.471114 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-094a0911-cf46-441c-a62f-3cbdf86e207b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:56.471599 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-094a0911-cf46-441c-a62f-3cbdf86e207b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:56.472041 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-094a0911-cf46-441c-a62f-3cbdf86e207b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:56.472804 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-094a0911-cf46-441c-a62f-3cbdf86e207b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:56.473850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-094a0911-cf46-441c-a62f-3cbdf86e207b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:56.474294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-094a0911-cf46-441c-a62f-3cbdf86e207b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:56.493262 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5d3f0132-e6c9-4d6b-a8a1-2092032deaf2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:56.494127 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5d3f0132-e6c9-4d6b-a8a1-2092032deaf2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:56.500188 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d3f0132-e6c9-4d6b-a8a1-2092032deaf2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:56.500671 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d3f0132-e6c9-4d6b-a8a1-2092032deaf2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:56.501114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d3f0132-e6c9-4d6b-a8a1-2092032deaf2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:56.501799 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d3f0132-e6c9-4d6b-a8a1-2092032deaf2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:56.502252 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d3f0132-e6c9-4d6b-a8a1-2092032deaf2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:56.502697 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d3f0132-e6c9-4d6b-a8a1-2092032deaf2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:56.607394 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-094a0911-cf46-441c-a62f-3cbdf86e207b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:56.616942 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-094a0911-cf46-441c-a62f-3cbdf86e207b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:56.618502 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-094a0911-cf46-441c-a62f-3cbdf86e207b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:56.619718 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-094a0911-cf46-441c-a62f-3cbdf86e207b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.159832 Aug 24 12:52:56.620467 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1436/2870] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:56 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:52:56.652759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5d3f0132-e6c9-4d6b-a8a1-2092032deaf2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:56.652759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5d3f0132-e6c9-4d6b-a8a1-2092032deaf2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.162114 Aug 24 12:52:56.652759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1435/2871] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:56 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:57.089565 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6716e748-d2be-4f81-b149-31756385753e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:57.090214 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6716e748-d2be-4f81-b149-31756385753e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:57.096451 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6716e748-d2be-4f81-b149-31756385753e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:57.096939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6716e748-d2be-4f81-b149-31756385753e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:57.097382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6716e748-d2be-4f81-b149-31756385753e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:57.098070 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6716e748-d2be-4f81-b149-31756385753e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:57.098529 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6716e748-d2be-4f81-b149-31756385753e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:57.098995 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6716e748-d2be-4f81-b149-31756385753e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:57.225878 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6716e748-d2be-4f81-b149-31756385753e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:57.234042 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6716e748-d2be-4f81-b149-31756385753e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148342 Aug 24 12:52:57.234596 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1437/2872] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:57 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:57.489304 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8c830567-001c-4cfd-b26d-1dd40fa48d90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:57.489916 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8c830567-001c-4cfd-b26d-1dd40fa48d90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:57.496477 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c830567-001c-4cfd-b26d-1dd40fa48d90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:57.496954 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c830567-001c-4cfd-b26d-1dd40fa48d90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:57.497387 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c830567-001c-4cfd-b26d-1dd40fa48d90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:57.498063 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c830567-001c-4cfd-b26d-1dd40fa48d90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:57.498515 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c830567-001c-4cfd-b26d-1dd40fa48d90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:57.498961 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c830567-001c-4cfd-b26d-1dd40fa48d90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:57.622460 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8c830567-001c-4cfd-b26d-1dd40fa48d90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:57.630497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8c830567-001c-4cfd-b26d-1dd40fa48d90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.145894 Aug 24 12:52:57.631230 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1436/2873] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:57 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:57.642045 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-42c6dccd-e798-4256-8c1e-d21e05a17562 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:57.642757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-42c6dccd-e798-4256-8c1e-d21e05a17562 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:57.649117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-42c6dccd-e798-4256-8c1e-d21e05a17562 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:57.649601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-42c6dccd-e798-4256-8c1e-d21e05a17562 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:57.650034 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-42c6dccd-e798-4256-8c1e-d21e05a17562 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:57.650749 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-42c6dccd-e798-4256-8c1e-d21e05a17562 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:57.651207 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-42c6dccd-e798-4256-8c1e-d21e05a17562 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:57.651633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-42c6dccd-e798-4256-8c1e-d21e05a17562 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:57.672058 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-df6aa68b-0611-4b80-884f-582319f8a1ba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:57.672664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-df6aa68b-0611-4b80-884f-582319f8a1ba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:57.679122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-df6aa68b-0611-4b80-884f-582319f8a1ba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:57.679544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-df6aa68b-0611-4b80-884f-582319f8a1ba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:57.679979 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-df6aa68b-0611-4b80-884f-582319f8a1ba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:57.680657 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-df6aa68b-0611-4b80-884f-582319f8a1ba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:57.681109 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-df6aa68b-0611-4b80-884f-582319f8a1ba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:57.681531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-df6aa68b-0611-4b80-884f-582319f8a1ba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:57.780520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-42c6dccd-e798-4256-8c1e-d21e05a17562 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:57.789819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-42c6dccd-e798-4256-8c1e-d21e05a17562 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:57.791336 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-42c6dccd-e798-4256-8c1e-d21e05a17562 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:57.792503 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-42c6dccd-e798-4256-8c1e-d21e05a17562 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154262 Aug 24 12:52:57.793054 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1438/2874] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:57 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:57.811983 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-df6aa68b-0611-4b80-884f-582319f8a1ba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:57.820033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-df6aa68b-0611-4b80-884f-582319f8a1ba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151685 Aug 24 12:52:57.820587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1437/2875] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:57 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:58.255770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7fadfda7-3317-42b9-98b5-6d17173d16eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:58.256293 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7fadfda7-3317-42b9-98b5-6d17173d16eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:58.262221 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7fadfda7-3317-42b9-98b5-6d17173d16eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:58.262743 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7fadfda7-3317-42b9-98b5-6d17173d16eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:58.263178 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7fadfda7-3317-42b9-98b5-6d17173d16eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:58.263859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7fadfda7-3317-42b9-98b5-6d17173d16eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:58.264317 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7fadfda7-3317-42b9-98b5-6d17173d16eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:58.264739 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7fadfda7-3317-42b9-98b5-6d17173d16eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:58.268553 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:52:58.395981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7fadfda7-3317-42b9-98b5-6d17173d16eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:58.404572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7fadfda7-3317-42b9-98b5-6d17173d16eb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152378 Aug 24 12:52:58.404734 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1439/2876] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:58 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:58.651680 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-34c3c613-e8ce-40d2-a7eb-1adf7c18c2d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:58.652214 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-34c3c613-e8ce-40d2-a7eb-1adf7c18c2d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:58.658846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-34c3c613-e8ce-40d2-a7eb-1adf7c18c2d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:58.659332 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-34c3c613-e8ce-40d2-a7eb-1adf7c18c2d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:58.659768 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-34c3c613-e8ce-40d2-a7eb-1adf7c18c2d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:58.661114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-34c3c613-e8ce-40d2-a7eb-1adf7c18c2d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:58.661567 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-34c3c613-e8ce-40d2-a7eb-1adf7c18c2d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:58.661993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-34c3c613-e8ce-40d2-a7eb-1adf7c18c2d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:58.676535 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:52:58.786086 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-34c3c613-e8ce-40d2-a7eb-1adf7c18c2d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:58.794101 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-34c3c613-e8ce-40d2-a7eb-1adf7c18c2d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.146340 Aug 24 12:52:58.794679 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1438/2877] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:58 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:58.815281 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-07e1ebea-9a6b-4eab-aa44-1f55d4d0b167 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:58.815895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-07e1ebea-9a6b-4eab-aa44-1f55d4d0b167 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:58.822804 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-07e1ebea-9a6b-4eab-aa44-1f55d4d0b167 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:58.823291 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-07e1ebea-9a6b-4eab-aa44-1f55d4d0b167 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:58.823964 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-07e1ebea-9a6b-4eab-aa44-1f55d4d0b167 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:58.824652 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-07e1ebea-9a6b-4eab-aa44-1f55d4d0b167 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:58.825108 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-07e1ebea-9a6b-4eab-aa44-1f55d4d0b167 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:58.825534 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-07e1ebea-9a6b-4eab-aa44-1f55d4d0b167 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:58.840973 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a7050439-4f76-4d04-afc9-26871d05814a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:58.841591 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a7050439-4f76-4d04-afc9-26871d05814a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:58.847406 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a7050439-4f76-4d04-afc9-26871d05814a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:58.847873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a7050439-4f76-4d04-afc9-26871d05814a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:58.848309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a7050439-4f76-4d04-afc9-26871d05814a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:58.848994 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a7050439-4f76-4d04-afc9-26871d05814a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:58.849448 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a7050439-4f76-4d04-afc9-26871d05814a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:58.849877 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a7050439-4f76-4d04-afc9-26871d05814a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:58.953838 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-07e1ebea-9a6b-4eab-aa44-1f55d4d0b167 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:58.963117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-07e1ebea-9a6b-4eab-aa44-1f55d4d0b167 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:58.964598 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-07e1ebea-9a6b-4eab-aa44-1f55d4d0b167 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:58.965756 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-07e1ebea-9a6b-4eab-aa44-1f55d4d0b167 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154382 Aug 24 12:52:58.966318 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1440/2878] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:58 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:52:58.977547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a7050439-4f76-4d04-afc9-26871d05814a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:58.985816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a7050439-4f76-4d04-afc9-26871d05814a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.148571 Aug 24 12:52:58.986378 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1439/2879] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:58 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:52:59.425128 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-07ab7a2a-4b1b-485a-af4f-c4532dab80ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:59.426275 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-07ab7a2a-4b1b-485a-af4f-c4532dab80ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:59.432272 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-07ab7a2a-4b1b-485a-af4f-c4532dab80ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:59.432761 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-07ab7a2a-4b1b-485a-af4f-c4532dab80ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:59.433186 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-07ab7a2a-4b1b-485a-af4f-c4532dab80ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:59.433866 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-07ab7a2a-4b1b-485a-af4f-c4532dab80ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:59.434314 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-07ab7a2a-4b1b-485a-af4f-c4532dab80ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:59.434759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-07ab7a2a-4b1b-485a-af4f-c4532dab80ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:59.563112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-07ab7a2a-4b1b-485a-af4f-c4532dab80ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:59.571959 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-07ab7a2a-4b1b-485a-af4f-c4532dab80ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150584 Aug 24 12:52:59.572530 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1441/2880] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:59 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:59.814862 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2b21cee3-c798-44cb-957c-fa18ae54b358 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:59.815469 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2b21cee3-c798-44cb-957c-fa18ae54b358 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:59.821768 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b21cee3-c798-44cb-957c-fa18ae54b358 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:59.822253 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b21cee3-c798-44cb-957c-fa18ae54b358 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:59.822700 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b21cee3-c798-44cb-957c-fa18ae54b358 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:59.823374 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b21cee3-c798-44cb-957c-fa18ae54b358 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:59.823817 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b21cee3-c798-44cb-957c-fa18ae54b358 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:59.824234 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b21cee3-c798-44cb-957c-fa18ae54b358 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:59.952225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2b21cee3-c798-44cb-957c-fa18ae54b358 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:52:59.961046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2b21cee3-c798-44cb-957c-fa18ae54b358 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149967 Aug 24 12:52:59.961681 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1440/2881] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:52:59 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:52:59.988607 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-cd0a971e-f962-4097-93fa-24e0010faf2a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:52:59.989209 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-cd0a971e-f962-4097-93fa-24e0010faf2a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:52:59.995468 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd0a971e-f962-4097-93fa-24e0010faf2a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:59.995944 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd0a971e-f962-4097-93fa-24e0010faf2a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:59.996375 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd0a971e-f962-4097-93fa-24e0010faf2a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:52:59.997051 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd0a971e-f962-4097-93fa-24e0010faf2a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:52:59.997501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd0a971e-f962-4097-93fa-24e0010faf2a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:52:59.997917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd0a971e-f962-4097-93fa-24e0010faf2a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:00.006046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-dd5f2c34-5726-4b51-b874-552d5caca0b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:00.006678 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-dd5f2c34-5726-4b51-b874-552d5caca0b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:00.012453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd5f2c34-5726-4b51-b874-552d5caca0b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:00.012930 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd5f2c34-5726-4b51-b874-552d5caca0b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:00.013363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd5f2c34-5726-4b51-b874-552d5caca0b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:00.014045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd5f2c34-5726-4b51-b874-552d5caca0b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:00.014495 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd5f2c34-5726-4b51-b874-552d5caca0b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:00.014969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd5f2c34-5726-4b51-b874-552d5caca0b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:00.126866 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-cd0a971e-f962-4097-93fa-24e0010faf2a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:00.135630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-cd0a971e-f962-4097-93fa-24e0010faf2a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:00.137124 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-cd0a971e-f962-4097-93fa-24e0010faf2a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:00.138291 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-cd0a971e-f962-4097-93fa-24e0010faf2a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.153772 Aug 24 12:53:00.138883 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1442/2882] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:52:59 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:00.142344 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-dd5f2c34-5726-4b51-b874-552d5caca0b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:00.151247 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-dd5f2c34-5726-4b51-b874-552d5caca0b7 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.148918 Aug 24 12:53:00.151794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1441/2883] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:00 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:00.592627 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0fc12849-7865-485a-85df-6a2d82ae666d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:00.593238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0fc12849-7865-485a-85df-6a2d82ae666d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:00.599713 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fc12849-7865-485a-85df-6a2d82ae666d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:00.600191 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fc12849-7865-485a-85df-6a2d82ae666d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:00.600626 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fc12849-7865-485a-85df-6a2d82ae666d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:00.601311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fc12849-7865-485a-85df-6a2d82ae666d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:00.601774 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fc12849-7865-485a-85df-6a2d82ae666d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:00.602199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fc12849-7865-485a-85df-6a2d82ae666d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:00.739488 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0fc12849-7865-485a-85df-6a2d82ae666d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:00.747448 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0fc12849-7865-485a-85df-6a2d82ae666d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.158595 Aug 24 12:53:00.748012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1443/2884] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:00 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:00.982891 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bd50f429-fffb-4383-a92b-73ce1738ecfb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:00.983533 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-bd50f429-fffb-4383-a92b-73ce1738ecfb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:00.990113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd50f429-fffb-4383-a92b-73ce1738ecfb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:00.990588 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd50f429-fffb-4383-a92b-73ce1738ecfb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:00.991051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd50f429-fffb-4383-a92b-73ce1738ecfb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:00.991725 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd50f429-fffb-4383-a92b-73ce1738ecfb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:00.992177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd50f429-fffb-4383-a92b-73ce1738ecfb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:00.992603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd50f429-fffb-4383-a92b-73ce1738ecfb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:01.119732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-bd50f429-fffb-4383-a92b-73ce1738ecfb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:01.127777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bd50f429-fffb-4383-a92b-73ce1738ecfb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.148779 Aug 24 12:53:01.128333 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1442/2885] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:00 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:01.161683 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dbe6a12f-3c5f-4948-948a-570551929b40 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:01.162528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dbe6a12f-3c5f-4948-948a-570551929b40 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:01.171013 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dbe6a12f-3c5f-4948-948a-570551929b40 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:01.171504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dbe6a12f-3c5f-4948-948a-570551929b40 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:01.171652 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3d75691e-c571-4c69-aec4-6463a027addf tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:01.171943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dbe6a12f-3c5f-4948-948a-570551929b40 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:01.172259 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3d75691e-c571-4c69-aec4-6463a027addf tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:01.172641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dbe6a12f-3c5f-4948-948a-570551929b40 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:01.173103 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dbe6a12f-3c5f-4948-948a-570551929b40 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:01.173530 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dbe6a12f-3c5f-4948-948a-570551929b40 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:01.178154 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3d75691e-c571-4c69-aec4-6463a027addf tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:01.178634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3d75691e-c571-4c69-aec4-6463a027addf tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:01.179103 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3d75691e-c571-4c69-aec4-6463a027addf tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:01.179791 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3d75691e-c571-4c69-aec4-6463a027addf tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:01.180241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3d75691e-c571-4c69-aec4-6463a027addf tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:01.180661 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3d75691e-c571-4c69-aec4-6463a027addf tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:01.309871 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3d75691e-c571-4c69-aec4-6463a027addf tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:01.310244 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-dbe6a12f-3c5f-4948-948a-570551929b40 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:01.318839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3d75691e-c571-4c69-aec4-6463a027addf tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150875 Aug 24 12:53:01.319382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-dbe6a12f-3c5f-4948-948a-570551929b40 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:01.319526 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1443/2886] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:01 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:01.321042 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-dbe6a12f-3c5f-4948-948a-570551929b40 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:01.322206 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dbe6a12f-3c5f-4948-948a-570551929b40 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.164868 Aug 24 12:53:01.322759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1444/2887] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:01 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:01.768063 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1b682ec5-09a1-4e02-a896-78d3ca571854 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:01.768618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1b682ec5-09a1-4e02-a896-78d3ca571854 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:01.774465 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b682ec5-09a1-4e02-a896-78d3ca571854 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:01.774969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b682ec5-09a1-4e02-a896-78d3ca571854 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:01.775400 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b682ec5-09a1-4e02-a896-78d3ca571854 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:01.776066 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b682ec5-09a1-4e02-a896-78d3ca571854 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:01.776510 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b682ec5-09a1-4e02-a896-78d3ca571854 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:01.776929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b682ec5-09a1-4e02-a896-78d3ca571854 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:01.903035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1b682ec5-09a1-4e02-a896-78d3ca571854 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:01.911602 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1b682ec5-09a1-4e02-a896-78d3ca571854 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.147403 Aug 24 12:53:01.912162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1444/2888] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:01 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:02.148726 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b3c310b6-102c-41fb-8cc7-61bd20ad8caa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:02.149267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b3c310b6-102c-41fb-8cc7-61bd20ad8caa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:02.155358 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3c310b6-102c-41fb-8cc7-61bd20ad8caa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:02.155848 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3c310b6-102c-41fb-8cc7-61bd20ad8caa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:02.156288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3c310b6-102c-41fb-8cc7-61bd20ad8caa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:02.156978 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3c310b6-102c-41fb-8cc7-61bd20ad8caa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:02.157439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3c310b6-102c-41fb-8cc7-61bd20ad8caa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:02.157871 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3c310b6-102c-41fb-8cc7-61bd20ad8caa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:02.286906 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b3c310b6-102c-41fb-8cc7-61bd20ad8caa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:02.295089 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b3c310b6-102c-41fb-8cc7-61bd20ad8caa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150296 Aug 24 12:53:02.295644 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1445/2889] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:02 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:02.339827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a329dc2a-aea9-4103-b10f-c1edb1ff204e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:02.340535 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a329dc2a-aea9-4103-b10f-c1edb1ff204e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:02.344708 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f9e2bb4f-47eb-4c00-abd2-c5d5de085dcd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:02.345310 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f9e2bb4f-47eb-4c00-abd2-c5d5de085dcd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:02.346989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a329dc2a-aea9-4103-b10f-c1edb1ff204e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:02.347590 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a329dc2a-aea9-4103-b10f-c1edb1ff204e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:02.348464 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a329dc2a-aea9-4103-b10f-c1edb1ff204e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:02.349379 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a329dc2a-aea9-4103-b10f-c1edb1ff204e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:02.349828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a329dc2a-aea9-4103-b10f-c1edb1ff204e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:02.350250 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a329dc2a-aea9-4103-b10f-c1edb1ff204e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:02.351806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9e2bb4f-47eb-4c00-abd2-c5d5de085dcd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:02.352285 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9e2bb4f-47eb-4c00-abd2-c5d5de085dcd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:02.352895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9e2bb4f-47eb-4c00-abd2-c5d5de085dcd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:02.353583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9e2bb4f-47eb-4c00-abd2-c5d5de085dcd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:02.354040 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9e2bb4f-47eb-4c00-abd2-c5d5de085dcd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:02.354462 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9e2bb4f-47eb-4c00-abd2-c5d5de085dcd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:02.480809 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a329dc2a-aea9-4103-b10f-c1edb1ff204e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:02.487613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f9e2bb4f-47eb-4c00-abd2-c5d5de085dcd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:02.489200 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a329dc2a-aea9-4103-b10f-c1edb1ff204e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.153401 Aug 24 12:53:02.489950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1445/2890] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:02 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:02.496700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f9e2bb4f-47eb-4c00-abd2-c5d5de085dcd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:02.498260 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f9e2bb4f-47eb-4c00-abd2-c5d5de085dcd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:02.499675 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f9e2bb4f-47eb-4c00-abd2-c5d5de085dcd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.158957 Aug 24 12:53:02.500292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1446/2891] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:02 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:53:02.932347 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-988cdbc5-9f46-4960-8991-a910ee1796f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:02.932953 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-988cdbc5-9f46-4960-8991-a910ee1796f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:02.938916 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-988cdbc5-9f46-4960-8991-a910ee1796f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:02.939381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-988cdbc5-9f46-4960-8991-a910ee1796f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:02.939816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-988cdbc5-9f46-4960-8991-a910ee1796f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:02.940498 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-988cdbc5-9f46-4960-8991-a910ee1796f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:02.940943 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-988cdbc5-9f46-4960-8991-a910ee1796f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:02.941883 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-988cdbc5-9f46-4960-8991-a910ee1796f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:03.065913 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-988cdbc5-9f46-4960-8991-a910ee1796f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:03.074548 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-988cdbc5-9f46-4960-8991-a910ee1796f5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.146141 Aug 24 12:53:03.075133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1446/2892] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:02 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:03.315801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5310516a-ab7e-4c4d-ad8f-0da75425c319 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:03.316988 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5310516a-ab7e-4c4d-ad8f-0da75425c319 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:03.323488 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5310516a-ab7e-4c4d-ad8f-0da75425c319 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:03.323974 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5310516a-ab7e-4c4d-ad8f-0da75425c319 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:03.324416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5310516a-ab7e-4c4d-ad8f-0da75425c319 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:03.325102 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5310516a-ab7e-4c4d-ad8f-0da75425c319 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:03.325558 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5310516a-ab7e-4c4d-ad8f-0da75425c319 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:03.325984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5310516a-ab7e-4c4d-ad8f-0da75425c319 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:03.452955 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5310516a-ab7e-4c4d-ad8f-0da75425c319 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:03.461130 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5310516a-ab7e-4c4d-ad8f-0da75425c319 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149161 Aug 24 12:53:03.461696 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1447/2893] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:03 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:03.509536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1dbc31f6-65b3-45fc-9a79-514a163409c9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:03.510142 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1dbc31f6-65b3-45fc-9a79-514a163409c9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:03.517727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1dbc31f6-65b3-45fc-9a79-514a163409c9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:03.518249 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1dbc31f6-65b3-45fc-9a79-514a163409c9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:03.518705 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1dbc31f6-65b3-45fc-9a79-514a163409c9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:03.519417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1dbc31f6-65b3-45fc-9a79-514a163409c9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:03.519864 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1dbc31f6-65b3-45fc-9a79-514a163409c9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:03.520282 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1dbc31f6-65b3-45fc-9a79-514a163409c9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:03.522975 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0ca21a2a-a0fb-4f7d-ac78-8b4ec587fdde tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:03.523595 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0ca21a2a-a0fb-4f7d-ac78-8b4ec587fdde tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:03.530286 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0ca21a2a-a0fb-4f7d-ac78-8b4ec587fdde tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:03.530819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0ca21a2a-a0fb-4f7d-ac78-8b4ec587fdde tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:03.531262 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0ca21a2a-a0fb-4f7d-ac78-8b4ec587fdde tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:03.531953 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0ca21a2a-a0fb-4f7d-ac78-8b4ec587fdde tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:03.532426 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0ca21a2a-a0fb-4f7d-ac78-8b4ec587fdde tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:03.532844 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0ca21a2a-a0fb-4f7d-ac78-8b4ec587fdde tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:03.678265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0ca21a2a-a0fb-4f7d-ac78-8b4ec587fdde tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:03.687613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0ca21a2a-a0fb-4f7d-ac78-8b4ec587fdde tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:03.689124 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0ca21a2a-a0fb-4f7d-ac78-8b4ec587fdde tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:03.690294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0ca21a2a-a0fb-4f7d-ac78-8b4ec587fdde tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.171609 Aug 24 12:53:03.690880 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1448/2894] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:03 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:03.897935 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1dbc31f6-65b3-45fc-9a79-514a163409c9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:03.905960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1dbc31f6-65b3-45fc-9a79-514a163409c9 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.400558 Aug 24 12:53:03.906518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1447/2895] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:03 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:04.094296 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-09012f81-5437-4ab4-90a3-a0bf42570749 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:04.094940 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-09012f81-5437-4ab4-90a3-a0bf42570749 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:04.100824 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09012f81-5437-4ab4-90a3-a0bf42570749 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:04.101304 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09012f81-5437-4ab4-90a3-a0bf42570749 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:04.101737 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09012f81-5437-4ab4-90a3-a0bf42570749 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:04.102414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09012f81-5437-4ab4-90a3-a0bf42570749 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:04.102895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09012f81-5437-4ab4-90a3-a0bf42570749 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:04.103319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09012f81-5437-4ab4-90a3-a0bf42570749 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:04.228778 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-09012f81-5437-4ab4-90a3-a0bf42570749 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:04.237082 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-09012f81-5437-4ab4-90a3-a0bf42570749 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.146335 Aug 24 12:53:04.237648 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1449/2896] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:04 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:04.482593 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b75245db-c20d-4375-b2a6-3a5ce6025594 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:04.483225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b75245db-c20d-4375-b2a6-3a5ce6025594 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:04.489857 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b75245db-c20d-4375-b2a6-3a5ce6025594 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:04.490331 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b75245db-c20d-4375-b2a6-3a5ce6025594 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:04.490790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b75245db-c20d-4375-b2a6-3a5ce6025594 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:04.491462 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b75245db-c20d-4375-b2a6-3a5ce6025594 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:04.491907 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b75245db-c20d-4375-b2a6-3a5ce6025594 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:04.492331 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b75245db-c20d-4375-b2a6-3a5ce6025594 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:04.615501 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b75245db-c20d-4375-b2a6-3a5ce6025594 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:04.623456 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b75245db-c20d-4375-b2a6-3a5ce6025594 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.144665 Aug 24 12:53:04.624004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1448/2897] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:04 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:04.713438 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7a898573-925a-4c30-b68d-b5951dba30a5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:04.714048 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7a898573-925a-4c30-b68d-b5951dba30a5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:04.720405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a898573-925a-4c30-b68d-b5951dba30a5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:04.720883 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a898573-925a-4c30-b68d-b5951dba30a5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:04.721317 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a898573-925a-4c30-b68d-b5951dba30a5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:04.722041 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a898573-925a-4c30-b68d-b5951dba30a5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:04.722458 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a898573-925a-4c30-b68d-b5951dba30a5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:04.722934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a898573-925a-4c30-b68d-b5951dba30a5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:04.849475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7a898573-925a-4c30-b68d-b5951dba30a5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:04.858092 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7a898573-925a-4c30-b68d-b5951dba30a5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:04.859609 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7a898573-925a-4c30-b68d-b5951dba30a5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:04.860768 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7a898573-925a-4c30-b68d-b5951dba30a5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.151172 Aug 24 12:53:04.861324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1450/2898] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:04 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:04.927353 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c987dfea-6628-4144-b43a-dadd0d58f11f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:04.927959 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c987dfea-6628-4144-b43a-dadd0d58f11f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:04.933894 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c987dfea-6628-4144-b43a-dadd0d58f11f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:04.934374 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c987dfea-6628-4144-b43a-dadd0d58f11f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:04.934846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c987dfea-6628-4144-b43a-dadd0d58f11f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:04.935522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c987dfea-6628-4144-b43a-dadd0d58f11f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:04.935972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c987dfea-6628-4144-b43a-dadd0d58f11f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:04.936394 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c987dfea-6628-4144-b43a-dadd0d58f11f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:05.064912 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c987dfea-6628-4144-b43a-dadd0d58f11f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:05.073103 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c987dfea-6628-4144-b43a-dadd0d58f11f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150626 Aug 24 12:53:05.073667 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1449/2899] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:04 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:05.257678 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4ccf798d-8950-43f9-8b6b-f01854f07787 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:05.258305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4ccf798d-8950-43f9-8b6b-f01854f07787 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:05.264269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4ccf798d-8950-43f9-8b6b-f01854f07787 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:05.264747 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4ccf798d-8950-43f9-8b6b-f01854f07787 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:05.265180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4ccf798d-8950-43f9-8b6b-f01854f07787 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:05.265886 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4ccf798d-8950-43f9-8b6b-f01854f07787 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:05.266337 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4ccf798d-8950-43f9-8b6b-f01854f07787 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:05.266798 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4ccf798d-8950-43f9-8b6b-f01854f07787 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:05.395372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4ccf798d-8950-43f9-8b6b-f01854f07787 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:05.403335 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4ccf798d-8950-43f9-8b6b-f01854f07787 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149674 Aug 24 12:53:05.403893 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1451/2900] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:05 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:05.645101 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9f6d6440-8c45-42c7-870d-2a29b09318b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:05.645639 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9f6d6440-8c45-42c7-870d-2a29b09318b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:05.651963 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f6d6440-8c45-42c7-870d-2a29b09318b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:05.652434 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f6d6440-8c45-42c7-870d-2a29b09318b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:05.652859 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f6d6440-8c45-42c7-870d-2a29b09318b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:05.653555 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f6d6440-8c45-42c7-870d-2a29b09318b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:05.653998 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f6d6440-8c45-42c7-870d-2a29b09318b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:05.654418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9f6d6440-8c45-42c7-870d-2a29b09318b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:05.780178 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9f6d6440-8c45-42c7-870d-2a29b09318b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:05.788785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9f6d6440-8c45-42c7-870d-2a29b09318b3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.147594 Aug 24 12:53:05.789341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1450/2901] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:05 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:05.885427 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1de64376-0afd-4cd9-8932-e6ff055f0e2d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:05.886037 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1de64376-0afd-4cd9-8932-e6ff055f0e2d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:05.892370 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1de64376-0afd-4cd9-8932-e6ff055f0e2d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:05.892847 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1de64376-0afd-4cd9-8932-e6ff055f0e2d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:05.893278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1de64376-0afd-4cd9-8932-e6ff055f0e2d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:05.893953 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1de64376-0afd-4cd9-8932-e6ff055f0e2d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:05.894406 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1de64376-0afd-4cd9-8932-e6ff055f0e2d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:05.894862 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1de64376-0afd-4cd9-8932-e6ff055f0e2d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:06.022576 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1de64376-0afd-4cd9-8932-e6ff055f0e2d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:06.031389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1de64376-0afd-4cd9-8932-e6ff055f0e2d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:06.032940 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1de64376-0afd-4cd9-8932-e6ff055f0e2d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:06.034075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1de64376-0afd-4cd9-8932-e6ff055f0e2d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.152554 Aug 24 12:53:06.034764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1452/2902] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:05 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:06.093299 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-55dc9bd5-3475-47ea-a119-949293b3464a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:06.093902 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-55dc9bd5-3475-47ea-a119-949293b3464a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:06.100366 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-55dc9bd5-3475-47ea-a119-949293b3464a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:06.100842 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-55dc9bd5-3475-47ea-a119-949293b3464a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:06.101270 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-55dc9bd5-3475-47ea-a119-949293b3464a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:06.101941 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-55dc9bd5-3475-47ea-a119-949293b3464a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:06.102385 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-55dc9bd5-3475-47ea-a119-949293b3464a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:06.102836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-55dc9bd5-3475-47ea-a119-949293b3464a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:06.227297 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-55dc9bd5-3475-47ea-a119-949293b3464a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:06.235307 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-55dc9bd5-3475-47ea-a119-949293b3464a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.145958 Aug 24 12:53:06.235853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1451/2903] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:06 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:06.425007 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a1374647-f789-40ee-9356-77d20d06ef82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:06.425610 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a1374647-f789-40ee-9356-77d20d06ef82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:06.431884 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a1374647-f789-40ee-9356-77d20d06ef82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:06.432369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a1374647-f789-40ee-9356-77d20d06ef82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:06.432806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a1374647-f789-40ee-9356-77d20d06ef82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:06.433501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a1374647-f789-40ee-9356-77d20d06ef82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:06.433954 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a1374647-f789-40ee-9356-77d20d06ef82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:06.434380 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a1374647-f789-40ee-9356-77d20d06ef82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:06.561908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a1374647-f789-40ee-9356-77d20d06ef82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:06.571030 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a1374647-f789-40ee-9356-77d20d06ef82 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149787 Aug 24 12:53:06.571586 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1453/2904] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:06 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:06.809082 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f5f4e28a-2ed3-48e7-9b44-990127ae23f8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:06.809692 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f5f4e28a-2ed3-48e7-9b44-990127ae23f8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:06.816031 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5f4e28a-2ed3-48e7-9b44-990127ae23f8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:06.817150 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5f4e28a-2ed3-48e7-9b44-990127ae23f8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:06.817585 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5f4e28a-2ed3-48e7-9b44-990127ae23f8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:06.818258 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5f4e28a-2ed3-48e7-9b44-990127ae23f8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:06.818738 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5f4e28a-2ed3-48e7-9b44-990127ae23f8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:06.819161 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5f4e28a-2ed3-48e7-9b44-990127ae23f8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:06.945431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f5f4e28a-2ed3-48e7-9b44-990127ae23f8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:06.953398 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f5f4e28a-2ed3-48e7-9b44-990127ae23f8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.148093 Aug 24 12:53:06.953953 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1452/2905] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:06 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:07.057582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8bc55f64-21da-41ce-85e8-67627e2d8da8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:07.058101 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8bc55f64-21da-41ce-85e8-67627e2d8da8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:07.063927 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8bc55f64-21da-41ce-85e8-67627e2d8da8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:07.064407 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8bc55f64-21da-41ce-85e8-67627e2d8da8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:07.064840 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8bc55f64-21da-41ce-85e8-67627e2d8da8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:07.065553 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8bc55f64-21da-41ce-85e8-67627e2d8da8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:07.066004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8bc55f64-21da-41ce-85e8-67627e2d8da8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:07.067049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8bc55f64-21da-41ce-85e8-67627e2d8da8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:07.191924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8bc55f64-21da-41ce-85e8-67627e2d8da8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:07.200385 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8bc55f64-21da-41ce-85e8-67627e2d8da8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:07.201865 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8bc55f64-21da-41ce-85e8-67627e2d8da8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:07.203040 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8bc55f64-21da-41ce-85e8-67627e2d8da8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.149379 Aug 24 12:53:07.203587 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1454/2906] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:07 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:07.256506 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0bdd76e4-5566-4211-b807-eef5b558c80e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:07.257111 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0bdd76e4-5566-4211-b807-eef5b558c80e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:07.263002 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0bdd76e4-5566-4211-b807-eef5b558c80e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:07.263477 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0bdd76e4-5566-4211-b807-eef5b558c80e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:07.263905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0bdd76e4-5566-4211-b807-eef5b558c80e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:07.264572 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0bdd76e4-5566-4211-b807-eef5b558c80e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:07.265018 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0bdd76e4-5566-4211-b807-eef5b558c80e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:07.265463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0bdd76e4-5566-4211-b807-eef5b558c80e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:07.389981 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0bdd76e4-5566-4211-b807-eef5b558c80e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:07.398876 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0bdd76e4-5566-4211-b807-eef5b558c80e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.146423 Aug 24 12:53:07.399435 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1453/2907] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:07 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:07.592152 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c18b3f97-c22d-485d-8124-459452956c6c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:07.592693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c18b3f97-c22d-485d-8124-459452956c6c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:07.599042 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c18b3f97-c22d-485d-8124-459452956c6c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:07.599525 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c18b3f97-c22d-485d-8124-459452956c6c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:07.599962 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c18b3f97-c22d-485d-8124-459452956c6c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:07.600648 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c18b3f97-c22d-485d-8124-459452956c6c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:07.601102 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c18b3f97-c22d-485d-8124-459452956c6c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:07.601535 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c18b3f97-c22d-485d-8124-459452956c6c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:07.731311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c18b3f97-c22d-485d-8124-459452956c6c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:07.733457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:53:07.740686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c18b3f97-c22d-485d-8124-459452956c6c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152433 Aug 24 12:53:07.741241 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1455/2908] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:07 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:07.974525 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4314ab75-189d-479e-9f16-502c68e09e94 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:07.975183 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4314ab75-189d-479e-9f16-502c68e09e94 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:07.981533 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4314ab75-189d-479e-9f16-502c68e09e94 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:07.982035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4314ab75-189d-479e-9f16-502c68e09e94 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:07.982465 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4314ab75-189d-479e-9f16-502c68e09e94 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:07.983161 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4314ab75-189d-479e-9f16-502c68e09e94 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:07.983599 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4314ab75-189d-479e-9f16-502c68e09e94 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:07.984012 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4314ab75-189d-479e-9f16-502c68e09e94 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:08.113181 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4314ab75-189d-479e-9f16-502c68e09e94 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:08.121776 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4314ab75-189d-479e-9f16-502c68e09e94 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151492 Aug 24 12:53:08.122328 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1454/2909] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:07 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:08.226164 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b67595cb-2a70-4340-8e1d-79c62ea503e2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:08.226801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b67595cb-2a70-4340-8e1d-79c62ea503e2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:08.232892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b67595cb-2a70-4340-8e1d-79c62ea503e2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:08.233364 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b67595cb-2a70-4340-8e1d-79c62ea503e2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:08.233796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b67595cb-2a70-4340-8e1d-79c62ea503e2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:08.234468 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b67595cb-2a70-4340-8e1d-79c62ea503e2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:08.234953 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b67595cb-2a70-4340-8e1d-79c62ea503e2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:08.235372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b67595cb-2a70-4340-8e1d-79c62ea503e2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:08.360636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b67595cb-2a70-4340-8e1d-79c62ea503e2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:08.369266 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b67595cb-2a70-4340-8e1d-79c62ea503e2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:08.370793 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b67595cb-2a70-4340-8e1d-79c62ea503e2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:08.371937 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b67595cb-2a70-4340-8e1d-79c62ea503e2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.150602 Aug 24 12:53:08.372484 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1456/2910] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:08 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:08.419858 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a49d2c0e-7452-4d81-b73d-f5ac8e1fc8c8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:08.420465 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a49d2c0e-7452-4d81-b73d-f5ac8e1fc8c8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:08.426471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a49d2c0e-7452-4d81-b73d-f5ac8e1fc8c8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:08.426993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a49d2c0e-7452-4d81-b73d-f5ac8e1fc8c8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:08.427424 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a49d2c0e-7452-4d81-b73d-f5ac8e1fc8c8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:08.428500 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a49d2c0e-7452-4d81-b73d-f5ac8e1fc8c8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:08.428612 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a49d2c0e-7452-4d81-b73d-f5ac8e1fc8c8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:08.428943 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a49d2c0e-7452-4d81-b73d-f5ac8e1fc8c8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:08.431531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:53:08.557310 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a49d2c0e-7452-4d81-b73d-f5ac8e1fc8c8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:08.565388 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a49d2c0e-7452-4d81-b73d-f5ac8e1fc8c8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149414 Aug 24 12:53:08.565956 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1455/2911] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:08 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:08.761547 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-37895105-d930-4bdf-b80d-5873c605c501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:08.762197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-37895105-d930-4bdf-b80d-5873c605c501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:08.768541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37895105-d930-4bdf-b80d-5873c605c501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:08.769020 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37895105-d930-4bdf-b80d-5873c605c501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:08.769457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37895105-d930-4bdf-b80d-5873c605c501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:08.770792 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37895105-d930-4bdf-b80d-5873c605c501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:08.771252 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37895105-d930-4bdf-b80d-5873c605c501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:08.771678 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37895105-d930-4bdf-b80d-5873c605c501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:08.898368 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-37895105-d930-4bdf-b80d-5873c605c501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:08.906854 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-37895105-d930-4bdf-b80d-5873c605c501 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149033 Aug 24 12:53:08.907611 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1457/2912] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:08 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:09.142519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e4acae88-42f0-400c-8675-52a738e0365f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:09.143099 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e4acae88-42f0-400c-8675-52a738e0365f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:09.149626 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4acae88-42f0-400c-8675-52a738e0365f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:09.150102 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4acae88-42f0-400c-8675-52a738e0365f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:09.150539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4acae88-42f0-400c-8675-52a738e0365f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:09.151249 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4acae88-42f0-400c-8675-52a738e0365f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:09.151699 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4acae88-42f0-400c-8675-52a738e0365f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:09.152121 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4acae88-42f0-400c-8675-52a738e0365f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:09.394520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9e098740-f37c-4a6f-aea6-6a47319be1c3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:09.395124 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9e098740-f37c-4a6f-aea6-6a47319be1c3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:09.400955 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e098740-f37c-4a6f-aea6-6a47319be1c3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:09.401434 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e098740-f37c-4a6f-aea6-6a47319be1c3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:09.401869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e098740-f37c-4a6f-aea6-6a47319be1c3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:09.402558 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e098740-f37c-4a6f-aea6-6a47319be1c3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:09.403068 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e098740-f37c-4a6f-aea6-6a47319be1c3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:09.403481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e098740-f37c-4a6f-aea6-6a47319be1c3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:09.409184 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e4acae88-42f0-400c-8675-52a738e0365f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:09.418405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e4acae88-42f0-400c-8675-52a738e0365f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.279724 Aug 24 12:53:09.419002 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1456/2913] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:09 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:09.548399 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9e098740-f37c-4a6f-aea6-6a47319be1c3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:09.557728 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9e098740-f37c-4a6f-aea6-6a47319be1c3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:09.559260 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9e098740-f37c-4a6f-aea6-6a47319be1c3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:09.560433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9e098740-f37c-4a6f-aea6-6a47319be1c3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.169902 Aug 24 12:53:09.561002 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1458/2914] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:09 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:09.586618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e36c4053-2503-43f1-bb1b-937f27c5f85e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:09.587257 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e36c4053-2503-43f1-bb1b-937f27c5f85e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:09.593167 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e36c4053-2503-43f1-bb1b-937f27c5f85e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:09.593638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e36c4053-2503-43f1-bb1b-937f27c5f85e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:09.594063 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e36c4053-2503-43f1-bb1b-937f27c5f85e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:09.594764 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e36c4053-2503-43f1-bb1b-937f27c5f85e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:09.595212 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e36c4053-2503-43f1-bb1b-937f27c5f85e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:09.595697 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e36c4053-2503-43f1-bb1b-937f27c5f85e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:09.728456 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e36c4053-2503-43f1-bb1b-937f27c5f85e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:09.736528 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e36c4053-2503-43f1-bb1b-937f27c5f85e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.153840 Aug 24 12:53:09.737351 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1457/2915] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:09 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:09.927424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-92a97c24-8529-4fc1-b0f5-1edb0b4289f4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:09.928036 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-92a97c24-8529-4fc1-b0f5-1edb0b4289f4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:09.934077 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92a97c24-8529-4fc1-b0f5-1edb0b4289f4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:09.934502 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92a97c24-8529-4fc1-b0f5-1edb0b4289f4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:09.934967 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92a97c24-8529-4fc1-b0f5-1edb0b4289f4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:09.935646 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92a97c24-8529-4fc1-b0f5-1edb0b4289f4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:09.936097 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92a97c24-8529-4fc1-b0f5-1edb0b4289f4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:09.936516 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92a97c24-8529-4fc1-b0f5-1edb0b4289f4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:10.063568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-92a97c24-8529-4fc1-b0f5-1edb0b4289f4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:10.072204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-92a97c24-8529-4fc1-b0f5-1edb0b4289f4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149173 Aug 24 12:53:10.072762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1459/2916] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:09 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:10.439757 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1a3fe289-be92-4c53-83e0-1ef18022cfde tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:10.440359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1a3fe289-be92-4c53-83e0-1ef18022cfde tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:10.446754 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1a3fe289-be92-4c53-83e0-1ef18022cfde tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:10.447229 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1a3fe289-be92-4c53-83e0-1ef18022cfde tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:10.447657 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1a3fe289-be92-4c53-83e0-1ef18022cfde tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:10.448327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1a3fe289-be92-4c53-83e0-1ef18022cfde tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:10.448771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1a3fe289-be92-4c53-83e0-1ef18022cfde tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:10.449189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1a3fe289-be92-4c53-83e0-1ef18022cfde tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:10.573967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1a3fe289-be92-4c53-83e0-1ef18022cfde tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:10.582120 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1a3fe289-be92-4c53-83e0-1ef18022cfde tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.146154 Aug 24 12:53:10.583214 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1458/2917] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:10 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:10.583785 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-52bcb03b-8c71-41fa-b9ad-ede00894a0f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:10.584481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-52bcb03b-8c71-41fa-b9ad-ede00894a0f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:10.590373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52bcb03b-8c71-41fa-b9ad-ede00894a0f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:10.590898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52bcb03b-8c71-41fa-b9ad-ede00894a0f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:10.591345 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52bcb03b-8c71-41fa-b9ad-ede00894a0f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:10.592039 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52bcb03b-8c71-41fa-b9ad-ede00894a0f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:10.592495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52bcb03b-8c71-41fa-b9ad-ede00894a0f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:10.592922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52bcb03b-8c71-41fa-b9ad-ede00894a0f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:10.729958 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-52bcb03b-8c71-41fa-b9ad-ede00894a0f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:10.738850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-52bcb03b-8c71-41fa-b9ad-ede00894a0f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:10.740358 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-52bcb03b-8c71-41fa-b9ad-ede00894a0f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:10.741513 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-52bcb03b-8c71-41fa-b9ad-ede00894a0f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.162113 Aug 24 12:53:10.742099 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1460/2918] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:10 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:53:10.757364 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-382e34ff-b1cf-4977-9a46-237b16c7cb7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:10.757970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-382e34ff-b1cf-4977-9a46-237b16c7cb7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:10.763965 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-382e34ff-b1cf-4977-9a46-237b16c7cb7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:10.764443 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-382e34ff-b1cf-4977-9a46-237b16c7cb7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:10.764877 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-382e34ff-b1cf-4977-9a46-237b16c7cb7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:10.765553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-382e34ff-b1cf-4977-9a46-237b16c7cb7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:10.766002 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-382e34ff-b1cf-4977-9a46-237b16c7cb7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:10.766425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-382e34ff-b1cf-4977-9a46-237b16c7cb7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:10.897225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-382e34ff-b1cf-4977-9a46-237b16c7cb7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:10.905319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-382e34ff-b1cf-4977-9a46-237b16c7cb7c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151769 Aug 24 12:53:10.905875 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1459/2919] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:10 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:11.092951 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6101d41f-be71-4bf0-acd1-bec9b1c93a75 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:11.093493 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6101d41f-be71-4bf0-acd1-bec9b1c93a75 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:11.100399 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6101d41f-be71-4bf0-acd1-bec9b1c93a75 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:11.100884 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6101d41f-be71-4bf0-acd1-bec9b1c93a75 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:11.101335 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6101d41f-be71-4bf0-acd1-bec9b1c93a75 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:11.102020 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6101d41f-be71-4bf0-acd1-bec9b1c93a75 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:11.102471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6101d41f-be71-4bf0-acd1-bec9b1c93a75 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:11.102925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6101d41f-be71-4bf0-acd1-bec9b1c93a75 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:11.228601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6101d41f-be71-4bf0-acd1-bec9b1c93a75 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:11.236687 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6101d41f-be71-4bf0-acd1-bec9b1c93a75 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.147679 Aug 24 12:53:11.237505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1461/2920] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:11 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:11.603603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4a245725-eb59-498d-ac46-a25273a74cfe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:11.604264 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4a245725-eb59-498d-ac46-a25273a74cfe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:11.610782 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a245725-eb59-498d-ac46-a25273a74cfe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:11.611282 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a245725-eb59-498d-ac46-a25273a74cfe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:11.611709 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a245725-eb59-498d-ac46-a25273a74cfe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:11.612670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a245725-eb59-498d-ac46-a25273a74cfe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:11.613121 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a245725-eb59-498d-ac46-a25273a74cfe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:11.613567 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a245725-eb59-498d-ac46-a25273a74cfe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:11.739326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4a245725-eb59-498d-ac46-a25273a74cfe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:11.747431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4a245725-eb59-498d-ac46-a25273a74cfe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.147610 Aug 24 12:53:11.747984 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1460/2921] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:11 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:11.763937 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-04fa906f-1a06-4984-a8bd-4ac30a1970f9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:11.764550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-04fa906f-1a06-4984-a8bd-4ac30a1970f9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:11.770967 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-04fa906f-1a06-4984-a8bd-4ac30a1970f9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:11.771450 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-04fa906f-1a06-4984-a8bd-4ac30a1970f9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:11.771887 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-04fa906f-1a06-4984-a8bd-4ac30a1970f9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:11.772569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-04fa906f-1a06-4984-a8bd-4ac30a1970f9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:11.773027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-04fa906f-1a06-4984-a8bd-4ac30a1970f9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:11.773452 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-04fa906f-1a06-4984-a8bd-4ac30a1970f9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:11.897976 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-04fa906f-1a06-4984-a8bd-4ac30a1970f9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:11.906420 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-04fa906f-1a06-4984-a8bd-4ac30a1970f9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:11.908016 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-04fa906f-1a06-4984-a8bd-4ac30a1970f9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:11.909173 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-04fa906f-1a06-4984-a8bd-4ac30a1970f9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.149065 Aug 24 12:53:11.909731 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1462/2922] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:11 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:11.925691 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-beb5bcbb-d850-4f50-bfbc-4f0b9cf1d45b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:11.926866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-beb5bcbb-d850-4f50-bfbc-4f0b9cf1d45b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:11.932719 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-beb5bcbb-d850-4f50-bfbc-4f0b9cf1d45b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:11.933195 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-beb5bcbb-d850-4f50-bfbc-4f0b9cf1d45b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:11.933625 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-beb5bcbb-d850-4f50-bfbc-4f0b9cf1d45b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:11.934297 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-beb5bcbb-d850-4f50-bfbc-4f0b9cf1d45b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:11.934771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-beb5bcbb-d850-4f50-bfbc-4f0b9cf1d45b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:11.935190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-beb5bcbb-d850-4f50-bfbc-4f0b9cf1d45b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:12.063817 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-beb5bcbb-d850-4f50-bfbc-4f0b9cf1d45b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:12.073022 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-beb5bcbb-d850-4f50-bfbc-4f0b9cf1d45b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151004 Aug 24 12:53:12.073652 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1461/2923] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:11 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:12.265238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d65ea32c-0f3d-44e6-8173-759288fb9152 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:12.265847 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d65ea32c-0f3d-44e6-8173-759288fb9152 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:12.272221 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d65ea32c-0f3d-44e6-8173-759288fb9152 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:12.272712 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d65ea32c-0f3d-44e6-8173-759288fb9152 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:12.273146 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d65ea32c-0f3d-44e6-8173-759288fb9152 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:12.273835 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d65ea32c-0f3d-44e6-8173-759288fb9152 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:12.274288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d65ea32c-0f3d-44e6-8173-759288fb9152 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:12.274740 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d65ea32c-0f3d-44e6-8173-759288fb9152 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:12.404788 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d65ea32c-0f3d-44e6-8173-759288fb9152 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:12.413576 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d65ea32c-0f3d-44e6-8173-759288fb9152 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.159841 Aug 24 12:53:12.414141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1463/2924] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:12 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:12.768847 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f922e456-12fd-4fc0-8669-5c92b28412ec tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:12.769458 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f922e456-12fd-4fc0-8669-5c92b28412ec tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:12.775822 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f922e456-12fd-4fc0-8669-5c92b28412ec tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:12.776327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f922e456-12fd-4fc0-8669-5c92b28412ec tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:12.776758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f922e456-12fd-4fc0-8669-5c92b28412ec tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:12.777431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f922e456-12fd-4fc0-8669-5c92b28412ec tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:12.777913 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f922e456-12fd-4fc0-8669-5c92b28412ec tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:12.778335 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f922e456-12fd-4fc0-8669-5c92b28412ec tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:12.904727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f922e456-12fd-4fc0-8669-5c92b28412ec tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:12.912893 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f922e456-12fd-4fc0-8669-5c92b28412ec tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.147884 Aug 24 12:53:12.913457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1462/2925] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:12 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:12.931693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b7e45b64-ffb6-46f2-a500-130c402be987 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:12.932386 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b7e45b64-ffb6-46f2-a500-130c402be987 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:12.938394 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7e45b64-ffb6-46f2-a500-130c402be987 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:12.938927 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7e45b64-ffb6-46f2-a500-130c402be987 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:12.939359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7e45b64-ffb6-46f2-a500-130c402be987 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:12.940038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7e45b64-ffb6-46f2-a500-130c402be987 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:12.940485 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7e45b64-ffb6-46f2-a500-130c402be987 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:12.940902 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7e45b64-ffb6-46f2-a500-130c402be987 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:13.065346 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b7e45b64-ffb6-46f2-a500-130c402be987 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:13.074443 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b7e45b64-ffb6-46f2-a500-130c402be987 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:13.075968 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b7e45b64-ffb6-46f2-a500-130c402be987 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:13.077149 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b7e45b64-ffb6-46f2-a500-130c402be987 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.149322 Aug 24 12:53:13.077702 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1464/2926] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:12 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:13.093032 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ffc2a35e-3eff-4adf-8f85-7a3b07272ab8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:13.093698 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ffc2a35e-3eff-4adf-8f85-7a3b07272ab8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:13.100161 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ffc2a35e-3eff-4adf-8f85-7a3b07272ab8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:13.100645 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ffc2a35e-3eff-4adf-8f85-7a3b07272ab8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:13.101153 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ffc2a35e-3eff-4adf-8f85-7a3b07272ab8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:13.101842 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ffc2a35e-3eff-4adf-8f85-7a3b07272ab8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:13.102293 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ffc2a35e-3eff-4adf-8f85-7a3b07272ab8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:13.102753 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ffc2a35e-3eff-4adf-8f85-7a3b07272ab8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:13.227817 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ffc2a35e-3eff-4adf-8f85-7a3b07272ab8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:13.235948 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ffc2a35e-3eff-4adf-8f85-7a3b07272ab8 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.146674 Aug 24 12:53:13.236497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1463/2927] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:13 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:13.435173 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-07ac10d5-44bb-45c8-9149-8b7bd1bd16cd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:13.435780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-07ac10d5-44bb-45c8-9149-8b7bd1bd16cd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:13.442107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-07ac10d5-44bb-45c8-9149-8b7bd1bd16cd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:13.442583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-07ac10d5-44bb-45c8-9149-8b7bd1bd16cd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:13.443054 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-07ac10d5-44bb-45c8-9149-8b7bd1bd16cd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:13.443728 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-07ac10d5-44bb-45c8-9149-8b7bd1bd16cd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:13.444208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-07ac10d5-44bb-45c8-9149-8b7bd1bd16cd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:13.444627 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-07ac10d5-44bb-45c8-9149-8b7bd1bd16cd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:13.574222 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-07ac10d5-44bb-45c8-9149-8b7bd1bd16cd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:13.582957 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-07ac10d5-44bb-45c8-9149-8b7bd1bd16cd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151119 Aug 24 12:53:13.583511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1465/2928] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:13 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:13.933652 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c099f7f4-7341-4c3b-ace3-80aac7bf556e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:13.934241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c099f7f4-7341-4c3b-ace3-80aac7bf556e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:13.940593 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c099f7f4-7341-4c3b-ace3-80aac7bf556e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:13.941073 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c099f7f4-7341-4c3b-ace3-80aac7bf556e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:13.941511 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c099f7f4-7341-4c3b-ace3-80aac7bf556e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:13.942721 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c099f7f4-7341-4c3b-ace3-80aac7bf556e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:13.943177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c099f7f4-7341-4c3b-ace3-80aac7bf556e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:13.943597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c099f7f4-7341-4c3b-ace3-80aac7bf556e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:14.071932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c099f7f4-7341-4c3b-ace3-80aac7bf556e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:14.079949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c099f7f4-7341-4c3b-ace3-80aac7bf556e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150172 Aug 24 12:53:14.080507 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1464/2929] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:13 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:14.099849 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f4baaa4e-40ba-4cb2-897b-dc3cfc7ff7c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:14.100453 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f4baaa4e-40ba-4cb2-897b-dc3cfc7ff7c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:14.102274 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:53:14.106885 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4baaa4e-40ba-4cb2-897b-dc3cfc7ff7c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:14.107362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4baaa4e-40ba-4cb2-897b-dc3cfc7ff7c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:14.107791 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4baaa4e-40ba-4cb2-897b-dc3cfc7ff7c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:14.108460 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4baaa4e-40ba-4cb2-897b-dc3cfc7ff7c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:14.108910 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4baaa4e-40ba-4cb2-897b-dc3cfc7ff7c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:14.109329 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4baaa4e-40ba-4cb2-897b-dc3cfc7ff7c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:14.237864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f4baaa4e-40ba-4cb2-897b-dc3cfc7ff7c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:14.247086 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f4baaa4e-40ba-4cb2-897b-dc3cfc7ff7c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:14.248582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f4baaa4e-40ba-4cb2-897b-dc3cfc7ff7c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:14.249742 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f4baaa4e-40ba-4cb2-897b-dc3cfc7ff7c8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.153831 Aug 24 12:53:14.250302 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1466/2930] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:14 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:14.257878 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d0a4c60c-8790-414b-be33-2ce833b67115 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:14.258511 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d0a4c60c-8790-414b-be33-2ce833b67115 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:14.264397 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0a4c60c-8790-414b-be33-2ce833b67115 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:14.264885 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0a4c60c-8790-414b-be33-2ce833b67115 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:14.265329 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0a4c60c-8790-414b-be33-2ce833b67115 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:14.265996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0a4c60c-8790-414b-be33-2ce833b67115 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:14.266448 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0a4c60c-8790-414b-be33-2ce833b67115 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:14.266891 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d0a4c60c-8790-414b-be33-2ce833b67115 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:14.392261 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d0a4c60c-8790-414b-be33-2ce833b67115 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:14.400400 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d0a4c60c-8790-414b-be33-2ce833b67115 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.146993 Aug 24 12:53:14.400961 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1465/2931] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:14 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:14.603572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-52f0b391-817d-4a1c-9f82-35395ec1fdb4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:14.604190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-52f0b391-817d-4a1c-9f82-35395ec1fdb4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:14.610572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52f0b391-817d-4a1c-9f82-35395ec1fdb4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:14.611099 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52f0b391-817d-4a1c-9f82-35395ec1fdb4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:14.611538 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52f0b391-817d-4a1c-9f82-35395ec1fdb4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:14.612486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52f0b391-817d-4a1c-9f82-35395ec1fdb4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:14.612947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52f0b391-817d-4a1c-9f82-35395ec1fdb4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:14.613377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52f0b391-817d-4a1c-9f82-35395ec1fdb4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:14.742772 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-52f0b391-817d-4a1c-9f82-35395ec1fdb4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:14.758259 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-52f0b391-817d-4a1c-9f82-35395ec1fdb4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.158493 Aug 24 12:53:14.758901 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1467/2932] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:14 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:15.102278 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d680f579-8ce8-4283-b582-faa9f85f4bad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:15.102933 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d680f579-8ce8-4283-b582-faa9f85f4bad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:15.109475 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d680f579-8ce8-4283-b582-faa9f85f4bad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:15.109960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d680f579-8ce8-4283-b582-faa9f85f4bad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:15.110401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d680f579-8ce8-4283-b582-faa9f85f4bad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:15.111199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d680f579-8ce8-4283-b582-faa9f85f4bad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:15.111659 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d680f579-8ce8-4283-b582-faa9f85f4bad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:15.112353 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d680f579-8ce8-4283-b582-faa9f85f4bad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:15.243370 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d680f579-8ce8-4283-b582-faa9f85f4bad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:15.251667 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d680f579-8ce8-4283-b582-faa9f85f4bad tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.153906 Aug 24 12:53:15.252234 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1466/2933] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:15 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:15.273723 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8a1b4f72-56cf-451a-a1c2-27ae5b22f72f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:15.274337 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8a1b4f72-56cf-451a-a1c2-27ae5b22f72f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:15.280386 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8a1b4f72-56cf-451a-a1c2-27ae5b22f72f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:15.280872 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8a1b4f72-56cf-451a-a1c2-27ae5b22f72f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:15.281310 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8a1b4f72-56cf-451a-a1c2-27ae5b22f72f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:15.281994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8a1b4f72-56cf-451a-a1c2-27ae5b22f72f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:15.282450 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8a1b4f72-56cf-451a-a1c2-27ae5b22f72f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:15.282903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8a1b4f72-56cf-451a-a1c2-27ae5b22f72f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:15.411512 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8a1b4f72-56cf-451a-a1c2-27ae5b22f72f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:15.420929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c0da4f71-7a42-4f48-8b8a-61ad6157af90 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:15.421534 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c0da4f71-7a42-4f48-8b8a-61ad6157af90 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:15.426378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8a1b4f72-56cf-451a-a1c2-27ae5b22f72f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:15.426378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8a1b4f72-56cf-451a-a1c2-27ae5b22f72f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:15.426378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8a1b4f72-56cf-451a-a1c2-27ae5b22f72f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.156765 Aug 24 12:53:15.427669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1468/2934] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:15 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:15.430236 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0da4f71-7a42-4f48-8b8a-61ad6157af90 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:15.430759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0da4f71-7a42-4f48-8b8a-61ad6157af90 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:15.431194 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0da4f71-7a42-4f48-8b8a-61ad6157af90 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:15.431983 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0da4f71-7a42-4f48-8b8a-61ad6157af90 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:15.432348 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0da4f71-7a42-4f48-8b8a-61ad6157af90 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:15.432766 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0da4f71-7a42-4f48-8b8a-61ad6157af90 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:15.559181 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c0da4f71-7a42-4f48-8b8a-61ad6157af90 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:15.567642 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c0da4f71-7a42-4f48-8b8a-61ad6157af90 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150502 Aug 24 12:53:15.568194 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1467/2935] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:15 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:15.831793 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-273aa11f-6cad-4baa-b113-7a8e2cdd7af1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:15.832302 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-273aa11f-6cad-4baa-b113-7a8e2cdd7af1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:15.838552 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-273aa11f-6cad-4baa-b113-7a8e2cdd7af1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:15.839112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-273aa11f-6cad-4baa-b113-7a8e2cdd7af1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:15.839544 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-273aa11f-6cad-4baa-b113-7a8e2cdd7af1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:15.840217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-273aa11f-6cad-4baa-b113-7a8e2cdd7af1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:15.840673 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-273aa11f-6cad-4baa-b113-7a8e2cdd7af1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:15.841092 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-273aa11f-6cad-4baa-b113-7a8e2cdd7af1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:15.967304 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-273aa11f-6cad-4baa-b113-7a8e2cdd7af1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:15.975974 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-273aa11f-6cad-4baa-b113-7a8e2cdd7af1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148112 Aug 24 12:53:15.984553 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1469/2936] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:15 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:16.273023 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6d21ecf8-634e-41b6-bff7-d75e5e0e7192 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:16.273639 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6d21ecf8-634e-41b6-bff7-d75e5e0e7192 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:16.279743 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d21ecf8-634e-41b6-bff7-d75e5e0e7192 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:16.280230 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d21ecf8-634e-41b6-bff7-d75e5e0e7192 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:16.280667 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d21ecf8-634e-41b6-bff7-d75e5e0e7192 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:16.281350 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d21ecf8-634e-41b6-bff7-d75e5e0e7192 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:16.281805 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d21ecf8-634e-41b6-bff7-d75e5e0e7192 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:16.282231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d21ecf8-634e-41b6-bff7-d75e5e0e7192 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:16.413303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6d21ecf8-634e-41b6-bff7-d75e5e0e7192 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:16.421422 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6d21ecf8-634e-41b6-bff7-d75e5e0e7192 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152907 Aug 24 12:53:16.421986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1468/2937] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:16 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:16.450556 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6e87c74c-ff25-4b45-acd3-ae93b8862823 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:16.451205 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6e87c74c-ff25-4b45-acd3-ae93b8862823 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:16.457094 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e87c74c-ff25-4b45-acd3-ae93b8862823 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:16.457579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e87c74c-ff25-4b45-acd3-ae93b8862823 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:16.458018 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e87c74c-ff25-4b45-acd3-ae93b8862823 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:16.458729 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e87c74c-ff25-4b45-acd3-ae93b8862823 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:16.459190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e87c74c-ff25-4b45-acd3-ae93b8862823 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:16.459621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e87c74c-ff25-4b45-acd3-ae93b8862823 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:16.588125 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-dd7820ae-cbe1-4184-8ba1-f9ea21313f04 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:16.588730 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-dd7820ae-cbe1-4184-8ba1-f9ea21313f04 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:16.594860 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd7820ae-cbe1-4184-8ba1-f9ea21313f04 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:16.595343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd7820ae-cbe1-4184-8ba1-f9ea21313f04 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:16.595777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd7820ae-cbe1-4184-8ba1-f9ea21313f04 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:16.596466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd7820ae-cbe1-4184-8ba1-f9ea21313f04 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:16.596909 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd7820ae-cbe1-4184-8ba1-f9ea21313f04 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:16.597327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd7820ae-cbe1-4184-8ba1-f9ea21313f04 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:16.638143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6e87c74c-ff25-4b45-acd3-ae93b8862823 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:16.647040 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6e87c74c-ff25-4b45-acd3-ae93b8862823 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:16.648526 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6e87c74c-ff25-4b45-acd3-ae93b8862823 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:16.649704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6e87c74c-ff25-4b45-acd3-ae93b8862823 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.203028 Aug 24 12:53:16.650263 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1470/2938] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:16 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:16.729353 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-dd7820ae-cbe1-4184-8ba1-f9ea21313f04 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:16.737911 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-dd7820ae-cbe1-4184-8ba1-f9ea21313f04 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.153545 Aug 24 12:53:16.739027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1469/2939] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:16 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:17.003770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-13a681b7-c1ce-461e-a044-d2fad96ca8ee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:17.004381 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-13a681b7-c1ce-461e-a044-d2fad96ca8ee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:17.010834 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13a681b7-c1ce-461e-a044-d2fad96ca8ee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:17.011319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13a681b7-c1ce-461e-a044-d2fad96ca8ee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:17.011829 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13a681b7-c1ce-461e-a044-d2fad96ca8ee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:17.012517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13a681b7-c1ce-461e-a044-d2fad96ca8ee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:17.012973 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13a681b7-c1ce-461e-a044-d2fad96ca8ee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:17.013403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13a681b7-c1ce-461e-a044-d2fad96ca8ee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:17.140372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-13a681b7-c1ce-461e-a044-d2fad96ca8ee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:17.148659 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-13a681b7-c1ce-461e-a044-d2fad96ca8ee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148735 Aug 24 12:53:17.149226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1471/2940] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:16 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:17.443819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6ea83f75-81b4-4347-b87c-70ee0649dba4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:17.444431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6ea83f75-81b4-4347-b87c-70ee0649dba4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:17.450841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6ea83f75-81b4-4347-b87c-70ee0649dba4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:17.451319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6ea83f75-81b4-4347-b87c-70ee0649dba4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:17.451753 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6ea83f75-81b4-4347-b87c-70ee0649dba4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:17.452432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6ea83f75-81b4-4347-b87c-70ee0649dba4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:17.452878 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6ea83f75-81b4-4347-b87c-70ee0649dba4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:17.453300 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6ea83f75-81b4-4347-b87c-70ee0649dba4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:17.642134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6ea83f75-81b4-4347-b87c-70ee0649dba4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:17.650282 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6ea83f75-81b4-4347-b87c-70ee0649dba4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.210977 Aug 24 12:53:17.650869 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1470/2941] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:17 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:17.672486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7ffa4e51-02e2-4b60-9c84-54adb2580405 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:17.673038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7ffa4e51-02e2-4b60-9c84-54adb2580405 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:17.679512 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7ffa4e51-02e2-4b60-9c84-54adb2580405 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:17.679994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7ffa4e51-02e2-4b60-9c84-54adb2580405 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:17.680434 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7ffa4e51-02e2-4b60-9c84-54adb2580405 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:17.681117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7ffa4e51-02e2-4b60-9c84-54adb2580405 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:17.681576 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7ffa4e51-02e2-4b60-9c84-54adb2580405 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:17.682006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7ffa4e51-02e2-4b60-9c84-54adb2580405 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:17.696195 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:53:17.765242 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-287ae1dc-566c-4982-a910-22e746402375 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:17.765883 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-287ae1dc-566c-4982-a910-22e746402375 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:17.771921 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-287ae1dc-566c-4982-a910-22e746402375 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:17.772399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-287ae1dc-566c-4982-a910-22e746402375 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:17.772836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-287ae1dc-566c-4982-a910-22e746402375 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:17.773524 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-287ae1dc-566c-4982-a910-22e746402375 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:17.773973 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-287ae1dc-566c-4982-a910-22e746402375 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:17.774395 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-287ae1dc-566c-4982-a910-22e746402375 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:17.810913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7ffa4e51-02e2-4b60-9c84-54adb2580405 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:17.819967 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7ffa4e51-02e2-4b60-9c84-54adb2580405 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:17.821457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7ffa4e51-02e2-4b60-9c84-54adb2580405 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:17.823054 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7ffa4e51-02e2-4b60-9c84-54adb2580405 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154195 Aug 24 12:53:17.823610 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1472/2942] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:17 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:17.902787 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-287ae1dc-566c-4982-a910-22e746402375 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:17.904985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:53:17.911966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-287ae1dc-566c-4982-a910-22e746402375 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150609 Aug 24 12:53:17.914602 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1471/2943] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:17 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:18.169168 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-26d7ab24-1141-4713-a72e-3d82208ae9ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:18.169778 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-26d7ab24-1141-4713-a72e-3d82208ae9ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:18.176149 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-26d7ab24-1141-4713-a72e-3d82208ae9ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:18.176637 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-26d7ab24-1141-4713-a72e-3d82208ae9ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:18.177073 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-26d7ab24-1141-4713-a72e-3d82208ae9ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:18.177762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-26d7ab24-1141-4713-a72e-3d82208ae9ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:18.178218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-26d7ab24-1141-4713-a72e-3d82208ae9ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:18.178639 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-26d7ab24-1141-4713-a72e-3d82208ae9ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:18.304741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-26d7ab24-1141-4713-a72e-3d82208ae9ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:18.312934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-26d7ab24-1141-4713-a72e-3d82208ae9ae tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.147592 Aug 24 12:53:18.313496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1473/2944] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:18 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:18.671902 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-20027b0b-75f7-48cd-b6b4-20a88c3d27cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:18.672503 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-20027b0b-75f7-48cd-b6b4-20a88c3d27cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:18.679598 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20027b0b-75f7-48cd-b6b4-20a88c3d27cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:18.680011 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20027b0b-75f7-48cd-b6b4-20a88c3d27cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:18.680439 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20027b0b-75f7-48cd-b6b4-20a88c3d27cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:18.681108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20027b0b-75f7-48cd-b6b4-20a88c3d27cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:18.681553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20027b0b-75f7-48cd-b6b4-20a88c3d27cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:18.681973 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20027b0b-75f7-48cd-b6b4-20a88c3d27cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:18.807968 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-20027b0b-75f7-48cd-b6b4-20a88c3d27cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:18.816123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-20027b0b-75f7-48cd-b6b4-20a88c3d27cd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.148365 Aug 24 12:53:18.817359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1472/2945] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:18 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:18.845387 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-506ac440-5026-4326-b51f-1949de80da6c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:18.846023 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-506ac440-5026-4326-b51f-1949de80da6c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:18.852562 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-506ac440-5026-4326-b51f-1949de80da6c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:18.853056 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-506ac440-5026-4326-b51f-1949de80da6c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:18.858117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-506ac440-5026-4326-b51f-1949de80da6c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:18.858117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-506ac440-5026-4326-b51f-1949de80da6c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:18.858117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-506ac440-5026-4326-b51f-1949de80da6c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:18.858117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-506ac440-5026-4326-b51f-1949de80da6c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:18.933368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bd662a95-8a65-4832-bfe0-5ce4490ed255 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:18.933887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-bd662a95-8a65-4832-bfe0-5ce4490ed255 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:18.939785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd662a95-8a65-4832-bfe0-5ce4490ed255 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:18.940262 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd662a95-8a65-4832-bfe0-5ce4490ed255 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:18.940693 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd662a95-8a65-4832-bfe0-5ce4490ed255 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:18.941394 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd662a95-8a65-4832-bfe0-5ce4490ed255 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:18.942473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd662a95-8a65-4832-bfe0-5ce4490ed255 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:18.942949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd662a95-8a65-4832-bfe0-5ce4490ed255 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:18.986730 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-506ac440-5026-4326-b51f-1949de80da6c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:18.996117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-506ac440-5026-4326-b51f-1949de80da6c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:18.997600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-506ac440-5026-4326-b51f-1949de80da6c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:18.998779 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-506ac440-5026-4326-b51f-1949de80da6c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.157282 Aug 24 12:53:18.999324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1474/2946] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:18 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:19.073285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-bd662a95-8a65-4832-bfe0-5ce4490ed255 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:19.081296 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bd662a95-8a65-4832-bfe0-5ce4490ed255 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151985 Aug 24 12:53:19.081857 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1473/2947] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:18 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:19.241402 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:53:19.241656 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 12:53:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:53:19.333891 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5aad239f-4777-47c7-9bf0-f234b2fca56c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:19.334525 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5aad239f-4777-47c7-9bf0-f234b2fca56c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:19.340834 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5aad239f-4777-47c7-9bf0-f234b2fca56c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:19.341317 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5aad239f-4777-47c7-9bf0-f234b2fca56c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:19.341747 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5aad239f-4777-47c7-9bf0-f234b2fca56c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:19.342424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5aad239f-4777-47c7-9bf0-f234b2fca56c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:19.342908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5aad239f-4777-47c7-9bf0-f234b2fca56c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:19.343325 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5aad239f-4777-47c7-9bf0-f234b2fca56c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:19.481057 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5aad239f-4777-47c7-9bf0-f234b2fca56c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:19.489555 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5aad239f-4777-47c7-9bf0-f234b2fca56c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.159472 Aug 24 12:53:19.490098 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1475/2948] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:19 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:19.837960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-910eac25-300f-455e-918c-2d6b6d23e1ab tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:19.838561 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-910eac25-300f-455e-918c-2d6b6d23e1ab tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:19.840957 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:53:19.845522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-910eac25-300f-455e-918c-2d6b6d23e1ab tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:19.845995 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-910eac25-300f-455e-918c-2d6b6d23e1ab tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:19.846423 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-910eac25-300f-455e-918c-2d6b6d23e1ab tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:19.847118 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-910eac25-300f-455e-918c-2d6b6d23e1ab tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:19.847564 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-910eac25-300f-455e-918c-2d6b6d23e1ab tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:19.847981 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-910eac25-300f-455e-918c-2d6b6d23e1ab tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:19.974905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-910eac25-300f-455e-918c-2d6b6d23e1ab tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:19.983179 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-910eac25-300f-455e-918c-2d6b6d23e1ab tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.148991 Aug 24 12:53:19.983736 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1474/2949] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:19 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:20.021809 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f5b2d5fb-7cd7-486e-b75f-a6993099b5c3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:20.022413 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f5b2d5fb-7cd7-486e-b75f-a6993099b5c3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:20.028267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f5b2d5fb-7cd7-486e-b75f-a6993099b5c3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:20.028759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f5b2d5fb-7cd7-486e-b75f-a6993099b5c3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:20.029183 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f5b2d5fb-7cd7-486e-b75f-a6993099b5c3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:20.029854 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f5b2d5fb-7cd7-486e-b75f-a6993099b5c3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:20.030303 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f5b2d5fb-7cd7-486e-b75f-a6993099b5c3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:20.030748 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f5b2d5fb-7cd7-486e-b75f-a6993099b5c3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:20.101498 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b9d498b7-b636-4bb7-8f3d-3d018862564d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:20.102023 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b9d498b7-b636-4bb7-8f3d-3d018862564d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:20.107864 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b9d498b7-b636-4bb7-8f3d-3d018862564d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:20.108343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b9d498b7-b636-4bb7-8f3d-3d018862564d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:20.108775 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b9d498b7-b636-4bb7-8f3d-3d018862564d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:20.109453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b9d498b7-b636-4bb7-8f3d-3d018862564d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:20.109903 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b9d498b7-b636-4bb7-8f3d-3d018862564d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:20.110322 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b9d498b7-b636-4bb7-8f3d-3d018862564d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:20.157691 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f5b2d5fb-7cd7-486e-b75f-a6993099b5c3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:20.166395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f5b2d5fb-7cd7-486e-b75f-a6993099b5c3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:20.167930 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f5b2d5fb-7cd7-486e-b75f-a6993099b5c3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:20.169097 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f5b2d5fb-7cd7-486e-b75f-a6993099b5c3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.151782 Aug 24 12:53:20.169646 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1476/2950] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:20 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:20.241465 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b9d498b7-b636-4bb7-8f3d-3d018862564d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:20.252149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b9d498b7-b636-4bb7-8f3d-3d018862564d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.154052 Aug 24 12:53:20.252772 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1475/2951] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:20 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:20.509818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fa1ede0b-6bef-4140-9a07-e605edd10da5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:20.510421 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fa1ede0b-6bef-4140-9a07-e605edd10da5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:20.516692 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa1ede0b-6bef-4140-9a07-e605edd10da5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:20.517170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa1ede0b-6bef-4140-9a07-e605edd10da5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:20.517604 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa1ede0b-6bef-4140-9a07-e605edd10da5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:20.518279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa1ede0b-6bef-4140-9a07-e605edd10da5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:20.518757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa1ede0b-6bef-4140-9a07-e605edd10da5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:20.519179 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa1ede0b-6bef-4140-9a07-e605edd10da5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:20.649896 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fa1ede0b-6bef-4140-9a07-e605edd10da5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:20.657928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fa1ede0b-6bef-4140-9a07-e605edd10da5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151969 Aug 24 12:53:20.658485 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1477/2952] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:20 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:21.004227 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6df21c35-fe8d-4c66-9a97-177783829c0c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:21.004833 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6df21c35-fe8d-4c66-9a97-177783829c0c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:21.011188 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6df21c35-fe8d-4c66-9a97-177783829c0c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:21.011659 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6df21c35-fe8d-4c66-9a97-177783829c0c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:21.012085 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6df21c35-fe8d-4c66-9a97-177783829c0c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:21.012751 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6df21c35-fe8d-4c66-9a97-177783829c0c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:21.013193 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6df21c35-fe8d-4c66-9a97-177783829c0c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:21.013609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6df21c35-fe8d-4c66-9a97-177783829c0c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:21.142014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6df21c35-fe8d-4c66-9a97-177783829c0c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:21.150925 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6df21c35-fe8d-4c66-9a97-177783829c0c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150512 Aug 24 12:53:21.151621 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1476/2953] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:20 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:21.192738 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-69eff8d4-7ea2-4c42-a627-09f99638f3bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:21.193638 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-69eff8d4-7ea2-4c42-a627-09f99638f3bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:21.199805 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-69eff8d4-7ea2-4c42-a627-09f99638f3bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:21.200284 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-69eff8d4-7ea2-4c42-a627-09f99638f3bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:21.200717 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-69eff8d4-7ea2-4c42-a627-09f99638f3bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:21.201391 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-69eff8d4-7ea2-4c42-a627-09f99638f3bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:21.201842 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-69eff8d4-7ea2-4c42-a627-09f99638f3bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:21.202260 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-69eff8d4-7ea2-4c42-a627-09f99638f3bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:21.273833 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3dc43129-2155-496e-86d4-d8eac549beba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:21.274555 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3dc43129-2155-496e-86d4-d8eac549beba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:21.280299 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3dc43129-2155-496e-86d4-d8eac549beba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:21.280770 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3dc43129-2155-496e-86d4-d8eac549beba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:21.281198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3dc43129-2155-496e-86d4-d8eac549beba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:21.281869 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3dc43129-2155-496e-86d4-d8eac549beba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:21.282812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3dc43129-2155-496e-86d4-d8eac549beba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:21.282812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3dc43129-2155-496e-86d4-d8eac549beba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:21.336091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-69eff8d4-7ea2-4c42-a627-09f99638f3bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:21.344633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-69eff8d4-7ea2-4c42-a627-09f99638f3bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:21.346099 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-69eff8d4-7ea2-4c42-a627-09f99638f3bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:21.347288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-69eff8d4-7ea2-4c42-a627-09f99638f3bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.158674 Aug 24 12:53:21.347872 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1478/2954] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:21 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:21.410641 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3dc43129-2155-496e-86d4-d8eac549beba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:21.418892 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3dc43129-2155-496e-86d4-d8eac549beba tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149424 Aug 24 12:53:21.419453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1477/2955] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:21 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:21.679640 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-468ee192-62d7-47d2-8ac5-e7b08fcb6eb4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:21.680246 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-468ee192-62d7-47d2-8ac5-e7b08fcb6eb4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:21.686520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-468ee192-62d7-47d2-8ac5-e7b08fcb6eb4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:21.694720 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-468ee192-62d7-47d2-8ac5-e7b08fcb6eb4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:21.694720 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-468ee192-62d7-47d2-8ac5-e7b08fcb6eb4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:21.694720 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-468ee192-62d7-47d2-8ac5-e7b08fcb6eb4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:21.694720 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-468ee192-62d7-47d2-8ac5-e7b08fcb6eb4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:21.695150 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-468ee192-62d7-47d2-8ac5-e7b08fcb6eb4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:21.817826 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-468ee192-62d7-47d2-8ac5-e7b08fcb6eb4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:21.825906 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-468ee192-62d7-47d2-8ac5-e7b08fcb6eb4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150630 Aug 24 12:53:21.826458 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1479/2956] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:21 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:22.173097 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0d762e7c-3834-49c8-aae3-b4f8c8043012 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:22.173642 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0d762e7c-3834-49c8-aae3-b4f8c8043012 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:22.180745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d762e7c-3834-49c8-aae3-b4f8c8043012 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:22.181223 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d762e7c-3834-49c8-aae3-b4f8c8043012 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:22.181658 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d762e7c-3834-49c8-aae3-b4f8c8043012 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:22.182334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d762e7c-3834-49c8-aae3-b4f8c8043012 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:22.182819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d762e7c-3834-49c8-aae3-b4f8c8043012 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:22.183244 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0d762e7c-3834-49c8-aae3-b4f8c8043012 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:22.313505 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0d762e7c-3834-49c8-aae3-b4f8c8043012 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:22.321627 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0d762e7c-3834-49c8-aae3-b4f8c8043012 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152429 Aug 24 12:53:22.322181 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1478/2957] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:22 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:22.370405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-66bc5611-52f6-482b-abe7-2108cac4cc24 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:22.371034 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-66bc5611-52f6-482b-abe7-2108cac4cc24 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:22.376871 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-66bc5611-52f6-482b-abe7-2108cac4cc24 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:22.377346 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-66bc5611-52f6-482b-abe7-2108cac4cc24 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:22.377778 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-66bc5611-52f6-482b-abe7-2108cac4cc24 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:22.378451 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-66bc5611-52f6-482b-abe7-2108cac4cc24 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:22.378963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-66bc5611-52f6-482b-abe7-2108cac4cc24 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:22.379382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-66bc5611-52f6-482b-abe7-2108cac4cc24 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:22.439201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b754743d-9581-4e10-ae9b-53520d7b3db0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:22.439839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b754743d-9581-4e10-ae9b-53520d7b3db0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:22.445630 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b754743d-9581-4e10-ae9b-53520d7b3db0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:22.446115 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b754743d-9581-4e10-ae9b-53520d7b3db0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:22.446543 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b754743d-9581-4e10-ae9b-53520d7b3db0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:22.447247 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b754743d-9581-4e10-ae9b-53520d7b3db0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:22.447694 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b754743d-9581-4e10-ae9b-53520d7b3db0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:22.448111 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b754743d-9581-4e10-ae9b-53520d7b3db0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:22.508524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-66bc5611-52f6-482b-abe7-2108cac4cc24 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:22.518782 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-66bc5611-52f6-482b-abe7-2108cac4cc24 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:22.520814 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-66bc5611-52f6-482b-abe7-2108cac4cc24 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:22.521999 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-66bc5611-52f6-482b-abe7-2108cac4cc24 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155475 Aug 24 12:53:22.522542 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1480/2958] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:22 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:22.578034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b754743d-9581-4e10-ae9b-53520d7b3db0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:22.586661 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b754743d-9581-4e10-ae9b-53520d7b3db0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151282 Aug 24 12:53:22.587242 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1479/2959] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:22 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:22.846769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6fda5e43-cba3-47ca-b782-e9e66c2c7a18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:22.847374 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6fda5e43-cba3-47ca-b782-e9e66c2c7a18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:22.853647 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6fda5e43-cba3-47ca-b782-e9e66c2c7a18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:22.854125 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6fda5e43-cba3-47ca-b782-e9e66c2c7a18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:22.854558 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6fda5e43-cba3-47ca-b782-e9e66c2c7a18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:22.855270 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6fda5e43-cba3-47ca-b782-e9e66c2c7a18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:22.855721 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6fda5e43-cba3-47ca-b782-e9e66c2c7a18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:22.856144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6fda5e43-cba3-47ca-b782-e9e66c2c7a18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:22.981413 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6fda5e43-cba3-47ca-b782-e9e66c2c7a18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:22.989962 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6fda5e43-cba3-47ca-b782-e9e66c2c7a18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.147033 Aug 24 12:53:22.990514 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1481/2960] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:22 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:23.032778 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:53:23.032939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 12:53:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:53:23.342422 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-eed6d2b2-2e14-4fed-b3b6-5c85a80e7a9a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:23.343115 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-eed6d2b2-2e14-4fed-b3b6-5c85a80e7a9a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:23.349485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eed6d2b2-2e14-4fed-b3b6-5c85a80e7a9a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:23.349959 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eed6d2b2-2e14-4fed-b3b6-5c85a80e7a9a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:23.350389 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eed6d2b2-2e14-4fed-b3b6-5c85a80e7a9a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:23.351085 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eed6d2b2-2e14-4fed-b3b6-5c85a80e7a9a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:23.351529 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eed6d2b2-2e14-4fed-b3b6-5c85a80e7a9a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:23.351946 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eed6d2b2-2e14-4fed-b3b6-5c85a80e7a9a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:23.480817 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-eed6d2b2-2e14-4fed-b3b6-5c85a80e7a9a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:23.489584 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-eed6d2b2-2e14-4fed-b3b6-5c85a80e7a9a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150985 Aug 24 12:53:23.490134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1480/2961] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:23 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:23.545608 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a6895f20-166d-4e2b-8e29-7d46405954d6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:23.546213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a6895f20-166d-4e2b-8e29-7d46405954d6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:23.552782 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6895f20-166d-4e2b-8e29-7d46405954d6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:23.553257 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6895f20-166d-4e2b-8e29-7d46405954d6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:23.553687 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6895f20-166d-4e2b-8e29-7d46405954d6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:23.554386 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6895f20-166d-4e2b-8e29-7d46405954d6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:23.554883 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6895f20-166d-4e2b-8e29-7d46405954d6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:23.555304 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a6895f20-166d-4e2b-8e29-7d46405954d6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:23.609340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3b7aecb0-689d-4156-8e3b-50b270b3604b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:23.609857 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3b7aecb0-689d-4156-8e3b-50b270b3604b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:23.616892 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b7aecb0-689d-4156-8e3b-50b270b3604b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:23.617375 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b7aecb0-689d-4156-8e3b-50b270b3604b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:23.617806 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b7aecb0-689d-4156-8e3b-50b270b3604b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:23.618496 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b7aecb0-689d-4156-8e3b-50b270b3604b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:23.619004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b7aecb0-689d-4156-8e3b-50b270b3604b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:23.619425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b7aecb0-689d-4156-8e3b-50b270b3604b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:23.762535 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3b7aecb0-689d-4156-8e3b-50b270b3604b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:23.771440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3b7aecb0-689d-4156-8e3b-50b270b3604b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.166205 Aug 24 12:53:23.772021 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1481/2962] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:23 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:23.892172 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a6895f20-166d-4e2b-8e29-7d46405954d6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:23.900653 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a6895f20-166d-4e2b-8e29-7d46405954d6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:23.902125 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a6895f20-166d-4e2b-8e29-7d46405954d6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:23.903303 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a6895f20-166d-4e2b-8e29-7d46405954d6 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.361611 Aug 24 12:53:23.903851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1482/2963] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:23 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:24.010609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5ac688c4-0432-4e84-94d8-1a3be59bde53 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:24.011236 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5ac688c4-0432-4e84-94d8-1a3be59bde53 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:24.017074 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ac688c4-0432-4e84-94d8-1a3be59bde53 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:24.017552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ac688c4-0432-4e84-94d8-1a3be59bde53 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:24.017986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ac688c4-0432-4e84-94d8-1a3be59bde53 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:24.018673 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ac688c4-0432-4e84-94d8-1a3be59bde53 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:24.019138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ac688c4-0432-4e84-94d8-1a3be59bde53 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:24.020070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5ac688c4-0432-4e84-94d8-1a3be59bde53 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:24.151484 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5ac688c4-0432-4e84-94d8-1a3be59bde53 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:24.159736 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5ac688c4-0432-4e84-94d8-1a3be59bde53 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152961 Aug 24 12:53:24.160920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1482/2964] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:24 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:24.510283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d9c3ad82-a134-4cfa-a7f9-e33e0bca9a78 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:24.510941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d9c3ad82-a134-4cfa-a7f9-e33e0bca9a78 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:24.516836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d9c3ad82-a134-4cfa-a7f9-e33e0bca9a78 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:24.517314 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d9c3ad82-a134-4cfa-a7f9-e33e0bca9a78 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:24.517745 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d9c3ad82-a134-4cfa-a7f9-e33e0bca9a78 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:24.518416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d9c3ad82-a134-4cfa-a7f9-e33e0bca9a78 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:24.518888 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d9c3ad82-a134-4cfa-a7f9-e33e0bca9a78 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:24.519346 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d9c3ad82-a134-4cfa-a7f9-e33e0bca9a78 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:24.648800 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d9c3ad82-a134-4cfa-a7f9-e33e0bca9a78 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:24.656860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d9c3ad82-a134-4cfa-a7f9-e33e0bca9a78 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150355 Aug 24 12:53:24.657421 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1483/2965] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:24 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:24.791965 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-48edd1f0-ccbf-4d52-9b4f-cee4e139c9af tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:24.792572 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-48edd1f0-ccbf-4d52-9b4f-cee4e139c9af tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:24.798809 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-48edd1f0-ccbf-4d52-9b4f-cee4e139c9af tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:24.799283 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-48edd1f0-ccbf-4d52-9b4f-cee4e139c9af tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:24.799708 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-48edd1f0-ccbf-4d52-9b4f-cee4e139c9af tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:24.800375 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-48edd1f0-ccbf-4d52-9b4f-cee4e139c9af tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:24.800865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-48edd1f0-ccbf-4d52-9b4f-cee4e139c9af tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:24.801282 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-48edd1f0-ccbf-4d52-9b4f-cee4e139c9af tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:24.927222 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3d6e9c2f-13d7-43f3-8be6-8721c28c205a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:24.927830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3d6e9c2f-13d7-43f3-8be6-8721c28c205a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:24.934214 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-48edd1f0-ccbf-4d52-9b4f-cee4e139c9af tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:24.935358 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d6e9c2f-13d7-43f3-8be6-8721c28c205a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:24.935851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d6e9c2f-13d7-43f3-8be6-8721c28c205a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:24.936331 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d6e9c2f-13d7-43f3-8be6-8721c28c205a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:24.937025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d6e9c2f-13d7-43f3-8be6-8721c28c205a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:24.937481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d6e9c2f-13d7-43f3-8be6-8721c28c205a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:24.937907 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d6e9c2f-13d7-43f3-8be6-8721c28c205a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:24.942552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-48edd1f0-ccbf-4d52-9b4f-cee4e139c9af tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.154293 Aug 24 12:53:24.943159 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1483/2966] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:24 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:25.071859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3d6e9c2f-13d7-43f3-8be6-8721c28c205a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:25.080453 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3d6e9c2f-13d7-43f3-8be6-8721c28c205a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:25.082725 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3d6e9c2f-13d7-43f3-8be6-8721c28c205a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:25.083888 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3d6e9c2f-13d7-43f3-8be6-8721c28c205a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.161033 Aug 24 12:53:25.084446 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1484/2967] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:24 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:53:25.180872 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ac366cf7-8e3a-48f1-a6ab-5b932099c168 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:25.181481 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ac366cf7-8e3a-48f1-a6ab-5b932099c168 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:25.187398 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ac366cf7-8e3a-48f1-a6ab-5b932099c168 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:25.187881 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ac366cf7-8e3a-48f1-a6ab-5b932099c168 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:25.188321 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ac366cf7-8e3a-48f1-a6ab-5b932099c168 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:25.189001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ac366cf7-8e3a-48f1-a6ab-5b932099c168 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:25.189454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ac366cf7-8e3a-48f1-a6ab-5b932099c168 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:25.189879 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ac366cf7-8e3a-48f1-a6ab-5b932099c168 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:25.318929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ac366cf7-8e3a-48f1-a6ab-5b932099c168 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:25.327096 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ac366cf7-8e3a-48f1-a6ab-5b932099c168 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150068 Aug 24 12:53:25.327657 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1484/2968] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:25 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:25.678852 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9becf45b-28bc-4353-8252-28e0ac477aa3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:25.679419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9becf45b-28bc-4353-8252-28e0ac477aa3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:25.685301 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9becf45b-28bc-4353-8252-28e0ac477aa3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:25.685780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9becf45b-28bc-4353-8252-28e0ac477aa3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:25.686216 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9becf45b-28bc-4353-8252-28e0ac477aa3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:25.686923 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9becf45b-28bc-4353-8252-28e0ac477aa3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:25.687380 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9becf45b-28bc-4353-8252-28e0ac477aa3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:25.687803 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9becf45b-28bc-4353-8252-28e0ac477aa3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:25.813281 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9becf45b-28bc-4353-8252-28e0ac477aa3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:25.822301 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9becf45b-28bc-4353-8252-28e0ac477aa3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.147929 Aug 24 12:53:25.822869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1485/2969] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:25 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:25.964135 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f4ddbcb0-903a-4e43-af2a-b197daa30265 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:25.964740 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f4ddbcb0-903a-4e43-af2a-b197daa30265 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:25.974816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4ddbcb0-903a-4e43-af2a-b197daa30265 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:25.974816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4ddbcb0-903a-4e43-af2a-b197daa30265 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:25.974816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4ddbcb0-903a-4e43-af2a-b197daa30265 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:25.974816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4ddbcb0-903a-4e43-af2a-b197daa30265 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:25.975255 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4ddbcb0-903a-4e43-af2a-b197daa30265 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:25.975255 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4ddbcb0-903a-4e43-af2a-b197daa30265 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:26.105237 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f4ddbcb0-903a-4e43-af2a-b197daa30265 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:26.106836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6b925567-63cb-4f67-b78a-3b89cd30557f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:26.107443 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6b925567-63cb-4f67-b78a-3b89cd30557f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:26.114192 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f4ddbcb0-903a-4e43-af2a-b197daa30265 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.153843 Aug 24 12:53:26.114777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1485/2970] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:25 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:26.114937 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b925567-63cb-4f67-b78a-3b89cd30557f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:26.115377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b925567-63cb-4f67-b78a-3b89cd30557f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:26.115863 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b925567-63cb-4f67-b78a-3b89cd30557f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:26.116574 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b925567-63cb-4f67-b78a-3b89cd30557f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:26.117049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b925567-63cb-4f67-b78a-3b89cd30557f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:26.117497 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b925567-63cb-4f67-b78a-3b89cd30557f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:26.247482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6b925567-63cb-4f67-b78a-3b89cd30557f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:26.256154 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6b925567-63cb-4f67-b78a-3b89cd30557f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:26.257729 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6b925567-63cb-4f67-b78a-3b89cd30557f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:26.258902 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6b925567-63cb-4f67-b78a-3b89cd30557f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155949 Aug 24 12:53:26.259446 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1486/2971] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:26 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:53:26.354436 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ab79f12d-ddf1-4df6-8932-4eafae47144d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:26.355085 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ab79f12d-ddf1-4df6-8932-4eafae47144d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:26.360943 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab79f12d-ddf1-4df6-8932-4eafae47144d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:26.361426 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab79f12d-ddf1-4df6-8932-4eafae47144d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:26.362131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab79f12d-ddf1-4df6-8932-4eafae47144d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:26.362849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab79f12d-ddf1-4df6-8932-4eafae47144d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:26.363328 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab79f12d-ddf1-4df6-8932-4eafae47144d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:26.363756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab79f12d-ddf1-4df6-8932-4eafae47144d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:26.491061 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ab79f12d-ddf1-4df6-8932-4eafae47144d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:26.499327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ab79f12d-ddf1-4df6-8932-4eafae47144d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148756 Aug 24 12:53:26.499835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1486/2972] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:26 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:26.842879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-60016e1e-f2eb-4047-82f3-4c659d5e10d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:26.843487 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-60016e1e-f2eb-4047-82f3-4c659d5e10d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:26.849364 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-60016e1e-f2eb-4047-82f3-4c659d5e10d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:26.849838 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-60016e1e-f2eb-4047-82f3-4c659d5e10d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:26.850267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-60016e1e-f2eb-4047-82f3-4c659d5e10d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:26.850967 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-60016e1e-f2eb-4047-82f3-4c659d5e10d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:26.851421 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-60016e1e-f2eb-4047-82f3-4c659d5e10d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:26.851840 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-60016e1e-f2eb-4047-82f3-4c659d5e10d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:26.978320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-60016e1e-f2eb-4047-82f3-4c659d5e10d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:26.986313 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-60016e1e-f2eb-4047-82f3-4c659d5e10d3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.147264 Aug 24 12:53:26.987164 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1487/2973] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:26 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:27.135562 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7924a55a-c6a6-4be9-8526-83ffd5b352f5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:27.136092 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7924a55a-c6a6-4be9-8526-83ffd5b352f5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:27.142425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7924a55a-c6a6-4be9-8526-83ffd5b352f5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:27.142932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7924a55a-c6a6-4be9-8526-83ffd5b352f5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:27.143431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7924a55a-c6a6-4be9-8526-83ffd5b352f5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:27.144113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7924a55a-c6a6-4be9-8526-83ffd5b352f5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:27.144567 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7924a55a-c6a6-4be9-8526-83ffd5b352f5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:27.144992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7924a55a-c6a6-4be9-8526-83ffd5b352f5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:27.276086 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7924a55a-c6a6-4be9-8526-83ffd5b352f5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:27.281432 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-62c5b329-6652-4e14-9f9d-74d71b61555d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:27.282243 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-62c5b329-6652-4e14-9f9d-74d71b61555d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:27.284961 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7924a55a-c6a6-4be9-8526-83ffd5b352f5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.153256 Aug 24 12:53:27.285724 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1487/2974] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:27 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:27.288885 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-62c5b329-6652-4e14-9f9d-74d71b61555d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:27.289454 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-62c5b329-6652-4e14-9f9d-74d71b61555d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:27.289959 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-62c5b329-6652-4e14-9f9d-74d71b61555d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:27.290758 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-62c5b329-6652-4e14-9f9d-74d71b61555d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:27.291282 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-62c5b329-6652-4e14-9f9d-74d71b61555d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:27.291777 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-62c5b329-6652-4e14-9f9d-74d71b61555d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:27.418786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-62c5b329-6652-4e14-9f9d-74d71b61555d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:27.428355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-62c5b329-6652-4e14-9f9d-74d71b61555d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:27.429596 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-62c5b329-6652-4e14-9f9d-74d71b61555d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:27.430776 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-62c5b329-6652-4e14-9f9d-74d71b61555d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.153376 Aug 24 12:53:27.431320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1488/2975] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:27 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:53:27.518932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c8886201-8f5e-4331-ad25-d23bcfb31fe3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:27.519596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c8886201-8f5e-4331-ad25-d23bcfb31fe3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:27.525450 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c8886201-8f5e-4331-ad25-d23bcfb31fe3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:27.525921 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c8886201-8f5e-4331-ad25-d23bcfb31fe3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:27.526344 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c8886201-8f5e-4331-ad25-d23bcfb31fe3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:27.527036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c8886201-8f5e-4331-ad25-d23bcfb31fe3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:27.527480 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c8886201-8f5e-4331-ad25-d23bcfb31fe3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:27.527896 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c8886201-8f5e-4331-ad25-d23bcfb31fe3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:27.542736 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:53:27.653759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c8886201-8f5e-4331-ad25-d23bcfb31fe3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:27.662164 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c8886201-8f5e-4331-ad25-d23bcfb31fe3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.146959 Aug 24 12:53:27.662733 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1488/2976] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:27 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:28.007068 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f2dc606d-34b0-4d34-b0db-8374ba1bcc99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:28.007681 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f2dc606d-34b0-4d34-b0db-8374ba1bcc99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:28.013547 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2dc606d-34b0-4d34-b0db-8374ba1bcc99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:28.014025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2dc606d-34b0-4d34-b0db-8374ba1bcc99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:28.014455 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2dc606d-34b0-4d34-b0db-8374ba1bcc99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:28.015158 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2dc606d-34b0-4d34-b0db-8374ba1bcc99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:28.015607 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2dc606d-34b0-4d34-b0db-8374ba1bcc99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:28.016027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f2dc606d-34b0-4d34-b0db-8374ba1bcc99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:28.020338 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:53:28.144170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f2dc606d-34b0-4d34-b0db-8374ba1bcc99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:28.152786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f2dc606d-34b0-4d34-b0db-8374ba1bcc99 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149451 Aug 24 12:53:28.153350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1489/2977] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:28 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:28.305155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-aeeafd2f-a07d-48d0-8812-4814c71be808 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:28.305763 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-aeeafd2f-a07d-48d0-8812-4814c71be808 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:28.312300 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aeeafd2f-a07d-48d0-8812-4814c71be808 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:28.312778 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aeeafd2f-a07d-48d0-8812-4814c71be808 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:28.313212 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aeeafd2f-a07d-48d0-8812-4814c71be808 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:28.313888 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aeeafd2f-a07d-48d0-8812-4814c71be808 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:28.314334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aeeafd2f-a07d-48d0-8812-4814c71be808 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:28.314864 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aeeafd2f-a07d-48d0-8812-4814c71be808 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:28.442826 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-aeeafd2f-a07d-48d0-8812-4814c71be808 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:28.451090 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-aeeafd2f-a07d-48d0-8812-4814c71be808 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149682 Aug 24 12:53:28.451648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1489/2978] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:28 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:28.453230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d9c0b3d1-ed59-400d-9399-08b70f444c7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:28.453844 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d9c0b3d1-ed59-400d-9399-08b70f444c7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:28.460329 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d9c0b3d1-ed59-400d-9399-08b70f444c7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:28.460817 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d9c0b3d1-ed59-400d-9399-08b70f444c7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:28.461257 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d9c0b3d1-ed59-400d-9399-08b70f444c7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:28.461945 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d9c0b3d1-ed59-400d-9399-08b70f444c7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:28.462407 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d9c0b3d1-ed59-400d-9399-08b70f444c7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:28.462869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d9c0b3d1-ed59-400d-9399-08b70f444c7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:28.587225 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d9c0b3d1-ed59-400d-9399-08b70f444c7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:28.595659 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d9c0b3d1-ed59-400d-9399-08b70f444c7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:28.597161 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d9c0b3d1-ed59-400d-9399-08b70f444c7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:28.598321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d9c0b3d1-ed59-400d-9399-08b70f444c7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.148922 Aug 24 12:53:28.598915 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1490/2979] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:28 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:53:28.682564 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5715b0e7-dc03-47eb-9179-89b1d9b7a7e9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:28.683158 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5715b0e7-dc03-47eb-9179-89b1d9b7a7e9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:28.689090 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5715b0e7-dc03-47eb-9179-89b1d9b7a7e9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:28.689570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5715b0e7-dc03-47eb-9179-89b1d9b7a7e9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:28.690007 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5715b0e7-dc03-47eb-9179-89b1d9b7a7e9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:28.690711 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5715b0e7-dc03-47eb-9179-89b1d9b7a7e9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:28.691812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5715b0e7-dc03-47eb-9179-89b1d9b7a7e9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:28.692241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5715b0e7-dc03-47eb-9179-89b1d9b7a7e9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:28.828040 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5715b0e7-dc03-47eb-9179-89b1d9b7a7e9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:28.836280 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5715b0e7-dc03-47eb-9179-89b1d9b7a7e9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.157630 Aug 24 12:53:28.836845 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1490/2980] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:28 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:29.173289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8b02feed-3f1a-4007-85ac-c1e0b46ca1a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:29.173917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8b02feed-3f1a-4007-85ac-c1e0b46ca1a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:29.180391 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b02feed-3f1a-4007-85ac-c1e0b46ca1a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:29.180867 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b02feed-3f1a-4007-85ac-c1e0b46ca1a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:29.181298 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b02feed-3f1a-4007-85ac-c1e0b46ca1a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:29.181971 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b02feed-3f1a-4007-85ac-c1e0b46ca1a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:29.182419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b02feed-3f1a-4007-85ac-c1e0b46ca1a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:29.182868 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b02feed-3f1a-4007-85ac-c1e0b46ca1a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:29.311817 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8b02feed-3f1a-4007-85ac-c1e0b46ca1a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:29.319875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8b02feed-3f1a-4007-85ac-c1e0b46ca1a1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150427 Aug 24 12:53:29.320430 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1491/2981] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:29 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:29.471978 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-891d58c3-03a4-405b-915c-a1dc1c0e958a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:29.473234 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-891d58c3-03a4-405b-915c-a1dc1c0e958a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:29.479578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-891d58c3-03a4-405b-915c-a1dc1c0e958a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:29.480058 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-891d58c3-03a4-405b-915c-a1dc1c0e958a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:29.480492 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-891d58c3-03a4-405b-915c-a1dc1c0e958a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:29.481179 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-891d58c3-03a4-405b-915c-a1dc1c0e958a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:29.481618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-891d58c3-03a4-405b-915c-a1dc1c0e958a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:29.482036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-891d58c3-03a4-405b-915c-a1dc1c0e958a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:29.609557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-891d58c3-03a4-405b-915c-a1dc1c0e958a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:29.618423 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-891d58c3-03a4-405b-915c-a1dc1c0e958a tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150276 Aug 24 12:53:29.619191 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1491/2982] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:29 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:29.622588 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c7abbd57-6746-48eb-b4c6-d5b2c921f326 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:29.623286 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c7abbd57-6746-48eb-b4c6-d5b2c921f326 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:29.629777 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7abbd57-6746-48eb-b4c6-d5b2c921f326 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:29.630330 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7abbd57-6746-48eb-b4c6-d5b2c921f326 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:29.630878 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7abbd57-6746-48eb-b4c6-d5b2c921f326 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:29.631617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7abbd57-6746-48eb-b4c6-d5b2c921f326 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:29.632072 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7abbd57-6746-48eb-b4c6-d5b2c921f326 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:29.632491 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7abbd57-6746-48eb-b4c6-d5b2c921f326 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:29.758802 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c7abbd57-6746-48eb-b4c6-d5b2c921f326 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:29.767356 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c7abbd57-6746-48eb-b4c6-d5b2c921f326 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:29.768878 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c7abbd57-6746-48eb-b4c6-d5b2c921f326 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:29.770099 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c7abbd57-6746-48eb-b4c6-d5b2c921f326 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.151496 Aug 24 12:53:29.770634 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1492/2983] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:29 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:53:29.857570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f4a5fac5-244c-409c-b35d-1380cd185eac tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:29.858136 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f4a5fac5-244c-409c-b35d-1380cd185eac tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:29.864973 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4a5fac5-244c-409c-b35d-1380cd185eac tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:29.865455 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4a5fac5-244c-409c-b35d-1380cd185eac tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:29.865885 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4a5fac5-244c-409c-b35d-1380cd185eac tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:29.866556 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4a5fac5-244c-409c-b35d-1380cd185eac tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:29.867032 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4a5fac5-244c-409c-b35d-1380cd185eac tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:29.867453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f4a5fac5-244c-409c-b35d-1380cd185eac tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:29.996690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f4a5fac5-244c-409c-b35d-1380cd185eac tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:30.004815 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f4a5fac5-244c-409c-b35d-1380cd185eac tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151044 Aug 24 12:53:30.005375 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1492/2984] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:29 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:30.341242 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c16890ee-aacd-4f8f-be30-7e7a625d7826 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:30.341849 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c16890ee-aacd-4f8f-be30-7e7a625d7826 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:30.347722 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c16890ee-aacd-4f8f-be30-7e7a625d7826 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:30.348198 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c16890ee-aacd-4f8f-be30-7e7a625d7826 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:30.348626 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c16890ee-aacd-4f8f-be30-7e7a625d7826 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:30.349298 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c16890ee-aacd-4f8f-be30-7e7a625d7826 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:30.349752 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c16890ee-aacd-4f8f-be30-7e7a625d7826 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:30.350170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c16890ee-aacd-4f8f-be30-7e7a625d7826 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:30.476637 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c16890ee-aacd-4f8f-be30-7e7a625d7826 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:30.484843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c16890ee-aacd-4f8f-be30-7e7a625d7826 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.147701 Aug 24 12:53:30.485428 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1493/2985] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:30 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:30.638875 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1495b12f-6100-4691-ad14-891028265922 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:30.639420 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1495b12f-6100-4691-ad14-891028265922 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:30.646340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1495b12f-6100-4691-ad14-891028265922 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:30.646857 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1495b12f-6100-4691-ad14-891028265922 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:30.647298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1495b12f-6100-4691-ad14-891028265922 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:30.647987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1495b12f-6100-4691-ad14-891028265922 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:30.648444 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1495b12f-6100-4691-ad14-891028265922 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:30.648868 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1495b12f-6100-4691-ad14-891028265922 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:30.775056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1495b12f-6100-4691-ad14-891028265922 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:30.783031 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1495b12f-6100-4691-ad14-891028265922 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147996 Aug 24 12:53:30.783585 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1493/2986] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:30 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:30.793288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-94672f39-afe3-42c5-8832-8d8cb8821cbf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:30.793974 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-94672f39-afe3-42c5-8832-8d8cb8821cbf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:30.801468 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94672f39-afe3-42c5-8832-8d8cb8821cbf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:30.801940 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94672f39-afe3-42c5-8832-8d8cb8821cbf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:30.802371 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94672f39-afe3-42c5-8832-8d8cb8821cbf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:30.803080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94672f39-afe3-42c5-8832-8d8cb8821cbf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:30.803530 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94672f39-afe3-42c5-8832-8d8cb8821cbf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:30.803950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94672f39-afe3-42c5-8832-8d8cb8821cbf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:30.935315 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-94672f39-afe3-42c5-8832-8d8cb8821cbf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:30.944453 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-94672f39-afe3-42c5-8832-8d8cb8821cbf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:30.945937 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-94672f39-afe3-42c5-8832-8d8cb8821cbf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:30.947132 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-94672f39-afe3-42c5-8832-8d8cb8821cbf tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.157647 Aug 24 12:53:30.947685 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1494/2987] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:30 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:31.025386 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-aaf2e421-059e-44d3-8b84-689f5ac2ab29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:31.025998 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-aaf2e421-059e-44d3-8b84-689f5ac2ab29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:31.031932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aaf2e421-059e-44d3-8b84-689f5ac2ab29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:31.032414 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aaf2e421-059e-44d3-8b84-689f5ac2ab29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:31.032852 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aaf2e421-059e-44d3-8b84-689f5ac2ab29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:31.033534 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aaf2e421-059e-44d3-8b84-689f5ac2ab29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:31.033987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aaf2e421-059e-44d3-8b84-689f5ac2ab29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:31.034413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aaf2e421-059e-44d3-8b84-689f5ac2ab29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:31.165466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-aaf2e421-059e-44d3-8b84-689f5ac2ab29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:31.173504 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-aaf2e421-059e-44d3-8b84-689f5ac2ab29 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151962 Aug 24 12:53:31.174060 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1494/2988] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:31 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:31.505942 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8373e31f-96f9-40d3-b525-8ae41cea74a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:31.506556 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8373e31f-96f9-40d3-b525-8ae41cea74a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:31.512514 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8373e31f-96f9-40d3-b525-8ae41cea74a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:31.512999 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8373e31f-96f9-40d3-b525-8ae41cea74a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:31.513435 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8373e31f-96f9-40d3-b525-8ae41cea74a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:31.514125 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8373e31f-96f9-40d3-b525-8ae41cea74a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:31.514583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8373e31f-96f9-40d3-b525-8ae41cea74a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:31.515034 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8373e31f-96f9-40d3-b525-8ae41cea74a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:31.643768 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8373e31f-96f9-40d3-b525-8ae41cea74a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:31.652189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8373e31f-96f9-40d3-b525-8ae41cea74a2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150181 Aug 24 12:53:31.655467 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1495/2989] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:31 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:31.804511 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a8a873c3-6656-44c8-96ab-b9465d4644df tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:31.805123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a8a873c3-6656-44c8-96ab-b9465d4644df tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:31.811629 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a8a873c3-6656-44c8-96ab-b9465d4644df tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:31.812111 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a8a873c3-6656-44c8-96ab-b9465d4644df tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:31.812547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a8a873c3-6656-44c8-96ab-b9465d4644df tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:31.813231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a8a873c3-6656-44c8-96ab-b9465d4644df tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:31.813681 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a8a873c3-6656-44c8-96ab-b9465d4644df tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:31.814109 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a8a873c3-6656-44c8-96ab-b9465d4644df tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:31.941109 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a8a873c3-6656-44c8-96ab-b9465d4644df tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:31.949185 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a8a873c3-6656-44c8-96ab-b9465d4644df tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149025 Aug 24 12:53:31.949747 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1495/2990] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:31 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:31.969315 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ea5de166-c781-42f8-8fd4-45aadc609ef2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:31.969946 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ea5de166-c781-42f8-8fd4-45aadc609ef2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:31.976906 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea5de166-c781-42f8-8fd4-45aadc609ef2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:31.977423 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea5de166-c781-42f8-8fd4-45aadc609ef2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:31.977857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea5de166-c781-42f8-8fd4-45aadc609ef2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:31.978537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea5de166-c781-42f8-8fd4-45aadc609ef2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:31.979024 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea5de166-c781-42f8-8fd4-45aadc609ef2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:31.979449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea5de166-c781-42f8-8fd4-45aadc609ef2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:32.071596 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:53:32.071776 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 12:53:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 (ip 10.222.0.45) !!! Aug 24 12:53:32.113804 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ea5de166-c781-42f8-8fd4-45aadc609ef2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:32.122344 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ea5de166-c781-42f8-8fd4-45aadc609ef2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:32.123856 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ea5de166-c781-42f8-8fd4-45aadc609ef2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:32.125005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ea5de166-c781-42f8-8fd4-45aadc609ef2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.159573 Aug 24 12:53:32.129603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1496/2991] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:31 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:32.194046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f82051dd-aaee-48e5-9795-d1063096d0be tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:32.194795 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f82051dd-aaee-48e5-9795-d1063096d0be tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:32.200589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f82051dd-aaee-48e5-9795-d1063096d0be tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:32.201072 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f82051dd-aaee-48e5-9795-d1063096d0be tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:32.201677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f82051dd-aaee-48e5-9795-d1063096d0be tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:32.202368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f82051dd-aaee-48e5-9795-d1063096d0be tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:32.202858 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f82051dd-aaee-48e5-9795-d1063096d0be tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:32.203287 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f82051dd-aaee-48e5-9795-d1063096d0be tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:32.334501 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f82051dd-aaee-48e5-9795-d1063096d0be tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:32.342636 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f82051dd-aaee-48e5-9795-d1063096d0be tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152421 Aug 24 12:53:32.343210 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1496/2992] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:32 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:32.601927 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:53:32.602086 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 12:53:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:53:32.673241 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d1571281-4095-4f7b-89ba-4d99ca20983e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:32.673860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d1571281-4095-4f7b-89ba-4d99ca20983e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:32.681347 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1571281-4095-4f7b-89ba-4d99ca20983e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:32.681830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1571281-4095-4f7b-89ba-4d99ca20983e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:32.682265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1571281-4095-4f7b-89ba-4d99ca20983e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:32.682979 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1571281-4095-4f7b-89ba-4d99ca20983e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:32.683437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1571281-4095-4f7b-89ba-4d99ca20983e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:32.683859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1571281-4095-4f7b-89ba-4d99ca20983e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:32.816517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d1571281-4095-4f7b-89ba-4d99ca20983e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:32.826434 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d1571281-4095-4f7b-89ba-4d99ca20983e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.156819 Aug 24 12:53:32.827166 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1497/2993] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:32 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:32.970228 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-aa5fa7d0-3eb9-480d-a747-4e0f3dc59236 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:32.970924 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-aa5fa7d0-3eb9-480d-a747-4e0f3dc59236 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:32.977813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aa5fa7d0-3eb9-480d-a747-4e0f3dc59236 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:32.978288 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aa5fa7d0-3eb9-480d-a747-4e0f3dc59236 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:32.978743 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aa5fa7d0-3eb9-480d-a747-4e0f3dc59236 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:32.979417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aa5fa7d0-3eb9-480d-a747-4e0f3dc59236 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:32.979858 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aa5fa7d0-3eb9-480d-a747-4e0f3dc59236 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:32.980273 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-aa5fa7d0-3eb9-480d-a747-4e0f3dc59236 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:33.111066 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-aa5fa7d0-3eb9-480d-a747-4e0f3dc59236 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:33.119354 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-aa5fa7d0-3eb9-480d-a747-4e0f3dc59236 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.153103 Aug 24 12:53:33.119901 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1497/2994] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:32 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:33.148172 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f6ffd217-d61f-46b7-9866-d48fce0f3979 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:33.148815 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f6ffd217-d61f-46b7-9866-d48fce0f3979 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:33.155161 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6ffd217-d61f-46b7-9866-d48fce0f3979 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:33.155636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6ffd217-d61f-46b7-9866-d48fce0f3979 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:33.156066 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6ffd217-d61f-46b7-9866-d48fce0f3979 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:33.156739 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6ffd217-d61f-46b7-9866-d48fce0f3979 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:33.157192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6ffd217-d61f-46b7-9866-d48fce0f3979 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:33.157613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f6ffd217-d61f-46b7-9866-d48fce0f3979 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:33.289209 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f6ffd217-d61f-46b7-9866-d48fce0f3979 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:33.297962 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f6ffd217-d61f-46b7-9866-d48fce0f3979 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:33.299509 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f6ffd217-d61f-46b7-9866-d48fce0f3979 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:33.301370 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f6ffd217-d61f-46b7-9866-d48fce0f3979 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.157698 Aug 24 12:53:33.301923 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1498/2995] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:33 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:33.364971 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7250f409-24fb-48fd-bf65-4dc468d8ea6d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:33.365568 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7250f409-24fb-48fd-bf65-4dc468d8ea6d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:33.371435 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7250f409-24fb-48fd-bf65-4dc468d8ea6d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:33.371907 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7250f409-24fb-48fd-bf65-4dc468d8ea6d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:33.372333 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7250f409-24fb-48fd-bf65-4dc468d8ea6d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:33.372999 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7250f409-24fb-48fd-bf65-4dc468d8ea6d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:33.373442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7250f409-24fb-48fd-bf65-4dc468d8ea6d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:33.373856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7250f409-24fb-48fd-bf65-4dc468d8ea6d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:33.500586 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7250f409-24fb-48fd-bf65-4dc468d8ea6d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:33.508349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7250f409-24fb-48fd-bf65-4dc468d8ea6d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148131 Aug 24 12:53:33.508914 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1498/2996] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:33 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:33.851896 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4c96d1bc-d286-472f-b679-1ca325b37478 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:33.852511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4c96d1bc-d286-472f-b679-1ca325b37478 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:33.858463 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4c96d1bc-d286-472f-b679-1ca325b37478 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:33.858980 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4c96d1bc-d286-472f-b679-1ca325b37478 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:33.859417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4c96d1bc-d286-472f-b679-1ca325b37478 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:33.860108 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4c96d1bc-d286-472f-b679-1ca325b37478 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:33.860564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4c96d1bc-d286-472f-b679-1ca325b37478 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:33.860990 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4c96d1bc-d286-472f-b679-1ca325b37478 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:33.988465 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4c96d1bc-d286-472f-b679-1ca325b37478 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:33.996551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4c96d1bc-d286-472f-b679-1ca325b37478 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149201 Aug 24 12:53:33.997114 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1499/2997] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:33 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:34.139922 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-92e58e94-000f-4753-944e-61d2431c6e74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:34.140478 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-92e58e94-000f-4753-944e-61d2431c6e74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:34.147486 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92e58e94-000f-4753-944e-61d2431c6e74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:34.147960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92e58e94-000f-4753-944e-61d2431c6e74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:34.148386 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92e58e94-000f-4753-944e-61d2431c6e74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:34.149051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92e58e94-000f-4753-944e-61d2431c6e74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:34.149490 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92e58e94-000f-4753-944e-61d2431c6e74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:34.149906 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92e58e94-000f-4753-944e-61d2431c6e74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:34.292321 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-92e58e94-000f-4753-944e-61d2431c6e74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:34.300579 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-92e58e94-000f-4753-944e-61d2431c6e74 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.164580 Aug 24 12:53:34.301159 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1499/2998] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:34 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:34.324931 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-79afcea6-ef3b-45e5-be0c-12e1cb4178ef tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:34.325537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-79afcea6-ef3b-45e5-be0c-12e1cb4178ef tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:34.332104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-79afcea6-ef3b-45e5-be0c-12e1cb4178ef tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:34.333111 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-79afcea6-ef3b-45e5-be0c-12e1cb4178ef tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:34.333550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-79afcea6-ef3b-45e5-be0c-12e1cb4178ef tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:34.334235 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-79afcea6-ef3b-45e5-be0c-12e1cb4178ef tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:34.334711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-79afcea6-ef3b-45e5-be0c-12e1cb4178ef tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:34.335140 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-79afcea6-ef3b-45e5-be0c-12e1cb4178ef tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:34.460755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-79afcea6-ef3b-45e5-be0c-12e1cb4178ef tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:34.469260 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-79afcea6-ef3b-45e5-be0c-12e1cb4178ef tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:34.470778 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-79afcea6-ef3b-45e5-be0c-12e1cb4178ef tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:34.471925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-79afcea6-ef3b-45e5-be0c-12e1cb4178ef tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.150855 Aug 24 12:53:34.472485 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1500/2999] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:34 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:34.528854 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-316a247d-a041-4bcf-a83e-fb1bd948022e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:34.529484 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-316a247d-a041-4bcf-a83e-fb1bd948022e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:34.535333 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-316a247d-a041-4bcf-a83e-fb1bd948022e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:34.535811 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-316a247d-a041-4bcf-a83e-fb1bd948022e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:34.536244 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-316a247d-a041-4bcf-a83e-fb1bd948022e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:34.536919 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-316a247d-a041-4bcf-a83e-fb1bd948022e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:34.537368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-316a247d-a041-4bcf-a83e-fb1bd948022e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:34.537790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-316a247d-a041-4bcf-a83e-fb1bd948022e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:34.668938 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-316a247d-a041-4bcf-a83e-fb1bd948022e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:34.677811 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-316a247d-a041-4bcf-a83e-fb1bd948022e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152695 Aug 24 12:53:34.678372 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1500/3000] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:34 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:35.017489 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-953aca67-bc59-44df-a3c6-bd43c6aa8878 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:35.018108 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-953aca67-bc59-44df-a3c6-bd43c6aa8878 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:35.024288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-953aca67-bc59-44df-a3c6-bd43c6aa8878 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:35.024778 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-953aca67-bc59-44df-a3c6-bd43c6aa8878 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:35.025220 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-953aca67-bc59-44df-a3c6-bd43c6aa8878 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:35.025940 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-953aca67-bc59-44df-a3c6-bd43c6aa8878 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:35.026455 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-953aca67-bc59-44df-a3c6-bd43c6aa8878 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:35.026918 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-953aca67-bc59-44df-a3c6-bd43c6aa8878 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:35.156316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-953aca67-bc59-44df-a3c6-bd43c6aa8878 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:35.165022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-953aca67-bc59-44df-a3c6-bd43c6aa8878 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151389 Aug 24 12:53:35.165587 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1501/3001] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:35 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:35.321315 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-426a51df-d44e-47de-805a-318f8467c63b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:35.322190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-426a51df-d44e-47de-805a-318f8467c63b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:35.329177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-426a51df-d44e-47de-805a-318f8467c63b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:35.329786 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-426a51df-d44e-47de-805a-318f8467c63b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:35.330232 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-426a51df-d44e-47de-805a-318f8467c63b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:35.330968 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-426a51df-d44e-47de-805a-318f8467c63b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:35.331427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-426a51df-d44e-47de-805a-318f8467c63b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:35.331854 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-426a51df-d44e-47de-805a-318f8467c63b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:35.459001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-426a51df-d44e-47de-805a-318f8467c63b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:35.467094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-426a51df-d44e-47de-805a-318f8467c63b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149545 Aug 24 12:53:35.467658 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1501/3002] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:35 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:35.495008 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-92e779be-07b4-47b6-8e8e-b0ba6e4182c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:35.495747 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-92e779be-07b4-47b6-8e8e-b0ba6e4182c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:35.502018 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92e779be-07b4-47b6-8e8e-b0ba6e4182c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:35.502510 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92e779be-07b4-47b6-8e8e-b0ba6e4182c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:35.502986 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92e779be-07b4-47b6-8e8e-b0ba6e4182c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:35.503673 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92e779be-07b4-47b6-8e8e-b0ba6e4182c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:35.504156 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92e779be-07b4-47b6-8e8e-b0ba6e4182c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:35.504582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-92e779be-07b4-47b6-8e8e-b0ba6e4182c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:35.632797 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-92e779be-07b4-47b6-8e8e-b0ba6e4182c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:35.641377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-92e779be-07b4-47b6-8e8e-b0ba6e4182c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:35.642923 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-92e779be-07b4-47b6-8e8e-b0ba6e4182c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:35.644084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-92e779be-07b4-47b6-8e8e-b0ba6e4182c7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.153065 Aug 24 12:53:35.645261 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1502/3003] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:35 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:35.698339 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5f7d5225-e19f-4bb0-ace7-e1f6abb5cf59 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:35.698972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5f7d5225-e19f-4bb0-ace7-e1f6abb5cf59 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:35.704856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5f7d5225-e19f-4bb0-ace7-e1f6abb5cf59 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:35.705339 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5f7d5225-e19f-4bb0-ace7-e1f6abb5cf59 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:35.705778 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5f7d5225-e19f-4bb0-ace7-e1f6abb5cf59 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:35.706459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5f7d5225-e19f-4bb0-ace7-e1f6abb5cf59 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:35.707594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5f7d5225-e19f-4bb0-ace7-e1f6abb5cf59 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:35.708026 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5f7d5225-e19f-4bb0-ace7-e1f6abb5cf59 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:35.837121 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5f7d5225-e19f-4bb0-ace7-e1f6abb5cf59 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:35.845154 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5f7d5225-e19f-4bb0-ace7-e1f6abb5cf59 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150602 Aug 24 12:53:35.845700 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1502/3004] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:35 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:36.187197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-eed12b1c-d00d-4987-8d63-b43abccf80d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:36.187752 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-eed12b1c-d00d-4987-8d63-b43abccf80d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:36.194239 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eed12b1c-d00d-4987-8d63-b43abccf80d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:36.194762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eed12b1c-d00d-4987-8d63-b43abccf80d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:36.195204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eed12b1c-d00d-4987-8d63-b43abccf80d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:36.195924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eed12b1c-d00d-4987-8d63-b43abccf80d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:36.196385 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eed12b1c-d00d-4987-8d63-b43abccf80d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:36.196817 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eed12b1c-d00d-4987-8d63-b43abccf80d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:36.327073 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-eed12b1c-d00d-4987-8d63-b43abccf80d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:36.335308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-eed12b1c-d00d-4987-8d63-b43abccf80d4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152050 Aug 24 12:53:36.335950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1503/3005] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:36 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:36.489103 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c6471596-2ba4-41b9-b652-3d1ed6488102 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:36.489706 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c6471596-2ba4-41b9-b652-3d1ed6488102 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:36.496065 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c6471596-2ba4-41b9-b652-3d1ed6488102 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:36.496538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c6471596-2ba4-41b9-b652-3d1ed6488102 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:36.496973 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c6471596-2ba4-41b9-b652-3d1ed6488102 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:36.497637 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c6471596-2ba4-41b9-b652-3d1ed6488102 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:36.498080 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c6471596-2ba4-41b9-b652-3d1ed6488102 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:36.498497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c6471596-2ba4-41b9-b652-3d1ed6488102 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:36.622537 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c6471596-2ba4-41b9-b652-3d1ed6488102 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:36.630634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c6471596-2ba4-41b9-b652-3d1ed6488102 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.146263 Aug 24 12:53:36.631207 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1503/3006] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:36 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:36.672528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f9d22491-be81-423f-abbe-7e8b45875fa7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:36.673132 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f9d22491-be81-423f-abbe-7e8b45875fa7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:36.679750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9d22491-be81-423f-abbe-7e8b45875fa7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:36.680236 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9d22491-be81-423f-abbe-7e8b45875fa7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:36.680675 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9d22491-be81-423f-abbe-7e8b45875fa7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:36.681364 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9d22491-be81-423f-abbe-7e8b45875fa7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:36.681821 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9d22491-be81-423f-abbe-7e8b45875fa7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:36.682245 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f9d22491-be81-423f-abbe-7e8b45875fa7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:36.807545 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f9d22491-be81-423f-abbe-7e8b45875fa7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:36.816042 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f9d22491-be81-423f-abbe-7e8b45875fa7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:36.817613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f9d22491-be81-423f-abbe-7e8b45875fa7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:36.818795 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f9d22491-be81-423f-abbe-7e8b45875fa7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.150347 Aug 24 12:53:36.819356 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1504/3007] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:36 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:36.865777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d7e3b014-568b-4aa9-b3ba-75bfe65e15e7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:36.866379 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d7e3b014-568b-4aa9-b3ba-75bfe65e15e7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:36.872262 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7e3b014-568b-4aa9-b3ba-75bfe65e15e7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:36.872734 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7e3b014-568b-4aa9-b3ba-75bfe65e15e7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:36.873165 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7e3b014-568b-4aa9-b3ba-75bfe65e15e7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:36.873834 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7e3b014-568b-4aa9-b3ba-75bfe65e15e7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:36.874277 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7e3b014-568b-4aa9-b3ba-75bfe65e15e7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:36.874712 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7e3b014-568b-4aa9-b3ba-75bfe65e15e7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:37.006003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d7e3b014-568b-4aa9-b3ba-75bfe65e15e7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:37.014185 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d7e3b014-568b-4aa9-b3ba-75bfe65e15e7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152433 Aug 24 12:53:37.014697 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1504/3008] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:36 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:37.356783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4e1fd147-3253-4766-bcb1-a0c7f1d2fa9f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:37.357350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4e1fd147-3253-4766-bcb1-a0c7f1d2fa9f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:37.363504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e1fd147-3253-4766-bcb1-a0c7f1d2fa9f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:37.363984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e1fd147-3253-4766-bcb1-a0c7f1d2fa9f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:37.364422 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e1fd147-3253-4766-bcb1-a0c7f1d2fa9f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:37.365101 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e1fd147-3253-4766-bcb1-a0c7f1d2fa9f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:37.365555 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e1fd147-3253-4766-bcb1-a0c7f1d2fa9f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:37.365977 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e1fd147-3253-4766-bcb1-a0c7f1d2fa9f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:37.492635 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4e1fd147-3253-4766-bcb1-a0c7f1d2fa9f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:37.494777 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:53:37.501203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4e1fd147-3253-4766-bcb1-a0c7f1d2fa9f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.148418 Aug 24 12:53:37.501759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1505/3009] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:37 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:37.656025 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cc15dc19-9fb1-4864-9b60-1eae1369cc34 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:37.656543 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cc15dc19-9fb1-4864-9b60-1eae1369cc34 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:37.662867 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc15dc19-9fb1-4864-9b60-1eae1369cc34 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:37.663341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc15dc19-9fb1-4864-9b60-1eae1369cc34 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:37.663767 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc15dc19-9fb1-4864-9b60-1eae1369cc34 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:37.664434 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc15dc19-9fb1-4864-9b60-1eae1369cc34 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:37.664879 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc15dc19-9fb1-4864-9b60-1eae1369cc34 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:37.665292 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc15dc19-9fb1-4864-9b60-1eae1369cc34 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:37.669060 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:53:37.794867 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cc15dc19-9fb1-4864-9b60-1eae1369cc34 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:37.803696 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cc15dc19-9fb1-4864-9b60-1eae1369cc34 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151489 Aug 24 12:53:37.804257 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1505/3010] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:37 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:37.841560 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b0cb323d-e734-4cdb-8a2f-9bc441e85023 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:37.842169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b0cb323d-e734-4cdb-8a2f-9bc441e85023 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:37.849134 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0cb323d-e734-4cdb-8a2f-9bc441e85023 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:37.849613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0cb323d-e734-4cdb-8a2f-9bc441e85023 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:37.850050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0cb323d-e734-4cdb-8a2f-9bc441e85023 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:37.850764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0cb323d-e734-4cdb-8a2f-9bc441e85023 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:37.851230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0cb323d-e734-4cdb-8a2f-9bc441e85023 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:37.851657 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0cb323d-e734-4cdb-8a2f-9bc441e85023 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:37.979997 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b0cb323d-e734-4cdb-8a2f-9bc441e85023 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:37.989436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b0cb323d-e734-4cdb-8a2f-9bc441e85023 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:37.991003 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b0cb323d-e734-4cdb-8a2f-9bc441e85023 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:37.992166 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b0cb323d-e734-4cdb-8a2f-9bc441e85023 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154821 Aug 24 12:53:37.992741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1506/3011] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:37 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:38.035804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-10d91093-5ac2-4bfc-9540-85d5c091b4e2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:38.036409 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-10d91093-5ac2-4bfc-9540-85d5c091b4e2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:38.042209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-10d91093-5ac2-4bfc-9540-85d5c091b4e2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:38.042717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-10d91093-5ac2-4bfc-9540-85d5c091b4e2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:38.043157 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-10d91093-5ac2-4bfc-9540-85d5c091b4e2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:38.043829 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-10d91093-5ac2-4bfc-9540-85d5c091b4e2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:38.044285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-10d91093-5ac2-4bfc-9540-85d5c091b4e2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:38.044708 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-10d91093-5ac2-4bfc-9540-85d5c091b4e2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:38.171709 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-10d91093-5ac2-4bfc-9540-85d5c091b4e2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:38.180284 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-10d91093-5ac2-4bfc-9540-85d5c091b4e2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148881 Aug 24 12:53:38.180887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1506/3012] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:38 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:38.525849 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9355ec0c-7905-4bba-b611-8f1cb7d5dcb3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:38.526464 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9355ec0c-7905-4bba-b611-8f1cb7d5dcb3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:38.532466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9355ec0c-7905-4bba-b611-8f1cb7d5dcb3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:38.532947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9355ec0c-7905-4bba-b611-8f1cb7d5dcb3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:38.533388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9355ec0c-7905-4bba-b611-8f1cb7d5dcb3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:38.534073 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9355ec0c-7905-4bba-b611-8f1cb7d5dcb3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:38.534535 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9355ec0c-7905-4bba-b611-8f1cb7d5dcb3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:38.534993 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9355ec0c-7905-4bba-b611-8f1cb7d5dcb3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:38.658887 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9355ec0c-7905-4bba-b611-8f1cb7d5dcb3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:38.666896 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9355ec0c-7905-4bba-b611-8f1cb7d5dcb3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.144919 Aug 24 12:53:38.667497 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1507/3013] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:38 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:38.824301 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c63947aa-d083-4f29-ba02-0c0483e1b71e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:38.824933 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c63947aa-d083-4f29-ba02-0c0483e1b71e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:38.831294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c63947aa-d083-4f29-ba02-0c0483e1b71e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:38.831765 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c63947aa-d083-4f29-ba02-0c0483e1b71e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:38.832844 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c63947aa-d083-4f29-ba02-0c0483e1b71e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:38.833515 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c63947aa-d083-4f29-ba02-0c0483e1b71e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:38.833956 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c63947aa-d083-4f29-ba02-0c0483e1b71e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:38.834372 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c63947aa-d083-4f29-ba02-0c0483e1b71e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:38.962811 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c63947aa-d083-4f29-ba02-0c0483e1b71e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:38.970832 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c63947aa-d083-4f29-ba02-0c0483e1b71e tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150335 Aug 24 12:53:38.971385 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1507/3014] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:38 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:39.014949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4992ba5f-a772-44ab-b37d-37450ba7773f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:39.015554 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4992ba5f-a772-44ab-b37d-37450ba7773f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:39.021826 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4992ba5f-a772-44ab-b37d-37450ba7773f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:39.022307 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4992ba5f-a772-44ab-b37d-37450ba7773f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:39.022769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4992ba5f-a772-44ab-b37d-37450ba7773f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:39.023456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4992ba5f-a772-44ab-b37d-37450ba7773f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:39.023906 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4992ba5f-a772-44ab-b37d-37450ba7773f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:39.024325 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4992ba5f-a772-44ab-b37d-37450ba7773f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:39.156580 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4992ba5f-a772-44ab-b37d-37450ba7773f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:39.165077 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4992ba5f-a772-44ab-b37d-37450ba7773f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:39.166572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4992ba5f-a772-44ab-b37d-37450ba7773f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:39.167760 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4992ba5f-a772-44ab-b37d-37450ba7773f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.156716 Aug 24 12:53:39.168318 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1508/3015] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:39 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:39.200993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-26cd1e7a-02f1-49db-9b9a-b6fa9439fea0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:39.201598 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-26cd1e7a-02f1-49db-9b9a-b6fa9439fea0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:39.207517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26cd1e7a-02f1-49db-9b9a-b6fa9439fea0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:39.207990 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26cd1e7a-02f1-49db-9b9a-b6fa9439fea0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:39.208494 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26cd1e7a-02f1-49db-9b9a-b6fa9439fea0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:39.209163 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26cd1e7a-02f1-49db-9b9a-b6fa9439fea0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:39.209607 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26cd1e7a-02f1-49db-9b9a-b6fa9439fea0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:39.210023 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-26cd1e7a-02f1-49db-9b9a-b6fa9439fea0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:39.335572 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-26cd1e7a-02f1-49db-9b9a-b6fa9439fea0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:39.343901 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-26cd1e7a-02f1-49db-9b9a-b6fa9439fea0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.146764 Aug 24 12:53:39.344482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1508/3016] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:39 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:39.687233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-36439876-0880-476d-b4c9-b0e8e4e1ed6e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:39.687755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-36439876-0880-476d-b4c9-b0e8e4e1ed6e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:39.693601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-36439876-0880-476d-b4c9-b0e8e4e1ed6e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:39.694079 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-36439876-0880-476d-b4c9-b0e8e4e1ed6e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:39.694512 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-36439876-0880-476d-b4c9-b0e8e4e1ed6e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:39.695237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-36439876-0880-476d-b4c9-b0e8e4e1ed6e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:39.695687 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-36439876-0880-476d-b4c9-b0e8e4e1ed6e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:39.696107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-36439876-0880-476d-b4c9-b0e8e4e1ed6e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:39.820300 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-36439876-0880-476d-b4c9-b0e8e4e1ed6e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:39.828378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-36439876-0880-476d-b4c9-b0e8e4e1ed6e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.145008 Aug 24 12:53:39.828971 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1509/3017] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:39 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:39.991512 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-94d2d2a6-c6c3-4987-bc11-f67fb60cd090 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:39.992115 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-94d2d2a6-c6c3-4987-bc11-f67fb60cd090 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:39.998607 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94d2d2a6-c6c3-4987-bc11-f67fb60cd090 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:39.999113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94d2d2a6-c6c3-4987-bc11-f67fb60cd090 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:39.999539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94d2d2a6-c6c3-4987-bc11-f67fb60cd090 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:40.000206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94d2d2a6-c6c3-4987-bc11-f67fb60cd090 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:40.000651 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94d2d2a6-c6c3-4987-bc11-f67fb60cd090 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:40.001070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94d2d2a6-c6c3-4987-bc11-f67fb60cd090 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:40.131575 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-94d2d2a6-c6c3-4987-bc11-f67fb60cd090 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:40.139587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-94d2d2a6-c6c3-4987-bc11-f67fb60cd090 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.152138 Aug 24 12:53:40.140135 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1509/3018] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:39 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:40.190719 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5dfeef69-edfb-4930-be48-bf24809e1c3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:40.191836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5dfeef69-edfb-4930-be48-bf24809e1c3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:40.198260 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5dfeef69-edfb-4930-be48-bf24809e1c3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:40.198782 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5dfeef69-edfb-4930-be48-bf24809e1c3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:40.199226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5dfeef69-edfb-4930-be48-bf24809e1c3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:40.199913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5dfeef69-edfb-4930-be48-bf24809e1c3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:40.200375 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5dfeef69-edfb-4930-be48-bf24809e1c3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:40.200807 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5dfeef69-edfb-4930-be48-bf24809e1c3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:40.331484 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5dfeef69-edfb-4930-be48-bf24809e1c3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:40.340866 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5dfeef69-edfb-4930-be48-bf24809e1c3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:40.342365 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5dfeef69-edfb-4930-be48-bf24809e1c3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:40.343550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5dfeef69-edfb-4930-be48-bf24809e1c3e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.156721 Aug 24 12:53:40.344113 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1510/3019] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:40 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:40.365028 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-347ce1e6-213c-432b-a839-ab576bab8e2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:40.371261 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-347ce1e6-213c-432b-a839-ab576bab8e2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:40.371816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-347ce1e6-213c-432b-a839-ab576bab8e2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:40.372334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-347ce1e6-213c-432b-a839-ab576bab8e2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:40.372775 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-347ce1e6-213c-432b-a839-ab576bab8e2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:40.373488 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-347ce1e6-213c-432b-a839-ab576bab8e2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:40.373978 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-347ce1e6-213c-432b-a839-ab576bab8e2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:40.374402 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-347ce1e6-213c-432b-a839-ab576bab8e2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:40.503451 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-347ce1e6-213c-432b-a839-ab576bab8e2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:40.512137 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-347ce1e6-213c-432b-a839-ab576bab8e2e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151257 Aug 24 12:53:40.512710 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1510/3020] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:40 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:40.850397 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2aeb6953-2c99-421f-a0cd-f1562094c417 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:40.850995 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2aeb6953-2c99-421f-a0cd-f1562094c417 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:40.856948 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2aeb6953-2c99-421f-a0cd-f1562094c417 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:40.857433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2aeb6953-2c99-421f-a0cd-f1562094c417 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:40.857869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2aeb6953-2c99-421f-a0cd-f1562094c417 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:40.858550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2aeb6953-2c99-421f-a0cd-f1562094c417 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:40.859045 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2aeb6953-2c99-421f-a0cd-f1562094c417 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:40.859471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2aeb6953-2c99-421f-a0cd-f1562094c417 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:40.996106 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2aeb6953-2c99-421f-a0cd-f1562094c417 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:41.004164 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2aeb6953-2c99-421f-a0cd-f1562094c417 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.158250 Aug 24 12:53:41.004720 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1511/3021] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:40 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:41.161090 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e93c73dc-79aa-4111-8006-366b59d7b041 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:41.161602 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e93c73dc-79aa-4111-8006-366b59d7b041 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:41.168019 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e93c73dc-79aa-4111-8006-366b59d7b041 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:41.168492 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e93c73dc-79aa-4111-8006-366b59d7b041 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:41.168917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e93c73dc-79aa-4111-8006-366b59d7b041 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:41.169587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e93c73dc-79aa-4111-8006-366b59d7b041 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:41.170030 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e93c73dc-79aa-4111-8006-366b59d7b041 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:41.170446 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e93c73dc-79aa-4111-8006-366b59d7b041 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:41.300440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e93c73dc-79aa-4111-8006-366b59d7b041 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:41.308475 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e93c73dc-79aa-4111-8006-366b59d7b041 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151789 Aug 24 12:53:41.309037 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1511/3022] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:41 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:41.365929 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c146ed08-8e34-4e1b-8adf-ffaa43cd4d71 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:41.366531 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c146ed08-8e34-4e1b-8adf-ffaa43cd4d71 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:41.372951 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c146ed08-8e34-4e1b-8adf-ffaa43cd4d71 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:41.373429 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c146ed08-8e34-4e1b-8adf-ffaa43cd4d71 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:41.373861 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c146ed08-8e34-4e1b-8adf-ffaa43cd4d71 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:41.374540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c146ed08-8e34-4e1b-8adf-ffaa43cd4d71 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:41.375020 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c146ed08-8e34-4e1b-8adf-ffaa43cd4d71 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:41.375440 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c146ed08-8e34-4e1b-8adf-ffaa43cd4d71 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:41.501617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c146ed08-8e34-4e1b-8adf-ffaa43cd4d71 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:41.510090 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c146ed08-8e34-4e1b-8adf-ffaa43cd4d71 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:41.511600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c146ed08-8e34-4e1b-8adf-ffaa43cd4d71 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:41.512745 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c146ed08-8e34-4e1b-8adf-ffaa43cd4d71 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.150924 Aug 24 12:53:41.513291 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1512/3023] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:41 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:41.531886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b299f0ca-a68d-4b82-b0e2-5f3587b998cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:41.532487 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b299f0ca-a68d-4b82-b0e2-5f3587b998cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:41.538832 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b299f0ca-a68d-4b82-b0e2-5f3587b998cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:41.539303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b299f0ca-a68d-4b82-b0e2-5f3587b998cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:41.539730 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b299f0ca-a68d-4b82-b0e2-5f3587b998cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:41.540394 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b299f0ca-a68d-4b82-b0e2-5f3587b998cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:41.540840 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b299f0ca-a68d-4b82-b0e2-5f3587b998cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:41.541259 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b299f0ca-a68d-4b82-b0e2-5f3587b998cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:41.669961 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b299f0ca-a68d-4b82-b0e2-5f3587b998cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:41.678135 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b299f0ca-a68d-4b82-b0e2-5f3587b998cb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149995 Aug 24 12:53:41.678643 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1512/3024] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:41 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:42.024646 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6aae60cb-32c7-4315-a315-460d37dd8a9f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:42.025254 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6aae60cb-32c7-4315-a315-460d37dd8a9f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:42.032338 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6aae60cb-32c7-4315-a315-460d37dd8a9f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:42.032824 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6aae60cb-32c7-4315-a315-460d37dd8a9f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:42.040593 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6aae60cb-32c7-4315-a315-460d37dd8a9f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:42.041334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6aae60cb-32c7-4315-a315-460d37dd8a9f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:42.041806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6aae60cb-32c7-4315-a315-460d37dd8a9f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:42.042236 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6aae60cb-32c7-4315-a315-460d37dd8a9f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:42.183027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6aae60cb-32c7-4315-a315-460d37dd8a9f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:42.191237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6aae60cb-32c7-4315-a315-460d37dd8a9f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.170452 Aug 24 12:53:42.192414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1513/3025] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:42 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:42.329255 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c8e0d5d7-049d-422a-abe3-f4eb6a9c6085 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:42.329886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c8e0d5d7-049d-422a-abe3-f4eb6a9c6085 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:42.336490 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c8e0d5d7-049d-422a-abe3-f4eb6a9c6085 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:42.336975 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c8e0d5d7-049d-422a-abe3-f4eb6a9c6085 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:42.337408 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c8e0d5d7-049d-422a-abe3-f4eb6a9c6085 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:42.338123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c8e0d5d7-049d-422a-abe3-f4eb6a9c6085 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:42.338576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c8e0d5d7-049d-422a-abe3-f4eb6a9c6085 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:42.339026 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c8e0d5d7-049d-422a-abe3-f4eb6a9c6085 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:42.464204 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c8e0d5d7-049d-422a-abe3-f4eb6a9c6085 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:42.472240 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c8e0d5d7-049d-422a-abe3-f4eb6a9c6085 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.146848 Aug 24 12:53:42.473398 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1513/3026] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:42 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:42.536244 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-75fbbf56-c39f-41ee-92be-3e5622dacbb4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:42.536790 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-75fbbf56-c39f-41ee-92be-3e5622dacbb4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:42.543069 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75fbbf56-c39f-41ee-92be-3e5622dacbb4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:42.543549 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75fbbf56-c39f-41ee-92be-3e5622dacbb4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:42.543988 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75fbbf56-c39f-41ee-92be-3e5622dacbb4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:42.544662 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75fbbf56-c39f-41ee-92be-3e5622dacbb4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:42.545118 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75fbbf56-c39f-41ee-92be-3e5622dacbb4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:42.545542 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-75fbbf56-c39f-41ee-92be-3e5622dacbb4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:42.672204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-75fbbf56-c39f-41ee-92be-3e5622dacbb4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:42.681843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-75fbbf56-c39f-41ee-92be-3e5622dacbb4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:42.683391 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-75fbbf56-c39f-41ee-92be-3e5622dacbb4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:42.684541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-75fbbf56-c39f-41ee-92be-3e5622dacbb4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.152728 Aug 24 12:53:42.685124 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1514/3027] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:42 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:42.700666 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e87685ad-7c85-4ee6-a738-aab4dd748b2f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:42.701309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e87685ad-7c85-4ee6-a738-aab4dd748b2f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:42.707694 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e87685ad-7c85-4ee6-a738-aab4dd748b2f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:42.708175 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e87685ad-7c85-4ee6-a738-aab4dd748b2f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:42.708606 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e87685ad-7c85-4ee6-a738-aab4dd748b2f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:42.709283 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e87685ad-7c85-4ee6-a738-aab4dd748b2f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:42.709732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e87685ad-7c85-4ee6-a738-aab4dd748b2f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:42.710156 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e87685ad-7c85-4ee6-a738-aab4dd748b2f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:42.837721 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e87685ad-7c85-4ee6-a738-aab4dd748b2f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:42.845752 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e87685ad-7c85-4ee6-a738-aab4dd748b2f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148923 Aug 24 12:53:42.846315 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1514/3028] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:42 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:43.213860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-139056ee-92a2-49d0-b76d-b0e98bc06bcd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:43.214427 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-139056ee-92a2-49d0-b76d-b0e98bc06bcd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:43.220392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-139056ee-92a2-49d0-b76d-b0e98bc06bcd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:43.220865 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-139056ee-92a2-49d0-b76d-b0e98bc06bcd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:43.221294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-139056ee-92a2-49d0-b76d-b0e98bc06bcd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:43.221964 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-139056ee-92a2-49d0-b76d-b0e98bc06bcd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:43.222412 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-139056ee-92a2-49d0-b76d-b0e98bc06bcd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:43.222866 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-139056ee-92a2-49d0-b76d-b0e98bc06bcd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:43.351358 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-139056ee-92a2-49d0-b76d-b0e98bc06bcd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:43.359415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-139056ee-92a2-49d0-b76d-b0e98bc06bcd tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149493 Aug 24 12:53:43.359972 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1515/3029] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:43 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:43.494035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f0a97d84-f8b3-43e7-99a7-57bca7d1ffdd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:43.494668 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f0a97d84-f8b3-43e7-99a7-57bca7d1ffdd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:43.501046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0a97d84-f8b3-43e7-99a7-57bca7d1ffdd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:43.501522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0a97d84-f8b3-43e7-99a7-57bca7d1ffdd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:43.501954 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0a97d84-f8b3-43e7-99a7-57bca7d1ffdd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:43.502626 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0a97d84-f8b3-43e7-99a7-57bca7d1ffdd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:43.503098 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0a97d84-f8b3-43e7-99a7-57bca7d1ffdd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:43.503518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0a97d84-f8b3-43e7-99a7-57bca7d1ffdd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:43.631910 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f0a97d84-f8b3-43e7-99a7-57bca7d1ffdd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:43.640330 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f0a97d84-f8b3-43e7-99a7-57bca7d1ffdd tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.150138 Aug 24 12:53:43.640971 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1515/3030] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:43 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:43.707685 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2ffa1756-ae74-4fb4-b2fe-c8374a5b514d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:43.708290 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2ffa1756-ae74-4fb4-b2fe-c8374a5b514d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:43.710572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:53:43.715221 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2ffa1756-ae74-4fb4-b2fe-c8374a5b514d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:43.715697 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2ffa1756-ae74-4fb4-b2fe-c8374a5b514d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:43.716127 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2ffa1756-ae74-4fb4-b2fe-c8374a5b514d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:43.716803 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2ffa1756-ae74-4fb4-b2fe-c8374a5b514d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:43.717252 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2ffa1756-ae74-4fb4-b2fe-c8374a5b514d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:43.717670 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2ffa1756-ae74-4fb4-b2fe-c8374a5b514d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:43.846965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2ffa1756-ae74-4fb4-b2fe-c8374a5b514d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:43.855976 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2ffa1756-ae74-4fb4-b2fe-c8374a5b514d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:43.857445 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2ffa1756-ae74-4fb4-b2fe-c8374a5b514d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:43.858616 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2ffa1756-ae74-4fb4-b2fe-c8374a5b514d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154840 Aug 24 12:53:43.859199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1516/3031] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:43 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:43.867558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-af242122-9045-4f1f-aee6-9e3ab643bd22 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:43.868161 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-af242122-9045-4f1f-aee6-9e3ab643bd22 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:43.873906 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af242122-9045-4f1f-aee6-9e3ab643bd22 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:43.874377 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af242122-9045-4f1f-aee6-9e3ab643bd22 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:43.874883 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af242122-9045-4f1f-aee6-9e3ab643bd22 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:43.875548 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af242122-9045-4f1f-aee6-9e3ab643bd22 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:43.875997 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af242122-9045-4f1f-aee6-9e3ab643bd22 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:43.876414 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af242122-9045-4f1f-aee6-9e3ab643bd22 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:44.005127 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-af242122-9045-4f1f-aee6-9e3ab643bd22 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:44.013323 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-af242122-9045-4f1f-aee6-9e3ab643bd22 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150117 Aug 24 12:53:44.013894 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1516/3032] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:43 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:44.379625 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c5aafde1-0315-44c2-ba1b-19db47e84c9e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:44.380265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c5aafde1-0315-44c2-ba1b-19db47e84c9e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:44.386262 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c5aafde1-0315-44c2-ba1b-19db47e84c9e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:44.386775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c5aafde1-0315-44c2-ba1b-19db47e84c9e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:44.387215 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c5aafde1-0315-44c2-ba1b-19db47e84c9e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:44.387899 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c5aafde1-0315-44c2-ba1b-19db47e84c9e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:44.388354 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c5aafde1-0315-44c2-ba1b-19db47e84c9e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:44.388780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c5aafde1-0315-44c2-ba1b-19db47e84c9e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:44.515525 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c5aafde1-0315-44c2-ba1b-19db47e84c9e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:44.524098 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c5aafde1-0315-44c2-ba1b-19db47e84c9e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.148304 Aug 24 12:53:44.524653 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1517/3033] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:44 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:44.661616 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0578a07c-5467-43a5-927e-994f59756828 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:44.662143 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0578a07c-5467-43a5-927e-994f59756828 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:44.668588 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0578a07c-5467-43a5-927e-994f59756828 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:44.669066 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0578a07c-5467-43a5-927e-994f59756828 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:44.669500 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0578a07c-5467-43a5-927e-994f59756828 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:44.670175 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0578a07c-5467-43a5-927e-994f59756828 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:44.670624 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0578a07c-5467-43a5-927e-994f59756828 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:44.671073 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0578a07c-5467-43a5-927e-994f59756828 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:44.797177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0578a07c-5467-43a5-927e-994f59756828 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:44.805369 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0578a07c-5467-43a5-927e-994f59756828 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147672 Aug 24 12:53:44.805838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1517/3034] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:44 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:44.882858 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-60e695f0-28f2-4792-bef8-950341007fa8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:44.883486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-60e695f0-28f2-4792-bef8-950341007fa8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:44.889734 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-60e695f0-28f2-4792-bef8-950341007fa8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:44.890217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-60e695f0-28f2-4792-bef8-950341007fa8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:44.890657 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-60e695f0-28f2-4792-bef8-950341007fa8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:44.891355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-60e695f0-28f2-4792-bef8-950341007fa8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:44.891809 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-60e695f0-28f2-4792-bef8-950341007fa8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:44.892263 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-60e695f0-28f2-4792-bef8-950341007fa8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:45.025258 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-60e695f0-28f2-4792-bef8-950341007fa8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:45.033145 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-986e0e25-56ae-4728-abe8-dbefca0277f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:45.033717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-986e0e25-56ae-4728-abe8-dbefca0277f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:45.034151 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-60e695f0-28f2-4792-bef8-950341007fa8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:45.035667 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-60e695f0-28f2-4792-bef8-950341007fa8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:45.036834 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-60e695f0-28f2-4792-bef8-950341007fa8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.158346 Aug 24 12:53:45.037392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1518/3035] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:44 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:45.039960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-986e0e25-56ae-4728-abe8-dbefca0277f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:45.040451 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-986e0e25-56ae-4728-abe8-dbefca0277f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:45.040923 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-986e0e25-56ae-4728-abe8-dbefca0277f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:45.041618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-986e0e25-56ae-4728-abe8-dbefca0277f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:45.042074 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-986e0e25-56ae-4728-abe8-dbefca0277f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:45.042503 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-986e0e25-56ae-4728-abe8-dbefca0277f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:45.174551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-986e0e25-56ae-4728-abe8-dbefca0277f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:45.183376 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-986e0e25-56ae-4728-abe8-dbefca0277f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153957 Aug 24 12:53:45.183865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1518/3036] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:45 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:45.545269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fd085183-17df-4cff-9070-467c8ab8491c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:45.545913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fd085183-17df-4cff-9070-467c8ab8491c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:45.552477 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fd085183-17df-4cff-9070-467c8ab8491c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:45.552959 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fd085183-17df-4cff-9070-467c8ab8491c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:45.553397 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fd085183-17df-4cff-9070-467c8ab8491c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:45.554078 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fd085183-17df-4cff-9070-467c8ab8491c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:45.554533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fd085183-17df-4cff-9070-467c8ab8491c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:45.554984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fd085183-17df-4cff-9070-467c8ab8491c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:45.678511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fd085183-17df-4cff-9070-467c8ab8491c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:45.686622 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fd085183-17df-4cff-9070-467c8ab8491c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.145204 Aug 24 12:53:45.687211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1519/3037] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:45 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:45.826943 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f81a137f-54ff-415e-8357-4f706877d863 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:45.827473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f81a137f-54ff-415e-8357-4f706877d863 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:45.833823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f81a137f-54ff-415e-8357-4f706877d863 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:45.834329 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f81a137f-54ff-415e-8357-4f706877d863 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:45.834783 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f81a137f-54ff-415e-8357-4f706877d863 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:45.835459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f81a137f-54ff-415e-8357-4f706877d863 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:45.835905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f81a137f-54ff-415e-8357-4f706877d863 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:45.836326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f81a137f-54ff-415e-8357-4f706877d863 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:45.961885 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f81a137f-54ff-415e-8357-4f706877d863 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:45.969907 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f81a137f-54ff-415e-8357-4f706877d863 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147141 Aug 24 12:53:45.970463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1519/3038] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:45 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:46.060269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8dd14e16-e550-4f2c-93fb-40c163560a53 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:46.060880 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8dd14e16-e550-4f2c-93fb-40c163560a53 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:46.068153 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8dd14e16-e550-4f2c-93fb-40c163560a53 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:46.068837 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8dd14e16-e550-4f2c-93fb-40c163560a53 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:46.069432 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8dd14e16-e550-4f2c-93fb-40c163560a53 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:46.070264 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8dd14e16-e550-4f2c-93fb-40c163560a53 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:46.070753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8dd14e16-e550-4f2c-93fb-40c163560a53 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:46.071181 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8dd14e16-e550-4f2c-93fb-40c163560a53 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:46.200966 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8dd14e16-e550-4f2c-93fb-40c163560a53 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:46.204275 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c0e4ff81-9f1e-4fb9-b34f-484b934bb1e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:46.204880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c0e4ff81-9f1e-4fb9-b34f-484b934bb1e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:46.210327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8dd14e16-e550-4f2c-93fb-40c163560a53 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:46.211371 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0e4ff81-9f1e-4fb9-b34f-484b934bb1e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:46.211857 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0e4ff81-9f1e-4fb9-b34f-484b934bb1e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:46.211986 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8dd14e16-e550-4f2c-93fb-40c163560a53 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:46.212277 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0e4ff81-9f1e-4fb9-b34f-484b934bb1e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:46.212950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0e4ff81-9f1e-4fb9-b34f-484b934bb1e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:46.213083 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8dd14e16-e550-4f2c-93fb-40c163560a53 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.156894 Aug 24 12:53:46.213397 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0e4ff81-9f1e-4fb9-b34f-484b934bb1e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:46.213635 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1520/3039] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:46 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:46.213877 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0e4ff81-9f1e-4fb9-b34f-484b934bb1e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:46.341384 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c0e4ff81-9f1e-4fb9-b34f-484b934bb1e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:46.349472 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c0e4ff81-9f1e-4fb9-b34f-484b934bb1e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148966 Aug 24 12:53:46.350029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1520/3040] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:46 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:46.707638 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-abdc562e-4703-41e9-831f-55214fffef75 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:46.708166 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-abdc562e-4703-41e9-831f-55214fffef75 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:46.714079 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-abdc562e-4703-41e9-831f-55214fffef75 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:46.714556 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-abdc562e-4703-41e9-831f-55214fffef75 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:46.715018 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-abdc562e-4703-41e9-831f-55214fffef75 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:46.715694 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-abdc562e-4703-41e9-831f-55214fffef75 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:46.716147 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-abdc562e-4703-41e9-831f-55214fffef75 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:46.716578 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-abdc562e-4703-41e9-831f-55214fffef75 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:46.839859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-abdc562e-4703-41e9-831f-55214fffef75 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:46.848388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-abdc562e-4703-41e9-831f-55214fffef75 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.144710 Aug 24 12:53:46.848945 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1521/3041] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:46 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:46.999159 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8b9d9ba8-c31c-402f-859d-7eb9380c0bc2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:46.999761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8b9d9ba8-c31c-402f-859d-7eb9380c0bc2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:47.006014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b9d9ba8-c31c-402f-859d-7eb9380c0bc2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:47.006482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b9d9ba8-c31c-402f-859d-7eb9380c0bc2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:47.006939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b9d9ba8-c31c-402f-859d-7eb9380c0bc2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:47.007607 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b9d9ba8-c31c-402f-859d-7eb9380c0bc2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:47.008052 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b9d9ba8-c31c-402f-859d-7eb9380c0bc2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:47.008469 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8b9d9ba8-c31c-402f-859d-7eb9380c0bc2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:47.137871 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8b9d9ba8-c31c-402f-859d-7eb9380c0bc2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:47.140124 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:53:47.146704 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8b9d9ba8-c31c-402f-859d-7eb9380c0bc2 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151369 Aug 24 12:53:47.147264 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1521/3042] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:46 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:47.235604 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8d5e94bf-8c3f-40cf-8ace-51670700b134 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:47.236204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8d5e94bf-8c3f-40cf-8ace-51670700b134 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:47.242841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d5e94bf-8c3f-40cf-8ace-51670700b134 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:47.243317 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d5e94bf-8c3f-40cf-8ace-51670700b134 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:47.243745 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d5e94bf-8c3f-40cf-8ace-51670700b134 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:47.244418 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d5e94bf-8c3f-40cf-8ace-51670700b134 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:47.244867 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d5e94bf-8c3f-40cf-8ace-51670700b134 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:47.245286 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d5e94bf-8c3f-40cf-8ace-51670700b134 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:47.259695 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:53:47.369818 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-eb718c04-e942-4566-bcee-2d7247b48ff4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:47.370473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-eb718c04-e942-4566-bcee-2d7247b48ff4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:47.376467 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb718c04-e942-4566-bcee-2d7247b48ff4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:47.376931 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb718c04-e942-4566-bcee-2d7247b48ff4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:47.377368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb718c04-e942-4566-bcee-2d7247b48ff4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:47.378046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb718c04-e942-4566-bcee-2d7247b48ff4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:47.378490 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb718c04-e942-4566-bcee-2d7247b48ff4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:47.378934 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb718c04-e942-4566-bcee-2d7247b48ff4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:47.382161 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8d5e94bf-8c3f-40cf-8ace-51670700b134 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:47.390609 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8d5e94bf-8c3f-40cf-8ace-51670700b134 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:47.392109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8d5e94bf-8c3f-40cf-8ace-51670700b134 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:47.393257 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8d5e94bf-8c3f-40cf-8ace-51670700b134 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.161504 Aug 24 12:53:47.393809 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1522/3043] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:47 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:53:47.506002 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-eb718c04-e942-4566-bcee-2d7247b48ff4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:47.514114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-eb718c04-e942-4566-bcee-2d7247b48ff4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148450 Aug 24 12:53:47.514610 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1522/3044] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:47 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:47.869105 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6af534b9-6183-429a-ad0e-f71643b7e661 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:47.869649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6af534b9-6183-429a-ad0e-f71643b7e661 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:47.875539 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6af534b9-6183-429a-ad0e-f71643b7e661 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:47.876017 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6af534b9-6183-429a-ad0e-f71643b7e661 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:47.876453 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6af534b9-6183-429a-ad0e-f71643b7e661 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:47.877165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6af534b9-6183-429a-ad0e-f71643b7e661 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:47.877620 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6af534b9-6183-429a-ad0e-f71643b7e661 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:47.878044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6af534b9-6183-429a-ad0e-f71643b7e661 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:48.005623 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6af534b9-6183-429a-ad0e-f71643b7e661 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:48.013716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6af534b9-6183-429a-ad0e-f71643b7e661 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.148533 Aug 24 12:53:48.014266 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1523/3045] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:47 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:48.176425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ae585eaf-94b8-413e-a10b-b236c05ff41b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:48.176961 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ae585eaf-94b8-413e-a10b-b236c05ff41b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:48.183283 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ae585eaf-94b8-413e-a10b-b236c05ff41b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:48.183757 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ae585eaf-94b8-413e-a10b-b236c05ff41b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:48.184190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ae585eaf-94b8-413e-a10b-b236c05ff41b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:48.184864 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ae585eaf-94b8-413e-a10b-b236c05ff41b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:48.185313 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ae585eaf-94b8-413e-a10b-b236c05ff41b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:48.185734 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ae585eaf-94b8-413e-a10b-b236c05ff41b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:48.316116 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ae585eaf-94b8-413e-a10b-b236c05ff41b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:48.324540 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ae585eaf-94b8-413e-a10b-b236c05ff41b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.152470 Aug 24 12:53:48.325135 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1523/3046] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:48 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:48.416825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9fad12a7-c892-4fac-81b3-95a7ebdfe4e3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:48.417436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9fad12a7-c892-4fac-81b3-95a7ebdfe4e3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:48.423860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9fad12a7-c892-4fac-81b3-95a7ebdfe4e3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:48.424346 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9fad12a7-c892-4fac-81b3-95a7ebdfe4e3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:48.424787 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9fad12a7-c892-4fac-81b3-95a7ebdfe4e3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:48.426144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9fad12a7-c892-4fac-81b3-95a7ebdfe4e3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:48.426685 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9fad12a7-c892-4fac-81b3-95a7ebdfe4e3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:48.427056 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9fad12a7-c892-4fac-81b3-95a7ebdfe4e3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:48.536108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-79d58054-b8c3-496d-9968-7628c975ccfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:48.536827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-79d58054-b8c3-496d-9968-7628c975ccfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:48.538761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:53:48.543412 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-79d58054-b8c3-496d-9968-7628c975ccfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:48.543966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-79d58054-b8c3-496d-9968-7628c975ccfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:48.544465 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-79d58054-b8c3-496d-9968-7628c975ccfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:48.545209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-79d58054-b8c3-496d-9968-7628c975ccfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:48.545738 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-79d58054-b8c3-496d-9968-7628c975ccfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:48.546160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-79d58054-b8c3-496d-9968-7628c975ccfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:48.553503 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9fad12a7-c892-4fac-81b3-95a7ebdfe4e3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:48.562161 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9fad12a7-c892-4fac-81b3-95a7ebdfe4e3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:48.563684 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9fad12a7-c892-4fac-81b3-95a7ebdfe4e3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:48.564847 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9fad12a7-c892-4fac-81b3-95a7ebdfe4e3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.151916 Aug 24 12:53:48.565405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1524/3047] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:48 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:48.672042 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-79d58054-b8c3-496d-9968-7628c975ccfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:48.680901 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-79d58054-b8c3-496d-9968-7628c975ccfc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149136 Aug 24 12:53:48.681410 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1524/3048] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:48 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:49.037984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d7574fa2-97f2-4224-8d1c-6e887d398d23 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:49.038597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d7574fa2-97f2-4224-8d1c-6e887d398d23 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:49.044511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7574fa2-97f2-4224-8d1c-6e887d398d23 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:49.044991 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7574fa2-97f2-4224-8d1c-6e887d398d23 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:49.045419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7574fa2-97f2-4224-8d1c-6e887d398d23 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:49.046096 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7574fa2-97f2-4224-8d1c-6e887d398d23 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:49.046545 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7574fa2-97f2-4224-8d1c-6e887d398d23 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:49.047098 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7574fa2-97f2-4224-8d1c-6e887d398d23 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:49.175811 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d7574fa2-97f2-4224-8d1c-6e887d398d23 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:49.184017 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d7574fa2-97f2-4224-8d1c-6e887d398d23 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150597 Aug 24 12:53:49.184576 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1525/3049] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:49 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:49.344848 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-497c86ab-21bc-4d60-835a-42aab6f2ca73 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:49.345415 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-497c86ab-21bc-4d60-835a-42aab6f2ca73 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:49.351798 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-497c86ab-21bc-4d60-835a-42aab6f2ca73 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:49.352277 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-497c86ab-21bc-4d60-835a-42aab6f2ca73 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:49.352714 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-497c86ab-21bc-4d60-835a-42aab6f2ca73 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:49.353391 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-497c86ab-21bc-4d60-835a-42aab6f2ca73 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:49.353838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-497c86ab-21bc-4d60-835a-42aab6f2ca73 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:49.354256 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-497c86ab-21bc-4d60-835a-42aab6f2ca73 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:49.481393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-497c86ab-21bc-4d60-835a-42aab6f2ca73 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:49.490353 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-497c86ab-21bc-4d60-835a-42aab6f2ca73 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149431 Aug 24 12:53:49.490959 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1525/3050] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:49 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:49.588293 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3695e3e3-ab92-4a34-adf7-c9697ff8251a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:49.588943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3695e3e3-ab92-4a34-adf7-c9697ff8251a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:49.595399 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3695e3e3-ab92-4a34-adf7-c9697ff8251a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:49.595824 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3695e3e3-ab92-4a34-adf7-c9697ff8251a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:49.596255 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3695e3e3-ab92-4a34-adf7-c9697ff8251a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:49.596983 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3695e3e3-ab92-4a34-adf7-c9697ff8251a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:49.597490 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3695e3e3-ab92-4a34-adf7-c9697ff8251a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:49.597876 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3695e3e3-ab92-4a34-adf7-c9697ff8251a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:49.701363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3b4ae23d-29c7-4c08-bd92-55a4517843a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:49.702068 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3b4ae23d-29c7-4c08-bd92-55a4517843a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:49.708556 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b4ae23d-29c7-4c08-bd92-55a4517843a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:49.709043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b4ae23d-29c7-4c08-bd92-55a4517843a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:49.709479 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b4ae23d-29c7-4c08-bd92-55a4517843a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:49.710169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b4ae23d-29c7-4c08-bd92-55a4517843a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:49.710623 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b4ae23d-29c7-4c08-bd92-55a4517843a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:49.711100 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3b4ae23d-29c7-4c08-bd92-55a4517843a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:49.733763 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3695e3e3-ab92-4a34-adf7-c9697ff8251a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:49.742581 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3695e3e3-ab92-4a34-adf7-c9697ff8251a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:49.744094 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3695e3e3-ab92-4a34-adf7-c9697ff8251a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:49.745257 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3695e3e3-ab92-4a34-adf7-c9697ff8251a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.161016 Aug 24 12:53:49.745813 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1526/3051] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:49 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:49.841346 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3b4ae23d-29c7-4c08-bd92-55a4517843a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:49.849383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3b4ae23d-29c7-4c08-bd92-55a4517843a5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151963 Aug 24 12:53:49.849877 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1526/3052] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:49 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:50.205070 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-cdf3fa1a-a372-42fe-82f7-1dc741c0e08e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:50.205708 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-cdf3fa1a-a372-42fe-82f7-1dc741c0e08e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:50.211824 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cdf3fa1a-a372-42fe-82f7-1dc741c0e08e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:50.212310 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cdf3fa1a-a372-42fe-82f7-1dc741c0e08e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:50.212751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cdf3fa1a-a372-42fe-82f7-1dc741c0e08e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:50.213434 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cdf3fa1a-a372-42fe-82f7-1dc741c0e08e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:50.213967 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cdf3fa1a-a372-42fe-82f7-1dc741c0e08e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:50.214398 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cdf3fa1a-a372-42fe-82f7-1dc741c0e08e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:50.347469 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-cdf3fa1a-a372-42fe-82f7-1dc741c0e08e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:50.355720 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-cdf3fa1a-a372-42fe-82f7-1dc741c0e08e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.154424 Aug 24 12:53:50.356416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1527/3053] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:50 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:50.511150 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3cfa769e-9489-4107-87d8-99a462760231 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:50.511763 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3cfa769e-9489-4107-87d8-99a462760231 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:50.518286 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3cfa769e-9489-4107-87d8-99a462760231 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:50.518806 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3cfa769e-9489-4107-87d8-99a462760231 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:50.519245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3cfa769e-9489-4107-87d8-99a462760231 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:50.519972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3cfa769e-9489-4107-87d8-99a462760231 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:50.520428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3cfa769e-9489-4107-87d8-99a462760231 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:50.520859 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3cfa769e-9489-4107-87d8-99a462760231 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:50.646164 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3cfa769e-9489-4107-87d8-99a462760231 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:50.654214 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3cfa769e-9489-4107-87d8-99a462760231 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.146946 Aug 24 12:53:50.654798 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1527/3054] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:50 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:50.768000 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3bc0174b-551d-4e65-9c6e-4f5479bcbdd4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:50.768612 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3bc0174b-551d-4e65-9c6e-4f5479bcbdd4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:50.774910 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3bc0174b-551d-4e65-9c6e-4f5479bcbdd4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:50.775395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3bc0174b-551d-4e65-9c6e-4f5479bcbdd4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:50.775839 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3bc0174b-551d-4e65-9c6e-4f5479bcbdd4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:50.776522 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3bc0174b-551d-4e65-9c6e-4f5479bcbdd4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:50.776979 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3bc0174b-551d-4e65-9c6e-4f5479bcbdd4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:50.777404 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3bc0174b-551d-4e65-9c6e-4f5479bcbdd4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:50.869942 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ab0e8445-5228-4ff4-81d9-9415d83d885c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:50.870582 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ab0e8445-5228-4ff4-81d9-9415d83d885c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:50.876413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab0e8445-5228-4ff4-81d9-9415d83d885c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:50.876900 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab0e8445-5228-4ff4-81d9-9415d83d885c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:50.877332 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab0e8445-5228-4ff4-81d9-9415d83d885c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:50.878008 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab0e8445-5228-4ff4-81d9-9415d83d885c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:50.878636 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab0e8445-5228-4ff4-81d9-9415d83d885c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:50.879179 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab0e8445-5228-4ff4-81d9-9415d83d885c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:50.904473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3bc0174b-551d-4e65-9c6e-4f5479bcbdd4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:50.913830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3bc0174b-551d-4e65-9c6e-4f5479bcbdd4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:50.915359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3bc0174b-551d-4e65-9c6e-4f5479bcbdd4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:50.916526 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3bc0174b-551d-4e65-9c6e-4f5479bcbdd4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.152438 Aug 24 12:53:50.917307 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1528/3055] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:50 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:51.006163 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ab0e8445-5228-4ff4-81d9-9415d83d885c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:51.014206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ab0e8445-5228-4ff4-81d9-9415d83d885c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148158 Aug 24 12:53:51.014801 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1528/3056] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:50 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:51.377211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1bf8403d-eccc-44c3-bad7-b18672dc50a5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:51.377823 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1bf8403d-eccc-44c3-bad7-b18672dc50a5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:51.383813 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1bf8403d-eccc-44c3-bad7-b18672dc50a5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:51.384301 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1bf8403d-eccc-44c3-bad7-b18672dc50a5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:51.384735 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1bf8403d-eccc-44c3-bad7-b18672dc50a5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:51.385424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1bf8403d-eccc-44c3-bad7-b18672dc50a5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:51.385880 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1bf8403d-eccc-44c3-bad7-b18672dc50a5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:51.386308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1bf8403d-eccc-44c3-bad7-b18672dc50a5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:51.510952 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1bf8403d-eccc-44c3-bad7-b18672dc50a5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:51.519038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1bf8403d-eccc-44c3-bad7-b18672dc50a5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.145669 Aug 24 12:53:51.519596 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1529/3057] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:51 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:51.676109 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2b77f07e-c5a0-45fc-9373-1f330c483108 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:51.676710 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2b77f07e-c5a0-45fc-9373-1f330c483108 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:51.683152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b77f07e-c5a0-45fc-9373-1f330c483108 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:51.683549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b77f07e-c5a0-45fc-9373-1f330c483108 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:51.684003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b77f07e-c5a0-45fc-9373-1f330c483108 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:51.684673 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b77f07e-c5a0-45fc-9373-1f330c483108 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:51.685119 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b77f07e-c5a0-45fc-9373-1f330c483108 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:51.685536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b77f07e-c5a0-45fc-9373-1f330c483108 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:51.811453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2b77f07e-c5a0-45fc-9373-1f330c483108 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:51.819462 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2b77f07e-c5a0-45fc-9373-1f330c483108 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147895 Aug 24 12:53:51.819997 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1529/3058] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:51 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:51.940072 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d80416a6-6a4d-4541-a8b5-a142bc232e77 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:51.940600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d80416a6-6a4d-4541-a8b5-a142bc232e77 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:51.946966 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d80416a6-6a4d-4541-a8b5-a142bc232e77 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:51.947441 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d80416a6-6a4d-4541-a8b5-a142bc232e77 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:51.947870 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d80416a6-6a4d-4541-a8b5-a142bc232e77 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:51.948539 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d80416a6-6a4d-4541-a8b5-a142bc232e77 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:51.948990 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d80416a6-6a4d-4541-a8b5-a142bc232e77 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:51.949410 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d80416a6-6a4d-4541-a8b5-a142bc232e77 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:52.035774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-245bb888-7d41-43c2-b881-cc806c2b059d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:52.036520 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-245bb888-7d41-43c2-b881-cc806c2b059d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:52.042411 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-245bb888-7d41-43c2-b881-cc806c2b059d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:52.042928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-245bb888-7d41-43c2-b881-cc806c2b059d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:52.043364 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-245bb888-7d41-43c2-b881-cc806c2b059d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:52.044052 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-245bb888-7d41-43c2-b881-cc806c2b059d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:52.044498 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-245bb888-7d41-43c2-b881-cc806c2b059d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:52.044922 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-245bb888-7d41-43c2-b881-cc806c2b059d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:52.079876 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d80416a6-6a4d-4541-a8b5-a142bc232e77 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:52.089304 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d80416a6-6a4d-4541-a8b5-a142bc232e77 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:52.090920 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d80416a6-6a4d-4541-a8b5-a142bc232e77 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:52.092156 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d80416a6-6a4d-4541-a8b5-a142bc232e77 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155995 Aug 24 12:53:52.092790 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1530/3059] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:51 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:52.174853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-245bb888-7d41-43c2-b881-cc806c2b059d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:52.182984 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-245bb888-7d41-43c2-b881-cc806c2b059d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151631 Aug 24 12:53:52.183538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1530/3060] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:52 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:52.539761 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3e333243-ca36-44bb-9c38-51b1a178d515 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:52.540368 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3e333243-ca36-44bb-9c38-51b1a178d515 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:52.546243 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e333243-ca36-44bb-9c38-51b1a178d515 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:52.546929 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e333243-ca36-44bb-9c38-51b1a178d515 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:52.547363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e333243-ca36-44bb-9c38-51b1a178d515 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:52.548043 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e333243-ca36-44bb-9c38-51b1a178d515 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:52.548494 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e333243-ca36-44bb-9c38-51b1a178d515 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:52.548923 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3e333243-ca36-44bb-9c38-51b1a178d515 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:52.674946 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3e333243-ca36-44bb-9c38-51b1a178d515 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:52.683569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3e333243-ca36-44bb-9c38-51b1a178d515 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.147660 Aug 24 12:53:52.684130 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1531/3061] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:52 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:52.841389 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-905f1fb1-6872-4b8e-8922-f338863c1dfb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:52.841898 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-905f1fb1-6872-4b8e-8922-f338863c1dfb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:52.848292 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-905f1fb1-6872-4b8e-8922-f338863c1dfb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:52.848759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-905f1fb1-6872-4b8e-8922-f338863c1dfb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:52.849184 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-905f1fb1-6872-4b8e-8922-f338863c1dfb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:52.849853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-905f1fb1-6872-4b8e-8922-f338863c1dfb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:52.850298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-905f1fb1-6872-4b8e-8922-f338863c1dfb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:52.850738 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-905f1fb1-6872-4b8e-8922-f338863c1dfb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:52.976385 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-905f1fb1-6872-4b8e-8922-f338863c1dfb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:52.984382 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-905f1fb1-6872-4b8e-8922-f338863c1dfb tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147062 Aug 24 12:53:52.984941 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1531/3062] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:52 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:53.115567 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e3b23c7d-43e6-40c3-a682-06d0ffb58535 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:53.116095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e3b23c7d-43e6-40c3-a682-06d0ffb58535 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:53.130937 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3b23c7d-43e6-40c3-a682-06d0ffb58535 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:53.131424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3b23c7d-43e6-40c3-a682-06d0ffb58535 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:53.131859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3b23c7d-43e6-40c3-a682-06d0ffb58535 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:53.132550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3b23c7d-43e6-40c3-a682-06d0ffb58535 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:53.133005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3b23c7d-43e6-40c3-a682-06d0ffb58535 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:53.133428 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3b23c7d-43e6-40c3-a682-06d0ffb58535 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:53.203995 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e1e187ba-5a9c-4862-b8cc-7c9622c20d59 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:53.204693 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e1e187ba-5a9c-4862-b8cc-7c9622c20d59 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:53.210579 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1e187ba-5a9c-4862-b8cc-7c9622c20d59 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:53.211085 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1e187ba-5a9c-4862-b8cc-7c9622c20d59 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:53.211517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1e187ba-5a9c-4862-b8cc-7c9622c20d59 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:53.212191 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1e187ba-5a9c-4862-b8cc-7c9622c20d59 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:53.212634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1e187ba-5a9c-4862-b8cc-7c9622c20d59 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:53.213090 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e1e187ba-5a9c-4862-b8cc-7c9622c20d59 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:53.267419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e3b23c7d-43e6-40c3-a682-06d0ffb58535 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:53.279895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e3b23c7d-43e6-40c3-a682-06d0ffb58535 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:53.279895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e3b23c7d-43e6-40c3-a682-06d0ffb58535 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:53.279895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e3b23c7d-43e6-40c3-a682-06d0ffb58535 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.167590 Aug 24 12:53:53.280263 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1532/3063] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:53 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:53.349769 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e1e187ba-5a9c-4862-b8cc-7c9622c20d59 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:53.357802 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e1e187ba-5a9c-4862-b8cc-7c9622c20d59 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.157641 Aug 24 12:53:53.358363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1532/3064] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:53 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:53.704417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-361386e5-2835-41ad-82ba-33fbaa5d28b8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:53.704964 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-361386e5-2835-41ad-82ba-33fbaa5d28b8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:53.710973 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-361386e5-2835-41ad-82ba-33fbaa5d28b8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:53.711490 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-361386e5-2835-41ad-82ba-33fbaa5d28b8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:53.711930 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-361386e5-2835-41ad-82ba-33fbaa5d28b8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:53.712618 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-361386e5-2835-41ad-82ba-33fbaa5d28b8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:53.713077 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-361386e5-2835-41ad-82ba-33fbaa5d28b8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:53.713506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-361386e5-2835-41ad-82ba-33fbaa5d28b8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:53.840809 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-361386e5-2835-41ad-82ba-33fbaa5d28b8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:53.849468 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-361386e5-2835-41ad-82ba-33fbaa5d28b8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.148976 Aug 24 12:53:53.850021 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1533/3065] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:53 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:54.005208 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-37fc335c-0ae1-47fa-a236-12b7fda5f2c4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:54.005847 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-37fc335c-0ae1-47fa-a236-12b7fda5f2c4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:54.012256 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37fc335c-0ae1-47fa-a236-12b7fda5f2c4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:54.012732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37fc335c-0ae1-47fa-a236-12b7fda5f2c4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:54.013167 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37fc335c-0ae1-47fa-a236-12b7fda5f2c4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:54.013846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37fc335c-0ae1-47fa-a236-12b7fda5f2c4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:54.014324 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37fc335c-0ae1-47fa-a236-12b7fda5f2c4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:54.014779 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37fc335c-0ae1-47fa-a236-12b7fda5f2c4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:54.145131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-37fc335c-0ae1-47fa-a236-12b7fda5f2c4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:54.153269 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-37fc335c-0ae1-47fa-a236-12b7fda5f2c4 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151895 Aug 24 12:53:54.153830 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1533/3066] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:54 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:54.301908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bf5ec389-08c0-4966-9559-757500ee5f41 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:54.302036 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bf5ec389-08c0-4966-9559-757500ee5f41 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:54.308657 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf5ec389-08c0-4966-9559-757500ee5f41 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:54.309142 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf5ec389-08c0-4966-9559-757500ee5f41 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:54.309636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf5ec389-08c0-4966-9559-757500ee5f41 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:54.310327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf5ec389-08c0-4966-9559-757500ee5f41 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:54.310820 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf5ec389-08c0-4966-9559-757500ee5f41 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:54.311244 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf5ec389-08c0-4966-9559-757500ee5f41 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:54.379701 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-30cd0e17-0806-4f9a-bb9b-81546ca5557e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:54.380409 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-30cd0e17-0806-4f9a-bb9b-81546ca5557e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:54.386316 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-30cd0e17-0806-4f9a-bb9b-81546ca5557e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:54.386834 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-30cd0e17-0806-4f9a-bb9b-81546ca5557e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:54.387267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-30cd0e17-0806-4f9a-bb9b-81546ca5557e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:54.388269 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-30cd0e17-0806-4f9a-bb9b-81546ca5557e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:54.388430 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-30cd0e17-0806-4f9a-bb9b-81546ca5557e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:54.388816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-30cd0e17-0806-4f9a-bb9b-81546ca5557e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:54.458278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bf5ec389-08c0-4966-9559-757500ee5f41 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:54.466975 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bf5ec389-08c0-4966-9559-757500ee5f41 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:54.468476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bf5ec389-08c0-4966-9559-757500ee5f41 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:54.469641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bf5ec389-08c0-4966-9559-757500ee5f41 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.172179 Aug 24 12:53:54.470187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1534/3067] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:54 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:54.515744 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-30cd0e17-0806-4f9a-bb9b-81546ca5557e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:54.524353 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-30cd0e17-0806-4f9a-bb9b-81546ca5557e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149129 Aug 24 12:53:54.524911 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1534/3068] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:54 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:54.871217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6582215e-d083-4de7-a3b5-2055601a7ac9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:54.871825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6582215e-d083-4de7-a3b5-2055601a7ac9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:54.877694 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6582215e-d083-4de7-a3b5-2055601a7ac9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:54.878177 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6582215e-d083-4de7-a3b5-2055601a7ac9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:54.879218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6582215e-d083-4de7-a3b5-2055601a7ac9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:54.879899 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6582215e-d083-4de7-a3b5-2055601a7ac9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:54.880357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6582215e-d083-4de7-a3b5-2055601a7ac9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:54.880783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6582215e-d083-4de7-a3b5-2055601a7ac9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:55.007353 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6582215e-d083-4de7-a3b5-2055601a7ac9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:55.015853 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6582215e-d083-4de7-a3b5-2055601a7ac9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.148402 Aug 24 12:53:55.016482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1535/3069] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:54 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:55.175013 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a2ae0329-d97f-46f0-9d04-fc3ef48e9f9d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:55.176342 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a2ae0329-d97f-46f0-9d04-fc3ef48e9f9d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:55.182807 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2ae0329-d97f-46f0-9d04-fc3ef48e9f9d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:55.183291 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2ae0329-d97f-46f0-9d04-fc3ef48e9f9d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:55.183727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2ae0329-d97f-46f0-9d04-fc3ef48e9f9d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:55.184416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2ae0329-d97f-46f0-9d04-fc3ef48e9f9d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:55.184869 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2ae0329-d97f-46f0-9d04-fc3ef48e9f9d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:55.185293 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2ae0329-d97f-46f0-9d04-fc3ef48e9f9d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:55.315976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a2ae0329-d97f-46f0-9d04-fc3ef48e9f9d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:55.324239 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a2ae0329-d97f-46f0-9d04-fc3ef48e9f9d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.153271 Aug 24 12:53:55.324798 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1535/3070] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:55 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:55.496152 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fc0d3408-9eed-4daf-a06e-f40a9a98981f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:55.496752 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fc0d3408-9eed-4daf-a06e-f40a9a98981f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:55.503061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc0d3408-9eed-4daf-a06e-f40a9a98981f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:55.503582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc0d3408-9eed-4daf-a06e-f40a9a98981f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:55.504012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc0d3408-9eed-4daf-a06e-f40a9a98981f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:55.504686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc0d3408-9eed-4daf-a06e-f40a9a98981f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:55.505133 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc0d3408-9eed-4daf-a06e-f40a9a98981f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:55.505549 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc0d3408-9eed-4daf-a06e-f40a9a98981f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:55.544396 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ef49910d-6c62-438c-a939-b5f5c40dcd97 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:55.545107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ef49910d-6c62-438c-a939-b5f5c40dcd97 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:55.551133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef49910d-6c62-438c-a939-b5f5c40dcd97 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:55.551619 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef49910d-6c62-438c-a939-b5f5c40dcd97 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:55.552055 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef49910d-6c62-438c-a939-b5f5c40dcd97 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:55.552742 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef49910d-6c62-438c-a939-b5f5c40dcd97 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:55.553193 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef49910d-6c62-438c-a939-b5f5c40dcd97 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:55.553648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef49910d-6c62-438c-a939-b5f5c40dcd97 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:55.635551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fc0d3408-9eed-4daf-a06e-f40a9a98981f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:55.644779 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fc0d3408-9eed-4daf-a06e-f40a9a98981f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:55.646260 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fc0d3408-9eed-4daf-a06e-f40a9a98981f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:55.647442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fc0d3408-9eed-4daf-a06e-f40a9a98981f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155204 Aug 24 12:53:55.648021 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1536/3071] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:55 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:55.683638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ef49910d-6c62-438c-a939-b5f5c40dcd97 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:55.691866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ef49910d-6c62-438c-a939-b5f5c40dcd97 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151340 Aug 24 12:53:55.692516 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1536/3072] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:55 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:56.036147 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-33d81e76-e4de-4eeb-914d-8804c89c67f8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:56.036788 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-33d81e76-e4de-4eeb-914d-8804c89c67f8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:56.042792 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33d81e76-e4de-4eeb-914d-8804c89c67f8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:56.043276 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33d81e76-e4de-4eeb-914d-8804c89c67f8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:56.043714 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33d81e76-e4de-4eeb-914d-8804c89c67f8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:56.044394 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33d81e76-e4de-4eeb-914d-8804c89c67f8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:56.044856 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33d81e76-e4de-4eeb-914d-8804c89c67f8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:56.045278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33d81e76-e4de-4eeb-914d-8804c89c67f8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:56.178542 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-33d81e76-e4de-4eeb-914d-8804c89c67f8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:56.187148 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-33d81e76-e4de-4eeb-914d-8804c89c67f8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.154876 Aug 24 12:53:56.187702 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1537/3073] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:56 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:56.344822 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3ba74b88-2a0a-4b41-8aaf-9fe49559ef4b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:56.345432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3ba74b88-2a0a-4b41-8aaf-9fe49559ef4b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:56.351793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ba74b88-2a0a-4b41-8aaf-9fe49559ef4b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:56.352270 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ba74b88-2a0a-4b41-8aaf-9fe49559ef4b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:56.352706 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ba74b88-2a0a-4b41-8aaf-9fe49559ef4b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:56.353381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ba74b88-2a0a-4b41-8aaf-9fe49559ef4b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:56.353832 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ba74b88-2a0a-4b41-8aaf-9fe49559ef4b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:56.354254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ba74b88-2a0a-4b41-8aaf-9fe49559ef4b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:56.483329 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3ba74b88-2a0a-4b41-8aaf-9fe49559ef4b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:56.492092 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3ba74b88-2a0a-4b41-8aaf-9fe49559ef4b tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151057 Aug 24 12:53:56.492707 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1537/3074] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:56 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:56.670808 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-aa44abb2-af18-4025-8e38-292f42feaa45 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:56.671420 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-aa44abb2-af18-4025-8e38-292f42feaa45 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:56.678292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aa44abb2-af18-4025-8e38-292f42feaa45 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:56.678803 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aa44abb2-af18-4025-8e38-292f42feaa45 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:56.679242 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aa44abb2-af18-4025-8e38-292f42feaa45 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:56.679927 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aa44abb2-af18-4025-8e38-292f42feaa45 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:56.680387 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aa44abb2-af18-4025-8e38-292f42feaa45 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:56.680811 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aa44abb2-af18-4025-8e38-292f42feaa45 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:56.711834 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d27b42d0-0b58-45e2-9233-b279bef582c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:56.712428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d27b42d0-0b58-45e2-9233-b279bef582c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:56.718555 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d27b42d0-0b58-45e2-9233-b279bef582c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:56.719145 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d27b42d0-0b58-45e2-9233-b279bef582c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:56.719580 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d27b42d0-0b58-45e2-9233-b279bef582c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:56.720265 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d27b42d0-0b58-45e2-9233-b279bef582c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:56.720720 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d27b42d0-0b58-45e2-9233-b279bef582c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:56.721133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d27b42d0-0b58-45e2-9233-b279bef582c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:56.736038 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:53:56.809305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-aa44abb2-af18-4025-8e38-292f42feaa45 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:56.818088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-aa44abb2-af18-4025-8e38-292f42feaa45 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:56.819594 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-aa44abb2-af18-4025-8e38-292f42feaa45 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:56.820759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-aa44abb2-af18-4025-8e38-292f42feaa45 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.153786 Aug 24 12:53:56.821295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1538/3075] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:56 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:56.852730 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d27b42d0-0b58-45e2-9233-b279bef582c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:56.860997 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d27b42d0-0b58-45e2-9233-b279bef582c5 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153095 Aug 24 12:53:56.861542 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1538/3076] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:56 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:57.208753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-96e99b51-cd2b-4292-868d-a3a87deee815 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:57.209280 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-96e99b51-cd2b-4292-868d-a3a87deee815 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:57.215173 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96e99b51-cd2b-4292-868d-a3a87deee815 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:57.215651 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96e99b51-cd2b-4292-868d-a3a87deee815 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:57.216088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96e99b51-cd2b-4292-868d-a3a87deee815 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:57.216762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96e99b51-cd2b-4292-868d-a3a87deee815 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:57.217214 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96e99b51-cd2b-4292-868d-a3a87deee815 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:57.217635 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96e99b51-cd2b-4292-868d-a3a87deee815 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:57.220120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:53:57.348703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-96e99b51-cd2b-4292-868d-a3a87deee815 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:57.356771 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-96e99b51-cd2b-4292-868d-a3a87deee815 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152008 Aug 24 12:53:57.357333 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1539/3077] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:57 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:57.513784 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8f7e6a1f-56cd-4b77-9dd1-57f845f5b763 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:57.514394 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8f7e6a1f-56cd-4b77-9dd1-57f845f5b763 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:57.520865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f7e6a1f-56cd-4b77-9dd1-57f845f5b763 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:57.521342 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f7e6a1f-56cd-4b77-9dd1-57f845f5b763 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:57.521776 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f7e6a1f-56cd-4b77-9dd1-57f845f5b763 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:57.522454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f7e6a1f-56cd-4b77-9dd1-57f845f5b763 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:57.522927 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f7e6a1f-56cd-4b77-9dd1-57f845f5b763 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:57.523349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8f7e6a1f-56cd-4b77-9dd1-57f845f5b763 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:57.648768 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8f7e6a1f-56cd-4b77-9dd1-57f845f5b763 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:57.656843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8f7e6a1f-56cd-4b77-9dd1-57f845f5b763 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147197 Aug 24 12:53:57.657389 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1539/3078] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:57 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:57.843507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3332f6bb-563c-4d40-b84b-842c32f34340 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:57.844114 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3332f6bb-563c-4d40-b84b-842c32f34340 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:57.851332 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3332f6bb-563c-4d40-b84b-842c32f34340 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:57.851809 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3332f6bb-563c-4d40-b84b-842c32f34340 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:57.852241 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3332f6bb-563c-4d40-b84b-842c32f34340 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:57.852916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3332f6bb-563c-4d40-b84b-842c32f34340 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:57.853364 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3332f6bb-563c-4d40-b84b-842c32f34340 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:57.853927 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3332f6bb-563c-4d40-b84b-842c32f34340 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:57.883130 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-409d69ae-5167-414a-85fc-82d4ed77afa3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:57.883735 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-409d69ae-5167-414a-85fc-82d4ed77afa3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:57.889581 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-409d69ae-5167-414a-85fc-82d4ed77afa3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:57.890059 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-409d69ae-5167-414a-85fc-82d4ed77afa3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:57.890498 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-409d69ae-5167-414a-85fc-82d4ed77afa3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:57.891202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-409d69ae-5167-414a-85fc-82d4ed77afa3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:57.891649 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-409d69ae-5167-414a-85fc-82d4ed77afa3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:57.892071 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-409d69ae-5167-414a-85fc-82d4ed77afa3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:57.981388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3332f6bb-563c-4d40-b84b-842c32f34340 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:57.990266 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3332f6bb-563c-4d40-b84b-842c32f34340 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:57.991785 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3332f6bb-563c-4d40-b84b-842c32f34340 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:57.992951 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3332f6bb-563c-4d40-b84b-842c32f34340 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.153270 Aug 24 12:53:57.993505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1540/3079] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:57 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:58.024544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-409d69ae-5167-414a-85fc-82d4ed77afa3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:58.032802 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-409d69ae-5167-414a-85fc-82d4ed77afa3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153415 Aug 24 12:53:58.033370 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1540/3080] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:57 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:58.379096 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b690451a-fc50-4358-bd45-6173f6470278 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:58.379710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b690451a-fc50-4358-bd45-6173f6470278 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:58.385823 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b690451a-fc50-4358-bd45-6173f6470278 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:58.386307 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b690451a-fc50-4358-bd45-6173f6470278 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:58.386782 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b690451a-fc50-4358-bd45-6173f6470278 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:58.387468 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b690451a-fc50-4358-bd45-6173f6470278 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:58.387926 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b690451a-fc50-4358-bd45-6173f6470278 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:58.388353 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b690451a-fc50-4358-bd45-6173f6470278 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:58.513605 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b690451a-fc50-4358-bd45-6173f6470278 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:58.521758 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b690451a-fc50-4358-bd45-6173f6470278 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.147091 Aug 24 12:53:58.522326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1541/3081] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:58 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:58.678398 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-848ed333-9a0f-4472-9b8a-1c9b9da86c8f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:58.679028 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-848ed333-9a0f-4472-9b8a-1c9b9da86c8f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:58.685314 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-848ed333-9a0f-4472-9b8a-1c9b9da86c8f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:58.685800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-848ed333-9a0f-4472-9b8a-1c9b9da86c8f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:58.686231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-848ed333-9a0f-4472-9b8a-1c9b9da86c8f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:58.686933 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-848ed333-9a0f-4472-9b8a-1c9b9da86c8f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:58.687388 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-848ed333-9a0f-4472-9b8a-1c9b9da86c8f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:58.687808 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-848ed333-9a0f-4472-9b8a-1c9b9da86c8f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:58.813168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-848ed333-9a0f-4472-9b8a-1c9b9da86c8f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:58.821274 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-848ed333-9a0f-4472-9b8a-1c9b9da86c8f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.147194 Aug 24 12:53:58.821831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1541/3082] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:58 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:59.016142 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-158bee5e-483b-4395-93a2-ac058f81c403 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:59.016743 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-158bee5e-483b-4395-93a2-ac058f81c403 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:59.023712 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-158bee5e-483b-4395-93a2-ac058f81c403 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:59.024188 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-158bee5e-483b-4395-93a2-ac058f81c403 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:59.024621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-158bee5e-483b-4395-93a2-ac058f81c403 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:59.025295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-158bee5e-483b-4395-93a2-ac058f81c403 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:59.025746 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-158bee5e-483b-4395-93a2-ac058f81c403 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:59.026194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-158bee5e-483b-4395-93a2-ac058f81c403 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:59.053979 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3a201dcc-0fa2-4e46-9844-8f46e44cecce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:59.054709 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3a201dcc-0fa2-4e46-9844-8f46e44cecce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:59.060682 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a201dcc-0fa2-4e46-9844-8f46e44cecce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:59.061245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a201dcc-0fa2-4e46-9844-8f46e44cecce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:59.061618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a201dcc-0fa2-4e46-9844-8f46e44cecce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:59.062305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a201dcc-0fa2-4e46-9844-8f46e44cecce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:59.062792 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a201dcc-0fa2-4e46-9844-8f46e44cecce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:59.063222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a201dcc-0fa2-4e46-9844-8f46e44cecce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:59.158319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-158bee5e-483b-4395-93a2-ac058f81c403 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:59.167583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-158bee5e-483b-4395-93a2-ac058f81c403 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:59.169084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-158bee5e-483b-4395-93a2-ac058f81c403 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:59.170290 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-158bee5e-483b-4395-93a2-ac058f81c403 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.158015 Aug 24 12:53:59.170875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1542/3083] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:53:59 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:53:59.201175 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3a201dcc-0fa2-4e46-9844-8f46e44cecce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:59.210081 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3a201dcc-0fa2-4e46-9844-8f46e44cecce tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.160560 Aug 24 12:53:59.210637 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1542/3084] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:59 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:53:59.542347 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8975f0d2-b324-401b-8645-05f4bd84042e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:59.542982 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8975f0d2-b324-401b-8645-05f4bd84042e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:59.548916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8975f0d2-b324-401b-8645-05f4bd84042e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:59.549391 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8975f0d2-b324-401b-8645-05f4bd84042e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:59.549823 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8975f0d2-b324-401b-8645-05f4bd84042e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:59.550501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8975f0d2-b324-401b-8645-05f4bd84042e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:59.551055 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8975f0d2-b324-401b-8645-05f4bd84042e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:59.551482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8975f0d2-b324-401b-8645-05f4bd84042e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:59.827063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8975f0d2-b324-401b-8645-05f4bd84042e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:59.835660 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8975f0d2-b324-401b-8645-05f4bd84042e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.297173 Aug 24 12:53:59.836492 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1543/3085] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:59 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:53:59.841514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-19b9062e-5fd7-4096-aa76-9e5e00ad0c03 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:53:59.842123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-19b9062e-5fd7-4096-aa76-9e5e00ad0c03 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:53:59.848597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19b9062e-5fd7-4096-aa76-9e5e00ad0c03 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:59.849077 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19b9062e-5fd7-4096-aa76-9e5e00ad0c03 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:59.849514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19b9062e-5fd7-4096-aa76-9e5e00ad0c03 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:59.850190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19b9062e-5fd7-4096-aa76-9e5e00ad0c03 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:53:59.850640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19b9062e-5fd7-4096-aa76-9e5e00ad0c03 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:53:59.851086 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19b9062e-5fd7-4096-aa76-9e5e00ad0c03 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:53:59.982062 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-19b9062e-5fd7-4096-aa76-9e5e00ad0c03 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:53:59.990842 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-19b9062e-5fd7-4096-aa76-9e5e00ad0c03 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.153186 Aug 24 12:53:59.991387 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1543/3086] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:53:59 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:00.194971 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5b2dfdd2-b602-4e1a-890f-622acaf79bf8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:00.195511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5b2dfdd2-b602-4e1a-890f-622acaf79bf8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:00.201772 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b2dfdd2-b602-4e1a-890f-622acaf79bf8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:00.202264 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b2dfdd2-b602-4e1a-890f-622acaf79bf8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:00.202741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b2dfdd2-b602-4e1a-890f-622acaf79bf8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:00.203428 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b2dfdd2-b602-4e1a-890f-622acaf79bf8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:00.203888 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b2dfdd2-b602-4e1a-890f-622acaf79bf8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:00.204314 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b2dfdd2-b602-4e1a-890f-622acaf79bf8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:00.230750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e4b4f1a8-d18d-45e2-9b47-fe315a7d1b01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:00.231375 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e4b4f1a8-d18d-45e2-9b47-fe315a7d1b01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:00.238086 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4b4f1a8-d18d-45e2-9b47-fe315a7d1b01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:00.238567 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4b4f1a8-d18d-45e2-9b47-fe315a7d1b01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:00.239026 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4b4f1a8-d18d-45e2-9b47-fe315a7d1b01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:00.239736 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4b4f1a8-d18d-45e2-9b47-fe315a7d1b01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:00.240184 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4b4f1a8-d18d-45e2-9b47-fe315a7d1b01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:00.240605 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4b4f1a8-d18d-45e2-9b47-fe315a7d1b01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:00.338035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5b2dfdd2-b602-4e1a-890f-622acaf79bf8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:00.347307 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5b2dfdd2-b602-4e1a-890f-622acaf79bf8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:00.348809 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5b2dfdd2-b602-4e1a-890f-622acaf79bf8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:00.349971 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5b2dfdd2-b602-4e1a-890f-622acaf79bf8 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.159616 Aug 24 12:54:00.350589 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1544/3087] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:00 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:00.371406 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e4b4f1a8-d18d-45e2-9b47-fe315a7d1b01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:00.379353 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e4b4f1a8-d18d-45e2-9b47-fe315a7d1b01 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152422 Aug 24 12:54:00.379902 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1544/3088] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:00 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:00.856193 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dc55d5e0-1790-4c5c-bb72-612d16a7db27 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:00.856805 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dc55d5e0-1790-4c5c-bb72-612d16a7db27 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:00.863513 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc55d5e0-1790-4c5c-bb72-612d16a7db27 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:00.864005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc55d5e0-1790-4c5c-bb72-612d16a7db27 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:00.864446 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc55d5e0-1790-4c5c-bb72-612d16a7db27 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:00.865137 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc55d5e0-1790-4c5c-bb72-612d16a7db27 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:00.865601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc55d5e0-1790-4c5c-bb72-612d16a7db27 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:00.866028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc55d5e0-1790-4c5c-bb72-612d16a7db27 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:00.991700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-dc55d5e0-1790-4c5c-bb72-612d16a7db27 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:00.999686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dc55d5e0-1790-4c5c-bb72-612d16a7db27 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.147343 Aug 24 12:54:01.000230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1545/3089] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:00 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:01.012138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-52dd4d07-25db-4840-be2d-6e37de041107 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:01.012749 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-52dd4d07-25db-4840-be2d-6e37de041107 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:01.019818 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-52dd4d07-25db-4840-be2d-6e37de041107 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:01.020300 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-52dd4d07-25db-4840-be2d-6e37de041107 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:01.020743 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-52dd4d07-25db-4840-be2d-6e37de041107 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:01.021428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-52dd4d07-25db-4840-be2d-6e37de041107 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:01.021881 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-52dd4d07-25db-4840-be2d-6e37de041107 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:01.022309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-52dd4d07-25db-4840-be2d-6e37de041107 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:01.152013 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-52dd4d07-25db-4840-be2d-6e37de041107 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:01.160165 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-52dd4d07-25db-4840-be2d-6e37de041107 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151860 Aug 24 12:54:01.160726 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1545/3090] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:01 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:01.373715 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-51e6253b-5af9-4c4d-8e52-483479f03177 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:01.374321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-51e6253b-5af9-4c4d-8e52-483479f03177 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:01.381150 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51e6253b-5af9-4c4d-8e52-483479f03177 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:01.381632 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51e6253b-5af9-4c4d-8e52-483479f03177 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:01.382070 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51e6253b-5af9-4c4d-8e52-483479f03177 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:01.382776 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51e6253b-5af9-4c4d-8e52-483479f03177 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:01.383236 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51e6253b-5af9-4c4d-8e52-483479f03177 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:01.383661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51e6253b-5af9-4c4d-8e52-483479f03177 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:01.400171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-98b04ed4-b2ed-4b25-85a6-3b5a53390406 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:01.400838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-98b04ed4-b2ed-4b25-85a6-3b5a53390406 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:01.406617 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98b04ed4-b2ed-4b25-85a6-3b5a53390406 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:01.407133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98b04ed4-b2ed-4b25-85a6-3b5a53390406 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:01.407573 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98b04ed4-b2ed-4b25-85a6-3b5a53390406 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:01.408254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98b04ed4-b2ed-4b25-85a6-3b5a53390406 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:01.408712 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98b04ed4-b2ed-4b25-85a6-3b5a53390406 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:01.409143 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98b04ed4-b2ed-4b25-85a6-3b5a53390406 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:01.517204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-51e6253b-5af9-4c4d-8e52-483479f03177 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:01.525866 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-51e6253b-5af9-4c4d-8e52-483479f03177 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:01.527522 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-51e6253b-5af9-4c4d-8e52-483479f03177 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:01.528757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-51e6253b-5af9-4c4d-8e52-483479f03177 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.158946 Aug 24 12:54:01.529308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1546/3091] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:01 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:01.539368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-98b04ed4-b2ed-4b25-85a6-3b5a53390406 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:01.547485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-98b04ed4-b2ed-4b25-85a6-3b5a53390406 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151156 Aug 24 12:54:01.548030 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1546/3092] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:01 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:02.019526 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2ca4cdf8-4d27-4a27-9e74-85ddaee41e23 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:02.020139 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2ca4cdf8-4d27-4a27-9e74-85ddaee41e23 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:02.026082 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2ca4cdf8-4d27-4a27-9e74-85ddaee41e23 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:02.026566 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2ca4cdf8-4d27-4a27-9e74-85ddaee41e23 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:02.027036 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2ca4cdf8-4d27-4a27-9e74-85ddaee41e23 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:02.027722 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2ca4cdf8-4d27-4a27-9e74-85ddaee41e23 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:02.028178 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2ca4cdf8-4d27-4a27-9e74-85ddaee41e23 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:02.028605 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2ca4cdf8-4d27-4a27-9e74-85ddaee41e23 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:02.153688 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2ca4cdf8-4d27-4a27-9e74-85ddaee41e23 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:02.162324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2ca4cdf8-4d27-4a27-9e74-85ddaee41e23 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.146642 Aug 24 12:54:02.162912 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1547/3093] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:02 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:02.181444 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2a41846e-b66e-49aa-ac8e-580f08425b87 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:02.182046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2a41846e-b66e-49aa-ac8e-580f08425b87 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:02.188419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a41846e-b66e-49aa-ac8e-580f08425b87 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:02.188890 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a41846e-b66e-49aa-ac8e-580f08425b87 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:02.189318 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a41846e-b66e-49aa-ac8e-580f08425b87 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:02.189985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a41846e-b66e-49aa-ac8e-580f08425b87 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:02.190434 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a41846e-b66e-49aa-ac8e-580f08425b87 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:02.190885 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a41846e-b66e-49aa-ac8e-580f08425b87 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:02.322408 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2a41846e-b66e-49aa-ac8e-580f08425b87 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:02.330521 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2a41846e-b66e-49aa-ac8e-580f08425b87 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.152920 Aug 24 12:54:02.337757 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1547/3094] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:02 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:02.552483 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-611f7fcc-c288-453c-9171-c21aa8d16c23 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:02.553051 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-611f7fcc-c288-453c-9171-c21aa8d16c23 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:02.559376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-611f7fcc-c288-453c-9171-c21aa8d16c23 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:02.559851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-611f7fcc-c288-453c-9171-c21aa8d16c23 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:02.560284 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-611f7fcc-c288-453c-9171-c21aa8d16c23 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:02.560962 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-611f7fcc-c288-453c-9171-c21aa8d16c23 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:02.561414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-611f7fcc-c288-453c-9171-c21aa8d16c23 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:02.561868 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-611f7fcc-c288-453c-9171-c21aa8d16c23 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:02.568559 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f43d4d13-2970-45d0-92a2-dd338a17a4ea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:02.569167 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f43d4d13-2970-45d0-92a2-dd338a17a4ea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:02.574899 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f43d4d13-2970-45d0-92a2-dd338a17a4ea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:02.575394 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f43d4d13-2970-45d0-92a2-dd338a17a4ea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:02.575813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f43d4d13-2970-45d0-92a2-dd338a17a4ea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:02.576493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f43d4d13-2970-45d0-92a2-dd338a17a4ea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:02.576939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f43d4d13-2970-45d0-92a2-dd338a17a4ea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:02.577361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f43d4d13-2970-45d0-92a2-dd338a17a4ea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:02.690082 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-611f7fcc-c288-453c-9171-c21aa8d16c23 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:02.699375 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-611f7fcc-c288-453c-9171-c21aa8d16c23 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:02.700863 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-611f7fcc-c288-453c-9171-c21aa8d16c23 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:02.702035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-611f7fcc-c288-453c-9171-c21aa8d16c23 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.153512 Aug 24 12:54:02.702567 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1548/3095] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:02 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:02.703733 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f43d4d13-2970-45d0-92a2-dd338a17a4ea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:02.712619 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f43d4d13-2970-45d0-92a2-dd338a17a4ea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148321 Aug 24 12:54:02.713163 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1548/3096] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:02 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:03.182826 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5e41c7bf-0c30-441d-965a-6679b659c27d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:03.183435 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5e41c7bf-0c30-441d-965a-6679b659c27d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:03.189959 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e41c7bf-0c30-441d-965a-6679b659c27d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:03.191113 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e41c7bf-0c30-441d-965a-6679b659c27d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:03.191552 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e41c7bf-0c30-441d-965a-6679b659c27d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:03.192248 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e41c7bf-0c30-441d-965a-6679b659c27d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:03.192697 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e41c7bf-0c30-441d-965a-6679b659c27d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:03.193117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e41c7bf-0c30-441d-965a-6679b659c27d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:03.325712 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5e41c7bf-0c30-441d-965a-6679b659c27d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:03.333820 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5e41c7bf-0c30-441d-965a-6679b659c27d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.154963 Aug 24 12:54:03.334375 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1549/3097] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:03 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:03.357087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ac7b9319-2ef1-4377-b0e9-897c3a7ba92c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:03.357696 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ac7b9319-2ef1-4377-b0e9-897c3a7ba92c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:03.364912 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ac7b9319-2ef1-4377-b0e9-897c3a7ba92c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:03.365389 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ac7b9319-2ef1-4377-b0e9-897c3a7ba92c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:03.365832 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ac7b9319-2ef1-4377-b0e9-897c3a7ba92c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:03.366497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ac7b9319-2ef1-4377-b0e9-897c3a7ba92c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:03.366983 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ac7b9319-2ef1-4377-b0e9-897c3a7ba92c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:03.367404 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ac7b9319-2ef1-4377-b0e9-897c3a7ba92c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:03.498199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ac7b9319-2ef1-4377-b0e9-897c3a7ba92c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:03.506718 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ac7b9319-2ef1-4377-b0e9-897c3a7ba92c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.153373 Aug 24 12:54:03.507370 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1549/3098] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:03 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:03.725994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bc2f149e-dfed-4f29-9252-3b53df374907 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:03.726543 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bc2f149e-dfed-4f29-9252-3b53df374907 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:03.732875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc2f149e-dfed-4f29-9252-3b53df374907 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:03.736175 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f93b7bb9-7883-492f-b6fc-bbe2c06bccf3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:03.736323 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc2f149e-dfed-4f29-9252-3b53df374907 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:03.736457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f93b7bb9-7883-492f-b6fc-bbe2c06bccf3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:03.736564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc2f149e-dfed-4f29-9252-3b53df374907 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:03.736564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc2f149e-dfed-4f29-9252-3b53df374907 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:03.736564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc2f149e-dfed-4f29-9252-3b53df374907 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:03.736564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bc2f149e-dfed-4f29-9252-3b53df374907 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:03.740231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f93b7bb9-7883-492f-b6fc-bbe2c06bccf3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:03.740713 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f93b7bb9-7883-492f-b6fc-bbe2c06bccf3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:03.741151 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f93b7bb9-7883-492f-b6fc-bbe2c06bccf3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:03.741849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f93b7bb9-7883-492f-b6fc-bbe2c06bccf3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:03.742336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f93b7bb9-7883-492f-b6fc-bbe2c06bccf3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:03.742791 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f93b7bb9-7883-492f-b6fc-bbe2c06bccf3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:03.872384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bc2f149e-dfed-4f29-9252-3b53df374907 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:03.878015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f93b7bb9-7883-492f-b6fc-bbe2c06bccf3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:03.880462 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bc2f149e-dfed-4f29-9252-3b53df374907 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:03.881960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bc2f149e-dfed-4f29-9252-3b53df374907 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:03.883156 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bc2f149e-dfed-4f29-9252-3b53df374907 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.161691 Aug 24 12:54:03.883697 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1550/3099] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:03 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:03.888105 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f93b7bb9-7883-492f-b6fc-bbe2c06bccf3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.158947 Aug 24 12:54:03.888844 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1550/3100] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:03 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:04.355217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-37fdca6d-7641-4258-9268-20c7dca5b2cc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:04.355831 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-37fdca6d-7641-4258-9268-20c7dca5b2cc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:04.362038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37fdca6d-7641-4258-9268-20c7dca5b2cc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:04.362518 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37fdca6d-7641-4258-9268-20c7dca5b2cc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:04.362983 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37fdca6d-7641-4258-9268-20c7dca5b2cc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:04.363666 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37fdca6d-7641-4258-9268-20c7dca5b2cc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:04.364123 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37fdca6d-7641-4258-9268-20c7dca5b2cc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:04.364547 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-37fdca6d-7641-4258-9268-20c7dca5b2cc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:04.492440 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-37fdca6d-7641-4258-9268-20c7dca5b2cc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:04.500516 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-37fdca6d-7641-4258-9268-20c7dca5b2cc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149246 Aug 24 12:54:04.501064 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1551/3101] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:04 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:04.529055 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-97a769cc-f499-461f-a7e2-de19603a1c4d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:04.529712 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-97a769cc-f499-461f-a7e2-de19603a1c4d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:04.536213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-97a769cc-f499-461f-a7e2-de19603a1c4d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:04.536695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-97a769cc-f499-461f-a7e2-de19603a1c4d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:04.537135 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-97a769cc-f499-461f-a7e2-de19603a1c4d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:04.537847 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-97a769cc-f499-461f-a7e2-de19603a1c4d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:04.538306 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-97a769cc-f499-461f-a7e2-de19603a1c4d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:04.538759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-97a769cc-f499-461f-a7e2-de19603a1c4d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:04.663190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-97a769cc-f499-461f-a7e2-de19603a1c4d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:04.671253 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-97a769cc-f499-461f-a7e2-de19603a1c4d tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.145953 Aug 24 12:54:04.671813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1551/3102] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:04 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:04.906475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ac1c00f8-b1a7-4872-a96b-bb994e9b877b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:04.907212 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ac1c00f8-b1a7-4872-a96b-bb994e9b877b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:04.909030 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d9b306f0-4ec2-4309-a756-4857123cd9f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:04.909570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d9b306f0-4ec2-4309-a756-4857123cd9f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:04.913792 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac1c00f8-b1a7-4872-a96b-bb994e9b877b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:04.919350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac1c00f8-b1a7-4872-a96b-bb994e9b877b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:04.919350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac1c00f8-b1a7-4872-a96b-bb994e9b877b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:04.919350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac1c00f8-b1a7-4872-a96b-bb994e9b877b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:04.919902 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d9b306f0-4ec2-4309-a756-4857123cd9f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:04.920010 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac1c00f8-b1a7-4872-a96b-bb994e9b877b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:04.920108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d9b306f0-4ec2-4309-a756-4857123cd9f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:04.920222 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac1c00f8-b1a7-4872-a96b-bb994e9b877b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:04.920314 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d9b306f0-4ec2-4309-a756-4857123cd9f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:04.920314 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d9b306f0-4ec2-4309-a756-4857123cd9f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:04.920314 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d9b306f0-4ec2-4309-a756-4857123cd9f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:04.920314 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d9b306f0-4ec2-4309-a756-4857123cd9f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:05.048552 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ac1c00f8-b1a7-4872-a96b-bb994e9b877b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:05.052363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d9b306f0-4ec2-4309-a756-4857123cd9f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:05.057496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ac1c00f8-b1a7-4872-a96b-bb994e9b877b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:05.059016 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ac1c00f8-b1a7-4872-a96b-bb994e9b877b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:05.060201 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ac1c00f8-b1a7-4872-a96b-bb994e9b877b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.157658 Aug 24 12:54:05.060338 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d9b306f0-4ec2-4309-a756-4857123cd9f8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.155192 Aug 24 12:54:05.060952 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1552/3103] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:04 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:05.061094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1552/3104] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:04 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:05.521836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f8eadc48-c05c-42eb-b88d-410ffb2aa1de tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:05.522440 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f8eadc48-c05c-42eb-b88d-410ffb2aa1de tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:05.528349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f8eadc48-c05c-42eb-b88d-410ffb2aa1de tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:05.528823 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f8eadc48-c05c-42eb-b88d-410ffb2aa1de tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:05.529256 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f8eadc48-c05c-42eb-b88d-410ffb2aa1de tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:05.529930 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f8eadc48-c05c-42eb-b88d-410ffb2aa1de tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:05.530383 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f8eadc48-c05c-42eb-b88d-410ffb2aa1de tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:05.530838 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f8eadc48-c05c-42eb-b88d-410ffb2aa1de tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:05.654935 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f8eadc48-c05c-42eb-b88d-410ffb2aa1de tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:05.663510 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f8eadc48-c05c-42eb-b88d-410ffb2aa1de tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.145605 Aug 24 12:54:05.664061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1553/3105] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:05 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:05.692231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a1159759-bf9c-4972-99bd-20a4c9920df0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:05.692779 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a1159759-bf9c-4972-99bd-20a4c9920df0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:05.699270 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1159759-bf9c-4972-99bd-20a4c9920df0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:05.699747 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1159759-bf9c-4972-99bd-20a4c9920df0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:05.700183 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1159759-bf9c-4972-99bd-20a4c9920df0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:05.700856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1159759-bf9c-4972-99bd-20a4c9920df0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:05.701334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1159759-bf9c-4972-99bd-20a4c9920df0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:05.701757 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a1159759-bf9c-4972-99bd-20a4c9920df0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:05.829850 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a1159759-bf9c-4972-99bd-20a4c9920df0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:05.837951 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a1159759-bf9c-4972-99bd-20a4c9920df0 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149570 Aug 24 12:54:05.838512 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1553/3106] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:05 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:06.082165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-cca5a025-b581-4cd9-a608-08dfd1b1fbd6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:06.082844 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-cca5a025-b581-4cd9-a608-08dfd1b1fbd6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:06.084731 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-70bf3fd6-23b6-4608-a48f-ab8f280ac095 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:06.085333 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-70bf3fd6-23b6-4608-a48f-ab8f280ac095 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:06.089321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cca5a025-b581-4cd9-a608-08dfd1b1fbd6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:06.089801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cca5a025-b581-4cd9-a608-08dfd1b1fbd6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:06.090238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cca5a025-b581-4cd9-a608-08dfd1b1fbd6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:06.091073 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cca5a025-b581-4cd9-a608-08dfd1b1fbd6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:06.091201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70bf3fd6-23b6-4608-a48f-ab8f280ac095 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:06.091523 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cca5a025-b581-4cd9-a608-08dfd1b1fbd6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:06.091663 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70bf3fd6-23b6-4608-a48f-ab8f280ac095 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:06.091945 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cca5a025-b581-4cd9-a608-08dfd1b1fbd6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:06.092078 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70bf3fd6-23b6-4608-a48f-ab8f280ac095 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:06.092690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70bf3fd6-23b6-4608-a48f-ab8f280ac095 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:06.093136 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70bf3fd6-23b6-4608-a48f-ab8f280ac095 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:06.093555 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70bf3fd6-23b6-4608-a48f-ab8f280ac095 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:06.224158 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-cca5a025-b581-4cd9-a608-08dfd1b1fbd6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:06.225843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-70bf3fd6-23b6-4608-a48f-ab8f280ac095 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:06.232620 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-cca5a025-b581-4cd9-a608-08dfd1b1fbd6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.154780 Aug 24 12:54:06.233183 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1554/3107] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:06 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:06.234416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-70bf3fd6-23b6-4608-a48f-ab8f280ac095 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:06.235928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-70bf3fd6-23b6-4608-a48f-ab8f280ac095 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:06.237354 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-70bf3fd6-23b6-4608-a48f-ab8f280ac095 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.157106 Aug 24 12:54:06.237890 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1554/3108] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:06 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:54:06.684861 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-434921de-0a96-4cfb-9408-86c68ceec7ae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:06.685473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-434921de-0a96-4cfb-9408-86c68ceec7ae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:06.692200 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-434921de-0a96-4cfb-9408-86c68ceec7ae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:06.692689 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-434921de-0a96-4cfb-9408-86c68ceec7ae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:06.693113 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-434921de-0a96-4cfb-9408-86c68ceec7ae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:06.693792 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-434921de-0a96-4cfb-9408-86c68ceec7ae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:06.694247 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-434921de-0a96-4cfb-9408-86c68ceec7ae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:06.694690 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-434921de-0a96-4cfb-9408-86c68ceec7ae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:06.818623 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-434921de-0a96-4cfb-9408-86c68ceec7ae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:06.820767 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:54:06.827424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-434921de-0a96-4cfb-9408-86c68ceec7ae tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.146432 Aug 24 12:54:06.827985 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1555/3109] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:06 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:06.859084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-76e94c57-bc59-4b9f-a1a6-7904859514e1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:06.859692 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-76e94c57-bc59-4b9f-a1a6-7904859514e1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:06.866887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76e94c57-bc59-4b9f-a1a6-7904859514e1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:06.867368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76e94c57-bc59-4b9f-a1a6-7904859514e1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:06.867835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76e94c57-bc59-4b9f-a1a6-7904859514e1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:06.868522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76e94c57-bc59-4b9f-a1a6-7904859514e1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:06.868976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76e94c57-bc59-4b9f-a1a6-7904859514e1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:06.869404 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76e94c57-bc59-4b9f-a1a6-7904859514e1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:06.871920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:54:06.997806 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-76e94c57-bc59-4b9f-a1a6-7904859514e1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:07.006636 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-76e94c57-bc59-4b9f-a1a6-7904859514e1 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151306 Aug 24 12:54:07.007223 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1555/3110] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:06 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:07.254123 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6d3c785b-bdae-4def-af7d-1a510ac4e7a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:07.254786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6d3c785b-bdae-4def-af7d-1a510ac4e7a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:07.260285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-223e872d-28a4-4973-938a-d63b4ec4de20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:07.260893 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-223e872d-28a4-4973-938a-d63b4ec4de20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:07.261025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d3c785b-bdae-4def-af7d-1a510ac4e7a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:07.261501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d3c785b-bdae-4def-af7d-1a510ac4e7a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:07.261938 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d3c785b-bdae-4def-af7d-1a510ac4e7a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:07.262626 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d3c785b-bdae-4def-af7d-1a510ac4e7a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:07.263103 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d3c785b-bdae-4def-af7d-1a510ac4e7a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:07.263527 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d3c785b-bdae-4def-af7d-1a510ac4e7a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:07.266851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-223e872d-28a4-4973-938a-d63b4ec4de20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:07.267336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-223e872d-28a4-4973-938a-d63b4ec4de20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:07.267777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-223e872d-28a4-4973-938a-d63b4ec4de20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:07.268464 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-223e872d-28a4-4973-938a-d63b4ec4de20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:07.268922 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-223e872d-28a4-4973-938a-d63b4ec4de20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:07.269347 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-223e872d-28a4-4973-938a-d63b4ec4de20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:07.403544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-223e872d-28a4-4973-938a-d63b4ec4de20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:07.407091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6d3c785b-bdae-4def-af7d-1a510ac4e7a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:07.413346 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-223e872d-28a4-4973-938a-d63b4ec4de20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:07.414775 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-223e872d-28a4-4973-938a-d63b4ec4de20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:07.416045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-223e872d-28a4-4973-938a-d63b4ec4de20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.159722 Aug 24 12:54:07.416185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6d3c785b-bdae-4def-af7d-1a510ac4e7a2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.166133 Aug 24 12:54:07.416837 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1556/3111] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:07 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:07.417206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1556/3112] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:07 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:54:07.852855 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-97e6933b-5eb1-443d-8edd-cf841f66a6f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:07.853491 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-97e6933b-5eb1-443d-8edd-cf841f66a6f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:07.859885 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97e6933b-5eb1-443d-8edd-cf841f66a6f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:07.860365 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97e6933b-5eb1-443d-8edd-cf841f66a6f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:07.860796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97e6933b-5eb1-443d-8edd-cf841f66a6f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:07.861476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97e6933b-5eb1-443d-8edd-cf841f66a6f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:07.862180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97e6933b-5eb1-443d-8edd-cf841f66a6f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:07.862604 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97e6933b-5eb1-443d-8edd-cf841f66a6f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:07.993121 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-97e6933b-5eb1-443d-8edd-cf841f66a6f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:08.001097 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-97e6933b-5eb1-443d-8edd-cf841f66a6f0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152153 Aug 24 12:54:08.001653 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1557/3113] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:07 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:08.027361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7c101b9c-2c9b-44a6-a34b-f2e13fd8f7f3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:08.027996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7c101b9c-2c9b-44a6-a34b-f2e13fd8f7f3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:08.034371 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7c101b9c-2c9b-44a6-a34b-f2e13fd8f7f3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:08.034877 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7c101b9c-2c9b-44a6-a34b-f2e13fd8f7f3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:08.035305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7c101b9c-2c9b-44a6-a34b-f2e13fd8f7f3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:08.035975 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7c101b9c-2c9b-44a6-a34b-f2e13fd8f7f3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:08.036416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7c101b9c-2c9b-44a6-a34b-f2e13fd8f7f3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:08.036836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7c101b9c-2c9b-44a6-a34b-f2e13fd8f7f3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:08.167064 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7c101b9c-2c9b-44a6-a34b-f2e13fd8f7f3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:08.175119 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7c101b9c-2c9b-44a6-a34b-f2e13fd8f7f3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.151489 Aug 24 12:54:08.175674 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1557/3114] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:08 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:08.436131 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-49835fc7-ca56-4d74-9389-1f696a660cc7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:08.436742 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-49835fc7-ca56-4d74-9389-1f696a660cc7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:08.439100 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-86e7bf69-2050-4156-b69d-c222a5edccac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:08.439710 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-86e7bf69-2050-4156-b69d-c222a5edccac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:08.443358 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49835fc7-ca56-4d74-9389-1f696a660cc7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:08.443846 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49835fc7-ca56-4d74-9389-1f696a660cc7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:08.444283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49835fc7-ca56-4d74-9389-1f696a660cc7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:08.444978 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49835fc7-ca56-4d74-9389-1f696a660cc7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:08.445438 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49835fc7-ca56-4d74-9389-1f696a660cc7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:08.445865 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49835fc7-ca56-4d74-9389-1f696a660cc7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:08.446717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86e7bf69-2050-4156-b69d-c222a5edccac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:08.447203 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86e7bf69-2050-4156-b69d-c222a5edccac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:08.447648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86e7bf69-2050-4156-b69d-c222a5edccac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:08.448329 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86e7bf69-2050-4156-b69d-c222a5edccac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:08.448785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86e7bf69-2050-4156-b69d-c222a5edccac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:08.449209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86e7bf69-2050-4156-b69d-c222a5edccac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:08.576984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-49835fc7-ca56-4d74-9389-1f696a660cc7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:08.577136 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-86e7bf69-2050-4156-b69d-c222a5edccac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:08.583295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-49835fc7-ca56-4d74-9389-1f696a660cc7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151048 Aug 24 12:54:08.584091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1558/3115] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:08 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:08.584242 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-86e7bf69-2050-4156-b69d-c222a5edccac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:08.585531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-86e7bf69-2050-4156-b69d-c222a5edccac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:08.586674 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-86e7bf69-2050-4156-b69d-c222a5edccac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.151411 Aug 24 12:54:08.587244 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1558/3116] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:08 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:54:09.022368 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6c04df68-6ab7-498d-9822-0981d1e17c93 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:09.023034 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6c04df68-6ab7-498d-9822-0981d1e17c93 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:09.029574 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6c04df68-6ab7-498d-9822-0981d1e17c93 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:09.030053 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6c04df68-6ab7-498d-9822-0981d1e17c93 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:09.030484 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6c04df68-6ab7-498d-9822-0981d1e17c93 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:09.031190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6c04df68-6ab7-498d-9822-0981d1e17c93 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:09.031643 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6c04df68-6ab7-498d-9822-0981d1e17c93 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:09.032071 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6c04df68-6ab7-498d-9822-0981d1e17c93 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:09.159155 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6c04df68-6ab7-498d-9822-0981d1e17c93 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:09.167334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6c04df68-6ab7-498d-9822-0981d1e17c93 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.148767 Aug 24 12:54:09.167890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1559/3117] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:09 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:09.196772 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cb20162e-14f5-43db-8fb7-766cf887ce95 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:09.197407 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cb20162e-14f5-43db-8fb7-766cf887ce95 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:09.203797 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cb20162e-14f5-43db-8fb7-766cf887ce95 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:09.204276 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cb20162e-14f5-43db-8fb7-766cf887ce95 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:09.204731 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cb20162e-14f5-43db-8fb7-766cf887ce95 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:09.205406 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cb20162e-14f5-43db-8fb7-766cf887ce95 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:09.205856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cb20162e-14f5-43db-8fb7-766cf887ce95 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:09.206281 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cb20162e-14f5-43db-8fb7-766cf887ce95 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:09.342285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cb20162e-14f5-43db-8fb7-766cf887ce95 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:09.350993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cb20162e-14f5-43db-8fb7-766cf887ce95 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.158084 Aug 24 12:54:09.351571 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1559/3118] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:09 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:09.604977 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f97b5b40-1f8d-4fb0-b205-1dea3fe2d53f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:09.605584 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f97b5b40-1f8d-4fb0-b205-1dea3fe2d53f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:09.609027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3f456bf1-0afd-40a0-95ee-0a14f3000437 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:09.609632 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3f456bf1-0afd-40a0-95ee-0a14f3000437 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:09.611568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f97b5b40-1f8d-4fb0-b205-1dea3fe2d53f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:09.612314 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f97b5b40-1f8d-4fb0-b205-1dea3fe2d53f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:09.612747 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f97b5b40-1f8d-4fb0-b205-1dea3fe2d53f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:09.613503 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f97b5b40-1f8d-4fb0-b205-1dea3fe2d53f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:09.614464 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f97b5b40-1f8d-4fb0-b205-1dea3fe2d53f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:09.614921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f97b5b40-1f8d-4fb0-b205-1dea3fe2d53f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:09.616480 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f456bf1-0afd-40a0-95ee-0a14f3000437 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:09.616952 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f456bf1-0afd-40a0-95ee-0a14f3000437 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:09.617379 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f456bf1-0afd-40a0-95ee-0a14f3000437 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:09.618041 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f456bf1-0afd-40a0-95ee-0a14f3000437 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:09.618484 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f456bf1-0afd-40a0-95ee-0a14f3000437 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:09.618924 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f456bf1-0afd-40a0-95ee-0a14f3000437 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:09.743105 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f97b5b40-1f8d-4fb0-b205-1dea3fe2d53f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:09.746020 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3f456bf1-0afd-40a0-95ee-0a14f3000437 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:09.751540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f97b5b40-1f8d-4fb0-b205-1dea3fe2d53f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150495 Aug 24 12:54:09.752109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1560/3119] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:09 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:09.754696 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3f456bf1-0afd-40a0-95ee-0a14f3000437 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:09.756246 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3f456bf1-0afd-40a0-95ee-0a14f3000437 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:09.757395 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3f456bf1-0afd-40a0-95ee-0a14f3000437 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.152197 Aug 24 12:54:09.757936 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1560/3120] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:09 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:54:10.189041 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d475a214-8d87-47d1-8141-89e2eb6213fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:10.189727 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d475a214-8d87-47d1-8141-89e2eb6213fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:10.196732 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d475a214-8d87-47d1-8141-89e2eb6213fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:10.197213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d475a214-8d87-47d1-8141-89e2eb6213fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:10.197645 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d475a214-8d87-47d1-8141-89e2eb6213fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:10.198359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d475a214-8d87-47d1-8141-89e2eb6213fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:10.198839 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d475a214-8d87-47d1-8141-89e2eb6213fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:10.199263 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d475a214-8d87-47d1-8141-89e2eb6213fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:10.330820 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d475a214-8d87-47d1-8141-89e2eb6213fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:10.339493 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d475a214-8d87-47d1-8141-89e2eb6213fe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.154576 Aug 24 12:54:10.340046 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1561/3121] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:10 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:10.372501 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3c8525a4-125f-4a2c-8d81-c5082595a8c3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:10.373108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3c8525a4-125f-4a2c-8d81-c5082595a8c3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:10.379941 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c8525a4-125f-4a2c-8d81-c5082595a8c3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:10.380420 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c8525a4-125f-4a2c-8d81-c5082595a8c3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:10.380852 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c8525a4-125f-4a2c-8d81-c5082595a8c3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:10.381525 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c8525a4-125f-4a2c-8d81-c5082595a8c3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:10.381978 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c8525a4-125f-4a2c-8d81-c5082595a8c3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:10.382403 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c8525a4-125f-4a2c-8d81-c5082595a8c3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:10.508903 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3c8525a4-125f-4a2c-8d81-c5082595a8c3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:10.516918 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3c8525a4-125f-4a2c-8d81-c5082595a8c3 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.148305 Aug 24 12:54:10.517474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1561/3122] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:10 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:10.771707 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c75c7faf-bada-49ec-ad0c-9c76bc82a73c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:10.772343 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c75c7faf-bada-49ec-ad0c-9c76bc82a73c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:10.778519 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c75c7faf-bada-49ec-ad0c-9c76bc82a73c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:10.779048 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c75c7faf-bada-49ec-ad0c-9c76bc82a73c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:10.779627 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c75c7faf-bada-49ec-ad0c-9c76bc82a73c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:10.780254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7e83d431-0289-42bf-aa06-74af0e7ff7a5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:10.780382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c75c7faf-bada-49ec-ad0c-9c76bc82a73c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:10.780760 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c75c7faf-bada-49ec-ad0c-9c76bc82a73c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:10.780897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7e83d431-0289-42bf-aa06-74af0e7ff7a5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:10.781185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c75c7faf-bada-49ec-ad0c-9c76bc82a73c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:10.786630 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7e83d431-0289-42bf-aa06-74af0e7ff7a5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:10.787129 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7e83d431-0289-42bf-aa06-74af0e7ff7a5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:10.787560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7e83d431-0289-42bf-aa06-74af0e7ff7a5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:10.788234 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7e83d431-0289-42bf-aa06-74af0e7ff7a5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:10.788679 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7e83d431-0289-42bf-aa06-74af0e7ff7a5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:10.789095 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7e83d431-0289-42bf-aa06-74af0e7ff7a5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:10.913249 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c75c7faf-bada-49ec-ad0c-9c76bc82a73c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:10.921769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c75c7faf-bada-49ec-ad0c-9c76bc82a73c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.154425 Aug 24 12:54:10.922356 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1562/3123] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:10 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:11.157945 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7e83d431-0289-42bf-aa06-74af0e7ff7a5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:11.166401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7e83d431-0289-42bf-aa06-74af0e7ff7a5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:11.167907 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7e83d431-0289-42bf-aa06-74af0e7ff7a5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:11.169060 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7e83d431-0289-42bf-aa06-74af0e7ff7a5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.392545 Aug 24 12:54:11.169593 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1562/3124] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:10 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:54:11.360416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-302424c6-5fba-44e6-b321-359d3ac29b46 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:11.361001 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-302424c6-5fba-44e6-b321-359d3ac29b46 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:11.368005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-302424c6-5fba-44e6-b321-359d3ac29b46 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:11.368489 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-302424c6-5fba-44e6-b321-359d3ac29b46 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:11.368927 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-302424c6-5fba-44e6-b321-359d3ac29b46 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:11.369613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-302424c6-5fba-44e6-b321-359d3ac29b46 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:11.370068 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-302424c6-5fba-44e6-b321-359d3ac29b46 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:11.370499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-302424c6-5fba-44e6-b321-359d3ac29b46 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:11.498506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-302424c6-5fba-44e6-b321-359d3ac29b46 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:11.507259 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-302424c6-5fba-44e6-b321-359d3ac29b46 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150807 Aug 24 12:54:11.507811 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1563/3125] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:11 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:11.537512 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5edaa85c-904d-4e4f-affb-afcfc99d4a15 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:11.538107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5edaa85c-904d-4e4f-affb-afcfc99d4a15 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:11.544321 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5edaa85c-904d-4e4f-affb-afcfc99d4a15 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:11.544797 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5edaa85c-904d-4e4f-affb-afcfc99d4a15 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:11.545220 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5edaa85c-904d-4e4f-affb-afcfc99d4a15 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:11.545887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5edaa85c-904d-4e4f-affb-afcfc99d4a15 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:11.546328 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5edaa85c-904d-4e4f-affb-afcfc99d4a15 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:11.546775 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5edaa85c-904d-4e4f-affb-afcfc99d4a15 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:11.674317 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5edaa85c-904d-4e4f-affb-afcfc99d4a15 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:11.683172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5edaa85c-904d-4e4f-affb-afcfc99d4a15 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.149886 Aug 24 12:54:11.683733 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1563/3126] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:11 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:11.942111 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-197f1fc0-7766-4e8b-91a6-86f6a6d184d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:11.942664 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-197f1fc0-7766-4e8b-91a6-86f6a6d184d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:11.948524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-197f1fc0-7766-4e8b-91a6-86f6a6d184d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:11.949035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-197f1fc0-7766-4e8b-91a6-86f6a6d184d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:11.949473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-197f1fc0-7766-4e8b-91a6-86f6a6d184d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:11.950158 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-197f1fc0-7766-4e8b-91a6-86f6a6d184d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:11.950643 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-197f1fc0-7766-4e8b-91a6-86f6a6d184d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:11.951095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-197f1fc0-7766-4e8b-91a6-86f6a6d184d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:12.075983 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-197f1fc0-7766-4e8b-91a6-86f6a6d184d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:12.084618 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-197f1fc0-7766-4e8b-91a6-86f6a6d184d1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.146451 Aug 24 12:54:12.085169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1564/3127] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:11 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:12.192418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-76591f7c-c34c-4444-82b4-cab6f34e6159 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:12.192935 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-76591f7c-c34c-4444-82b4-cab6f34e6159 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:12.198757 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76591f7c-c34c-4444-82b4-cab6f34e6159 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:12.199233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76591f7c-c34c-4444-82b4-cab6f34e6159 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:12.199660 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76591f7c-c34c-4444-82b4-cab6f34e6159 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:12.200330 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76591f7c-c34c-4444-82b4-cab6f34e6159 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:12.200774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76591f7c-c34c-4444-82b4-cab6f34e6159 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:12.201190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-76591f7c-c34c-4444-82b4-cab6f34e6159 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:12.331973 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-76591f7c-c34c-4444-82b4-cab6f34e6159 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:12.340540 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-76591f7c-c34c-4444-82b4-cab6f34e6159 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:12.342021 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-76591f7c-c34c-4444-82b4-cab6f34e6159 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:12.343198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-76591f7c-c34c-4444-82b4-cab6f34e6159 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154909 Aug 24 12:54:12.343747 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1564/3128] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:12 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:12.527994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-af035869-f8fa-4ebb-9ae6-6b79862bf541 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:12.528604 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-af035869-f8fa-4ebb-9ae6-6b79862bf541 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:12.534977 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af035869-f8fa-4ebb-9ae6-6b79862bf541 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:12.535953 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af035869-f8fa-4ebb-9ae6-6b79862bf541 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:12.536383 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af035869-f8fa-4ebb-9ae6-6b79862bf541 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:12.537057 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af035869-f8fa-4ebb-9ae6-6b79862bf541 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:12.537508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af035869-f8fa-4ebb-9ae6-6b79862bf541 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:12.537930 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-af035869-f8fa-4ebb-9ae6-6b79862bf541 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:12.664759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-af035869-f8fa-4ebb-9ae6-6b79862bf541 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:12.672824 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-af035869-f8fa-4ebb-9ae6-6b79862bf541 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.148719 Aug 24 12:54:12.673382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1565/3129] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:12 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:12.703728 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7f099c82-90f5-4f78-823f-d04a024816a5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:12.704331 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7f099c82-90f5-4f78-823f-d04a024816a5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:12.711144 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7f099c82-90f5-4f78-823f-d04a024816a5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:12.711616 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7f099c82-90f5-4f78-823f-d04a024816a5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:12.712049 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7f099c82-90f5-4f78-823f-d04a024816a5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:12.712727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7f099c82-90f5-4f78-823f-d04a024816a5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:12.713176 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7f099c82-90f5-4f78-823f-d04a024816a5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:12.713597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7f099c82-90f5-4f78-823f-d04a024816a5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:12.838474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7f099c82-90f5-4f78-823f-d04a024816a5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:12.846547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7f099c82-90f5-4f78-823f-d04a024816a5 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.146622 Aug 24 12:54:12.848236 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1565/3130] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:12 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:13.104850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5081beb5-54d6-49ff-a5c4-5769eeadee98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:13.105499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5081beb5-54d6-49ff-a5c4-5769eeadee98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:13.107445 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:54:13.112292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5081beb5-54d6-49ff-a5c4-5769eeadee98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:13.112770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5081beb5-54d6-49ff-a5c4-5769eeadee98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:13.113202 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5081beb5-54d6-49ff-a5c4-5769eeadee98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:13.113882 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5081beb5-54d6-49ff-a5c4-5769eeadee98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:13.114333 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5081beb5-54d6-49ff-a5c4-5769eeadee98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:13.114783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5081beb5-54d6-49ff-a5c4-5769eeadee98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:13.245395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5081beb5-54d6-49ff-a5c4-5769eeadee98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:13.253472 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5081beb5-54d6-49ff-a5c4-5769eeadee98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152549 Aug 24 12:54:13.254531 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1566/3131] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:13 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:13.367367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bdd65b08-11b1-49ed-810e-9e1a09c5ec7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:13.368092 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-bdd65b08-11b1-49ed-810e-9e1a09c5ec7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:13.374015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bdd65b08-11b1-49ed-810e-9e1a09c5ec7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:13.374500 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bdd65b08-11b1-49ed-810e-9e1a09c5ec7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:13.374977 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bdd65b08-11b1-49ed-810e-9e1a09c5ec7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:13.375658 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bdd65b08-11b1-49ed-810e-9e1a09c5ec7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:13.376110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bdd65b08-11b1-49ed-810e-9e1a09c5ec7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:13.376546 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bdd65b08-11b1-49ed-810e-9e1a09c5ec7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:13.506558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-bdd65b08-11b1-49ed-810e-9e1a09c5ec7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:13.515031 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-bdd65b08-11b1-49ed-810e-9e1a09c5ec7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:13.516521 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-bdd65b08-11b1-49ed-810e-9e1a09c5ec7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:13.517663 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bdd65b08-11b1-49ed-810e-9e1a09c5ec7e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154774 Aug 24 12:54:13.518212 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1566/3132] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:13 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:13.694029 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-db43d0ed-c6e3-4e69-8450-bc0379a9b20c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:13.694551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-db43d0ed-c6e3-4e69-8450-bc0379a9b20c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:13.700892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db43d0ed-c6e3-4e69-8450-bc0379a9b20c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:13.701379 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db43d0ed-c6e3-4e69-8450-bc0379a9b20c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:13.701815 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db43d0ed-c6e3-4e69-8450-bc0379a9b20c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:13.702503 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db43d0ed-c6e3-4e69-8450-bc0379a9b20c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:13.702986 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db43d0ed-c6e3-4e69-8450-bc0379a9b20c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:13.728675 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db43d0ed-c6e3-4e69-8450-bc0379a9b20c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:13.830327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-db43d0ed-c6e3-4e69-8450-bc0379a9b20c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:13.839214 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-db43d0ed-c6e3-4e69-8450-bc0379a9b20c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149797 Aug 24 12:54:13.839765 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1567/3133] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:13 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:13.867630 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-27b66e29-2ae3-4e89-b65a-b686f4e5918f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:13.868243 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-27b66e29-2ae3-4e89-b65a-b686f4e5918f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:13.874580 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-27b66e29-2ae3-4e89-b65a-b686f4e5918f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:13.875093 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-27b66e29-2ae3-4e89-b65a-b686f4e5918f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:13.875529 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-27b66e29-2ae3-4e89-b65a-b686f4e5918f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:13.876211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-27b66e29-2ae3-4e89-b65a-b686f4e5918f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:13.876667 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-27b66e29-2ae3-4e89-b65a-b686f4e5918f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:13.877093 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-27b66e29-2ae3-4e89-b65a-b686f4e5918f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:14.001762 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-27b66e29-2ae3-4e89-b65a-b686f4e5918f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:14.010289 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-27b66e29-2ae3-4e89-b65a-b686f4e5918f tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.146416 Aug 24 12:54:14.010874 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1567/3134] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:13 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:14.275131 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4db2401e-201b-4a4e-ae5a-8720790399aa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:14.275749 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4db2401e-201b-4a4e-ae5a-8720790399aa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:14.281655 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4db2401e-201b-4a4e-ae5a-8720790399aa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:14.282143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4db2401e-201b-4a4e-ae5a-8720790399aa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:14.282593 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4db2401e-201b-4a4e-ae5a-8720790399aa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:14.283306 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4db2401e-201b-4a4e-ae5a-8720790399aa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:14.283768 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4db2401e-201b-4a4e-ae5a-8720790399aa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:14.284200 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4db2401e-201b-4a4e-ae5a-8720790399aa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:14.414580 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4db2401e-201b-4a4e-ae5a-8720790399aa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:14.423597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4db2401e-201b-4a4e-ae5a-8720790399aa tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151600 Aug 24 12:54:14.423597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1568/3135] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:14 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:14.540917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e5ee5acc-c36f-4371-bc6b-2ca45389122d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:14.541442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e5ee5acc-c36f-4371-bc6b-2ca45389122d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:14.547303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e5ee5acc-c36f-4371-bc6b-2ca45389122d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:14.547773 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e5ee5acc-c36f-4371-bc6b-2ca45389122d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:14.548199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e5ee5acc-c36f-4371-bc6b-2ca45389122d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:14.548864 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e5ee5acc-c36f-4371-bc6b-2ca45389122d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:14.549305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e5ee5acc-c36f-4371-bc6b-2ca45389122d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:14.549719 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e5ee5acc-c36f-4371-bc6b-2ca45389122d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:14.673603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e5ee5acc-c36f-4371-bc6b-2ca45389122d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:14.682691 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e5ee5acc-c36f-4371-bc6b-2ca45389122d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:14.684159 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e5ee5acc-c36f-4371-bc6b-2ca45389122d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:14.685289 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e5ee5acc-c36f-4371-bc6b-2ca45389122d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.148326 Aug 24 12:54:14.685840 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1568/3136] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:14 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:14.859732 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1fb5c87b-ef7c-4ddb-8c22-967e4a024926 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:14.860257 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1fb5c87b-ef7c-4ddb-8c22-967e4a024926 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:14.867459 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1fb5c87b-ef7c-4ddb-8c22-967e4a024926 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:14.867947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1fb5c87b-ef7c-4ddb-8c22-967e4a024926 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:14.868384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1fb5c87b-ef7c-4ddb-8c22-967e4a024926 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:14.869071 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1fb5c87b-ef7c-4ddb-8c22-967e4a024926 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:14.869528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1fb5c87b-ef7c-4ddb-8c22-967e4a024926 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:14.869959 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1fb5c87b-ef7c-4ddb-8c22-967e4a024926 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:15.006397 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1fb5c87b-ef7c-4ddb-8c22-967e4a024926 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:15.014515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1fb5c87b-ef7c-4ddb-8c22-967e4a024926 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.158747 Aug 24 12:54:15.017863 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1569/3137] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:14 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:15.031017 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-77a058a6-f9d4-4f9a-b1cf-fb35597f572c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:15.031623 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-77a058a6-f9d4-4f9a-b1cf-fb35597f572c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:15.038844 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-77a058a6-f9d4-4f9a-b1cf-fb35597f572c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:15.046823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-77a058a6-f9d4-4f9a-b1cf-fb35597f572c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:15.046823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-77a058a6-f9d4-4f9a-b1cf-fb35597f572c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:15.046823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-77a058a6-f9d4-4f9a-b1cf-fb35597f572c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:15.046823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-77a058a6-f9d4-4f9a-b1cf-fb35597f572c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:15.047250 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-77a058a6-f9d4-4f9a-b1cf-fb35597f572c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:15.172574 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-77a058a6-f9d4-4f9a-b1cf-fb35597f572c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:15.180818 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-77a058a6-f9d4-4f9a-b1cf-fb35597f572c tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.153840 Aug 24 12:54:15.181378 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1569/3138] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:15 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:15.443393 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e6db2ca9-378c-4d49-8b67-565370851bb6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:15.444032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e6db2ca9-378c-4d49-8b67-565370851bb6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:15.449904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e6db2ca9-378c-4d49-8b67-565370851bb6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:15.450392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e6db2ca9-378c-4d49-8b67-565370851bb6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:15.450881 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e6db2ca9-378c-4d49-8b67-565370851bb6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:15.451576 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e6db2ca9-378c-4d49-8b67-565370851bb6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:15.452038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e6db2ca9-378c-4d49-8b67-565370851bb6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:15.452474 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e6db2ca9-378c-4d49-8b67-565370851bb6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:15.582599 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e6db2ca9-378c-4d49-8b67-565370851bb6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:15.590756 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e6db2ca9-378c-4d49-8b67-565370851bb6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151245 Aug 24 12:54:15.591313 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1570/3139] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:15 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:15.708447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-68989650-ed28-41ca-84bd-6185eda36373 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:15.708970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-68989650-ed28-41ca-84bd-6185eda36373 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:15.715059 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68989650-ed28-41ca-84bd-6185eda36373 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:15.715535 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68989650-ed28-41ca-84bd-6185eda36373 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:15.715973 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68989650-ed28-41ca-84bd-6185eda36373 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:15.716651 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68989650-ed28-41ca-84bd-6185eda36373 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:15.717099 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68989650-ed28-41ca-84bd-6185eda36373 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:15.717519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-68989650-ed28-41ca-84bd-6185eda36373 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:15.842990 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-68989650-ed28-41ca-84bd-6185eda36373 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:15.851988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-68989650-ed28-41ca-84bd-6185eda36373 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:15.853462 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-68989650-ed28-41ca-84bd-6185eda36373 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:15.854790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-68989650-ed28-41ca-84bd-6185eda36373 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.150788 Aug 24 12:54:15.855359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1570/3140] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:15 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:16.036376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f38ece55-b591-4ba0-9ab3-a069b82663c0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:16.036973 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f38ece55-b591-4ba0-9ab3-a069b82663c0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:16.046060 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f38ece55-b591-4ba0-9ab3-a069b82663c0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:16.046545 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f38ece55-b591-4ba0-9ab3-a069b82663c0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:16.047013 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f38ece55-b591-4ba0-9ab3-a069b82663c0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:16.047707 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f38ece55-b591-4ba0-9ab3-a069b82663c0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:16.048167 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f38ece55-b591-4ba0-9ab3-a069b82663c0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:16.048597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f38ece55-b591-4ba0-9ab3-a069b82663c0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:16.178025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f38ece55-b591-4ba0-9ab3-a069b82663c0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:16.186160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f38ece55-b591-4ba0-9ab3-a069b82663c0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.153874 Aug 24 12:54:16.186743 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1571/3141] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:16 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:16.201409 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-51cb8815-81f2-489e-b38f-a620fc33a266 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:16.202127 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-51cb8815-81f2-489e-b38f-a620fc33a266 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] [instance: b9fbb4c1-a035-462e-b287-be4131984b09] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:16.208539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51cb8815-81f2-489e-b38f-a620fc33a266 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:16.209045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51cb8815-81f2-489e-b38f-a620fc33a266 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:16.209472 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51cb8815-81f2-489e-b38f-a620fc33a266 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:16.210146 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51cb8815-81f2-489e-b38f-a620fc33a266 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:16.210611 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51cb8815-81f2-489e-b38f-a620fc33a266 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:16.211087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51cb8815-81f2-489e-b38f-a620fc33a266 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:16.443911 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-51cb8815-81f2-489e-b38f-a620fc33a266 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19f208c6c274e7d89a7bf08f908871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3be3dcc1f48afbf2c60f233b8032d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:16.446179 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:54:16.452991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-51cb8815-81f2-489e-b38f-a620fc33a266 tempest-VolumesSnapshotTestJSON-335767640 tempest-VolumesSnapshotTestJSON-335767640-project] 10.222.0.45 "GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09" status: 200 len: 1559 microversion: 2.1 time: 0.255525 Aug 24 12:54:16.458333 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1571/3142] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:16 2022] GET /compute/v2.1/servers/b9fbb4c1-a035-462e-b287-be4131984b09 => generated 1559 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:16.613006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-be49854f-a5dd-4b41-aa7a-ef5d5f8c1522 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:16.614080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-be49854f-a5dd-4b41-aa7a-ef5d5f8c1522 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:16.622360 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be49854f-a5dd-4b41-aa7a-ef5d5f8c1522 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:16.624406 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be49854f-a5dd-4b41-aa7a-ef5d5f8c1522 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:16.625987 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be49854f-a5dd-4b41-aa7a-ef5d5f8c1522 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:16.629193 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be49854f-a5dd-4b41-aa7a-ef5d5f8c1522 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:16.630746 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be49854f-a5dd-4b41-aa7a-ef5d5f8c1522 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:16.631479 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be49854f-a5dd-4b41-aa7a-ef5d5f8c1522 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:16.656022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:54:16.735414 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ab32bb57-cc4c-40bf-b847-475790840a50 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:16.735894 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ab32bb57-cc4c-40bf-b847-475790840a50 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:16.744084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab32bb57-cc4c-40bf-b847-475790840a50 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:16.744569 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab32bb57-cc4c-40bf-b847-475790840a50 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:16.744998 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab32bb57-cc4c-40bf-b847-475790840a50 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:16.745715 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab32bb57-cc4c-40bf-b847-475790840a50 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:16.746196 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab32bb57-cc4c-40bf-b847-475790840a50 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:16.746640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab32bb57-cc4c-40bf-b847-475790840a50 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:16.803071 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-be49854f-a5dd-4b41-aa7a-ef5d5f8c1522 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:16.811605 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-be49854f-a5dd-4b41-aa7a-ef5d5f8c1522 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.202916 Aug 24 12:54:16.812843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1572/3143] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:16 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:16.877868 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9db1ce92-fbcb-4239-89ec-66fe5c4c0fce tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:16.878593 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9db1ce92-fbcb-4239-89ec-66fe5c4c0fce tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:16.885743 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9db1ce92-fbcb-4239-89ec-66fe5c4c0fce tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:16.889054 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9db1ce92-fbcb-4239-89ec-66fe5c4c0fce tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:16.889054 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9db1ce92-fbcb-4239-89ec-66fe5c4c0fce tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:16.889054 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9db1ce92-fbcb-4239-89ec-66fe5c4c0fce tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:16.889054 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9db1ce92-fbcb-4239-89ec-66fe5c4c0fce tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:16.889473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9db1ce92-fbcb-4239-89ec-66fe5c4c0fce tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:16.927373 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ab32bb57-cc4c-40bf-b847-475790840a50 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Going to try to terminate instance {{(pid=121171) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:54:17.026884 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9db1ce92-fbcb-4239-89ec-66fe5c4c0fce tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:17.036781 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9db1ce92-fbcb-4239-89ec-66fe5c4c0fce tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:17.038268 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9db1ce92-fbcb-4239-89ec-66fe5c4c0fce tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:17.039516 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9db1ce92-fbcb-4239-89ec-66fe5c4c0fce tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.165851 Aug 24 12:54:17.043790 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1573/3144] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:16 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:17.132419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:54:17.207963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-964a3495-9088-4e19-991a-bd4b6847e89f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:17.208585 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-964a3495-9088-4e19-991a-bd4b6847e89f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:17.215217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-964a3495-9088-4e19-991a-bd4b6847e89f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:17.215706 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-964a3495-9088-4e19-991a-bd4b6847e89f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:17.216150 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-964a3495-9088-4e19-991a-bd4b6847e89f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:17.216845 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-964a3495-9088-4e19-991a-bd4b6847e89f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:17.217308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-964a3495-9088-4e19-991a-bd4b6847e89f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:17.217737 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-964a3495-9088-4e19-991a-bd4b6847e89f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:17.223051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ab32bb57-cc4c-40bf-b847-475790840a50 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "DELETE /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 204 len: 0 microversion: 2.1 time: 0.491261 Aug 24 12:54:17.223736 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1572/3145] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 12:54:16 2022] DELETE /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 12:54:17.233587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2a8c6120-b31d-4eb4-b3c1-951533b7ebaa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:17.234341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2a8c6120-b31d-4eb4-b3c1-951533b7ebaa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:17.241031 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a8c6120-b31d-4eb4-b3c1-951533b7ebaa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:17.241603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a8c6120-b31d-4eb4-b3c1-951533b7ebaa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:17.242036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a8c6120-b31d-4eb4-b3c1-951533b7ebaa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:17.242797 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a8c6120-b31d-4eb4-b3c1-951533b7ebaa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:17.243252 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a8c6120-b31d-4eb4-b3c1-951533b7ebaa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:17.243672 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a8c6120-b31d-4eb4-b3c1-951533b7ebaa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:17.358825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-964a3495-9088-4e19-991a-bd4b6847e89f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:17.365859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-964a3495-9088-4e19-991a-bd4b6847e89f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.161745 Aug 24 12:54:17.366786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1574/3146] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:17 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:17.404291 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2a8c6120-b31d-4eb4-b3c1-951533b7ebaa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:17.414393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2a8c6120-b31d-4eb4-b3c1-951533b7ebaa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1718 microversion: 2.1 time: 0.185980 Aug 24 12:54:17.420182 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1573/3147] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:17 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1718 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:17.833172 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f4c9863e-da14-4a3b-adaa-496c8f68b588 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:17.833790 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f4c9863e-da14-4a3b-adaa-496c8f68b588 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:17.839924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4c9863e-da14-4a3b-adaa-496c8f68b588 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:17.840536 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4c9863e-da14-4a3b-adaa-496c8f68b588 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:17.841044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4c9863e-da14-4a3b-adaa-496c8f68b588 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:17.841903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4c9863e-da14-4a3b-adaa-496c8f68b588 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:17.842461 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4c9863e-da14-4a3b-adaa-496c8f68b588 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:17.843092 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4c9863e-da14-4a3b-adaa-496c8f68b588 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:17.975383 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f4c9863e-da14-4a3b-adaa-496c8f68b588 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:17.983488 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f4c9863e-da14-4a3b-adaa-496c8f68b588 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.154199 Aug 24 12:54:17.984040 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1575/3148] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:17 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:18.062327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cdecca0e-23c8-475b-9c04-bdf38776100b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:18.062926 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cdecca0e-23c8-475b-9c04-bdf38776100b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:18.069254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cdecca0e-23c8-475b-9c04-bdf38776100b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:18.069788 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cdecca0e-23c8-475b-9c04-bdf38776100b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:18.070230 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cdecca0e-23c8-475b-9c04-bdf38776100b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:18.070946 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cdecca0e-23c8-475b-9c04-bdf38776100b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:18.071407 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cdecca0e-23c8-475b-9c04-bdf38776100b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:18.071842 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cdecca0e-23c8-475b-9c04-bdf38776100b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:18.203084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cdecca0e-23c8-475b-9c04-bdf38776100b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:18.212515 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cdecca0e-23c8-475b-9c04-bdf38776100b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:18.214001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cdecca0e-23c8-475b-9c04-bdf38776100b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:18.215231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cdecca0e-23c8-475b-9c04-bdf38776100b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.156822 Aug 24 12:54:18.215770 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1574/3149] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:18 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:18.387451 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-697f8621-7d41-4203-acb0-9e897e4a8fea tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:18.387991 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-697f8621-7d41-4203-acb0-9e897e4a8fea tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:18.394298 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-697f8621-7d41-4203-acb0-9e897e4a8fea tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:18.394817 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-697f8621-7d41-4203-acb0-9e897e4a8fea tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:18.395261 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-697f8621-7d41-4203-acb0-9e897e4a8fea tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:18.395942 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-697f8621-7d41-4203-acb0-9e897e4a8fea tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:18.396398 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-697f8621-7d41-4203-acb0-9e897e4a8fea tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:18.396852 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-697f8621-7d41-4203-acb0-9e897e4a8fea tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:18.436821 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-01429367-74a5-4b79-b3d8-b1aea04f760b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:18.437428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-01429367-74a5-4b79-b3d8-b1aea04f760b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:18.443372 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01429367-74a5-4b79-b3d8-b1aea04f760b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:18.443856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01429367-74a5-4b79-b3d8-b1aea04f760b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:18.444358 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01429367-74a5-4b79-b3d8-b1aea04f760b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:18.445048 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01429367-74a5-4b79-b3d8-b1aea04f760b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:18.445509 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01429367-74a5-4b79-b3d8-b1aea04f760b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:18.445930 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01429367-74a5-4b79-b3d8-b1aea04f760b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:18.525008 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-697f8621-7d41-4203-acb0-9e897e4a8fea tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:18.534284 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-697f8621-7d41-4203-acb0-9e897e4a8fea tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150758 Aug 24 12:54:18.538843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1576/3150] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:18 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:18.577827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-01429367-74a5-4b79-b3d8-b1aea04f760b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:18.584016 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-01429367-74a5-4b79-b3d8-b1aea04f760b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1718 microversion: 2.1 time: 0.151001 Aug 24 12:54:18.584570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1575/3151] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:18 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:19.005097 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1da8db41-7872-44b4-8cbb-c63f41154116 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:19.005702 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1da8db41-7872-44b4-8cbb-c63f41154116 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:19.011558 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1da8db41-7872-44b4-8cbb-c63f41154116 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:19.012040 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1da8db41-7872-44b4-8cbb-c63f41154116 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:19.012474 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1da8db41-7872-44b4-8cbb-c63f41154116 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:19.013152 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1da8db41-7872-44b4-8cbb-c63f41154116 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:19.013607 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1da8db41-7872-44b4-8cbb-c63f41154116 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:19.014024 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1da8db41-7872-44b4-8cbb-c63f41154116 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:19.141247 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1da8db41-7872-44b4-8cbb-c63f41154116 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:19.149899 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1da8db41-7872-44b4-8cbb-c63f41154116 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149202 Aug 24 12:54:19.150495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1577/3152] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:18 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:19.238168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-44165f31-1c38-4b6b-8899-40e5442117ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:19.238811 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-44165f31-1c38-4b6b-8899-40e5442117ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:19.245029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-44165f31-1c38-4b6b-8899-40e5442117ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:19.245614 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-44165f31-1c38-4b6b-8899-40e5442117ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:19.246058 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-44165f31-1c38-4b6b-8899-40e5442117ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:19.246997 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-44165f31-1c38-4b6b-8899-40e5442117ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:19.247453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-44165f31-1c38-4b6b-8899-40e5442117ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:19.247879 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-44165f31-1c38-4b6b-8899-40e5442117ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:19.383267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-44165f31-1c38-4b6b-8899-40e5442117ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:19.392893 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-44165f31-1c38-4b6b-8899-40e5442117ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:19.394485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-44165f31-1c38-4b6b-8899-40e5442117ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:19.395703 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-44165f31-1c38-4b6b-8899-40e5442117ac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.161788 Aug 24 12:54:19.396518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1576/3153] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:19 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:19.557700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-68810a19-018c-4fd9-8d2e-c1491efa8cfc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:19.558316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-68810a19-018c-4fd9-8d2e-c1491efa8cfc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:19.564730 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-68810a19-018c-4fd9-8d2e-c1491efa8cfc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:19.565209 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-68810a19-018c-4fd9-8d2e-c1491efa8cfc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:19.565638 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-68810a19-018c-4fd9-8d2e-c1491efa8cfc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:19.566924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-68810a19-018c-4fd9-8d2e-c1491efa8cfc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:19.567395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-68810a19-018c-4fd9-8d2e-c1491efa8cfc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:19.567796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-68810a19-018c-4fd9-8d2e-c1491efa8cfc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:19.614563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4ede3801-8462-4291-b9db-018c3321dc2b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:19.614563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4ede3801-8462-4291-b9db-018c3321dc2b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:19.615552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ede3801-8462-4291-b9db-018c3321dc2b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:19.616231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ede3801-8462-4291-b9db-018c3321dc2b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:19.616843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ede3801-8462-4291-b9db-018c3321dc2b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:19.617844 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ede3801-8462-4291-b9db-018c3321dc2b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:19.618462 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ede3801-8462-4291-b9db-018c3321dc2b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:19.619111 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ede3801-8462-4291-b9db-018c3321dc2b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:19.714259 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4ede3801-8462-4291-b9db-018c3321dc2b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:19.724511 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4ede3801-8462-4291-b9db-018c3321dc2b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1651 microversion: 2.1 time: 0.122997 Aug 24 12:54:19.726562 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1577/3154] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:19 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1651 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:19.738873 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-68810a19-018c-4fd9-8d2e-c1491efa8cfc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:19.748339 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-68810a19-018c-4fd9-8d2e-c1491efa8cfc tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.194529 Aug 24 12:54:19.749514 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1578/3155] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:19 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:19.814087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-89daa948-7d86-46e9-87c9-ab9c32144c02 req-8616e8da-3456-4dfb-a4db-e57c28b5f998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720992f6-0031-4c2a-801d-07a71dd87158", "name": "network-vif-deleted", "tag": "ffb749d1-7131-4112-a58f-5f3e9cc94cd1"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:54:19.823618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-89daa948-7d86-46e9-87c9-ab9c32144c02 req-8616e8da-3456-4dfb-a4db-e57c28b5f998 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:19.824240 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-89daa948-7d86-46e9-87c9-ab9c32144c02 req-8616e8da-3456-4dfb-a4db-e57c28b5f998 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:19.824682 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-89daa948-7d86-46e9-87c9-ab9c32144c02 req-8616e8da-3456-4dfb-a4db-e57c28b5f998 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:19.836262 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-89daa948-7d86-46e9-87c9-ab9c32144c02 req-8616e8da-3456-4dfb-a4db-e57c28b5f998 service nova] Creating event network-vif-deleted:ffb749d1-7131-4112-a58f-5f3e9cc94cd1 for instance 720992f6-0031-4c2a-801d-07a71dd87158 on hv-cinder-84889 Aug 24 12:54:19.841258 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-89daa948-7d86-46e9-87c9-ab9c32144c02 req-8616e8da-3456-4dfb-a4db-e57c28b5f998 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086502 Aug 24 12:54:19.842158 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1578/3156] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:54:20.171013 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b7b62ce4-f440-4482-9186-f929b71a28c1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:20.171759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b7b62ce4-f440-4482-9186-f929b71a28c1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:20.177791 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7b62ce4-f440-4482-9186-f929b71a28c1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:20.178283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7b62ce4-f440-4482-9186-f929b71a28c1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:20.178756 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7b62ce4-f440-4482-9186-f929b71a28c1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:20.179456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7b62ce4-f440-4482-9186-f929b71a28c1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:20.179916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7b62ce4-f440-4482-9186-f929b71a28c1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:20.180343 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7b62ce4-f440-4482-9186-f929b71a28c1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:20.327628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b7b62ce4-f440-4482-9186-f929b71a28c1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:20.337626 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b7b62ce4-f440-4482-9186-f929b71a28c1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.170524 Aug 24 12:54:20.338523 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1579/3157] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:20 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:20.420139 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8e44d3b5-69ee-4a22-b8e0-f82edcebdb22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:20.420836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8e44d3b5-69ee-4a22-b8e0-f82edcebdb22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:20.430557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8e44d3b5-69ee-4a22-b8e0-f82edcebdb22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:20.431109 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8e44d3b5-69ee-4a22-b8e0-f82edcebdb22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:20.431553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8e44d3b5-69ee-4a22-b8e0-f82edcebdb22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:20.432258 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8e44d3b5-69ee-4a22-b8e0-f82edcebdb22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:20.432715 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8e44d3b5-69ee-4a22-b8e0-f82edcebdb22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:20.433146 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8e44d3b5-69ee-4a22-b8e0-f82edcebdb22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:20.588770 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8e44d3b5-69ee-4a22-b8e0-f82edcebdb22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:20.598348 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8e44d3b5-69ee-4a22-b8e0-f82edcebdb22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:20.600487 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8e44d3b5-69ee-4a22-b8e0-f82edcebdb22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:20.601685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8e44d3b5-69ee-4a22-b8e0-f82edcebdb22 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.186923 Aug 24 12:54:20.602776 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1579/3158] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:20 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:20.747898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f087b859-7f4c-4483-a3d5-6f186db856b8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:20.748506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f087b859-7f4c-4483-a3d5-6f186db856b8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:20.755551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f087b859-7f4c-4483-a3d5-6f186db856b8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:20.756516 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f087b859-7f4c-4483-a3d5-6f186db856b8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:20.756516 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f087b859-7f4c-4483-a3d5-6f186db856b8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:20.757217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f087b859-7f4c-4483-a3d5-6f186db856b8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:20.757674 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f087b859-7f4c-4483-a3d5-6f186db856b8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:20.758095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f087b859-7f4c-4483-a3d5-6f186db856b8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:20.770719 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c4ee5d15-a592-4da6-b283-b34db4b389f7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:20.772042 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c4ee5d15-a592-4da6-b283-b34db4b389f7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:20.778855 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4ee5d15-a592-4da6-b283-b34db4b389f7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:20.779340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4ee5d15-a592-4da6-b283-b34db4b389f7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:20.779770 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4ee5d15-a592-4da6-b283-b34db4b389f7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:20.780461 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4ee5d15-a592-4da6-b283-b34db4b389f7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:20.780957 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4ee5d15-a592-4da6-b283-b34db4b389f7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:20.781421 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c4ee5d15-a592-4da6-b283-b34db4b389f7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:20.836505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f087b859-7f4c-4483-a3d5-6f186db856b8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:20.845798 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f087b859-7f4c-4483-a3d5-6f186db856b8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.101735 Aug 24 12:54:20.846960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1580/3159] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:20 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:20.945907 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c4ee5d15-a592-4da6-b283-b34db4b389f7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:20.954304 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c4ee5d15-a592-4da6-b283-b34db4b389f7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.188743 Aug 24 12:54:20.954890 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1580/3160] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:20 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:21.359536 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-24643a18-8663-45c5-ab3b-36faa706d9dc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:21.360181 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-24643a18-8663-45c5-ab3b-36faa706d9dc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:21.367268 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-24643a18-8663-45c5-ab3b-36faa706d9dc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:21.367757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-24643a18-8663-45c5-ab3b-36faa706d9dc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:21.368192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-24643a18-8663-45c5-ab3b-36faa706d9dc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:21.368871 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-24643a18-8663-45c5-ab3b-36faa706d9dc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:21.369322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-24643a18-8663-45c5-ab3b-36faa706d9dc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:21.369743 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-24643a18-8663-45c5-ab3b-36faa706d9dc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:21.506213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-24643a18-8663-45c5-ab3b-36faa706d9dc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:21.514825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-24643a18-8663-45c5-ab3b-36faa706d9dc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.159034 Aug 24 12:54:21.515564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1581/3161] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:21 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:21.625223 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b06d5921-42c0-4416-b7e9-b0ed73b77740 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:21.626194 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b06d5921-42c0-4416-b7e9-b0ed73b77740 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:21.632664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b06d5921-42c0-4416-b7e9-b0ed73b77740 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:21.633153 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b06d5921-42c0-4416-b7e9-b0ed73b77740 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:21.633591 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b06d5921-42c0-4416-b7e9-b0ed73b77740 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:21.634300 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b06d5921-42c0-4416-b7e9-b0ed73b77740 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:21.634788 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b06d5921-42c0-4416-b7e9-b0ed73b77740 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:21.635219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b06d5921-42c0-4416-b7e9-b0ed73b77740 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:21.765502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b06d5921-42c0-4416-b7e9-b0ed73b77740 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:21.774702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b06d5921-42c0-4416-b7e9-b0ed73b77740 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:21.776183 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b06d5921-42c0-4416-b7e9-b0ed73b77740 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:21.777328 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b06d5921-42c0-4416-b7e9-b0ed73b77740 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.156082 Aug 24 12:54:21.777872 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1581/3162] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:21 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:21.867007 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-42708419-d2ce-42e0-9fc3-7924920b4253 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:21.867624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-42708419-d2ce-42e0-9fc3-7924920b4253 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:21.873963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-42708419-d2ce-42e0-9fc3-7924920b4253 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:21.874442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-42708419-d2ce-42e0-9fc3-7924920b4253 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:21.874914 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-42708419-d2ce-42e0-9fc3-7924920b4253 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:21.875590 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-42708419-d2ce-42e0-9fc3-7924920b4253 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:21.876042 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-42708419-d2ce-42e0-9fc3-7924920b4253 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:21.876462 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-42708419-d2ce-42e0-9fc3-7924920b4253 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:21.936582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-42708419-d2ce-42e0-9fc3-7924920b4253 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:21.944659 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-42708419-d2ce-42e0-9fc3-7924920b4253 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081652 Aug 24 12:54:21.945205 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1582/3163] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:21 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:21.975826 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9bd7621d-e3db-472e-aaaa-414815d924ef tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:21.976638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9bd7621d-e3db-472e-aaaa-414815d924ef tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:21.982437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bd7621d-e3db-472e-aaaa-414815d924ef tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:21.982954 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bd7621d-e3db-472e-aaaa-414815d924ef tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:21.983396 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bd7621d-e3db-472e-aaaa-414815d924ef tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:21.984078 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bd7621d-e3db-472e-aaaa-414815d924ef tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:21.984534 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bd7621d-e3db-472e-aaaa-414815d924ef tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:21.984957 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bd7621d-e3db-472e-aaaa-414815d924ef tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:22.112762 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9bd7621d-e3db-472e-aaaa-414815d924ef tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:22.121238 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9bd7621d-e3db-472e-aaaa-414815d924ef tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149667 Aug 24 12:54:22.121814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1582/3164] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:21 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:22.536268 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-660391e6-49b0-4687-abb8-7aa56a4fa012 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:22.536878 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-660391e6-49b0-4687-abb8-7aa56a4fa012 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:22.542892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-660391e6-49b0-4687-abb8-7aa56a4fa012 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:22.543378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-660391e6-49b0-4687-abb8-7aa56a4fa012 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:22.543817 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-660391e6-49b0-4687-abb8-7aa56a4fa012 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:22.544497 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-660391e6-49b0-4687-abb8-7aa56a4fa012 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:22.544957 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-660391e6-49b0-4687-abb8-7aa56a4fa012 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:22.545483 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-660391e6-49b0-4687-abb8-7aa56a4fa012 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:22.674631 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-660391e6-49b0-4687-abb8-7aa56a4fa012 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:22.682923 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-660391e6-49b0-4687-abb8-7aa56a4fa012 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151248 Aug 24 12:54:22.683475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1583/3165] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:22 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:22.800273 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2545257f-8399-4ff5-a481-f3133c189291 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:22.801449 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2545257f-8399-4ff5-a481-f3133c189291 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:22.808257 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2545257f-8399-4ff5-a481-f3133c189291 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:22.808732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2545257f-8399-4ff5-a481-f3133c189291 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:22.809164 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2545257f-8399-4ff5-a481-f3133c189291 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:22.809845 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2545257f-8399-4ff5-a481-f3133c189291 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:22.810294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2545257f-8399-4ff5-a481-f3133c189291 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:22.810744 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2545257f-8399-4ff5-a481-f3133c189291 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:22.935125 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2545257f-8399-4ff5-a481-f3133c189291 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:22.943629 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2545257f-8399-4ff5-a481-f3133c189291 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:22.945092 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2545257f-8399-4ff5-a481-f3133c189291 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:22.946238 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2545257f-8399-4ff5-a481-f3133c189291 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.149849 Aug 24 12:54:22.946807 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1583/3166] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:22 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:22.965069 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f1725886-a20c-494a-bcfc-ee85bfee5b76 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:22.965675 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f1725886-a20c-494a-bcfc-ee85bfee5b76 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:22.972759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1725886-a20c-494a-bcfc-ee85bfee5b76 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:22.973241 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1725886-a20c-494a-bcfc-ee85bfee5b76 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:22.973672 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1725886-a20c-494a-bcfc-ee85bfee5b76 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:22.974351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1725886-a20c-494a-bcfc-ee85bfee5b76 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:22.974836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1725886-a20c-494a-bcfc-ee85bfee5b76 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:22.975257 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f1725886-a20c-494a-bcfc-ee85bfee5b76 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:23.035696 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f1725886-a20c-494a-bcfc-ee85bfee5b76 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:23.044943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f1725886-a20c-494a-bcfc-ee85bfee5b76 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083606 Aug 24 12:54:23.045492 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1584/3167] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:22 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:23.142951 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5c662070-d9f7-424f-8d90-4aa171899ce8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:23.143488 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5c662070-d9f7-424f-8d90-4aa171899ce8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:23.150284 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c662070-d9f7-424f-8d90-4aa171899ce8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:23.150791 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c662070-d9f7-424f-8d90-4aa171899ce8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:23.151227 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c662070-d9f7-424f-8d90-4aa171899ce8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:23.151899 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c662070-d9f7-424f-8d90-4aa171899ce8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:23.152345 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c662070-d9f7-424f-8d90-4aa171899ce8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:23.152761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c662070-d9f7-424f-8d90-4aa171899ce8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:23.280199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5c662070-d9f7-424f-8d90-4aa171899ce8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:23.289064 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5c662070-d9f7-424f-8d90-4aa171899ce8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150020 Aug 24 12:54:23.289615 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1584/3168] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:23 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:23.703800 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-edb5d83c-ddce-413a-b115-ba6c24f52620 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:23.704347 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-edb5d83c-ddce-413a-b115-ba6c24f52620 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:23.711785 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edb5d83c-ddce-413a-b115-ba6c24f52620 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:23.712275 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edb5d83c-ddce-413a-b115-ba6c24f52620 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:23.712771 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edb5d83c-ddce-413a-b115-ba6c24f52620 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:23.713487 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edb5d83c-ddce-413a-b115-ba6c24f52620 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:23.713965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edb5d83c-ddce-413a-b115-ba6c24f52620 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:23.714390 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-edb5d83c-ddce-413a-b115-ba6c24f52620 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:23.844486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-edb5d83c-ddce-413a-b115-ba6c24f52620 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:23.853167 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-edb5d83c-ddce-413a-b115-ba6c24f52620 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153391 Aug 24 12:54:23.854108 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1585/3169] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:23 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:23.968835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0dccc4f6-1d47-4431-8262-2cd26524d4f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:23.969369 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0dccc4f6-1d47-4431-8262-2cd26524d4f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:23.976392 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0dccc4f6-1d47-4431-8262-2cd26524d4f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:23.976875 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0dccc4f6-1d47-4431-8262-2cd26524d4f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:23.977308 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0dccc4f6-1d47-4431-8262-2cd26524d4f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:23.977988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0dccc4f6-1d47-4431-8262-2cd26524d4f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:23.978437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0dccc4f6-1d47-4431-8262-2cd26524d4f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:23.978888 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0dccc4f6-1d47-4431-8262-2cd26524d4f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:24.065859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-482cb1e7-4b7a-47fd-bf0b-aba48bcad210 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:24.066482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-482cb1e7-4b7a-47fd-bf0b-aba48bcad210 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:24.072815 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-482cb1e7-4b7a-47fd-bf0b-aba48bcad210 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:24.073308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-482cb1e7-4b7a-47fd-bf0b-aba48bcad210 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:24.073750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-482cb1e7-4b7a-47fd-bf0b-aba48bcad210 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:24.074493 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-482cb1e7-4b7a-47fd-bf0b-aba48bcad210 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:24.075239 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-482cb1e7-4b7a-47fd-bf0b-aba48bcad210 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:24.075568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-482cb1e7-4b7a-47fd-bf0b-aba48bcad210 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:24.113196 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0dccc4f6-1d47-4431-8262-2cd26524d4f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:24.121945 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0dccc4f6-1d47-4431-8262-2cd26524d4f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:24.123479 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0dccc4f6-1d47-4431-8262-2cd26524d4f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:24.124637 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0dccc4f6-1d47-4431-8262-2cd26524d4f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.159780 Aug 24 12:54:24.125190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1585/3170] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:23 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:24.143947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-482cb1e7-4b7a-47fd-bf0b-aba48bcad210 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:24.152738 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-482cb1e7-4b7a-47fd-bf0b-aba48bcad210 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.091034 Aug 24 12:54:24.153294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1586/3171] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:24 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:24.309828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5d77bb9f-01b7-4a9b-befd-e14f12121d6b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:24.310434 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5d77bb9f-01b7-4a9b-befd-e14f12121d6b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:24.316280 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d77bb9f-01b7-4a9b-befd-e14f12121d6b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:24.316760 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d77bb9f-01b7-4a9b-befd-e14f12121d6b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:24.317194 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d77bb9f-01b7-4a9b-befd-e14f12121d6b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:24.317871 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d77bb9f-01b7-4a9b-befd-e14f12121d6b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:24.318327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d77bb9f-01b7-4a9b-befd-e14f12121d6b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:24.318781 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5d77bb9f-01b7-4a9b-befd-e14f12121d6b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:24.443883 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5d77bb9f-01b7-4a9b-befd-e14f12121d6b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:24.451989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5d77bb9f-01b7-4a9b-befd-e14f12121d6b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.146024 Aug 24 12:54:24.452545 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1586/3172] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:24 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:24.874943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-95966d90-f2b2-4880-b622-caeba312f0c7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:24.875548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-95966d90-f2b2-4880-b622-caeba312f0c7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:24.881462 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95966d90-f2b2-4880-b622-caeba312f0c7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:24.881943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95966d90-f2b2-4880-b622-caeba312f0c7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:24.882375 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95966d90-f2b2-4880-b622-caeba312f0c7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:24.883076 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95966d90-f2b2-4880-b622-caeba312f0c7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:24.883527 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95966d90-f2b2-4880-b622-caeba312f0c7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:24.883950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95966d90-f2b2-4880-b622-caeba312f0c7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:25.011597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-95966d90-f2b2-4880-b622-caeba312f0c7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:25.020369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-95966d90-f2b2-4880-b622-caeba312f0c7 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149356 Aug 24 12:54:25.023531 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1587/3173] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:24 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:25.148938 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9136ea1e-6db6-42fe-9f0d-b93eed41c718 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:25.149488 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9136ea1e-6db6-42fe-9f0d-b93eed41c718 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:25.156492 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9136ea1e-6db6-42fe-9f0d-b93eed41c718 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:25.156985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9136ea1e-6db6-42fe-9f0d-b93eed41c718 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:25.157452 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9136ea1e-6db6-42fe-9f0d-b93eed41c718 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:25.158142 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9136ea1e-6db6-42fe-9f0d-b93eed41c718 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:25.158597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9136ea1e-6db6-42fe-9f0d-b93eed41c718 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:25.159050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9136ea1e-6db6-42fe-9f0d-b93eed41c718 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:25.173154 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bec0a432-4d53-4dc8-9e57-e07041acb426 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:25.173763 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bec0a432-4d53-4dc8-9e57-e07041acb426 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:25.174007 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:54:25.180196 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bec0a432-4d53-4dc8-9e57-e07041acb426 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:25.180815 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bec0a432-4d53-4dc8-9e57-e07041acb426 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:25.181259 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bec0a432-4d53-4dc8-9e57-e07041acb426 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:25.182070 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bec0a432-4d53-4dc8-9e57-e07041acb426 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:25.182540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bec0a432-4d53-4dc8-9e57-e07041acb426 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:25.183022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bec0a432-4d53-4dc8-9e57-e07041acb426 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:25.246064 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bec0a432-4d53-4dc8-9e57-e07041acb426 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:25.255352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bec0a432-4d53-4dc8-9e57-e07041acb426 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085920 Aug 24 12:54:25.256731 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1588/3174] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:25 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:25.292434 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9136ea1e-6db6-42fe-9f0d-b93eed41c718 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:25.301006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9136ea1e-6db6-42fe-9f0d-b93eed41c718 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:25.302503 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9136ea1e-6db6-42fe-9f0d-b93eed41c718 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:25.303687 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9136ea1e-6db6-42fe-9f0d-b93eed41c718 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.159837 Aug 24 12:54:25.304240 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1587/3175] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:25 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:25.473203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-78eb0d87-6f70-4c9f-91d5-73170b04021b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:25.473848 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-78eb0d87-6f70-4c9f-91d5-73170b04021b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:25.479873 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-78eb0d87-6f70-4c9f-91d5-73170b04021b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:25.480363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-78eb0d87-6f70-4c9f-91d5-73170b04021b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:25.480806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-78eb0d87-6f70-4c9f-91d5-73170b04021b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:25.481494 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-78eb0d87-6f70-4c9f-91d5-73170b04021b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:25.481955 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-78eb0d87-6f70-4c9f-91d5-73170b04021b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:25.482394 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-78eb0d87-6f70-4c9f-91d5-73170b04021b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:25.484896 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:54:25.821157 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-78eb0d87-6f70-4c9f-91d5-73170b04021b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:25.829294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-78eb0d87-6f70-4c9f-91d5-73170b04021b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.360033 Aug 24 12:54:25.829850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1589/3176] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:25 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:26.041702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9311ed88-e798-4112-a391-d0a48f66b9a9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:26.042311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9311ed88-e798-4112-a391-d0a48f66b9a9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:26.048323 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9311ed88-e798-4112-a391-d0a48f66b9a9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:26.048833 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9311ed88-e798-4112-a391-d0a48f66b9a9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:26.049270 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9311ed88-e798-4112-a391-d0a48f66b9a9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:26.049949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9311ed88-e798-4112-a391-d0a48f66b9a9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:26.051074 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9311ed88-e798-4112-a391-d0a48f66b9a9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:26.051502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9311ed88-e798-4112-a391-d0a48f66b9a9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:26.178041 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9311ed88-e798-4112-a391-d0a48f66b9a9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:26.186193 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9311ed88-e798-4112-a391-d0a48f66b9a9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148306 Aug 24 12:54:26.186769 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1588/3177] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:26 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:26.276420 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-223e9aea-4a66-4bfd-8a8e-9cbf3d448368 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:26.277075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-223e9aea-4a66-4bfd-8a8e-9cbf3d448368 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:26.283366 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-223e9aea-4a66-4bfd-8a8e-9cbf3d448368 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:26.283842 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-223e9aea-4a66-4bfd-8a8e-9cbf3d448368 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:26.284265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-223e9aea-4a66-4bfd-8a8e-9cbf3d448368 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:26.285608 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-223e9aea-4a66-4bfd-8a8e-9cbf3d448368 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:26.286069 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-223e9aea-4a66-4bfd-8a8e-9cbf3d448368 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:26.286492 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-223e9aea-4a66-4bfd-8a8e-9cbf3d448368 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:26.326984 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-24ad7347-1452-4e72-8949-2227f931c8ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:26.327590 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-24ad7347-1452-4e72-8949-2227f931c8ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:26.334030 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-24ad7347-1452-4e72-8949-2227f931c8ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:26.334503 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-24ad7347-1452-4e72-8949-2227f931c8ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:26.334979 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-24ad7347-1452-4e72-8949-2227f931c8ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:26.335666 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-24ad7347-1452-4e72-8949-2227f931c8ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:26.336119 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-24ad7347-1452-4e72-8949-2227f931c8ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:26.336543 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-24ad7347-1452-4e72-8949-2227f931c8ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:26.348322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-223e9aea-4a66-4bfd-8a8e-9cbf3d448368 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:26.356645 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-223e9aea-4a66-4bfd-8a8e-9cbf3d448368 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084136 Aug 24 12:54:26.357204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1590/3178] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:26 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:26.464440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-24ad7347-1452-4e72-8949-2227f931c8ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:26.473575 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-24ad7347-1452-4e72-8949-2227f931c8ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:26.475253 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-24ad7347-1452-4e72-8949-2227f931c8ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:26.476421 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-24ad7347-1452-4e72-8949-2227f931c8ec tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.153396 Aug 24 12:54:26.476978 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1589/3179] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:26 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:54:26.850070 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-63c865a4-b88b-4d02-a012-74f4c4388abe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:26.850796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-63c865a4-b88b-4d02-a012-74f4c4388abe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:26.856831 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63c865a4-b88b-4d02-a012-74f4c4388abe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:26.857322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63c865a4-b88b-4d02-a012-74f4c4388abe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:26.857762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63c865a4-b88b-4d02-a012-74f4c4388abe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:26.858449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63c865a4-b88b-4d02-a012-74f4c4388abe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:26.858941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63c865a4-b88b-4d02-a012-74f4c4388abe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:26.859369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63c865a4-b88b-4d02-a012-74f4c4388abe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:26.982863 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-63c865a4-b88b-4d02-a012-74f4c4388abe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:26.991756 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-63c865a4-b88b-4d02-a012-74f4c4388abe tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.145603 Aug 24 12:54:26.992316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1591/3180] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:26 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:27.206781 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5c2c8d00-3270-4138-8c52-0ab8c3198647 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:27.207309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5c2c8d00-3270-4138-8c52-0ab8c3198647 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:27.213626 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c2c8d00-3270-4138-8c52-0ab8c3198647 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:27.214101 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c2c8d00-3270-4138-8c52-0ab8c3198647 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:27.214543 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c2c8d00-3270-4138-8c52-0ab8c3198647 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:27.215247 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c2c8d00-3270-4138-8c52-0ab8c3198647 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:27.215696 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c2c8d00-3270-4138-8c52-0ab8c3198647 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:27.216118 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c2c8d00-3270-4138-8c52-0ab8c3198647 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:27.347640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5c2c8d00-3270-4138-8c52-0ab8c3198647 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:27.355754 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5c2c8d00-3270-4138-8c52-0ab8c3198647 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153036 Aug 24 12:54:27.356319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1590/3181] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:27 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:27.377402 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b8f27205-ee94-45ec-a915-fc35543771cf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:27.377995 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b8f27205-ee94-45ec-a915-fc35543771cf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:27.384450 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b8f27205-ee94-45ec-a915-fc35543771cf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:27.384941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b8f27205-ee94-45ec-a915-fc35543771cf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:27.385386 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b8f27205-ee94-45ec-a915-fc35543771cf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:27.386072 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b8f27205-ee94-45ec-a915-fc35543771cf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:27.386537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b8f27205-ee94-45ec-a915-fc35543771cf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:27.387015 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b8f27205-ee94-45ec-a915-fc35543771cf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:27.450070 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b8f27205-ee94-45ec-a915-fc35543771cf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:27.458353 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b8f27205-ee94-45ec-a915-fc35543771cf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084829 Aug 24 12:54:27.458879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1592/3182] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:27 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:27.498905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e881ca77-5185-4442-829d-7b5793e30e8b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:27.499506 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e881ca77-5185-4442-829d-7b5793e30e8b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:27.505398 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e881ca77-5185-4442-829d-7b5793e30e8b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:27.505866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e881ca77-5185-4442-829d-7b5793e30e8b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:27.506293 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e881ca77-5185-4442-829d-7b5793e30e8b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:27.506993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e881ca77-5185-4442-829d-7b5793e30e8b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:27.507440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e881ca77-5185-4442-829d-7b5793e30e8b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:27.507889 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e881ca77-5185-4442-829d-7b5793e30e8b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:27.632122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e881ca77-5185-4442-829d-7b5793e30e8b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:27.640538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e881ca77-5185-4442-829d-7b5793e30e8b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:27.642001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e881ca77-5185-4442-829d-7b5793e30e8b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:27.643184 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e881ca77-5185-4442-829d-7b5793e30e8b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.148238 Aug 24 12:54:27.643732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1591/3183] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:27 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:28.013199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-40734f1b-559b-4537-bb7e-c34e4e74ea90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:28.013859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-40734f1b-559b-4537-bb7e-c34e4e74ea90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:28.020403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40734f1b-559b-4537-bb7e-c34e4e74ea90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:28.020881 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40734f1b-559b-4537-bb7e-c34e4e74ea90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:28.021309 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40734f1b-559b-4537-bb7e-c34e4e74ea90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:28.021985 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40734f1b-559b-4537-bb7e-c34e4e74ea90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:28.022437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40734f1b-559b-4537-bb7e-c34e4e74ea90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:28.022886 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40734f1b-559b-4537-bb7e-c34e4e74ea90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:28.147407 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-40734f1b-559b-4537-bb7e-c34e4e74ea90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:28.155625 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-40734f1b-559b-4537-bb7e-c34e4e74ea90 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.146180 Aug 24 12:54:28.156137 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1593/3184] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:28 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:28.377065 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a70ad92c-49b5-4d0a-bca8-a13977eec264 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:28.377742 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a70ad92c-49b5-4d0a-bca8-a13977eec264 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:28.384024 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a70ad92c-49b5-4d0a-bca8-a13977eec264 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:28.384497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a70ad92c-49b5-4d0a-bca8-a13977eec264 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:28.384927 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a70ad92c-49b5-4d0a-bca8-a13977eec264 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:28.385596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a70ad92c-49b5-4d0a-bca8-a13977eec264 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:28.386044 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a70ad92c-49b5-4d0a-bca8-a13977eec264 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:28.386461 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a70ad92c-49b5-4d0a-bca8-a13977eec264 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:28.479330 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dcd9027e-a962-4e58-8a17-2e9f49dc6ec2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:28.479939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dcd9027e-a962-4e58-8a17-2e9f49dc6ec2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:28.486204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dcd9027e-a962-4e58-8a17-2e9f49dc6ec2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:28.486992 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dcd9027e-a962-4e58-8a17-2e9f49dc6ec2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:28.487428 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dcd9027e-a962-4e58-8a17-2e9f49dc6ec2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:28.488119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dcd9027e-a962-4e58-8a17-2e9f49dc6ec2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:28.488571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dcd9027e-a962-4e58-8a17-2e9f49dc6ec2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:28.488995 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dcd9027e-a962-4e58-8a17-2e9f49dc6ec2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:28.516703 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a70ad92c-49b5-4d0a-bca8-a13977eec264 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:28.525372 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a70ad92c-49b5-4d0a-bca8-a13977eec264 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152077 Aug 24 12:54:28.525935 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1592/3185] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:28 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:28.550758 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-dcd9027e-a962-4e58-8a17-2e9f49dc6ec2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:28.558839 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dcd9027e-a962-4e58-8a17-2e9f49dc6ec2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083450 Aug 24 12:54:28.559382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1594/3186] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:28 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:28.666602 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-924c7477-e55c-4bb8-b8ef-c96c477ef8e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:28.667235 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-924c7477-e55c-4bb8-b8ef-c96c477ef8e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:28.673084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-924c7477-e55c-4bb8-b8ef-c96c477ef8e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:28.673589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-924c7477-e55c-4bb8-b8ef-c96c477ef8e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:28.674024 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-924c7477-e55c-4bb8-b8ef-c96c477ef8e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:28.674724 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-924c7477-e55c-4bb8-b8ef-c96c477ef8e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:28.675177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-924c7477-e55c-4bb8-b8ef-c96c477ef8e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:28.675597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-924c7477-e55c-4bb8-b8ef-c96c477ef8e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:28.801068 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-924c7477-e55c-4bb8-b8ef-c96c477ef8e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:28.809660 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-924c7477-e55c-4bb8-b8ef-c96c477ef8e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:28.811178 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-924c7477-e55c-4bb8-b8ef-c96c477ef8e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:28.812380 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-924c7477-e55c-4bb8-b8ef-c96c477ef8e4 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.149568 Aug 24 12:54:28.812928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1593/3187] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:28 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:29.176901 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e9a54bad-dc9c-4b31-9e21-576591bd822e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:29.177435 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e9a54bad-dc9c-4b31-9e21-576591bd822e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:29.183544 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9a54bad-dc9c-4b31-9e21-576591bd822e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:29.184031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9a54bad-dc9c-4b31-9e21-576591bd822e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:29.184468 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9a54bad-dc9c-4b31-9e21-576591bd822e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:29.185160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9a54bad-dc9c-4b31-9e21-576591bd822e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:29.185615 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9a54bad-dc9c-4b31-9e21-576591bd822e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:29.186045 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9a54bad-dc9c-4b31-9e21-576591bd822e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:29.315192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e9a54bad-dc9c-4b31-9e21-576591bd822e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:29.323891 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e9a54bad-dc9c-4b31-9e21-576591bd822e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151467 Aug 24 12:54:29.324454 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1595/3188] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:29 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:29.547003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-da7fde43-5f53-45c9-94f0-7cc96b6897bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:29.547604 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-da7fde43-5f53-45c9-94f0-7cc96b6897bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:29.554466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-da7fde43-5f53-45c9-94f0-7cc96b6897bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:29.554970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-da7fde43-5f53-45c9-94f0-7cc96b6897bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:29.555485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-da7fde43-5f53-45c9-94f0-7cc96b6897bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:29.556162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-da7fde43-5f53-45c9-94f0-7cc96b6897bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:29.556612 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-da7fde43-5f53-45c9-94f0-7cc96b6897bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:29.557044 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-da7fde43-5f53-45c9-94f0-7cc96b6897bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:29.578810 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ff3ca4b2-f524-4d70-bb73-427593dc3d68 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:29.579554 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ff3ca4b2-f524-4d70-bb73-427593dc3d68 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:29.585957 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ff3ca4b2-f524-4d70-bb73-427593dc3d68 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:29.586444 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ff3ca4b2-f524-4d70-bb73-427593dc3d68 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:29.586918 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ff3ca4b2-f524-4d70-bb73-427593dc3d68 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:29.587615 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ff3ca4b2-f524-4d70-bb73-427593dc3d68 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:29.588080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ff3ca4b2-f524-4d70-bb73-427593dc3d68 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:29.588511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ff3ca4b2-f524-4d70-bb73-427593dc3d68 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:29.650412 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ff3ca4b2-f524-4d70-bb73-427593dc3d68 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:29.658582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ff3ca4b2-f524-4d70-bb73-427593dc3d68 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083683 Aug 24 12:54:29.659252 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1596/3189] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:29 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:29.689615 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-da7fde43-5f53-45c9-94f0-7cc96b6897bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:29.697766 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-da7fde43-5f53-45c9-94f0-7cc96b6897bd tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.154802 Aug 24 12:54:29.698311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1594/3190] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:29 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:29.835707 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e2e5ff72-adc9-43c3-aac1-eb9f4ea3b019 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:29.836323 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e2e5ff72-adc9-43c3-aac1-eb9f4ea3b019 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:29.842184 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2e5ff72-adc9-43c3-aac1-eb9f4ea3b019 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:29.842684 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2e5ff72-adc9-43c3-aac1-eb9f4ea3b019 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:29.843130 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2e5ff72-adc9-43c3-aac1-eb9f4ea3b019 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:29.843811 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2e5ff72-adc9-43c3-aac1-eb9f4ea3b019 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:29.844268 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2e5ff72-adc9-43c3-aac1-eb9f4ea3b019 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:29.844696 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2e5ff72-adc9-43c3-aac1-eb9f4ea3b019 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:29.968920 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e2e5ff72-adc9-43c3-aac1-eb9f4ea3b019 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:29.977992 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e2e5ff72-adc9-43c3-aac1-eb9f4ea3b019 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:29.979530 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e2e5ff72-adc9-43c3-aac1-eb9f4ea3b019 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:29.983354 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e2e5ff72-adc9-43c3-aac1-eb9f4ea3b019 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.148986 Aug 24 12:54:29.983354 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1597/3191] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:29 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:30.344454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6e5959e0-c1da-42df-acfc-3e4f3acd897f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:30.345062 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6e5959e0-c1da-42df-acfc-3e4f3acd897f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:30.351184 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e5959e0-c1da-42df-acfc-3e4f3acd897f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:30.351659 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e5959e0-c1da-42df-acfc-3e4f3acd897f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:30.352090 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e5959e0-c1da-42df-acfc-3e4f3acd897f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:30.352763 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e5959e0-c1da-42df-acfc-3e4f3acd897f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:30.353207 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e5959e0-c1da-42df-acfc-3e4f3acd897f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:30.353625 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e5959e0-c1da-42df-acfc-3e4f3acd897f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:30.485340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6e5959e0-c1da-42df-acfc-3e4f3acd897f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:30.493712 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6e5959e0-c1da-42df-acfc-3e4f3acd897f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.153234 Aug 24 12:54:30.494265 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1595/3192] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:30 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:30.679895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8b9fbeb5-8ed4-4794-80f4-30f32e0a6849 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:30.680456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8b9fbeb5-8ed4-4794-80f4-30f32e0a6849 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:30.687024 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b9fbeb5-8ed4-4794-80f4-30f32e0a6849 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:30.687621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b9fbeb5-8ed4-4794-80f4-30f32e0a6849 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:30.688061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b9fbeb5-8ed4-4794-80f4-30f32e0a6849 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:30.688743 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b9fbeb5-8ed4-4794-80f4-30f32e0a6849 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:30.689195 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b9fbeb5-8ed4-4794-80f4-30f32e0a6849 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:30.689618 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8b9fbeb5-8ed4-4794-80f4-30f32e0a6849 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:30.717130 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b18aff8b-8992-4cf2-9d14-92c00b7d008e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:30.717735 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b18aff8b-8992-4cf2-9d14-92c00b7d008e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:30.724071 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b18aff8b-8992-4cf2-9d14-92c00b7d008e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:30.724548 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b18aff8b-8992-4cf2-9d14-92c00b7d008e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:30.724978 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b18aff8b-8992-4cf2-9d14-92c00b7d008e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:30.725657 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b18aff8b-8992-4cf2-9d14-92c00b7d008e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:30.726105 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b18aff8b-8992-4cf2-9d14-92c00b7d008e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:30.726525 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b18aff8b-8992-4cf2-9d14-92c00b7d008e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:30.753628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8b9fbeb5-8ed4-4794-80f4-30f32e0a6849 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:30.764410 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8b9fbeb5-8ed4-4794-80f4-30f32e0a6849 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.088843 Aug 24 12:54:30.764980 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1598/3193] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:30 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:30.853743 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b18aff8b-8992-4cf2-9d14-92c00b7d008e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:30.862146 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b18aff8b-8992-4cf2-9d14-92c00b7d008e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148570 Aug 24 12:54:30.862716 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1596/3194] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:30 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:31.003996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2f13dceb-51f1-46c2-b986-5e926fe6b29c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:31.004622 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2f13dceb-51f1-46c2-b986-5e926fe6b29c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:31.010489 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f13dceb-51f1-46c2-b986-5e926fe6b29c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:31.011006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f13dceb-51f1-46c2-b986-5e926fe6b29c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:31.011453 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f13dceb-51f1-46c2-b986-5e926fe6b29c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:31.012138 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f13dceb-51f1-46c2-b986-5e926fe6b29c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:31.012600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f13dceb-51f1-46c2-b986-5e926fe6b29c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:31.013033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2f13dceb-51f1-46c2-b986-5e926fe6b29c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:31.141702 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2f13dceb-51f1-46c2-b986-5e926fe6b29c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:31.150292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2f13dceb-51f1-46c2-b986-5e926fe6b29c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:31.151854 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2f13dceb-51f1-46c2-b986-5e926fe6b29c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:31.153033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2f13dceb-51f1-46c2-b986-5e926fe6b29c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.152920 Aug 24 12:54:31.153578 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1599/3195] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:30 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:31.518530 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d2b95cc1-051e-44ef-9092-227cd3b098e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:31.519268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d2b95cc1-051e-44ef-9092-227cd3b098e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:31.525742 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d2b95cc1-051e-44ef-9092-227cd3b098e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:31.526225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d2b95cc1-051e-44ef-9092-227cd3b098e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:31.526685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d2b95cc1-051e-44ef-9092-227cd3b098e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:31.527380 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d2b95cc1-051e-44ef-9092-227cd3b098e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:31.528124 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d2b95cc1-051e-44ef-9092-227cd3b098e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:31.528552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d2b95cc1-051e-44ef-9092-227cd3b098e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:31.657952 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d2b95cc1-051e-44ef-9092-227cd3b098e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:31.666545 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d2b95cc1-051e-44ef-9092-227cd3b098e1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151879 Aug 24 12:54:31.667122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1597/3196] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:31 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:31.785270 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-18928013-ea85-4362-a262-620d38abcb22 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:31.785932 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-18928013-ea85-4362-a262-620d38abcb22 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:31.792257 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-18928013-ea85-4362-a262-620d38abcb22 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:31.792879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-18928013-ea85-4362-a262-620d38abcb22 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:31.793324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-18928013-ea85-4362-a262-620d38abcb22 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:31.794010 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-18928013-ea85-4362-a262-620d38abcb22 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:31.794499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-18928013-ea85-4362-a262-620d38abcb22 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:31.794950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-18928013-ea85-4362-a262-620d38abcb22 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:31.855660 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-18928013-ea85-4362-a262-620d38abcb22 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:31.863983 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-18928013-ea85-4362-a262-620d38abcb22 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082610 Aug 24 12:54:31.864542 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1600/3197] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:31 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:31.882729 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1a443971-b943-4c67-8d80-b4fa76264f6f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:31.883342 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1a443971-b943-4c67-8d80-b4fa76264f6f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:31.889652 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1a443971-b943-4c67-8d80-b4fa76264f6f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:31.890132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1a443971-b943-4c67-8d80-b4fa76264f6f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:31.890565 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1a443971-b943-4c67-8d80-b4fa76264f6f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:31.891270 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1a443971-b943-4c67-8d80-b4fa76264f6f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:31.891717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1a443971-b943-4c67-8d80-b4fa76264f6f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:31.892137 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1a443971-b943-4c67-8d80-b4fa76264f6f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:32.017184 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1a443971-b943-4c67-8d80-b4fa76264f6f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:32.025966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1a443971-b943-4c67-8d80-b4fa76264f6f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.147592 Aug 24 12:54:32.026527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1598/3198] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:31 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:32.176616 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1a396c4a-6448-4fd1-9fc6-3847a0c8599c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:32.177250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1a396c4a-6448-4fd1-9fc6-3847a0c8599c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:32.183099 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1a396c4a-6448-4fd1-9fc6-3847a0c8599c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:32.183581 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1a396c4a-6448-4fd1-9fc6-3847a0c8599c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:32.184017 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1a396c4a-6448-4fd1-9fc6-3847a0c8599c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:32.184698 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1a396c4a-6448-4fd1-9fc6-3847a0c8599c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:32.185157 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1a396c4a-6448-4fd1-9fc6-3847a0c8599c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:32.185579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1a396c4a-6448-4fd1-9fc6-3847a0c8599c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:32.313860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1a396c4a-6448-4fd1-9fc6-3847a0c8599c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:32.323315 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1a396c4a-6448-4fd1-9fc6-3847a0c8599c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:32.324805 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1a396c4a-6448-4fd1-9fc6-3847a0c8599c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:32.325967 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1a396c4a-6448-4fd1-9fc6-3847a0c8599c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.153725 Aug 24 12:54:32.326514 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1601/3199] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:32 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:32.687323 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d8bb71ad-2198-4f69-88d2-674596f14e4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:32.687847 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d8bb71ad-2198-4f69-88d2-674596f14e4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:32.693611 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8bb71ad-2198-4f69-88d2-674596f14e4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:32.694078 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8bb71ad-2198-4f69-88d2-674596f14e4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:32.694506 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8bb71ad-2198-4f69-88d2-674596f14e4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:32.695197 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8bb71ad-2198-4f69-88d2-674596f14e4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:32.695645 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8bb71ad-2198-4f69-88d2-674596f14e4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:32.696064 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8bb71ad-2198-4f69-88d2-674596f14e4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:32.823942 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d8bb71ad-2198-4f69-88d2-674596f14e4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:32.832146 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d8bb71ad-2198-4f69-88d2-674596f14e4e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.148738 Aug 24 12:54:32.832708 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1599/3200] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:32 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:32.884753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-76ae439c-795c-43cd-98d2-1ed71125e214 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:32.885365 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-76ae439c-795c-43cd-98d2-1ed71125e214 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:32.891676 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-76ae439c-795c-43cd-98d2-1ed71125e214 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:32.892154 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-76ae439c-795c-43cd-98d2-1ed71125e214 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:32.892590 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-76ae439c-795c-43cd-98d2-1ed71125e214 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:32.893315 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-76ae439c-795c-43cd-98d2-1ed71125e214 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:32.893771 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-76ae439c-795c-43cd-98d2-1ed71125e214 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:32.894202 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-76ae439c-795c-43cd-98d2-1ed71125e214 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:32.956614 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-76ae439c-795c-43cd-98d2-1ed71125e214 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:32.965312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-76ae439c-795c-43cd-98d2-1ed71125e214 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084436 Aug 24 12:54:32.965865 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1602/3201] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:32 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:33.046337 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a38f4edc-e932-410f-836f-d0bb2f1eefed tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:33.046984 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a38f4edc-e932-410f-836f-d0bb2f1eefed tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:33.053340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a38f4edc-e932-410f-836f-d0bb2f1eefed tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:33.053812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a38f4edc-e932-410f-836f-d0bb2f1eefed tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:33.054241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a38f4edc-e932-410f-836f-d0bb2f1eefed tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:33.054947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a38f4edc-e932-410f-836f-d0bb2f1eefed tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:33.055397 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a38f4edc-e932-410f-836f-d0bb2f1eefed tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:33.055816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a38f4edc-e932-410f-836f-d0bb2f1eefed tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:33.183372 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a38f4edc-e932-410f-836f-d0bb2f1eefed tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:33.191368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a38f4edc-e932-410f-836f-d0bb2f1eefed tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148867 Aug 24 12:54:33.191916 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1600/3202] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:33 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:33.348611 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ebbf4147-53d5-4239-ac0a-c455bd602f36 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:33.349216 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ebbf4147-53d5-4239-ac0a-c455bd602f36 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:33.355079 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ebbf4147-53d5-4239-ac0a-c455bd602f36 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:33.355561 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ebbf4147-53d5-4239-ac0a-c455bd602f36 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:33.355997 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ebbf4147-53d5-4239-ac0a-c455bd602f36 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:33.356677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ebbf4147-53d5-4239-ac0a-c455bd602f36 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:33.357131 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ebbf4147-53d5-4239-ac0a-c455bd602f36 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:33.357553 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ebbf4147-53d5-4239-ac0a-c455bd602f36 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:33.482400 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ebbf4147-53d5-4239-ac0a-c455bd602f36 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:33.491254 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ebbf4147-53d5-4239-ac0a-c455bd602f36 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:33.492729 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ebbf4147-53d5-4239-ac0a-c455bd602f36 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:33.493887 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ebbf4147-53d5-4239-ac0a-c455bd602f36 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.149179 Aug 24 12:54:33.494443 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1603/3203] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:33 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:33.853142 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cec4c79c-912d-4315-8fb6-312b92ab176b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:33.853773 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cec4c79c-912d-4315-8fb6-312b92ab176b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:33.859687 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cec4c79c-912d-4315-8fb6-312b92ab176b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:33.860161 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cec4c79c-912d-4315-8fb6-312b92ab176b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:33.860591 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cec4c79c-912d-4315-8fb6-312b92ab176b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:33.861269 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cec4c79c-912d-4315-8fb6-312b92ab176b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:33.861970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cec4c79c-912d-4315-8fb6-312b92ab176b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:33.862388 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cec4c79c-912d-4315-8fb6-312b92ab176b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:33.986266 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ab1f7da1-7314-4d45-8748-9318e061a6ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:33.987080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ab1f7da1-7314-4d45-8748-9318e061a6ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:33.988864 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cec4c79c-912d-4315-8fb6-312b92ab176b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:33.994117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab1f7da1-7314-4d45-8748-9318e061a6ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:33.994605 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab1f7da1-7314-4d45-8748-9318e061a6ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:33.995061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab1f7da1-7314-4d45-8748-9318e061a6ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:33.995755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab1f7da1-7314-4d45-8748-9318e061a6ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:33.996205 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab1f7da1-7314-4d45-8748-9318e061a6ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:33.996629 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab1f7da1-7314-4d45-8748-9318e061a6ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:33.997699 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cec4c79c-912d-4315-8fb6-312b92ab176b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.148479 Aug 24 12:54:33.998363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1601/3204] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:33 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:34.063935 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ab1f7da1-7314-4d45-8748-9318e061a6ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:34.072053 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ab1f7da1-7314-4d45-8748-9318e061a6ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.090111 Aug 24 12:54:34.072601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1604/3205] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:33 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:34.212102 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e8fba438-a01b-408e-8a3f-1dde47e3a728 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:34.212685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e8fba438-a01b-408e-8a3f-1dde47e3a728 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:34.219269 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e8fba438-a01b-408e-8a3f-1dde47e3a728 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:34.219756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e8fba438-a01b-408e-8a3f-1dde47e3a728 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:34.220202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e8fba438-a01b-408e-8a3f-1dde47e3a728 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:34.220890 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e8fba438-a01b-408e-8a3f-1dde47e3a728 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:34.221346 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e8fba438-a01b-408e-8a3f-1dde47e3a728 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:34.221780 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e8fba438-a01b-408e-8a3f-1dde47e3a728 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:34.367117 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e8fba438-a01b-408e-8a3f-1dde47e3a728 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:34.375272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e8fba438-a01b-408e-8a3f-1dde47e3a728 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.167250 Aug 24 12:54:34.375836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1602/3206] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:34 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:34.517521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c8db38da-1d45-4000-9d20-e038c7b11a6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:34.518130 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c8db38da-1d45-4000-9d20-e038c7b11a6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:34.524642 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c8db38da-1d45-4000-9d20-e038c7b11a6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:34.525121 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c8db38da-1d45-4000-9d20-e038c7b11a6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:34.525556 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c8db38da-1d45-4000-9d20-e038c7b11a6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:34.526234 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c8db38da-1d45-4000-9d20-e038c7b11a6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:34.526706 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c8db38da-1d45-4000-9d20-e038c7b11a6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:34.527131 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c8db38da-1d45-4000-9d20-e038c7b11a6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:34.654120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c8db38da-1d45-4000-9d20-e038c7b11a6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:34.656337 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:54:34.663841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c8db38da-1d45-4000-9d20-e038c7b11a6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:34.665377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c8db38da-1d45-4000-9d20-e038c7b11a6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:34.666528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c8db38da-1d45-4000-9d20-e038c7b11a6a tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.152932 Aug 24 12:54:34.667100 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1605/3207] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:34 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:35.018913 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-00ecfc25-0604-4900-8c30-483af79c0359 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:35.019604 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-00ecfc25-0604-4900-8c30-483af79c0359 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:35.026053 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00ecfc25-0604-4900-8c30-483af79c0359 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:35.026577 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00ecfc25-0604-4900-8c30-483af79c0359 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:35.027087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00ecfc25-0604-4900-8c30-483af79c0359 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:35.027780 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00ecfc25-0604-4900-8c30-483af79c0359 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:35.028234 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00ecfc25-0604-4900-8c30-483af79c0359 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:35.028662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00ecfc25-0604-4900-8c30-483af79c0359 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:35.092676 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4c97adb1-fcff-493a-8374-adb6d2e4797d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:35.093296 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4c97adb1-fcff-493a-8374-adb6d2e4797d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:35.100204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4c97adb1-fcff-493a-8374-adb6d2e4797d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:35.100697 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4c97adb1-fcff-493a-8374-adb6d2e4797d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:35.101143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4c97adb1-fcff-493a-8374-adb6d2e4797d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:35.101833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4c97adb1-fcff-493a-8374-adb6d2e4797d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:35.102295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4c97adb1-fcff-493a-8374-adb6d2e4797d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:35.102749 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4c97adb1-fcff-493a-8374-adb6d2e4797d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:35.157033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-00ecfc25-0604-4900-8c30-483af79c0359 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:35.164608 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4c97adb1-fcff-493a-8374-adb6d2e4797d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:35.165341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-00ecfc25-0604-4900-8c30-483af79c0359 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150323 Aug 24 12:54:35.165913 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1603/3208] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:35 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:35.172720 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4c97adb1-fcff-493a-8374-adb6d2e4797d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083964 Aug 24 12:54:35.173267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1606/3209] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:35 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:35.396182 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7c9348ec-ed2b-4fff-bf59-3ce363f68d75 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:35.396738 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7c9348ec-ed2b-4fff-bf59-3ce363f68d75 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:35.402959 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7c9348ec-ed2b-4fff-bf59-3ce363f68d75 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:35.403439 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7c9348ec-ed2b-4fff-bf59-3ce363f68d75 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:35.403872 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7c9348ec-ed2b-4fff-bf59-3ce363f68d75 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:35.404544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7c9348ec-ed2b-4fff-bf59-3ce363f68d75 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:35.404989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7c9348ec-ed2b-4fff-bf59-3ce363f68d75 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:35.405411 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7c9348ec-ed2b-4fff-bf59-3ce363f68d75 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:35.409185 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:54:35.533647 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7c9348ec-ed2b-4fff-bf59-3ce363f68d75 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:35.542349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7c9348ec-ed2b-4fff-bf59-3ce363f68d75 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149900 Aug 24 12:54:35.542926 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1604/3210] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:35 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:35.689466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bf84a3d3-50f8-45ea-8250-ff91b7435a30 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:35.689994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bf84a3d3-50f8-45ea-8250-ff91b7435a30 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:35.696112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf84a3d3-50f8-45ea-8250-ff91b7435a30 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:35.696597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf84a3d3-50f8-45ea-8250-ff91b7435a30 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:35.697038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf84a3d3-50f8-45ea-8250-ff91b7435a30 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:35.697721 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf84a3d3-50f8-45ea-8250-ff91b7435a30 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:35.698179 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf84a3d3-50f8-45ea-8250-ff91b7435a30 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:35.698603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf84a3d3-50f8-45ea-8250-ff91b7435a30 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:35.826164 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bf84a3d3-50f8-45ea-8250-ff91b7435a30 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:35.834700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bf84a3d3-50f8-45ea-8250-ff91b7435a30 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:35.836186 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bf84a3d3-50f8-45ea-8250-ff91b7435a30 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:35.837340 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bf84a3d3-50f8-45ea-8250-ff91b7435a30 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.151895 Aug 24 12:54:35.837896 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1607/3211] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:35 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:36.187081 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-473933fc-93ba-49f9-8123-2f982631aded tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:36.187732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-473933fc-93ba-49f9-8123-2f982631aded tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:36.193686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e22e6e04-f0ca-43a4-81e5-db7637c38925 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:36.194202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-473933fc-93ba-49f9-8123-2f982631aded tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:36.194202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-473933fc-93ba-49f9-8123-2f982631aded tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:36.194423 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e22e6e04-f0ca-43a4-81e5-db7637c38925 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:36.194734 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-473933fc-93ba-49f9-8123-2f982631aded tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:36.195297 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-473933fc-93ba-49f9-8123-2f982631aded tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:36.195751 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-473933fc-93ba-49f9-8123-2f982631aded tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:36.196177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-473933fc-93ba-49f9-8123-2f982631aded tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:36.200540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e22e6e04-f0ca-43a4-81e5-db7637c38925 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:36.201028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e22e6e04-f0ca-43a4-81e5-db7637c38925 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:36.201471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e22e6e04-f0ca-43a4-81e5-db7637c38925 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:36.202194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e22e6e04-f0ca-43a4-81e5-db7637c38925 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:36.202665 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e22e6e04-f0ca-43a4-81e5-db7637c38925 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:36.203101 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e22e6e04-f0ca-43a4-81e5-db7637c38925 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:36.265475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e22e6e04-f0ca-43a4-81e5-db7637c38925 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:36.274447 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e22e6e04-f0ca-43a4-81e5-db7637c38925 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084829 Aug 24 12:54:36.275035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1608/3212] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:36 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:36.323849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-473933fc-93ba-49f9-8123-2f982631aded tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:36.332931 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-473933fc-93ba-49f9-8123-2f982631aded tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149172 Aug 24 12:54:36.333491 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1605/3213] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:36 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:36.563006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-98149969-ba69-458f-946c-7a0e51179a4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:36.563613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-98149969-ba69-458f-946c-7a0e51179a4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:36.570167 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-98149969-ba69-458f-946c-7a0e51179a4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:36.570656 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-98149969-ba69-458f-946c-7a0e51179a4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:36.571114 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-98149969-ba69-458f-946c-7a0e51179a4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:36.571791 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-98149969-ba69-458f-946c-7a0e51179a4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:36.572247 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-98149969-ba69-458f-946c-7a0e51179a4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:36.572670 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-98149969-ba69-458f-946c-7a0e51179a4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:36.699281 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-98149969-ba69-458f-946c-7a0e51179a4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:36.707344 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-98149969-ba69-458f-946c-7a0e51179a4f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148252 Aug 24 12:54:36.707910 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1609/3214] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:36 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:36.860607 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f70ce8f6-ac37-4292-b0a1-9f755c1cdf21 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:36.861127 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f70ce8f6-ac37-4292-b0a1-9f755c1cdf21 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:36.868257 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f70ce8f6-ac37-4292-b0a1-9f755c1cdf21 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:36.868738 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f70ce8f6-ac37-4292-b0a1-9f755c1cdf21 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:36.869175 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f70ce8f6-ac37-4292-b0a1-9f755c1cdf21 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:36.869854 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f70ce8f6-ac37-4292-b0a1-9f755c1cdf21 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:36.870307 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f70ce8f6-ac37-4292-b0a1-9f755c1cdf21 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:36.870756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f70ce8f6-ac37-4292-b0a1-9f755c1cdf21 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:37.001052 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f70ce8f6-ac37-4292-b0a1-9f755c1cdf21 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:37.009617 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f70ce8f6-ac37-4292-b0a1-9f755c1cdf21 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:37.011135 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f70ce8f6-ac37-4292-b0a1-9f755c1cdf21 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:37.012281 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f70ce8f6-ac37-4292-b0a1-9f755c1cdf21 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.155743 Aug 24 12:54:37.012827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1606/3215] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:36 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:37.295102 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a02c11b8-2c33-43f5-a17b-0eaf112ced0b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:37.295764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a02c11b8-2c33-43f5-a17b-0eaf112ced0b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:37.302316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a02c11b8-2c33-43f5-a17b-0eaf112ced0b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:37.302902 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a02c11b8-2c33-43f5-a17b-0eaf112ced0b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:37.303338 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a02c11b8-2c33-43f5-a17b-0eaf112ced0b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:37.304012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a02c11b8-2c33-43f5-a17b-0eaf112ced0b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:37.304463 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a02c11b8-2c33-43f5-a17b-0eaf112ced0b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:37.304886 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a02c11b8-2c33-43f5-a17b-0eaf112ced0b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:37.353847 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-69c6aab5-eff8-4a54-b743-0bfc0fec9d7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:37.354467 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-69c6aab5-eff8-4a54-b743-0bfc0fec9d7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:37.360384 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69c6aab5-eff8-4a54-b743-0bfc0fec9d7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:37.360865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69c6aab5-eff8-4a54-b743-0bfc0fec9d7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:37.361301 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69c6aab5-eff8-4a54-b743-0bfc0fec9d7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:37.362233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69c6aab5-eff8-4a54-b743-0bfc0fec9d7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:37.362703 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69c6aab5-eff8-4a54-b743-0bfc0fec9d7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:37.363129 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69c6aab5-eff8-4a54-b743-0bfc0fec9d7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:37.369638 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a02c11b8-2c33-43f5-a17b-0eaf112ced0b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:37.377741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a02c11b8-2c33-43f5-a17b-0eaf112ced0b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.086467 Aug 24 12:54:37.378300 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1610/3216] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:37 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:37.489391 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-69c6aab5-eff8-4a54-b743-0bfc0fec9d7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:37.497621 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-69c6aab5-eff8-4a54-b743-0bfc0fec9d7b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.147579 Aug 24 12:54:37.498171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1607/3217] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:37 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:37.728130 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5b0c7d05-35b2-4e39-8ba1-05a88913c450 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:37.728712 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5b0c7d05-35b2-4e39-8ba1-05a88913c450 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:37.735138 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b0c7d05-35b2-4e39-8ba1-05a88913c450 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:37.735632 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b0c7d05-35b2-4e39-8ba1-05a88913c450 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:37.736077 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b0c7d05-35b2-4e39-8ba1-05a88913c450 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:37.737027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b0c7d05-35b2-4e39-8ba1-05a88913c450 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:37.737486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b0c7d05-35b2-4e39-8ba1-05a88913c450 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:37.737919 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b0c7d05-35b2-4e39-8ba1-05a88913c450 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:37.865625 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5b0c7d05-35b2-4e39-8ba1-05a88913c450 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:37.873663 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5b0c7d05-35b2-4e39-8ba1-05a88913c450 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150078 Aug 24 12:54:37.874228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1611/3218] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:37 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:38.035054 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cc003c4e-8ab6-4f32-9f23-e2ec689655e7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:38.035655 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cc003c4e-8ab6-4f32-9f23-e2ec689655e7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:38.042088 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc003c4e-8ab6-4f32-9f23-e2ec689655e7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:38.042566 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc003c4e-8ab6-4f32-9f23-e2ec689655e7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:38.043026 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc003c4e-8ab6-4f32-9f23-e2ec689655e7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:38.043714 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc003c4e-8ab6-4f32-9f23-e2ec689655e7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:38.044161 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc003c4e-8ab6-4f32-9f23-e2ec689655e7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:38.044585 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc003c4e-8ab6-4f32-9f23-e2ec689655e7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:38.172409 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cc003c4e-8ab6-4f32-9f23-e2ec689655e7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:38.181302 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cc003c4e-8ab6-4f32-9f23-e2ec689655e7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:38.182813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cc003c4e-8ab6-4f32-9f23-e2ec689655e7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:38.183968 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cc003c4e-8ab6-4f32-9f23-e2ec689655e7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.152718 Aug 24 12:54:38.184510 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1608/3219] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:38 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:38.397369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-43b7ebfd-0287-473c-a343-23512a508bd5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:38.397984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-43b7ebfd-0287-473c-a343-23512a508bd5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:38.403984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-43b7ebfd-0287-473c-a343-23512a508bd5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:38.404465 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-43b7ebfd-0287-473c-a343-23512a508bd5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:38.404902 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-43b7ebfd-0287-473c-a343-23512a508bd5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:38.405583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-43b7ebfd-0287-473c-a343-23512a508bd5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:38.406041 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-43b7ebfd-0287-473c-a343-23512a508bd5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:38.406465 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-43b7ebfd-0287-473c-a343-23512a508bd5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:38.466476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-43b7ebfd-0287-473c-a343-23512a508bd5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:38.475163 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-43b7ebfd-0287-473c-a343-23512a508bd5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081266 Aug 24 12:54:38.475720 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1612/3220] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:38 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:38.518126 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-70bae95e-9301-4175-bcd3-207ac7953ca0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:38.518763 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-70bae95e-9301-4175-bcd3-207ac7953ca0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:38.524713 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70bae95e-9301-4175-bcd3-207ac7953ca0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:38.525194 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70bae95e-9301-4175-bcd3-207ac7953ca0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:38.525633 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70bae95e-9301-4175-bcd3-207ac7953ca0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:38.526315 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70bae95e-9301-4175-bcd3-207ac7953ca0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:38.526802 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70bae95e-9301-4175-bcd3-207ac7953ca0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:38.527232 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70bae95e-9301-4175-bcd3-207ac7953ca0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:38.655139 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-70bae95e-9301-4175-bcd3-207ac7953ca0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:38.663732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-70bae95e-9301-4175-bcd3-207ac7953ca0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149457 Aug 24 12:54:38.664298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1609/3221] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:38 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:38.894686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8fbf52c5-a411-4c67-9359-21aaab9ef6a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:38.895238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8fbf52c5-a411-4c67-9359-21aaab9ef6a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:38.902052 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8fbf52c5-a411-4c67-9359-21aaab9ef6a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:38.902537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8fbf52c5-a411-4c67-9359-21aaab9ef6a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:38.903002 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8fbf52c5-a411-4c67-9359-21aaab9ef6a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:38.903687 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8fbf52c5-a411-4c67-9359-21aaab9ef6a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:38.904172 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8fbf52c5-a411-4c67-9359-21aaab9ef6a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:38.904598 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8fbf52c5-a411-4c67-9359-21aaab9ef6a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:39.034000 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8fbf52c5-a411-4c67-9359-21aaab9ef6a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:39.042775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8fbf52c5-a411-4c67-9359-21aaab9ef6a0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151992 Aug 24 12:54:39.043340 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1613/3222] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:38 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:39.207606 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-832ad19f-2085-4f9c-b8e5-8f8a578144dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:39.208139 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-832ad19f-2085-4f9c-b8e5-8f8a578144dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:39.215090 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-832ad19f-2085-4f9c-b8e5-8f8a578144dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:39.215565 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-832ad19f-2085-4f9c-b8e5-8f8a578144dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:39.216000 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-832ad19f-2085-4f9c-b8e5-8f8a578144dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:39.216669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-832ad19f-2085-4f9c-b8e5-8f8a578144dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:39.217115 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-832ad19f-2085-4f9c-b8e5-8f8a578144dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:39.217535 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-832ad19f-2085-4f9c-b8e5-8f8a578144dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:39.345751 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-832ad19f-2085-4f9c-b8e5-8f8a578144dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:39.354228 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-832ad19f-2085-4f9c-b8e5-8f8a578144dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:39.355743 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-832ad19f-2085-4f9c-b8e5-8f8a578144dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:39.356932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-832ad19f-2085-4f9c-b8e5-8f8a578144dd tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.153328 Aug 24 12:54:39.357492 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1610/3223] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:39 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:39.496035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-439da798-0648-4c37-bfe5-d87f6eda320f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:39.496651 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-439da798-0648-4c37-bfe5-d87f6eda320f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:39.502638 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-439da798-0648-4c37-bfe5-d87f6eda320f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:39.506735 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-439da798-0648-4c37-bfe5-d87f6eda320f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:39.506735 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-439da798-0648-4c37-bfe5-d87f6eda320f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:39.506735 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-439da798-0648-4c37-bfe5-d87f6eda320f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:39.506735 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-439da798-0648-4c37-bfe5-d87f6eda320f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:39.507242 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-439da798-0648-4c37-bfe5-d87f6eda320f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:39.566064 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-439da798-0648-4c37-bfe5-d87f6eda320f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:39.574793 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-439da798-0648-4c37-bfe5-d87f6eda320f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082693 Aug 24 12:54:39.575428 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1614/3224] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:39 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:39.684511 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0f09ff98-9a76-4d18-9828-ca653523dc9c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:39.685114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0f09ff98-9a76-4d18-9828-ca653523dc9c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:39.690931 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f09ff98-9a76-4d18-9828-ca653523dc9c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:39.691401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f09ff98-9a76-4d18-9828-ca653523dc9c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:39.691828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f09ff98-9a76-4d18-9828-ca653523dc9c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:39.692495 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f09ff98-9a76-4d18-9828-ca653523dc9c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:39.692939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f09ff98-9a76-4d18-9828-ca653523dc9c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:39.694027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0f09ff98-9a76-4d18-9828-ca653523dc9c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:39.822082 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0f09ff98-9a76-4d18-9828-ca653523dc9c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:39.830320 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0f09ff98-9a76-4d18-9828-ca653523dc9c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149553 Aug 24 12:54:39.830917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1611/3225] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:39 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:40.063453 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8f6fb86a-79a1-4194-83a6-36f7230e589f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:40.064000 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8f6fb86a-79a1-4194-83a6-36f7230e589f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:40.070972 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f6fb86a-79a1-4194-83a6-36f7230e589f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:40.071462 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f6fb86a-79a1-4194-83a6-36f7230e589f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:40.071907 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f6fb86a-79a1-4194-83a6-36f7230e589f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:40.072594 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f6fb86a-79a1-4194-83a6-36f7230e589f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:40.073055 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f6fb86a-79a1-4194-83a6-36f7230e589f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:40.073486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8f6fb86a-79a1-4194-83a6-36f7230e589f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:40.198442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8f6fb86a-79a1-4194-83a6-36f7230e589f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:40.206622 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8f6fb86a-79a1-4194-83a6-36f7230e589f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.147144 Aug 24 12:54:40.207201 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1615/3226] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:40 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:40.380186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-52e95a24-a3e2-4e43-87e8-c2d2c2872e9f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:40.381383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-52e95a24-a3e2-4e43-87e8-c2d2c2872e9f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:40.387723 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-52e95a24-a3e2-4e43-87e8-c2d2c2872e9f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:40.388200 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-52e95a24-a3e2-4e43-87e8-c2d2c2872e9f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:40.388633 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-52e95a24-a3e2-4e43-87e8-c2d2c2872e9f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:40.389306 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-52e95a24-a3e2-4e43-87e8-c2d2c2872e9f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:40.389765 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-52e95a24-a3e2-4e43-87e8-c2d2c2872e9f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:40.390184 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-52e95a24-a3e2-4e43-87e8-c2d2c2872e9f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:40.517354 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-52e95a24-a3e2-4e43-87e8-c2d2c2872e9f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:40.525801 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-52e95a24-a3e2-4e43-87e8-c2d2c2872e9f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:40.527305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-52e95a24-a3e2-4e43-87e8-c2d2c2872e9f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:40.528439 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-52e95a24-a3e2-4e43-87e8-c2d2c2872e9f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.152140 Aug 24 12:54:40.528985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1612/3227] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:40 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:40.601821 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-befad669-c4dc-4b1a-9f02-18fb6466c56b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:40.602372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-befad669-c4dc-4b1a-9f02-18fb6466c56b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:40.604193 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:54:40.608786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-befad669-c4dc-4b1a-9f02-18fb6466c56b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:40.609269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-befad669-c4dc-4b1a-9f02-18fb6466c56b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:40.609708 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-befad669-c4dc-4b1a-9f02-18fb6466c56b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:40.610392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-befad669-c4dc-4b1a-9f02-18fb6466c56b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:40.610954 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-befad669-c4dc-4b1a-9f02-18fb6466c56b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:40.611391 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-befad669-c4dc-4b1a-9f02-18fb6466c56b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:40.676088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-befad669-c4dc-4b1a-9f02-18fb6466c56b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:40.684776 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-befad669-c4dc-4b1a-9f02-18fb6466c56b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.086798 Aug 24 12:54:40.685330 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1616/3228] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:40 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:40.852170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bd7d1d54-0c58-4727-991e-ab75b7f41519 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:40.852696 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-bd7d1d54-0c58-4727-991e-ab75b7f41519 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:40.858708 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd7d1d54-0c58-4727-991e-ab75b7f41519 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:40.859186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd7d1d54-0c58-4727-991e-ab75b7f41519 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:40.859708 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd7d1d54-0c58-4727-991e-ab75b7f41519 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:40.860385 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd7d1d54-0c58-4727-991e-ab75b7f41519 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:40.860836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd7d1d54-0c58-4727-991e-ab75b7f41519 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:40.861247 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd7d1d54-0c58-4727-991e-ab75b7f41519 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:40.984446 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-bd7d1d54-0c58-4727-991e-ab75b7f41519 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:40.993309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bd7d1d54-0c58-4727-991e-ab75b7f41519 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.145571 Aug 24 12:54:40.993858 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1613/3229] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:40 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:41.228561 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-41be9574-d9db-4af6-9f12-acd380234cde tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:41.229090 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-41be9574-d9db-4af6-9f12-acd380234cde tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:41.235391 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-41be9574-d9db-4af6-9f12-acd380234cde tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:41.235866 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-41be9574-d9db-4af6-9f12-acd380234cde tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:41.236301 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-41be9574-d9db-4af6-9f12-acd380234cde tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:41.237230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-41be9574-d9db-4af6-9f12-acd380234cde tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:41.237680 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-41be9574-d9db-4af6-9f12-acd380234cde tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:41.238099 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-41be9574-d9db-4af6-9f12-acd380234cde tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:41.363386 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-41be9574-d9db-4af6-9f12-acd380234cde tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:41.371417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-41be9574-d9db-4af6-9f12-acd380234cde tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.147395 Aug 24 12:54:41.371967 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1617/3230] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:41 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:41.551160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cd964169-1538-411b-8902-3ef246c9fee2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:41.551923 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cd964169-1538-411b-8902-3ef246c9fee2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:41.558254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd964169-1538-411b-8902-3ef246c9fee2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:41.558764 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd964169-1538-411b-8902-3ef246c9fee2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:41.559195 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd964169-1538-411b-8902-3ef246c9fee2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:41.559865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd964169-1538-411b-8902-3ef246c9fee2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:41.560312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd964169-1538-411b-8902-3ef246c9fee2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:41.560729 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cd964169-1538-411b-8902-3ef246c9fee2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:41.697970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cd964169-1538-411b-8902-3ef246c9fee2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:41.704281 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-73f38d60-5a5b-450d-a132-c2f2eca62712 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:41.704903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-73f38d60-5a5b-450d-a132-c2f2eca62712 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:41.706590 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cd964169-1538-411b-8902-3ef246c9fee2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:41.708099 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cd964169-1538-411b-8902-3ef246c9fee2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:41.709249 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cd964169-1538-411b-8902-3ef246c9fee2 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.162082 Aug 24 12:54:41.710368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1614/3231] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:41 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:41.711421 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-73f38d60-5a5b-450d-a132-c2f2eca62712 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:41.711915 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-73f38d60-5a5b-450d-a132-c2f2eca62712 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:41.712364 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-73f38d60-5a5b-450d-a132-c2f2eca62712 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:41.713056 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-73f38d60-5a5b-450d-a132-c2f2eca62712 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:41.713517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-73f38d60-5a5b-450d-a132-c2f2eca62712 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:41.713947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-73f38d60-5a5b-450d-a132-c2f2eca62712 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:41.777383 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-73f38d60-5a5b-450d-a132-c2f2eca62712 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:41.785540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-73f38d60-5a5b-450d-a132-c2f2eca62712 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085111 Aug 24 12:54:41.786100 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1618/3232] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:41 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:42.014472 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-73074e11-1f1f-477b-afd5-6909e4332d4d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:42.015114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-73074e11-1f1f-477b-afd5-6909e4332d4d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:42.021070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-73074e11-1f1f-477b-afd5-6909e4332d4d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:42.021553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-73074e11-1f1f-477b-afd5-6909e4332d4d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:42.021990 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-73074e11-1f1f-477b-afd5-6909e4332d4d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:42.022697 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-73074e11-1f1f-477b-afd5-6909e4332d4d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:42.023152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-73074e11-1f1f-477b-afd5-6909e4332d4d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:42.023577 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-73074e11-1f1f-477b-afd5-6909e4332d4d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:42.148255 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-73074e11-1f1f-477b-afd5-6909e4332d4d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:42.156341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-73074e11-1f1f-477b-afd5-6909e4332d4d tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.145748 Aug 24 12:54:42.156922 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1615/3233] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:42 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:42.391919 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-97ff4b15-bed8-48dc-98f2-6f5d0373ffee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:42.392538 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-97ff4b15-bed8-48dc-98f2-6f5d0373ffee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:42.399473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97ff4b15-bed8-48dc-98f2-6f5d0373ffee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:42.399956 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97ff4b15-bed8-48dc-98f2-6f5d0373ffee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:42.400389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97ff4b15-bed8-48dc-98f2-6f5d0373ffee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:42.401070 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97ff4b15-bed8-48dc-98f2-6f5d0373ffee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:42.401526 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97ff4b15-bed8-48dc-98f2-6f5d0373ffee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:42.401952 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97ff4b15-bed8-48dc-98f2-6f5d0373ffee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:42.529984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-97ff4b15-bed8-48dc-98f2-6f5d0373ffee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:42.538321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-97ff4b15-bed8-48dc-98f2-6f5d0373ffee tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150316 Aug 24 12:54:42.538907 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1619/3234] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:42 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:42.732781 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2e630d6d-40e5-487b-ac04-8c7a1b6084a7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:42.733387 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2e630d6d-40e5-487b-ac04-8c7a1b6084a7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:42.740043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2e630d6d-40e5-487b-ac04-8c7a1b6084a7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:42.740511 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2e630d6d-40e5-487b-ac04-8c7a1b6084a7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:42.740939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2e630d6d-40e5-487b-ac04-8c7a1b6084a7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:42.742222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2e630d6d-40e5-487b-ac04-8c7a1b6084a7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:42.742685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2e630d6d-40e5-487b-ac04-8c7a1b6084a7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:42.743108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2e630d6d-40e5-487b-ac04-8c7a1b6084a7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:42.808788 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ba803bea-7fc5-4858-91c4-7440a4a09ada tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:42.809406 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ba803bea-7fc5-4858-91c4-7440a4a09ada tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:42.815295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba803bea-7fc5-4858-91c4-7440a4a09ada tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:42.815780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba803bea-7fc5-4858-91c4-7440a4a09ada tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:42.816217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba803bea-7fc5-4858-91c4-7440a4a09ada tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:42.816906 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba803bea-7fc5-4858-91c4-7440a4a09ada tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:42.817363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba803bea-7fc5-4858-91c4-7440a4a09ada tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:42.817789 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba803bea-7fc5-4858-91c4-7440a4a09ada tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:42.874492 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2e630d6d-40e5-487b-ac04-8c7a1b6084a7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:42.879835 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ba803bea-7fc5-4858-91c4-7440a4a09ada tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:42.884163 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2e630d6d-40e5-487b-ac04-8c7a1b6084a7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:42.885686 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2e630d6d-40e5-487b-ac04-8c7a1b6084a7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:42.887047 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2e630d6d-40e5-487b-ac04-8c7a1b6084a7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.158095 Aug 24 12:54:42.887616 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1616/3235] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:42 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:42.889445 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ba803bea-7fc5-4858-91c4-7440a4a09ada tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084377 Aug 24 12:54:42.890157 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1620/3236] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:42 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:43.177702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3ade8a5c-8cf0-47fa-94bb-ccd1dd240d68 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:43.178233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3ade8a5c-8cf0-47fa-94bb-ccd1dd240d68 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:43.184856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ade8a5c-8cf0-47fa-94bb-ccd1dd240d68 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:43.185329 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ade8a5c-8cf0-47fa-94bb-ccd1dd240d68 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:43.185757 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ade8a5c-8cf0-47fa-94bb-ccd1dd240d68 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:43.186427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ade8a5c-8cf0-47fa-94bb-ccd1dd240d68 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:43.186898 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ade8a5c-8cf0-47fa-94bb-ccd1dd240d68 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:43.187319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3ade8a5c-8cf0-47fa-94bb-ccd1dd240d68 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:43.312915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3ade8a5c-8cf0-47fa-94bb-ccd1dd240d68 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:43.321262 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3ade8a5c-8cf0-47fa-94bb-ccd1dd240d68 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.147494 Aug 24 12:54:43.321810 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1617/3237] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:43 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:43.558997 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-59e1d199-9ff3-48f7-8960-193f073616b0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:43.559610 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-59e1d199-9ff3-48f7-8960-193f073616b0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:43.566003 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59e1d199-9ff3-48f7-8960-193f073616b0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:43.566493 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59e1d199-9ff3-48f7-8960-193f073616b0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:43.566962 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59e1d199-9ff3-48f7-8960-193f073616b0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:43.567648 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59e1d199-9ff3-48f7-8960-193f073616b0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:43.568107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59e1d199-9ff3-48f7-8960-193f073616b0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:43.568538 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-59e1d199-9ff3-48f7-8960-193f073616b0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:43.695520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-59e1d199-9ff3-48f7-8960-193f073616b0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:43.703636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-59e1d199-9ff3-48f7-8960-193f073616b0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148508 Aug 24 12:54:43.704190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1621/3238] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:43 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:43.909957 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-90003017-53e3-4e13-91c7-0efdd0d3d85b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:43.910524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bb41ba0c-43c7-4efd-8b37-3aec5f5b4947 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:43.910937 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-90003017-53e3-4e13-91c7-0efdd0d3d85b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:43.911044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bb41ba0c-43c7-4efd-8b37-3aec5f5b4947 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:43.916615 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb41ba0c-43c7-4efd-8b37-3aec5f5b4947 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:43.916885 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-90003017-53e3-4e13-91c7-0efdd0d3d85b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:43.917106 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb41ba0c-43c7-4efd-8b37-3aec5f5b4947 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:43.917360 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-90003017-53e3-4e13-91c7-0efdd0d3d85b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:43.917545 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb41ba0c-43c7-4efd-8b37-3aec5f5b4947 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:43.917792 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-90003017-53e3-4e13-91c7-0efdd0d3d85b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:43.918265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb41ba0c-43c7-4efd-8b37-3aec5f5b4947 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:43.918466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-90003017-53e3-4e13-91c7-0efdd0d3d85b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:43.918747 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb41ba0c-43c7-4efd-8b37-3aec5f5b4947 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:43.918949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-90003017-53e3-4e13-91c7-0efdd0d3d85b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:43.919180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb41ba0c-43c7-4efd-8b37-3aec5f5b4947 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:43.919374 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-90003017-53e3-4e13-91c7-0efdd0d3d85b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:43.933586 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:54:43.984901 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bb41ba0c-43c7-4efd-8b37-3aec5f5b4947 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:43.993304 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bb41ba0c-43c7-4efd-8b37-3aec5f5b4947 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.087172 Aug 24 12:54:43.993872 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1622/3239] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:43 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:44.050401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-90003017-53e3-4e13-91c7-0efdd0d3d85b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:44.059548 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-90003017-53e3-4e13-91c7-0efdd0d3d85b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:44.061039 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-90003017-53e3-4e13-91c7-0efdd0d3d85b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:44.062184 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-90003017-53e3-4e13-91c7-0efdd0d3d85b tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.156188 Aug 24 12:54:44.062746 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1618/3240] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:43 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:44.341841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-65d8a199-9361-454b-8c75-f0b5edde2f0a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:44.342452 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-65d8a199-9361-454b-8c75-f0b5edde2f0a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:44.348383 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-65d8a199-9361-454b-8c75-f0b5edde2f0a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:44.348869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-65d8a199-9361-454b-8c75-f0b5edde2f0a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:44.349305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-65d8a199-9361-454b-8c75-f0b5edde2f0a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:44.349990 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-65d8a199-9361-454b-8c75-f0b5edde2f0a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:44.350449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-65d8a199-9361-454b-8c75-f0b5edde2f0a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:44.350911 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-65d8a199-9361-454b-8c75-f0b5edde2f0a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:44.478134 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-65d8a199-9361-454b-8c75-f0b5edde2f0a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:44.486292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-65d8a199-9361-454b-8c75-f0b5edde2f0a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.148303 Aug 24 12:54:44.487147 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1623/3241] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:44 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:44.725060 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-61d80a9e-e2a5-4ef1-b182-f4dce73cee3b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:44.726094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-61d80a9e-e2a5-4ef1-b182-f4dce73cee3b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:44.731993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61d80a9e-e2a5-4ef1-b182-f4dce73cee3b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:44.732478 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61d80a9e-e2a5-4ef1-b182-f4dce73cee3b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:44.732919 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61d80a9e-e2a5-4ef1-b182-f4dce73cee3b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:44.733601 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61d80a9e-e2a5-4ef1-b182-f4dce73cee3b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:44.734059 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61d80a9e-e2a5-4ef1-b182-f4dce73cee3b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:44.734490 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-61d80a9e-e2a5-4ef1-b182-f4dce73cee3b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:44.860235 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-61d80a9e-e2a5-4ef1-b182-f4dce73cee3b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:44.868487 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-61d80a9e-e2a5-4ef1-b182-f4dce73cee3b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.147324 Aug 24 12:54:44.869038 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1619/3242] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:44 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:45.013408 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c754b19b-640c-46e0-a27f-946819e0f66d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:45.014052 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c754b19b-640c-46e0-a27f-946819e0f66d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:45.020376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c754b19b-640c-46e0-a27f-946819e0f66d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:45.023124 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c754b19b-640c-46e0-a27f-946819e0f66d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:45.023124 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c754b19b-640c-46e0-a27f-946819e0f66d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:45.023124 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c754b19b-640c-46e0-a27f-946819e0f66d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:45.023124 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c754b19b-640c-46e0-a27f-946819e0f66d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:45.023543 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c754b19b-640c-46e0-a27f-946819e0f66d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:45.085553 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c754b19b-640c-46e0-a27f-946819e0f66d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:45.086362 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-28b2959c-c078-4b27-b250-85af8294916f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:45.087062 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-28b2959c-c078-4b27-b250-85af8294916f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:45.093482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28b2959c-c078-4b27-b250-85af8294916f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:45.093792 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c754b19b-640c-46e0-a27f-946819e0f66d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084342 Aug 24 12:54:45.094123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28b2959c-c078-4b27-b250-85af8294916f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:45.094349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1624/3243] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:45 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:45.099902 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28b2959c-c078-4b27-b250-85af8294916f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:45.100708 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28b2959c-c078-4b27-b250-85af8294916f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:45.101818 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28b2959c-c078-4b27-b250-85af8294916f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:45.102312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28b2959c-c078-4b27-b250-85af8294916f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:45.230172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-28b2959c-c078-4b27-b250-85af8294916f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:45.232363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:54:45.239515 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-28b2959c-c078-4b27-b250-85af8294916f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:45.241049 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-28b2959c-c078-4b27-b250-85af8294916f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:45.242167 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-28b2959c-c078-4b27-b250-85af8294916f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.160377 Aug 24 12:54:45.242730 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1620/3244] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:45 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:54:45.508576 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-cd634307-5f84-44c6-bf02-c03b461f1174 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:45.509211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-cd634307-5f84-44c6-bf02-c03b461f1174 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:45.515143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd634307-5f84-44c6-bf02-c03b461f1174 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:45.515632 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd634307-5f84-44c6-bf02-c03b461f1174 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:45.516075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd634307-5f84-44c6-bf02-c03b461f1174 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:45.516766 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd634307-5f84-44c6-bf02-c03b461f1174 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:45.517229 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd634307-5f84-44c6-bf02-c03b461f1174 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:45.517660 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd634307-5f84-44c6-bf02-c03b461f1174 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:45.645955 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-cd634307-5f84-44c6-bf02-c03b461f1174 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:45.654204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-cd634307-5f84-44c6-bf02-c03b461f1174 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149991 Aug 24 12:54:45.654792 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1625/3245] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:45 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:45.889462 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-dd752999-2b2a-4beb-8189-69779dcef4ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:45.889991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-dd752999-2b2a-4beb-8189-69779dcef4ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:45.891884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:54:45.896640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd752999-2b2a-4beb-8189-69779dcef4ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:45.897117 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd752999-2b2a-4beb-8189-69779dcef4ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:45.897577 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd752999-2b2a-4beb-8189-69779dcef4ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:45.898256 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd752999-2b2a-4beb-8189-69779dcef4ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:45.898734 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd752999-2b2a-4beb-8189-69779dcef4ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:45.899162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd752999-2b2a-4beb-8189-69779dcef4ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:46.033826 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-dd752999-2b2a-4beb-8189-69779dcef4ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:46.042368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-dd752999-2b2a-4beb-8189-69779dcef4ad tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.157339 Aug 24 12:54:46.042958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1621/3246] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:45 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:46.115277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ce27416a-afd3-4f57-a136-98c9e8e58514 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:46.115886 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ce27416a-afd3-4f57-a136-98c9e8e58514 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:46.122932 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ce27416a-afd3-4f57-a136-98c9e8e58514 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:46.123443 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ce27416a-afd3-4f57-a136-98c9e8e58514 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:46.123882 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ce27416a-afd3-4f57-a136-98c9e8e58514 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:46.124635 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ce27416a-afd3-4f57-a136-98c9e8e58514 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:46.125092 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ce27416a-afd3-4f57-a136-98c9e8e58514 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:46.125521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ce27416a-afd3-4f57-a136-98c9e8e58514 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:46.187621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ce27416a-afd3-4f57-a136-98c9e8e58514 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:46.195633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ce27416a-afd3-4f57-a136-98c9e8e58514 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084490 Aug 24 12:54:46.196187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1626/3247] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:46 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:46.264925 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-63d9942f-b45a-478b-8802-795eabfcadff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:46.265559 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-63d9942f-b45a-478b-8802-795eabfcadff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:46.271448 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-63d9942f-b45a-478b-8802-795eabfcadff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:46.271924 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-63d9942f-b45a-478b-8802-795eabfcadff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:46.272355 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-63d9942f-b45a-478b-8802-795eabfcadff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:46.273527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-63d9942f-b45a-478b-8802-795eabfcadff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:46.273975 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-63d9942f-b45a-478b-8802-795eabfcadff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:46.274397 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-63d9942f-b45a-478b-8802-795eabfcadff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:46.399750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-63d9942f-b45a-478b-8802-795eabfcadff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:46.408288 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-63d9942f-b45a-478b-8802-795eabfcadff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:46.409781 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-63d9942f-b45a-478b-8802-795eabfcadff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:46.410967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-63d9942f-b45a-478b-8802-795eabfcadff tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.149912 Aug 24 12:54:46.411516 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1622/3248] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:46 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:46.675203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-24f681de-5906-4482-9af0-3f6ccb83d626 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:46.675815 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-24f681de-5906-4482-9af0-3f6ccb83d626 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:46.682395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-24f681de-5906-4482-9af0-3f6ccb83d626 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:46.682914 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-24f681de-5906-4482-9af0-3f6ccb83d626 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:46.683358 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-24f681de-5906-4482-9af0-3f6ccb83d626 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:46.684039 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-24f681de-5906-4482-9af0-3f6ccb83d626 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:46.684492 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-24f681de-5906-4482-9af0-3f6ccb83d626 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:46.684918 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-24f681de-5906-4482-9af0-3f6ccb83d626 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:46.810207 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-24f681de-5906-4482-9af0-3f6ccb83d626 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:46.818281 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-24f681de-5906-4482-9af0-3f6ccb83d626 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.146891 Aug 24 12:54:46.818983 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1627/3249] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:46 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:47.062857 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cf93c805-9f7f-4306-8fe6-5aeeffc3cbe6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:47.063498 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cf93c805-9f7f-4306-8fe6-5aeeffc3cbe6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:47.069946 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf93c805-9f7f-4306-8fe6-5aeeffc3cbe6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:47.070425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf93c805-9f7f-4306-8fe6-5aeeffc3cbe6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:47.070899 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf93c805-9f7f-4306-8fe6-5aeeffc3cbe6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:47.071579 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf93c805-9f7f-4306-8fe6-5aeeffc3cbe6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:47.072028 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf93c805-9f7f-4306-8fe6-5aeeffc3cbe6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:47.072448 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf93c805-9f7f-4306-8fe6-5aeeffc3cbe6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:47.201753 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cf93c805-9f7f-4306-8fe6-5aeeffc3cbe6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:47.209785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cf93c805-9f7f-4306-8fe6-5aeeffc3cbe6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150795 Aug 24 12:54:47.210880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1623/3250] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:47 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:47.216157 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a27c5223-7f23-4ada-844e-65b01fb39247 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:47.217369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a27c5223-7f23-4ada-844e-65b01fb39247 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:47.223813 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a27c5223-7f23-4ada-844e-65b01fb39247 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:47.224290 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a27c5223-7f23-4ada-844e-65b01fb39247 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:47.224774 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a27c5223-7f23-4ada-844e-65b01fb39247 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:47.225468 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a27c5223-7f23-4ada-844e-65b01fb39247 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:47.226748 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a27c5223-7f23-4ada-844e-65b01fb39247 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:47.227194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a27c5223-7f23-4ada-844e-65b01fb39247 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:47.291097 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a27c5223-7f23-4ada-844e-65b01fb39247 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:47.299102 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a27c5223-7f23-4ada-844e-65b01fb39247 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.086717 Aug 24 12:54:47.299657 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1628/3251] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:47 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:47.433449 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-22162f9d-50ca-4cb3-8969-965254d7383c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:47.434059 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-22162f9d-50ca-4cb3-8969-965254d7383c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:47.439941 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22162f9d-50ca-4cb3-8969-965254d7383c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:47.440421 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22162f9d-50ca-4cb3-8969-965254d7383c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:47.440857 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22162f9d-50ca-4cb3-8969-965254d7383c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:47.441542 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22162f9d-50ca-4cb3-8969-965254d7383c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:47.441993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22162f9d-50ca-4cb3-8969-965254d7383c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:47.442420 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-22162f9d-50ca-4cb3-8969-965254d7383c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:47.567606 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-22162f9d-50ca-4cb3-8969-965254d7383c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:47.576573 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-22162f9d-50ca-4cb3-8969-965254d7383c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:47.578055 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-22162f9d-50ca-4cb3-8969-965254d7383c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:47.579248 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-22162f9d-50ca-4cb3-8969-965254d7383c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.149736 Aug 24 12:54:47.579796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1624/3252] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:47 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:47.839425 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e0f47a58-cb5b-43ee-aa91-f622313b9e72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:47.840071 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e0f47a58-cb5b-43ee-aa91-f622313b9e72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:47.845991 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0f47a58-cb5b-43ee-aa91-f622313b9e72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:47.846471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0f47a58-cb5b-43ee-aa91-f622313b9e72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:47.846942 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0f47a58-cb5b-43ee-aa91-f622313b9e72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:47.847652 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0f47a58-cb5b-43ee-aa91-f622313b9e72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:47.848106 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0f47a58-cb5b-43ee-aa91-f622313b9e72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:47.848536 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0f47a58-cb5b-43ee-aa91-f622313b9e72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:47.972543 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e0f47a58-cb5b-43ee-aa91-f622313b9e72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:47.980610 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e0f47a58-cb5b-43ee-aa91-f622313b9e72 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.145075 Aug 24 12:54:47.981164 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1629/3253] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:47 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:48.231018 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-eec50716-7970-4c0d-9eb4-842f3871c7f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:48.231655 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-eec50716-7970-4c0d-9eb4-842f3871c7f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:48.238203 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eec50716-7970-4c0d-9eb4-842f3871c7f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:48.238696 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eec50716-7970-4c0d-9eb4-842f3871c7f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:48.239127 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eec50716-7970-4c0d-9eb4-842f3871c7f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:48.239795 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eec50716-7970-4c0d-9eb4-842f3871c7f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:48.240241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eec50716-7970-4c0d-9eb4-842f3871c7f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:48.240658 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eec50716-7970-4c0d-9eb4-842f3871c7f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:48.320207 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d6ff19b1-cc78-4e13-b44c-56a094491e1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:48.320958 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d6ff19b1-cc78-4e13-b44c-56a094491e1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:48.327630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d6ff19b1-cc78-4e13-b44c-56a094491e1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:48.328116 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d6ff19b1-cc78-4e13-b44c-56a094491e1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:48.328553 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d6ff19b1-cc78-4e13-b44c-56a094491e1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:48.329226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d6ff19b1-cc78-4e13-b44c-56a094491e1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:48.329845 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d6ff19b1-cc78-4e13-b44c-56a094491e1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:48.330194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d6ff19b1-cc78-4e13-b44c-56a094491e1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:48.367500 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-eec50716-7970-4c0d-9eb4-842f3871c7f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:48.375639 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-eec50716-7970-4c0d-9eb4-842f3871c7f9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148418 Aug 24 12:54:48.376198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1625/3254] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:48 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:48.391685 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d6ff19b1-cc78-4e13-b44c-56a094491e1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:48.400202 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d6ff19b1-cc78-4e13-b44c-56a094491e1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084438 Aug 24 12:54:48.400750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1630/3255] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:48 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:48.602401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cf47bd77-823c-4c84-b30c-a93cae6c35bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:48.603030 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cf47bd77-823c-4c84-b30c-a93cae6c35bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:48.609069 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf47bd77-823c-4c84-b30c-a93cae6c35bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:48.609541 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf47bd77-823c-4c84-b30c-a93cae6c35bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:48.609970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf47bd77-823c-4c84-b30c-a93cae6c35bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:48.610641 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf47bd77-823c-4c84-b30c-a93cae6c35bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:48.611112 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf47bd77-823c-4c84-b30c-a93cae6c35bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:48.611796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf47bd77-823c-4c84-b30c-a93cae6c35bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:48.738486 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cf47bd77-823c-4c84-b30c-a93cae6c35bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:48.747478 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cf47bd77-823c-4c84-b30c-a93cae6c35bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:48.748942 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cf47bd77-823c-4c84-b30c-a93cae6c35bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:48.750080 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cf47bd77-823c-4c84-b30c-a93cae6c35bc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.151563 Aug 24 12:54:48.750620 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1626/3256] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:48 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:49.002048 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4cd91735-7a6c-4046-824f-45639c7bcbc3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:49.002677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4cd91735-7a6c-4046-824f-45639c7bcbc3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:49.008710 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4cd91735-7a6c-4046-824f-45639c7bcbc3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:49.009192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4cd91735-7a6c-4046-824f-45639c7bcbc3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:49.009628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4cd91735-7a6c-4046-824f-45639c7bcbc3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:49.010309 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4cd91735-7a6c-4046-824f-45639c7bcbc3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:49.010799 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4cd91735-7a6c-4046-824f-45639c7bcbc3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:49.011230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4cd91735-7a6c-4046-824f-45639c7bcbc3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:49.139188 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4cd91735-7a6c-4046-824f-45639c7bcbc3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:49.147402 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4cd91735-7a6c-4046-824f-45639c7bcbc3 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149246 Aug 24 12:54:49.148236 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1631/3257] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:48 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:49.396164 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c51ecb15-0c36-4d92-80f6-e49adf017604 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:49.396695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c51ecb15-0c36-4d92-80f6-e49adf017604 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:49.403485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c51ecb15-0c36-4d92-80f6-e49adf017604 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:49.403965 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c51ecb15-0c36-4d92-80f6-e49adf017604 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:49.404411 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c51ecb15-0c36-4d92-80f6-e49adf017604 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:49.405086 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c51ecb15-0c36-4d92-80f6-e49adf017604 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:49.405540 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c51ecb15-0c36-4d92-80f6-e49adf017604 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:49.405964 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c51ecb15-0c36-4d92-80f6-e49adf017604 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:49.421341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b48b04b1-2aea-4e6d-ace9-f67514e426f3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:49.422582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b48b04b1-2aea-4e6d-ace9-f67514e426f3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:49.430256 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b48b04b1-2aea-4e6d-ace9-f67514e426f3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:49.430777 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b48b04b1-2aea-4e6d-ace9-f67514e426f3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:49.431214 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b48b04b1-2aea-4e6d-ace9-f67514e426f3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:49.431907 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b48b04b1-2aea-4e6d-ace9-f67514e426f3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:49.432357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b48b04b1-2aea-4e6d-ace9-f67514e426f3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:49.432813 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b48b04b1-2aea-4e6d-ace9-f67514e426f3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:49.494832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b48b04b1-2aea-4e6d-ace9-f67514e426f3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:49.503378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b48b04b1-2aea-4e6d-ace9-f67514e426f3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085668 Aug 24 12:54:49.503948 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1632/3258] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:49 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:49.542670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c51ecb15-0c36-4d92-80f6-e49adf017604 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:49.551406 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c51ecb15-0c36-4d92-80f6-e49adf017604 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.159214 Aug 24 12:54:49.552134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1627/3259] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:49 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:49.773828 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9e8c6088-99a2-405c-8195-e3272931596c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:49.774438 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9e8c6088-99a2-405c-8195-e3272931596c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:49.780410 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e8c6088-99a2-405c-8195-e3272931596c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:49.780892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e8c6088-99a2-405c-8195-e3272931596c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:49.781368 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e8c6088-99a2-405c-8195-e3272931596c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:49.782050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e8c6088-99a2-405c-8195-e3272931596c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:49.782506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e8c6088-99a2-405c-8195-e3272931596c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:49.782966 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e8c6088-99a2-405c-8195-e3272931596c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:49.913431 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9e8c6088-99a2-405c-8195-e3272931596c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:49.921965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9e8c6088-99a2-405c-8195-e3272931596c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:49.923490 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9e8c6088-99a2-405c-8195-e3272931596c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:49.924643 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9e8c6088-99a2-405c-8195-e3272931596c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.154838 Aug 24 12:54:49.925194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1633/3260] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:49 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:50.169067 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-70090515-24ee-4262-af90-96223be41e08 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:50.169616 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-70090515-24ee-4262-af90-96223be41e08 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:50.175806 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70090515-24ee-4262-af90-96223be41e08 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:50.176488 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70090515-24ee-4262-af90-96223be41e08 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:50.177020 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70090515-24ee-4262-af90-96223be41e08 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:50.177692 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70090515-24ee-4262-af90-96223be41e08 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:50.178134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70090515-24ee-4262-af90-96223be41e08 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:50.178551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70090515-24ee-4262-af90-96223be41e08 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:50.308394 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-70090515-24ee-4262-af90-96223be41e08 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:50.316600 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-70090515-24ee-4262-af90-96223be41e08 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151654 Aug 24 12:54:50.317157 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1628/3261] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:50 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:50.525454 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e418829f-c75c-4476-b6b4-1e333d0ad204 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:50.526075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e418829f-c75c-4476-b6b4-1e333d0ad204 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:50.532564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e418829f-c75c-4476-b6b4-1e333d0ad204 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:50.533052 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e418829f-c75c-4476-b6b4-1e333d0ad204 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:50.533492 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e418829f-c75c-4476-b6b4-1e333d0ad204 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:50.534179 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e418829f-c75c-4476-b6b4-1e333d0ad204 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:50.534636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e418829f-c75c-4476-b6b4-1e333d0ad204 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:50.535090 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e418829f-c75c-4476-b6b4-1e333d0ad204 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:50.573037 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8c0d869c-ca36-4e32-b74b-d379a03e5026 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:50.573635 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8c0d869c-ca36-4e32-b74b-d379a03e5026 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:50.579962 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c0d869c-ca36-4e32-b74b-d379a03e5026 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:50.580439 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c0d869c-ca36-4e32-b74b-d379a03e5026 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:50.580868 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c0d869c-ca36-4e32-b74b-d379a03e5026 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:50.581546 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c0d869c-ca36-4e32-b74b-d379a03e5026 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:50.581990 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c0d869c-ca36-4e32-b74b-d379a03e5026 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:50.582408 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c0d869c-ca36-4e32-b74b-d379a03e5026 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:50.601273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e418829f-c75c-4476-b6b4-1e333d0ad204 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:50.609277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e418829f-c75c-4476-b6b4-1e333d0ad204 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.088392 Aug 24 12:54:50.609827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1634/3262] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:50 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:50.711664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8c0d869c-ca36-4e32-b74b-d379a03e5026 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:50.719679 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8c0d869c-ca36-4e32-b74b-d379a03e5026 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150930 Aug 24 12:54:50.720229 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1629/3263] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:50 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:50.948061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-374a4f17-a11b-4477-8952-ce47dec11b8d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:50.948673 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-374a4f17-a11b-4477-8952-ce47dec11b8d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:50.954516 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-374a4f17-a11b-4477-8952-ce47dec11b8d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:50.955033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-374a4f17-a11b-4477-8952-ce47dec11b8d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:50.955470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-374a4f17-a11b-4477-8952-ce47dec11b8d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:50.956159 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-374a4f17-a11b-4477-8952-ce47dec11b8d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:50.956617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-374a4f17-a11b-4477-8952-ce47dec11b8d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:50.957044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-374a4f17-a11b-4477-8952-ce47dec11b8d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:51.082332 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-374a4f17-a11b-4477-8952-ce47dec11b8d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:51.090849 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-374a4f17-a11b-4477-8952-ce47dec11b8d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:51.092352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-374a4f17-a11b-4477-8952-ce47dec11b8d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:51.093496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-374a4f17-a11b-4477-8952-ce47dec11b8d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.149882 Aug 24 12:54:51.094061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1635/3264] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:50 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:51.337337 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-80b7875f-21f7-4a07-96d9-b7eb0180d3f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:51.337866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-80b7875f-21f7-4a07-96d9-b7eb0180d3f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:51.343843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80b7875f-21f7-4a07-96d9-b7eb0180d3f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:51.344350 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80b7875f-21f7-4a07-96d9-b7eb0180d3f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:51.344799 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80b7875f-21f7-4a07-96d9-b7eb0180d3f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:51.345481 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80b7875f-21f7-4a07-96d9-b7eb0180d3f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:51.345929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80b7875f-21f7-4a07-96d9-b7eb0180d3f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:51.346344 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80b7875f-21f7-4a07-96d9-b7eb0180d3f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:51.474005 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-80b7875f-21f7-4a07-96d9-b7eb0180d3f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:51.482578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-80b7875f-21f7-4a07-96d9-b7eb0180d3f1 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149201 Aug 24 12:54:51.483160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1630/3265] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:51 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:51.630365 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-33e8ebf6-9c1c-4229-8528-44416f3ddeb9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:51.630998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-33e8ebf6-9c1c-4229-8528-44416f3ddeb9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:51.637314 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33e8ebf6-9c1c-4229-8528-44416f3ddeb9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:51.637794 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33e8ebf6-9c1c-4229-8528-44416f3ddeb9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:51.638226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33e8ebf6-9c1c-4229-8528-44416f3ddeb9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:51.638995 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33e8ebf6-9c1c-4229-8528-44416f3ddeb9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:51.639389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33e8ebf6-9c1c-4229-8528-44416f3ddeb9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:51.639815 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33e8ebf6-9c1c-4229-8528-44416f3ddeb9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:51.702148 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-33e8ebf6-9c1c-4229-8528-44416f3ddeb9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:51.711521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-33e8ebf6-9c1c-4229-8528-44416f3ddeb9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084960 Aug 24 12:54:51.712088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1636/3266] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:51 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:51.740436 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-85d8dacf-8d1e-4b76-bec7-b88c06a4a36b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:51.741051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-85d8dacf-8d1e-4b76-bec7-b88c06a4a36b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:51.747604 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-85d8dacf-8d1e-4b76-bec7-b88c06a4a36b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:51.748089 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-85d8dacf-8d1e-4b76-bec7-b88c06a4a36b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:51.748530 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-85d8dacf-8d1e-4b76-bec7-b88c06a4a36b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:51.749330 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-85d8dacf-8d1e-4b76-bec7-b88c06a4a36b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:51.749791 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-85d8dacf-8d1e-4b76-bec7-b88c06a4a36b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:51.750220 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-85d8dacf-8d1e-4b76-bec7-b88c06a4a36b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:51.878160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-85d8dacf-8d1e-4b76-bec7-b88c06a4a36b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:51.886407 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-85d8dacf-8d1e-4b76-bec7-b88c06a4a36b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150161 Aug 24 12:54:51.886989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1631/3267] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:51 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:52.116988 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-61083805-2eeb-493a-bf1b-40046b2caa6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:52.117603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-61083805-2eeb-493a-bf1b-40046b2caa6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:52.123519 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-61083805-2eeb-493a-bf1b-40046b2caa6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:52.123998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-61083805-2eeb-493a-bf1b-40046b2caa6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:52.124437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-61083805-2eeb-493a-bf1b-40046b2caa6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:52.125112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-61083805-2eeb-493a-bf1b-40046b2caa6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:52.125566 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-61083805-2eeb-493a-bf1b-40046b2caa6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:52.126040 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-61083805-2eeb-493a-bf1b-40046b2caa6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:52.257783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-61083805-2eeb-493a-bf1b-40046b2caa6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:52.266318 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-61083805-2eeb-493a-bf1b-40046b2caa6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:52.267850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-61083805-2eeb-493a-bf1b-40046b2caa6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:52.269003 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-61083805-2eeb-493a-bf1b-40046b2caa6d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.156479 Aug 24 12:54:52.269553 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1637/3268] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:52 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:52.503323 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5a430377-4d14-4a09-8799-a3a7487c752e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:52.503925 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5a430377-4d14-4a09-8799-a3a7487c752e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:52.510458 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5a430377-4d14-4a09-8799-a3a7487c752e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:52.510966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5a430377-4d14-4a09-8799-a3a7487c752e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:52.512142 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5a430377-4d14-4a09-8799-a3a7487c752e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:52.512863 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5a430377-4d14-4a09-8799-a3a7487c752e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:52.513393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5a430377-4d14-4a09-8799-a3a7487c752e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:52.513828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5a430377-4d14-4a09-8799-a3a7487c752e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:52.639636 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5a430377-4d14-4a09-8799-a3a7487c752e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:52.647771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5a430377-4d14-4a09-8799-a3a7487c752e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.148253 Aug 24 12:54:52.648328 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1632/3269] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:52 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:52.732419 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d31c6335-ba35-4287-b120-8f6b163a2c72 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:52.733025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d31c6335-ba35-4287-b120-8f6b163a2c72 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:52.739688 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d31c6335-ba35-4287-b120-8f6b163a2c72 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:52.740163 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d31c6335-ba35-4287-b120-8f6b163a2c72 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:52.740594 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d31c6335-ba35-4287-b120-8f6b163a2c72 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:52.741894 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d31c6335-ba35-4287-b120-8f6b163a2c72 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:52.742346 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d31c6335-ba35-4287-b120-8f6b163a2c72 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:52.742793 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d31c6335-ba35-4287-b120-8f6b163a2c72 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:52.802176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d31c6335-ba35-4287-b120-8f6b163a2c72 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:52.811412 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d31c6335-ba35-4287-b120-8f6b163a2c72 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082912 Aug 24 12:54:52.811984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1638/3270] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:52 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:52.907450 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-344238f3-ebd6-4de6-9797-f6ad24fbaf67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:52.908076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-344238f3-ebd6-4de6-9797-f6ad24fbaf67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:52.914946 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-344238f3-ebd6-4de6-9797-f6ad24fbaf67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:52.915425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-344238f3-ebd6-4de6-9797-f6ad24fbaf67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:52.915862 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-344238f3-ebd6-4de6-9797-f6ad24fbaf67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:52.916542 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-344238f3-ebd6-4de6-9797-f6ad24fbaf67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:52.916996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-344238f3-ebd6-4de6-9797-f6ad24fbaf67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:52.917427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-344238f3-ebd6-4de6-9797-f6ad24fbaf67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:53.046834 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-344238f3-ebd6-4de6-9797-f6ad24fbaf67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:53.054971 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-344238f3-ebd6-4de6-9797-f6ad24fbaf67 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151338 Aug 24 12:54:53.055538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1633/3271] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:52 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:53.292836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d8aa048d-cd42-4166-b880-622415bc5a29 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:53.293401 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d8aa048d-cd42-4166-b880-622415bc5a29 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:53.299299 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d8aa048d-cd42-4166-b880-622415bc5a29 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:53.299783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d8aa048d-cd42-4166-b880-622415bc5a29 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:53.300223 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d8aa048d-cd42-4166-b880-622415bc5a29 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:53.300907 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d8aa048d-cd42-4166-b880-622415bc5a29 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:53.301362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d8aa048d-cd42-4166-b880-622415bc5a29 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:53.301786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d8aa048d-cd42-4166-b880-622415bc5a29 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:53.304269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:54:53.429997 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d8aa048d-cd42-4166-b880-622415bc5a29 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:53.438561 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d8aa048d-cd42-4166-b880-622415bc5a29 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:53.440082 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d8aa048d-cd42-4166-b880-622415bc5a29 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:53.441239 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d8aa048d-cd42-4166-b880-622415bc5a29 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.152408 Aug 24 12:54:53.441792 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1639/3272] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:53 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:53.668610 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-77f0b6ac-5860-4f05-bfe0-5a22b680f1c4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:53.669135 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-77f0b6ac-5860-4f05-bfe0-5a22b680f1c4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:53.675130 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-77f0b6ac-5860-4f05-bfe0-5a22b680f1c4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:53.675646 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-77f0b6ac-5860-4f05-bfe0-5a22b680f1c4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:53.676113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-77f0b6ac-5860-4f05-bfe0-5a22b680f1c4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:53.676797 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-77f0b6ac-5860-4f05-bfe0-5a22b680f1c4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:53.677250 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-77f0b6ac-5860-4f05-bfe0-5a22b680f1c4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:53.677677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-77f0b6ac-5860-4f05-bfe0-5a22b680f1c4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:53.810019 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-77f0b6ac-5860-4f05-bfe0-5a22b680f1c4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:53.818365 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-77f0b6ac-5860-4f05-bfe0-5a22b680f1c4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.153691 Aug 24 12:54:53.818956 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1634/3273] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:53 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:53.831895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1df9bc5e-08c9-4a91-943b-d59293fddf1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:53.838207 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1df9bc5e-08c9-4a91-943b-d59293fddf1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:53.839236 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1df9bc5e-08c9-4a91-943b-d59293fddf1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:53.839729 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1df9bc5e-08c9-4a91-943b-d59293fddf1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:53.840173 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1df9bc5e-08c9-4a91-943b-d59293fddf1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:53.840866 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1df9bc5e-08c9-4a91-943b-d59293fddf1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:53.841334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1df9bc5e-08c9-4a91-943b-d59293fddf1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:53.841765 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1df9bc5e-08c9-4a91-943b-d59293fddf1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:53.905496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1df9bc5e-08c9-4a91-943b-d59293fddf1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:53.913626 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1df9bc5e-08c9-4a91-943b-d59293fddf1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085595 Aug 24 12:54:53.914226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1640/3274] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:53 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:54.076289 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-dc7694f7-6878-41b3-bf02-59a589c6520f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:54.076897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-dc7694f7-6878-41b3-bf02-59a589c6520f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:54.083272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dc7694f7-6878-41b3-bf02-59a589c6520f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:54.083754 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dc7694f7-6878-41b3-bf02-59a589c6520f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:54.084188 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dc7694f7-6878-41b3-bf02-59a589c6520f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:54.084873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dc7694f7-6878-41b3-bf02-59a589c6520f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:54.085327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dc7694f7-6878-41b3-bf02-59a589c6520f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:54.085759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dc7694f7-6878-41b3-bf02-59a589c6520f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:54.218304 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-dc7694f7-6878-41b3-bf02-59a589c6520f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:54.226961 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-dc7694f7-6878-41b3-bf02-59a589c6520f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.154108 Aug 24 12:54:54.227520 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1635/3275] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:54 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:54.464542 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-18de6bc1-00f9-48c1-be17-4ab3921573ad tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:54.465159 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-18de6bc1-00f9-48c1-be17-4ab3921573ad tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:54.471120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-18de6bc1-00f9-48c1-be17-4ab3921573ad tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:54.471602 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-18de6bc1-00f9-48c1-be17-4ab3921573ad tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:54.472040 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-18de6bc1-00f9-48c1-be17-4ab3921573ad tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:54.472718 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-18de6bc1-00f9-48c1-be17-4ab3921573ad tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:54.473175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-18de6bc1-00f9-48c1-be17-4ab3921573ad tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:54.473603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-18de6bc1-00f9-48c1-be17-4ab3921573ad tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:54.602064 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-18de6bc1-00f9-48c1-be17-4ab3921573ad tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:54.610533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-18de6bc1-00f9-48c1-be17-4ab3921573ad tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:54.612316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-18de6bc1-00f9-48c1-be17-4ab3921573ad tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:54.613472 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-18de6bc1-00f9-48c1-be17-4ab3921573ad tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.152840 Aug 24 12:54:54.614020 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1641/3276] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:54 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:54.839876 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-330c167b-1194-48db-a15b-7b93a2b08a93 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:54.840459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-330c167b-1194-48db-a15b-7b93a2b08a93 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:54.846351 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-330c167b-1194-48db-a15b-7b93a2b08a93 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:54.846865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-330c167b-1194-48db-a15b-7b93a2b08a93 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:54.847295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-330c167b-1194-48db-a15b-7b93a2b08a93 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:54.847970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-330c167b-1194-48db-a15b-7b93a2b08a93 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:54.848415 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-330c167b-1194-48db-a15b-7b93a2b08a93 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:54.848835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-330c167b-1194-48db-a15b-7b93a2b08a93 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:54.934760 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7b50a49c-2b6d-436f-985a-1ea9f7c71d67 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:54.935396 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7b50a49c-2b6d-436f-985a-1ea9f7c71d67 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:54.941644 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b50a49c-2b6d-436f-985a-1ea9f7c71d67 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:54.942133 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b50a49c-2b6d-436f-985a-1ea9f7c71d67 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:54.942576 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b50a49c-2b6d-436f-985a-1ea9f7c71d67 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:54.943298 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b50a49c-2b6d-436f-985a-1ea9f7c71d67 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:54.943757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b50a49c-2b6d-436f-985a-1ea9f7c71d67 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:54.944186 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b50a49c-2b6d-436f-985a-1ea9f7c71d67 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:54.974636 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-330c167b-1194-48db-a15b-7b93a2b08a93 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:54.983577 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-330c167b-1194-48db-a15b-7b93a2b08a93 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.147508 Aug 24 12:54:54.984245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1636/3277] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:54 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:55.006921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7b50a49c-2b6d-436f-985a-1ea9f7c71d67 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:55.015357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7b50a49c-2b6d-436f-985a-1ea9f7c71d67 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084392 Aug 24 12:54:55.015914 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1642/3278] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:54 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:55.247657 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f607f4eb-18be-4d81-91fa-5881dc6a3266 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:55.248304 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f607f4eb-18be-4d81-91fa-5881dc6a3266 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:55.255109 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f607f4eb-18be-4d81-91fa-5881dc6a3266 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:55.255587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f607f4eb-18be-4d81-91fa-5881dc6a3266 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:55.256019 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f607f4eb-18be-4d81-91fa-5881dc6a3266 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:55.256702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f607f4eb-18be-4d81-91fa-5881dc6a3266 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:55.257149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f607f4eb-18be-4d81-91fa-5881dc6a3266 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:55.257669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f607f4eb-18be-4d81-91fa-5881dc6a3266 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:55.272572 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:54:55.385222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f607f4eb-18be-4d81-91fa-5881dc6a3266 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:55.393621 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f607f4eb-18be-4d81-91fa-5881dc6a3266 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149814 Aug 24 12:54:55.394179 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1637/3279] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:55 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:55.637437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4a51fc78-ba75-4870-968f-22a8e990a0f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:55.637960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4a51fc78-ba75-4870-968f-22a8e990a0f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:55.643983 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a51fc78-ba75-4870-968f-22a8e990a0f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:55.644459 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a51fc78-ba75-4870-968f-22a8e990a0f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:55.644889 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a51fc78-ba75-4870-968f-22a8e990a0f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:55.645567 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a51fc78-ba75-4870-968f-22a8e990a0f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:55.646017 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a51fc78-ba75-4870-968f-22a8e990a0f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:55.646438 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a51fc78-ba75-4870-968f-22a8e990a0f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:55.786119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4a51fc78-ba75-4870-968f-22a8e990a0f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:55.795307 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4a51fc78-ba75-4870-968f-22a8e990a0f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:55.796812 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4a51fc78-ba75-4870-968f-22a8e990a0f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:55.797997 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4a51fc78-ba75-4870-968f-22a8e990a0f1 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.165634 Aug 24 12:54:55.798553 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1643/3280] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:55 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:56.004397 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d48dd02a-9c97-49ce-823b-79e58ca1337c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:56.005005 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d48dd02a-9c97-49ce-823b-79e58ca1337c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:56.010912 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d48dd02a-9c97-49ce-823b-79e58ca1337c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:56.011393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d48dd02a-9c97-49ce-823b-79e58ca1337c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:56.011826 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d48dd02a-9c97-49ce-823b-79e58ca1337c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:56.012504 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d48dd02a-9c97-49ce-823b-79e58ca1337c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:56.012955 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d48dd02a-9c97-49ce-823b-79e58ca1337c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:56.013377 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d48dd02a-9c97-49ce-823b-79e58ca1337c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:56.036147 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d4a92c85-ed3b-4852-94c8-0c41afe8c27e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:56.036869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d4a92c85-ed3b-4852-94c8-0c41afe8c27e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:56.043893 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4a92c85-ed3b-4852-94c8-0c41afe8c27e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:56.044376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4a92c85-ed3b-4852-94c8-0c41afe8c27e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:56.044811 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4a92c85-ed3b-4852-94c8-0c41afe8c27e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:56.045492 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4a92c85-ed3b-4852-94c8-0c41afe8c27e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:56.046012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4a92c85-ed3b-4852-94c8-0c41afe8c27e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:56.046436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4a92c85-ed3b-4852-94c8-0c41afe8c27e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:56.109414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d4a92c85-ed3b-4852-94c8-0c41afe8c27e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:56.117980 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d4a92c85-ed3b-4852-94c8-0c41afe8c27e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085770 Aug 24 12:54:56.118676 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1644/3281] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:56 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:56.145212 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d48dd02a-9c97-49ce-823b-79e58ca1337c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:56.154245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d48dd02a-9c97-49ce-823b-79e58ca1337c tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.153813 Aug 24 12:54:56.154823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1638/3282] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:55 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:56.414973 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-038a4758-81c4-4df3-aba7-c431c1b75f64 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:56.415597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-038a4758-81c4-4df3-aba7-c431c1b75f64 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:56.421705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-038a4758-81c4-4df3-aba7-c431c1b75f64 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:56.422194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-038a4758-81c4-4df3-aba7-c431c1b75f64 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:56.422635 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-038a4758-81c4-4df3-aba7-c431c1b75f64 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:56.423346 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-038a4758-81c4-4df3-aba7-c431c1b75f64 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:56.423803 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-038a4758-81c4-4df3-aba7-c431c1b75f64 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:56.424226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-038a4758-81c4-4df3-aba7-c431c1b75f64 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:56.550441 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-038a4758-81c4-4df3-aba7-c431c1b75f64 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:56.558972 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-038a4758-81c4-4df3-aba7-c431c1b75f64 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148052 Aug 24 12:54:56.559530 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1645/3283] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:56 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:56.825412 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-360e602b-dd9d-4c2d-8409-4ad0119f72f7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:56.826025 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-360e602b-dd9d-4c2d-8409-4ad0119f72f7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:56.832467 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-360e602b-dd9d-4c2d-8409-4ad0119f72f7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:56.832946 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-360e602b-dd9d-4c2d-8409-4ad0119f72f7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:56.833386 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-360e602b-dd9d-4c2d-8409-4ad0119f72f7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:56.834069 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-360e602b-dd9d-4c2d-8409-4ad0119f72f7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:56.834523 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-360e602b-dd9d-4c2d-8409-4ad0119f72f7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:56.834988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-360e602b-dd9d-4c2d-8409-4ad0119f72f7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:56.961600 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-360e602b-dd9d-4c2d-8409-4ad0119f72f7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:56.970068 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-360e602b-dd9d-4c2d-8409-4ad0119f72f7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:56.971569 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-360e602b-dd9d-4c2d-8409-4ad0119f72f7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:56.972711 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-360e602b-dd9d-4c2d-8409-4ad0119f72f7 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.151245 Aug 24 12:54:56.973258 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1639/3284] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:56 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:54:57.139624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8d73dd7e-0888-446d-b102-a5e5e7cfdd41 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:57.140170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8d73dd7e-0888-446d-b102-a5e5e7cfdd41 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:57.146413 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d73dd7e-0888-446d-b102-a5e5e7cfdd41 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:57.146931 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d73dd7e-0888-446d-b102-a5e5e7cfdd41 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:57.147370 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d73dd7e-0888-446d-b102-a5e5e7cfdd41 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:57.148080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d73dd7e-0888-446d-b102-a5e5e7cfdd41 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:57.148586 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d73dd7e-0888-446d-b102-a5e5e7cfdd41 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:57.149009 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d73dd7e-0888-446d-b102-a5e5e7cfdd41 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:57.175978 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f3f02a76-638f-4177-af7d-59a7450e4c67 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:57.176610 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f3f02a76-638f-4177-af7d-59a7450e4c67 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:57.183222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f3f02a76-638f-4177-af7d-59a7450e4c67 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:57.183705 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f3f02a76-638f-4177-af7d-59a7450e4c67 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:57.184141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f3f02a76-638f-4177-af7d-59a7450e4c67 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:57.184826 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f3f02a76-638f-4177-af7d-59a7450e4c67 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:57.185279 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f3f02a76-638f-4177-af7d-59a7450e4c67 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:57.185785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f3f02a76-638f-4177-af7d-59a7450e4c67 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:57.212389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8d73dd7e-0888-446d-b102-a5e5e7cfdd41 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:57.220635 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8d73dd7e-0888-446d-b102-a5e5e7cfdd41 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084863 Aug 24 12:54:57.221535 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1646/3285] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:57 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:57.313889 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f3f02a76-638f-4177-af7d-59a7450e4c67 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:57.322139 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f3f02a76-638f-4177-af7d-59a7450e4c67 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149918 Aug 24 12:54:57.327141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1640/3286] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:57 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:54:57.579602 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-11c8abce-4b52-4a22-8f54-e018691632e2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:57.580286 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-11c8abce-4b52-4a22-8f54-e018691632e2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:57.586722 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11c8abce-4b52-4a22-8f54-e018691632e2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:57.587212 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11c8abce-4b52-4a22-8f54-e018691632e2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:57.587653 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11c8abce-4b52-4a22-8f54-e018691632e2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:57.588337 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11c8abce-4b52-4a22-8f54-e018691632e2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:57.588798 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11c8abce-4b52-4a22-8f54-e018691632e2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:57.589223 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11c8abce-4b52-4a22-8f54-e018691632e2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:57.713943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-11c8abce-4b52-4a22-8f54-e018691632e2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:57.722086 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-11c8abce-4b52-4a22-8f54-e018691632e2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.146357 Aug 24 12:54:57.722641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1647/3287] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:57 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:57.996360 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-835072b1-54ad-4b72-b736-c46ba62e5e20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:57.996966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-835072b1-54ad-4b72-b736-c46ba62e5e20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:58.003360 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-835072b1-54ad-4b72-b736-c46ba62e5e20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:58.003841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-835072b1-54ad-4b72-b736-c46ba62e5e20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:58.004277 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-835072b1-54ad-4b72-b736-c46ba62e5e20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:58.004958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-835072b1-54ad-4b72-b736-c46ba62e5e20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:58.005409 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-835072b1-54ad-4b72-b736-c46ba62e5e20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:58.005832 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-835072b1-54ad-4b72-b736-c46ba62e5e20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:58.132620 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-835072b1-54ad-4b72-b736-c46ba62e5e20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:58.141191 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-835072b1-54ad-4b72-b736-c46ba62e5e20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:58.142681 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-835072b1-54ad-4b72-b736-c46ba62e5e20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:58.143822 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-835072b1-54ad-4b72-b736-c46ba62e5e20 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.152117 Aug 24 12:54:58.144373 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1641/3288] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:57 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:58.241573 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f57ac99a-b855-4197-a765-27abebf43fe0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:58.242331 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f57ac99a-b855-4197-a765-27abebf43fe0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:58.249415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f57ac99a-b855-4197-a765-27abebf43fe0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:58.249843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f57ac99a-b855-4197-a765-27abebf43fe0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:58.250275 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f57ac99a-b855-4197-a765-27abebf43fe0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:58.251199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f57ac99a-b855-4197-a765-27abebf43fe0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:58.251653 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f57ac99a-b855-4197-a765-27abebf43fe0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:58.252107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f57ac99a-b855-4197-a765-27abebf43fe0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:58.314035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f57ac99a-b855-4197-a765-27abebf43fe0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:58.322131 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f57ac99a-b855-4197-a765-27abebf43fe0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084370 Aug 24 12:54:58.322705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1648/3289] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:58 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:58.342162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b27bda35-9b76-4301-af62-75c7b960042b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:58.342816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b27bda35-9b76-4301-af62-75c7b960042b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:58.348730 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b27bda35-9b76-4301-af62-75c7b960042b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:58.349243 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b27bda35-9b76-4301-af62-75c7b960042b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:58.349679 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b27bda35-9b76-4301-af62-75c7b960042b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:58.350387 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b27bda35-9b76-4301-af62-75c7b960042b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:58.350884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b27bda35-9b76-4301-af62-75c7b960042b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:58.351313 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b27bda35-9b76-4301-af62-75c7b960042b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:58.479444 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b27bda35-9b76-4301-af62-75c7b960042b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:58.487767 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b27bda35-9b76-4301-af62-75c7b960042b tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149421 Aug 24 12:54:58.488323 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1642/3290] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:58 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:58.743501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-15fc5ab8-a672-41e5-a0c6-60e4502aa050 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:58.744108 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-15fc5ab8-a672-41e5-a0c6-60e4502aa050 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:58.750010 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15fc5ab8-a672-41e5-a0c6-60e4502aa050 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:58.750486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15fc5ab8-a672-41e5-a0c6-60e4502aa050 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:58.750958 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15fc5ab8-a672-41e5-a0c6-60e4502aa050 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:58.751640 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15fc5ab8-a672-41e5-a0c6-60e4502aa050 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:58.752094 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15fc5ab8-a672-41e5-a0c6-60e4502aa050 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:58.752518 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15fc5ab8-a672-41e5-a0c6-60e4502aa050 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:58.879168 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-15fc5ab8-a672-41e5-a0c6-60e4502aa050 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:58.887246 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-15fc5ab8-a672-41e5-a0c6-60e4502aa050 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148202 Aug 24 12:54:58.887798 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1649/3291] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:58 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:59.167205 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d558aa8b-dcfe-4ef3-9fa1-c45ac992605d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:59.167808 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d558aa8b-dcfe-4ef3-9fa1-c45ac992605d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:59.174243 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d558aa8b-dcfe-4ef3-9fa1-c45ac992605d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:59.174745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d558aa8b-dcfe-4ef3-9fa1-c45ac992605d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:59.175176 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d558aa8b-dcfe-4ef3-9fa1-c45ac992605d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:59.175841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d558aa8b-dcfe-4ef3-9fa1-c45ac992605d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:59.176286 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d558aa8b-dcfe-4ef3-9fa1-c45ac992605d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:59.176704 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d558aa8b-dcfe-4ef3-9fa1-c45ac992605d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:59.303486 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d558aa8b-dcfe-4ef3-9fa1-c45ac992605d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:59.312091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d558aa8b-dcfe-4ef3-9fa1-c45ac992605d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:59.313577 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d558aa8b-dcfe-4ef3-9fa1-c45ac992605d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:59.314765 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d558aa8b-dcfe-4ef3-9fa1-c45ac992605d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.152009 Aug 24 12:54:59.315326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1643/3292] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:54:59 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:54:59.342674 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-90314ec1-e5e3-42ea-90bf-275336fe6de2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:59.343289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-90314ec1-e5e3-42ea-90bf-275336fe6de2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:59.349948 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-90314ec1-e5e3-42ea-90bf-275336fe6de2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:59.350428 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-90314ec1-e5e3-42ea-90bf-275336fe6de2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:59.350922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-90314ec1-e5e3-42ea-90bf-275336fe6de2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:59.351603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-90314ec1-e5e3-42ea-90bf-275336fe6de2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:59.352639 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-90314ec1-e5e3-42ea-90bf-275336fe6de2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:59.353063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-90314ec1-e5e3-42ea-90bf-275336fe6de2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:59.414544 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-90314ec1-e5e3-42ea-90bf-275336fe6de2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:59.422680 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-90314ec1-e5e3-42ea-90bf-275336fe6de2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083731 Aug 24 12:54:59.428002 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1650/3293] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:59 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:59.509493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a614b06c-0c65-443c-acef-506f916639d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:59.510149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a614b06c-0c65-443c-acef-506f916639d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:59.516013 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a614b06c-0c65-443c-acef-506f916639d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:59.516479 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a614b06c-0c65-443c-acef-506f916639d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:59.516904 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a614b06c-0c65-443c-acef-506f916639d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:59.517568 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a614b06c-0c65-443c-acef-506f916639d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:59.518019 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a614b06c-0c65-443c-acef-506f916639d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:59.518435 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a614b06c-0c65-443c-acef-506f916639d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:59.644748 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a614b06c-0c65-443c-acef-506f916639d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:54:59.653515 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a614b06c-0c65-443c-acef-506f916639d2 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.148473 Aug 24 12:54:59.654076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1644/3294] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:59 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:54:59.907600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3310bf47-6969-4898-9c8c-e43beedb7578 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:54:59.908211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3310bf47-6969-4898-9c8c-e43beedb7578 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:54:59.914183 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3310bf47-6969-4898-9c8c-e43beedb7578 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:59.914672 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3310bf47-6969-4898-9c8c-e43beedb7578 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:59.915124 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3310bf47-6969-4898-9c8c-e43beedb7578 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:54:59.915803 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3310bf47-6969-4898-9c8c-e43beedb7578 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:54:59.916256 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3310bf47-6969-4898-9c8c-e43beedb7578 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:54:59.916679 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3310bf47-6969-4898-9c8c-e43beedb7578 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:00.041562 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3310bf47-6969-4898-9c8c-e43beedb7578 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:00.049628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3310bf47-6969-4898-9c8c-e43beedb7578 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.145849 Aug 24 12:55:00.050180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1651/3295] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:54:59 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:00.337494 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2c36270d-b4e3-4c99-9931-79ea12c9ee08 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:00.338155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2c36270d-b4e3-4c99-9931-79ea12c9ee08 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:00.344356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c36270d-b4e3-4c99-9931-79ea12c9ee08 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:00.344828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c36270d-b4e3-4c99-9931-79ea12c9ee08 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:00.345286 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c36270d-b4e3-4c99-9931-79ea12c9ee08 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:00.345960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c36270d-b4e3-4c99-9931-79ea12c9ee08 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:00.346405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c36270d-b4e3-4c99-9931-79ea12c9ee08 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:00.346860 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2c36270d-b4e3-4c99-9931-79ea12c9ee08 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:00.442538 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6b9792c1-8c65-4749-a7e9-c0b7bbdea796 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:00.443179 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6b9792c1-8c65-4749-a7e9-c0b7bbdea796 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:00.449538 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b9792c1-8c65-4749-a7e9-c0b7bbdea796 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:00.450016 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b9792c1-8c65-4749-a7e9-c0b7bbdea796 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:00.450449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b9792c1-8c65-4749-a7e9-c0b7bbdea796 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:00.451179 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b9792c1-8c65-4749-a7e9-c0b7bbdea796 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:00.451614 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b9792c1-8c65-4749-a7e9-c0b7bbdea796 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:00.452037 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b9792c1-8c65-4749-a7e9-c0b7bbdea796 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:00.478264 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2c36270d-b4e3-4c99-9931-79ea12c9ee08 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:00.487344 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2c36270d-b4e3-4c99-9931-79ea12c9ee08 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:00.488927 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2c36270d-b4e3-4c99-9931-79ea12c9ee08 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:00.490087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2c36270d-b4e3-4c99-9931-79ea12c9ee08 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 200 len: 1802 microversion: 2.20 time: 0.156617 Aug 24 12:55:00.490767 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1645/3296] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:55:00 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:55:00.513227 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5c8d3a5d-f01a-45da-adc2-c72750a6a016 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '.version_select at 0x7f76f54b7d30>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:00.516632 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6b9792c1-8c65-4749-a7e9-c0b7bbdea796 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:00.528196 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6b9792c1-8c65-4749-a7e9-c0b7bbdea796 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.089391 Aug 24 12:55:00.528756 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1652/3297] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:00 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:00.605391 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5c8d3a5d-f01a-45da-adc2-c72750a6a016 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-491279861" status: 204 len: 0 microversion: 2.20 time: 0.095933 Aug 24 12:55:00.605972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1646/3298] 10.222.0.45 () {60 vars in 1259 bytes} [Wed Aug 24 12:55:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-491279861 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 12:55:00.673823 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-64c561f0-5ee6-41f8-bebe-03c90d3f0afa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:00.674469 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-64c561f0-5ee6-41f8-bebe-03c90d3f0afa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:00.680396 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-64c561f0-5ee6-41f8-bebe-03c90d3f0afa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:00.680886 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-64c561f0-5ee6-41f8-bebe-03c90d3f0afa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:00.681328 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-64c561f0-5ee6-41f8-bebe-03c90d3f0afa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:00.682022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-64c561f0-5ee6-41f8-bebe-03c90d3f0afa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:00.682485 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-64c561f0-5ee6-41f8-bebe-03c90d3f0afa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:00.682943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-64c561f0-5ee6-41f8-bebe-03c90d3f0afa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:00.896326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-64c561f0-5ee6-41f8-bebe-03c90d3f0afa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:00.905095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-64c561f0-5ee6-41f8-bebe-03c90d3f0afa tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.235102 Aug 24 12:55:00.905884 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1653/3299] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:00 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:01.071259 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c05f1dbc-8975-440b-bfe6-5344cd61f296 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:01.071818 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c05f1dbc-8975-440b-bfe6-5344cd61f296 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:01.077996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c05f1dbc-8975-440b-bfe6-5344cd61f296 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:01.078474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c05f1dbc-8975-440b-bfe6-5344cd61f296 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:01.078934 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c05f1dbc-8975-440b-bfe6-5344cd61f296 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:01.079619 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c05f1dbc-8975-440b-bfe6-5344cd61f296 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:01.080117 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c05f1dbc-8975-440b-bfe6-5344cd61f296 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:01.080535 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c05f1dbc-8975-440b-bfe6-5344cd61f296 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:01.207310 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c05f1dbc-8975-440b-bfe6-5344cd61f296 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:01.215494 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c05f1dbc-8975-440b-bfe6-5344cd61f296 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148624 Aug 24 12:55:01.216052 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1647/3300] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:01 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:01.549506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-72aca4b2-53e2-4a7e-91a0-f36dbc411661 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:01.550127 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-72aca4b2-53e2-4a7e-91a0-f36dbc411661 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:01.556990 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72aca4b2-53e2-4a7e-91a0-f36dbc411661 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:01.557480 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72aca4b2-53e2-4a7e-91a0-f36dbc411661 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:01.557912 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72aca4b2-53e2-4a7e-91a0-f36dbc411661 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:01.558597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72aca4b2-53e2-4a7e-91a0-f36dbc411661 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:01.559087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72aca4b2-53e2-4a7e-91a0-f36dbc411661 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:01.559514 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-72aca4b2-53e2-4a7e-91a0-f36dbc411661 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:01.651514 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-72aca4b2-53e2-4a7e-91a0-f36dbc411661 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:01.660310 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-72aca4b2-53e2-4a7e-91a0-f36dbc411661 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.114594 Aug 24 12:55:01.660934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1654/3301] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:01 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:01.796291 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-06af9b2f-2e21-4ddd-923b-c412b205fae7 req-f83181d4-44e2-4f79-b21c-9ea0727483a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e5a10ee-202a-453e-b3ff-6c5c05ec72f3", "tag": "65aeb21b-342d-4c27-963d-8c021915548c"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:55:01.806616 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-06af9b2f-2e21-4ddd-923b-c412b205fae7 req-f83181d4-44e2-4f79-b21c-9ea0727483a3 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:01.807113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-06af9b2f-2e21-4ddd-923b-c412b205fae7 req-f83181d4-44e2-4f79-b21c-9ea0727483a3 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:01.807788 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-06af9b2f-2e21-4ddd-923b-c412b205fae7 req-f83181d4-44e2-4f79-b21c-9ea0727483a3 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:01.818714 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-06af9b2f-2e21-4ddd-923b-c412b205fae7 req-f83181d4-44e2-4f79-b21c-9ea0727483a3 service nova] Creating event network-changed:65aeb21b-342d-4c27-963d-8c021915548c for instance 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 on hv-cinder-84889 Aug 24 12:55:01.824468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-06af9b2f-2e21-4ddd-923b-c412b205fae7 req-f83181d4-44e2-4f79-b21c-9ea0727483a3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097813 Aug 24 12:55:01.825061 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1648/3302] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:55:01.925786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dee04bd2-142f-438a-bbc3-bc972fbbdf1a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:01.926483 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dee04bd2-142f-438a-bbc3-bc972fbbdf1a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:01.933674 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dee04bd2-142f-438a-bbc3-bc972fbbdf1a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:01.934512 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dee04bd2-142f-438a-bbc3-bc972fbbdf1a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:01.935177 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dee04bd2-142f-438a-bbc3-bc972fbbdf1a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:01.936105 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dee04bd2-142f-438a-bbc3-bc972fbbdf1a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:01.936889 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dee04bd2-142f-438a-bbc3-bc972fbbdf1a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:01.937378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dee04bd2-142f-438a-bbc3-bc972fbbdf1a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:01.998706 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-167b0036-6597-45ba-b344-208d4fdb06df tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Action: 'create', calling method: .version_select at 0x7f76f54b78b0>, body: {"keypair": {"name": "tempest-keypair-744678341", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5GXVYjzAraw3lP8qCvWgX3Zi/loBa9+TTnkFF1GKpoOjTqz5OinKQM1+KwCQfR15MYz2N/WvEgaZxi+4MZAAlw1tsYKCAZH1cSUr4vUJsAKEeE3F0toGf0Cv3+GGxdvQ=="}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:55:02.029631 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-167b0036-6597-45ba-b344-208d4fdb06df tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Getting quotas for project 504b03560cf34426a08958b471c91646. Resources: {'key_pairs'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:55:02.035428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-167b0036-6597-45ba-b344-208d4fdb06df tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Getting quotas for user 6b94f244190e4af089d070ad83806c38 and project 504b03560cf34426a08958b471c91646. Resources: {'key_pairs'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:55:02.083822 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-dee04bd2-142f-438a-bbc3-bc972fbbdf1a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:02.086834 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:55:02.097139 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dee04bd2-142f-438a-bbc3-bc972fbbdf1a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.174789 Aug 24 12:55:02.099261 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1655/3303] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:01 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:02.166170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-167b0036-6597-45ba-b344-208d4fdb06df tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.173755 Aug 24 12:55:02.167066 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1649/3304] 10.222.0.45 () {62 vars in 1200 bytes} [Wed Aug 24 12:55:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 176 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 12:55:02.237986 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0948c1fa-2f82-4225-830a-4f21e2af7350 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:02.239035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0948c1fa-2f82-4225-830a-4f21e2af7350 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:02.247194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0948c1fa-2f82-4225-830a-4f21e2af7350 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:02.248286 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0948c1fa-2f82-4225-830a-4f21e2af7350 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:02.248971 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0948c1fa-2f82-4225-830a-4f21e2af7350 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:02.249931 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0948c1fa-2f82-4225-830a-4f21e2af7350 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:02.250704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0948c1fa-2f82-4225-830a-4f21e2af7350 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:02.251404 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0948c1fa-2f82-4225-830a-4f21e2af7350 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:02.428961 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0948c1fa-2f82-4225-830a-4f21e2af7350 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:02.437594 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0948c1fa-2f82-4225-830a-4f21e2af7350 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.204448 Aug 24 12:55:02.451737 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1656/3305] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:02 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:02.682401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a241cc12-2150-4887-ae0c-ac40f90884a7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:02.683162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a241cc12-2150-4887-ae0c-ac40f90884a7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:02.689866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a241cc12-2150-4887-ae0c-ac40f90884a7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:02.690379 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a241cc12-2150-4887-ae0c-ac40f90884a7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:02.690924 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a241cc12-2150-4887-ae0c-ac40f90884a7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:02.691649 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a241cc12-2150-4887-ae0c-ac40f90884a7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:02.692102 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a241cc12-2150-4887-ae0c-ac40f90884a7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:02.692522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a241cc12-2150-4887-ae0c-ac40f90884a7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:02.768597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a241cc12-2150-4887-ae0c-ac40f90884a7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:02.778642 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a241cc12-2150-4887-ae0c-ac40f90884a7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.100188 Aug 24 12:55:02.792486 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1650/3306] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:02 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:03.120176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b4e7b8ba-3286-46d5-a3e2-d05636c93397 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:03.120787 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b4e7b8ba-3286-46d5-a3e2-d05636c93397 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:03.127181 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4e7b8ba-3286-46d5-a3e2-d05636c93397 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:03.127660 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4e7b8ba-3286-46d5-a3e2-d05636c93397 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:03.128096 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4e7b8ba-3286-46d5-a3e2-d05636c93397 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:03.128788 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4e7b8ba-3286-46d5-a3e2-d05636c93397 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:03.129245 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4e7b8ba-3286-46d5-a3e2-d05636c93397 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:03.129671 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4e7b8ba-3286-46d5-a3e2-d05636c93397 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:03.261106 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b4e7b8ba-3286-46d5-a3e2-d05636c93397 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:03.269392 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b4e7b8ba-3286-46d5-a3e2-d05636c93397 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.153834 Aug 24 12:55:03.269949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1657/3307] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:03 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:03.461404 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-285f58ea-0ebe-454e-97ea-8982f75dbb55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:03.462016 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-285f58ea-0ebe-454e-97ea-8982f75dbb55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:03.467948 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-285f58ea-0ebe-454e-97ea-8982f75dbb55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:03.468428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-285f58ea-0ebe-454e-97ea-8982f75dbb55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:03.468870 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-285f58ea-0ebe-454e-97ea-8982f75dbb55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:03.469551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-285f58ea-0ebe-454e-97ea-8982f75dbb55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:03.470008 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-285f58ea-0ebe-454e-97ea-8982f75dbb55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:03.470435 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-285f58ea-0ebe-454e-97ea-8982f75dbb55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:03.622140 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-285f58ea-0ebe-454e-97ea-8982f75dbb55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:03.630433 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-285f58ea-0ebe-454e-97ea-8982f75dbb55 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.172957 Aug 24 12:55:03.631027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1651/3308] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:03 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:03.800805 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b64850c8-47b9-49bb-afd2-da2065931bce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:03.801439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b64850c8-47b9-49bb-afd2-da2065931bce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:03.807837 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b64850c8-47b9-49bb-afd2-da2065931bce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:03.808324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b64850c8-47b9-49bb-afd2-da2065931bce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:03.808763 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b64850c8-47b9-49bb-afd2-da2065931bce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:03.809460 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b64850c8-47b9-49bb-afd2-da2065931bce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:03.809918 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b64850c8-47b9-49bb-afd2-da2065931bce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:03.810345 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b64850c8-47b9-49bb-afd2-da2065931bce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:03.875935 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b64850c8-47b9-49bb-afd2-da2065931bce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:03.884405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b64850c8-47b9-49bb-afd2-da2065931bce tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.088274 Aug 24 12:55:03.884963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1658/3309] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:03 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:04.290036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1c18dacc-b35d-4608-a56f-cb1d2f0559a7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:04.290676 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1c18dacc-b35d-4608-a56f-cb1d2f0559a7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:04.296969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c18dacc-b35d-4608-a56f-cb1d2f0559a7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:04.297453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c18dacc-b35d-4608-a56f-cb1d2f0559a7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:04.297892 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c18dacc-b35d-4608-a56f-cb1d2f0559a7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:04.298583 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c18dacc-b35d-4608-a56f-cb1d2f0559a7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:04.299066 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c18dacc-b35d-4608-a56f-cb1d2f0559a7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:04.299494 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1c18dacc-b35d-4608-a56f-cb1d2f0559a7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:04.485307 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1c18dacc-b35d-4608-a56f-cb1d2f0559a7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:04.494351 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1c18dacc-b35d-4608-a56f-cb1d2f0559a7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.208771 Aug 24 12:55:04.494949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1652/3310] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:04 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:04.651496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ed846f58-e9b5-4182-ada1-40aacf4ffd04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:04.652152 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ed846f58-e9b5-4182-ada1-40aacf4ffd04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:04.658638 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ed846f58-e9b5-4182-ada1-40aacf4ffd04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:04.659249 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ed846f58-e9b5-4182-ada1-40aacf4ffd04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:04.659687 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ed846f58-e9b5-4182-ada1-40aacf4ffd04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:04.660372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ed846f58-e9b5-4182-ada1-40aacf4ffd04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:04.660825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ed846f58-e9b5-4182-ada1-40aacf4ffd04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:04.661278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ed846f58-e9b5-4182-ada1-40aacf4ffd04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:04.801427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-795529da-d912-4ee3-8242-75e00c450867 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2028390673", "imageRef": "62fcb2c8-bff4-46cf-9892-c43d7626629e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0bd50a11-ed3e-433c-846d-0a63b9713335"}], "security_groups": [{"name": "tempest-securitygroup--1476439073"}], "key_name": "tempest-keypair-744678341", "user_data": "}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:55:04.802128 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ed846f58-e9b5-4182-ada1-40aacf4ffd04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:04.811070 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ed846f58-e9b5-4182-ada1-40aacf4ffd04 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.163398 Aug 24 12:55:04.811638 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1659/3311] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:04 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:04.903951 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.network.neutron [None req-795529da-d912-4ee3-8242-75e00c450867 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] validate_networks() for [('0bd50a11-ed3e-433c-846d-0a63b9713335', None, None, None, None, None)] {{(pid=121171) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:55:04.905995 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6c3e3f5d-0eb6-4c52-9ea4-7211ad6bc088 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:04.906661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6c3e3f5d-0eb6-4c52-9ea4-7211ad6bc088 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:04.912719 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6c3e3f5d-0eb6-4c52-9ea4-7211ad6bc088 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:04.913229 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6c3e3f5d-0eb6-4c52-9ea4-7211ad6bc088 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:04.913657 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6c3e3f5d-0eb6-4c52-9ea4-7211ad6bc088 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:04.914368 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6c3e3f5d-0eb6-4c52-9ea4-7211ad6bc088 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:04.914875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6c3e3f5d-0eb6-4c52-9ea4-7211ad6bc088 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:04.915850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6c3e3f5d-0eb6-4c52-9ea4-7211ad6bc088 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:04.982729 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6c3e3f5d-0eb6-4c52-9ea4-7211ad6bc088 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:04.991622 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6c3e3f5d-0eb6-4c52-9ea4-7211ad6bc088 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.089636 Aug 24 12:55:04.992198 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1660/3312] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:04 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:05.353869 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-795529da-d912-4ee3-8242-75e00c450867 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Flavor limits 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:55:05.354292 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-795529da-d912-4ee3-8242-75e00c450867 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Image limits 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:55:05.354804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-795529da-d912-4ee3-8242-75e00c450867 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Flavor pref 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:55:05.355215 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-795529da-d912-4ee3-8242-75e00c450867 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Image pref 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:55:05.355627 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-795529da-d912-4ee3-8242-75e00c450867 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:55:05.365474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-795529da-d912-4ee3-8242-75e00c450867 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:05.365899 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-795529da-d912-4ee3-8242-75e00c450867 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:05.366335 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-795529da-d912-4ee3-8242-75e00c450867 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:05.367097 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-795529da-d912-4ee3-8242-75e00c450867 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:05.367555 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-795529da-d912-4ee3-8242-75e00c450867 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:05.367986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-795529da-d912-4ee3-8242-75e00c450867 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:05.384634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-795529da-d912-4ee3-8242-75e00c450867 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Getting quotas for project 504b03560cf34426a08958b471c91646. Resources: {'instances', 'cores', 'ram'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:55:05.388545 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-795529da-d912-4ee3-8242-75e00c450867 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Getting quotas for user 6b94f244190e4af089d070ad83806c38 and project 504b03560cf34426a08958b471c91646. Resources: {'instances', 'cores', 'ram'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:55:05.399263 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-795529da-d912-4ee3-8242-75e00c450867 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Going to run 1 instances... {{(pid=121171) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:55:05.402144 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-795529da-d912-4ee3-8242-75e00c450867 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='62fcb2c8-bff4-46cf-9892-c43d7626629e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:55:05.516191 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dde07393-9433-4b67-a605-5c8a04d8c5ee tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:05.516838 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dde07393-9433-4b67-a605-5c8a04d8c5ee tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:05.522887 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dde07393-9433-4b67-a605-5c8a04d8c5ee tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:05.523378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dde07393-9433-4b67-a605-5c8a04d8c5ee tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:05.523819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dde07393-9433-4b67-a605-5c8a04d8c5ee tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:05.524519 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dde07393-9433-4b67-a605-5c8a04d8c5ee tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:05.525541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dde07393-9433-4b67-a605-5c8a04d8c5ee tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:05.525970 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dde07393-9433-4b67-a605-5c8a04d8c5ee tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:05.562225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-795529da-d912-4ee3-8242-75e00c450867 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.764984 Aug 24 12:55:05.569617 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1653/3313] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Aug 24 12:55:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 12:55:05.576686 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ed93740b-b241-416e-afa7-860df6d2fb4f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:05.577298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ed93740b-b241-416e-afa7-860df6d2fb4f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:05.643716 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ed93740b-b241-416e-afa7-860df6d2fb4f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:05.652208 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ed93740b-b241-416e-afa7-860df6d2fb4f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:05.653766 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ed93740b-b241-416e-afa7-860df6d2fb4f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:05.654938 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ed93740b-b241-416e-afa7-860df6d2fb4f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124" status: 200 len: 1281 microversion: 2.20 time: 0.084300 Aug 24 12:55:05.655686 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1654/3314] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:55:05 2022] GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 => generated 1281 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:55:05.693603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-dde07393-9433-4b67-a605-5c8a04d8c5ee tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:05.702915 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dde07393-9433-4b67-a605-5c8a04d8c5ee tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.190581 Aug 24 12:55:05.703477 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1661/3315] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:05 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:05.832745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2ae479c2-4757-4041-8a1e-fe6f8d361dc9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:05.833357 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2ae479c2-4757-4041-8a1e-fe6f8d361dc9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:05.841761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ae479c2-4757-4041-8a1e-fe6f8d361dc9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:05.842281 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ae479c2-4757-4041-8a1e-fe6f8d361dc9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:05.842760 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ae479c2-4757-4041-8a1e-fe6f8d361dc9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:05.843461 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ae479c2-4757-4041-8a1e-fe6f8d361dc9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:05.843910 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ae479c2-4757-4041-8a1e-fe6f8d361dc9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:05.844333 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ae479c2-4757-4041-8a1e-fe6f8d361dc9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:05.998317 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2ae479c2-4757-4041-8a1e-fe6f8d361dc9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:06.008299 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2ae479c2-4757-4041-8a1e-fe6f8d361dc9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.179504 Aug 24 12:55:06.008881 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1655/3316] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:05 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:06.019677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-01309c08-1d04-41dd-8234-0417484e02f1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:06.020635 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-01309c08-1d04-41dd-8234-0417484e02f1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:06.030802 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01309c08-1d04-41dd-8234-0417484e02f1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:06.031856 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01309c08-1d04-41dd-8234-0417484e02f1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:06.033679 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01309c08-1d04-41dd-8234-0417484e02f1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:06.034807 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01309c08-1d04-41dd-8234-0417484e02f1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:06.035627 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01309c08-1d04-41dd-8234-0417484e02f1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:06.041523 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01309c08-1d04-41dd-8234-0417484e02f1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:06.112589 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-01309c08-1d04-41dd-8234-0417484e02f1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:06.121787 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-01309c08-1d04-41dd-8234-0417484e02f1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.111311 Aug 24 12:55:06.122347 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1662/3317] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:06 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:06.677655 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ea9d398e-903b-4116-bcd6-5e3281e8e463 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:06.678122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ea9d398e-903b-4116-bcd6-5e3281e8e463 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:06.680734 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:55:06.685964 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea9d398e-903b-4116-bcd6-5e3281e8e463 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:06.687101 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea9d398e-903b-4116-bcd6-5e3281e8e463 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:06.687550 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea9d398e-903b-4116-bcd6-5e3281e8e463 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:06.688673 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea9d398e-903b-4116-bcd6-5e3281e8e463 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:06.689140 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea9d398e-903b-4116-bcd6-5e3281e8e463 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:06.689640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea9d398e-903b-4116-bcd6-5e3281e8e463 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:06.726217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f79f01ec-7eb1-4d1d-84c6-696fe97a4ba9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:06.727624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f79f01ec-7eb1-4d1d-84c6-696fe97a4ba9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:06.737560 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f79f01ec-7eb1-4d1d-84c6-696fe97a4ba9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:06.738212 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f79f01ec-7eb1-4d1d-84c6-696fe97a4ba9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:06.739470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f79f01ec-7eb1-4d1d-84c6-696fe97a4ba9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:06.740217 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f79f01ec-7eb1-4d1d-84c6-696fe97a4ba9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:06.740679 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f79f01ec-7eb1-4d1d-84c6-696fe97a4ba9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:06.741107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f79f01ec-7eb1-4d1d-84c6-696fe97a4ba9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:06.755830 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ea9d398e-903b-4116-bcd6-5e3281e8e463 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:06.766526 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ea9d398e-903b-4116-bcd6-5e3281e8e463 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:06.768285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ea9d398e-903b-4116-bcd6-5e3281e8e463 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:06.769497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ea9d398e-903b-4116-bcd6-5e3281e8e463 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124" status: 200 len: 1285 microversion: 2.20 time: 0.095949 Aug 24 12:55:06.770188 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1656/3318] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:55:06 2022] GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 => generated 1285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:55:06.883070 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f79f01ec-7eb1-4d1d-84c6-696fe97a4ba9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:06.892004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f79f01ec-7eb1-4d1d-84c6-696fe97a4ba9 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.171093 Aug 24 12:55:06.892575 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1663/3319] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:06 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:07.029862 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e2a5deb2-8205-4f3a-b257-560417916f79 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:07.030489 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e2a5deb2-8205-4f3a-b257-560417916f79 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:07.036926 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2a5deb2-8205-4f3a-b257-560417916f79 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:07.037410 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2a5deb2-8205-4f3a-b257-560417916f79 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:07.037854 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2a5deb2-8205-4f3a-b257-560417916f79 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:07.038536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2a5deb2-8205-4f3a-b257-560417916f79 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:07.039014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2a5deb2-8205-4f3a-b257-560417916f79 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:07.039440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2a5deb2-8205-4f3a-b257-560417916f79 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:07.142680 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-33ab9765-925a-47e9-831e-2be8c8ed4b12 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:07.143345 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-33ab9765-925a-47e9-831e-2be8c8ed4b12 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:07.149186 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33ab9765-925a-47e9-831e-2be8c8ed4b12 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:07.149676 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33ab9765-925a-47e9-831e-2be8c8ed4b12 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:07.150112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33ab9765-925a-47e9-831e-2be8c8ed4b12 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:07.151689 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33ab9765-925a-47e9-831e-2be8c8ed4b12 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:07.152149 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33ab9765-925a-47e9-831e-2be8c8ed4b12 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:07.152580 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-33ab9765-925a-47e9-831e-2be8c8ed4b12 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:07.172236 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e2a5deb2-8205-4f3a-b257-560417916f79 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:07.181068 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e2a5deb2-8205-4f3a-b257-560417916f79 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.155524 Aug 24 12:55:07.181645 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1657/3320] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:07 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:07.217091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-33ab9765-925a-47e9-831e-2be8c8ed4b12 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:07.225304 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-33ab9765-925a-47e9-831e-2be8c8ed4b12 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.086392 Aug 24 12:55:07.225799 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1664/3321] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:07 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:07.792489 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-01a7f4ec-6c2b-4b53-9b19-6d2a29322e9c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:07.793202 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-01a7f4ec-6c2b-4b53-9b19-6d2a29322e9c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:07.799536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01a7f4ec-6c2b-4b53-9b19-6d2a29322e9c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:07.800016 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01a7f4ec-6c2b-4b53-9b19-6d2a29322e9c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:07.800447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01a7f4ec-6c2b-4b53-9b19-6d2a29322e9c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:07.801149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01a7f4ec-6c2b-4b53-9b19-6d2a29322e9c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:07.801603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01a7f4ec-6c2b-4b53-9b19-6d2a29322e9c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:07.802020 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01a7f4ec-6c2b-4b53-9b19-6d2a29322e9c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:07.818436 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:55:07.888329 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-01a7f4ec-6c2b-4b53-9b19-6d2a29322e9c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:07.896873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-01a7f4ec-6c2b-4b53-9b19-6d2a29322e9c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:07.898461 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-01a7f4ec-6c2b-4b53-9b19-6d2a29322e9c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:07.899726 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-01a7f4ec-6c2b-4b53-9b19-6d2a29322e9c tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124" status: 200 len: 1341 microversion: 2.20 time: 0.111653 Aug 24 12:55:07.900288 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1658/3322] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:55:07 2022] GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 => generated 1341 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:55:07.913345 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-cd28c894-79dc-4a8a-aeea-a819b20a7145 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:07.914176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-cd28c894-79dc-4a8a-aeea-a819b20a7145 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:07.921438 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd28c894-79dc-4a8a-aeea-a819b20a7145 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:07.923781 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd28c894-79dc-4a8a-aeea-a819b20a7145 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:07.923781 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd28c894-79dc-4a8a-aeea-a819b20a7145 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:07.923781 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd28c894-79dc-4a8a-aeea-a819b20a7145 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:07.923781 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd28c894-79dc-4a8a-aeea-a819b20a7145 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:07.924233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd28c894-79dc-4a8a-aeea-a819b20a7145 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:08.057936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-cd28c894-79dc-4a8a-aeea-a819b20a7145 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:08.066413 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-cd28c894-79dc-4a8a-aeea-a819b20a7145 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.156935 Aug 24 12:55:08.067067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1665/3323] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:07 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:08.203299 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6c1020d1-aef0-4d58-91af-efd3f48c2983 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:08.203942 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6c1020d1-aef0-4d58-91af-efd3f48c2983 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:08.209799 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c1020d1-aef0-4d58-91af-efd3f48c2983 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:08.210295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c1020d1-aef0-4d58-91af-efd3f48c2983 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:08.210780 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c1020d1-aef0-4d58-91af-efd3f48c2983 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:08.211469 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c1020d1-aef0-4d58-91af-efd3f48c2983 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:08.211927 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c1020d1-aef0-4d58-91af-efd3f48c2983 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:08.212356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c1020d1-aef0-4d58-91af-efd3f48c2983 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:08.245628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-17f59dd3-ce92-4886-9d2f-45f5cac8e785 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:08.246394 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-17f59dd3-ce92-4886-9d2f-45f5cac8e785 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:08.248332 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:55:08.254110 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-17f59dd3-ce92-4886-9d2f-45f5cac8e785 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:08.254601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-17f59dd3-ce92-4886-9d2f-45f5cac8e785 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:08.258076 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-17f59dd3-ce92-4886-9d2f-45f5cac8e785 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:08.258076 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-17f59dd3-ce92-4886-9d2f-45f5cac8e785 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:08.258076 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-17f59dd3-ce92-4886-9d2f-45f5cac8e785 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:08.258076 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-17f59dd3-ce92-4886-9d2f-45f5cac8e785 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:08.319709 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-17f59dd3-ce92-4886-9d2f-45f5cac8e785 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:08.328741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-17f59dd3-ce92-4886-9d2f-45f5cac8e785 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.086919 Aug 24 12:55:08.329418 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1666/3324] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:08 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:08.407364 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6c1020d1-aef0-4d58-91af-efd3f48c2983 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:08.415586 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6c1020d1-aef0-4d58-91af-efd3f48c2983 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.216270 Aug 24 12:55:08.416355 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1659/3325] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:08 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:08.922622 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fe5bec86-0b0f-4a34-85bb-19695d11823d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:08.923362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fe5bec86-0b0f-4a34-85bb-19695d11823d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:08.929677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe5bec86-0b0f-4a34-85bb-19695d11823d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:08.930235 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe5bec86-0b0f-4a34-85bb-19695d11823d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:08.930773 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe5bec86-0b0f-4a34-85bb-19695d11823d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:08.931536 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe5bec86-0b0f-4a34-85bb-19695d11823d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:08.932569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe5bec86-0b0f-4a34-85bb-19695d11823d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:08.933258 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe5bec86-0b0f-4a34-85bb-19695d11823d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:09.060293 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fe5bec86-0b0f-4a34-85bb-19695d11823d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:09.068374 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fe5bec86-0b0f-4a34-85bb-19695d11823d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:09.069856 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fe5bec86-0b0f-4a34-85bb-19695d11823d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:09.070991 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fe5bec86-0b0f-4a34-85bb-19695d11823d tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124" status: 200 len: 1407 microversion: 2.20 time: 0.152330 Aug 24 12:55:09.071537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1667/3326] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:55:08 2022] GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:55:09.087744 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2ae10f97-ce53-4641-a294-e9ca97bd6c30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:09.088583 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2ae10f97-ce53-4641-a294-e9ca97bd6c30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:09.095084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ae10f97-ce53-4641-a294-e9ca97bd6c30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:09.098206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ae10f97-ce53-4641-a294-e9ca97bd6c30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:09.098206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ae10f97-ce53-4641-a294-e9ca97bd6c30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:09.098206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ae10f97-ce53-4641-a294-e9ca97bd6c30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:09.098206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ae10f97-ce53-4641-a294-e9ca97bd6c30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:09.098631 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ae10f97-ce53-4641-a294-e9ca97bd6c30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:09.293127 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2ae10f97-ce53-4641-a294-e9ca97bd6c30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:09.301276 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2ae10f97-ce53-4641-a294-e9ca97bd6c30 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.217491 Aug 24 12:55:09.301847 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1660/3327] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:09 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:09.349435 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c1edf615-54f0-4522-b127-683c65922f20 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:09.350053 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c1edf615-54f0-4522-b127-683c65922f20 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:09.356528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1edf615-54f0-4522-b127-683c65922f20 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:09.357016 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1edf615-54f0-4522-b127-683c65922f20 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:09.357459 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1edf615-54f0-4522-b127-683c65922f20 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:09.358189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1edf615-54f0-4522-b127-683c65922f20 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:09.358666 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1edf615-54f0-4522-b127-683c65922f20 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:09.364592 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c1edf615-54f0-4522-b127-683c65922f20 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:09.420931 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c1edf615-54f0-4522-b127-683c65922f20 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:09.431864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c1edf615-54f0-4522-b127-683c65922f20 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.086219 Aug 24 12:55:09.433023 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1668/3328] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:09 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:09.436661 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-28b5e2c5-fb18-49e6-9dfb-441df341b170 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:09.437276 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-28b5e2c5-fb18-49e6-9dfb-441df341b170 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:09.443313 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28b5e2c5-fb18-49e6-9dfb-441df341b170 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:09.445110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28b5e2c5-fb18-49e6-9dfb-441df341b170 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:09.445110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28b5e2c5-fb18-49e6-9dfb-441df341b170 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:09.445110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28b5e2c5-fb18-49e6-9dfb-441df341b170 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:09.445463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28b5e2c5-fb18-49e6-9dfb-441df341b170 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:09.445795 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-28b5e2c5-fb18-49e6-9dfb-441df341b170 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:09.468091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-3615d844-008a-4dc5-998a-60ffae49c991 req-9038ebd1-1162-4141-9285-2deafdf32384 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ac9d8b8-cbcb-4861-9139-e5d6f7c97124", "tag": "4f158522-8fdb-41d0-82a1-ac1110e72623"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:55:09.480177 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-3615d844-008a-4dc5-998a-60ffae49c991 req-9038ebd1-1162-4141-9285-2deafdf32384 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:09.481034 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-3615d844-008a-4dc5-998a-60ffae49c991 req-9038ebd1-1162-4141-9285-2deafdf32384 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:09.481471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-3615d844-008a-4dc5-998a-60ffae49c991 req-9038ebd1-1162-4141-9285-2deafdf32384 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:09.494187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-3615d844-008a-4dc5-998a-60ffae49c991 req-9038ebd1-1162-4141-9285-2deafdf32384 service nova] Creating event network-changed:4f158522-8fdb-41d0-82a1-ac1110e72623 for instance 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 on hv-cinder-84889 Aug 24 12:55:09.497482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR oslo.messaging._drivers.impl_rabbit [req-3615d844-008a-4dc5-998a-60ffae49c991 req-9038ebd1-1162-4141-9285-2deafdf32384 service nova] [8e7a7ce7-00a0-492b-b53b-62a71173bff0] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 12:55:09.596551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-28b5e2c5-fb18-49e6-9dfb-441df341b170 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:09.605437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-28b5e2c5-fb18-49e6-9dfb-441df341b170 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.173223 Aug 24 12:55:09.606102 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1661/3329] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:09 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:10.093941 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7846e2d4-1f87-4b6a-a91b-e0eea5cbc0a9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:10.094601 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7846e2d4-1f87-4b6a-a91b-e0eea5cbc0a9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:10.100836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7846e2d4-1f87-4b6a-a91b-e0eea5cbc0a9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:10.103343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7846e2d4-1f87-4b6a-a91b-e0eea5cbc0a9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:10.103343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7846e2d4-1f87-4b6a-a91b-e0eea5cbc0a9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:10.103343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7846e2d4-1f87-4b6a-a91b-e0eea5cbc0a9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:10.103343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7846e2d4-1f87-4b6a-a91b-e0eea5cbc0a9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:10.103759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7846e2d4-1f87-4b6a-a91b-e0eea5cbc0a9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:10.230736 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7846e2d4-1f87-4b6a-a91b-e0eea5cbc0a9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:10.241814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7846e2d4-1f87-4b6a-a91b-e0eea5cbc0a9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:10.243336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7846e2d4-1f87-4b6a-a91b-e0eea5cbc0a9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:10.244450 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7846e2d4-1f87-4b6a-a91b-e0eea5cbc0a9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124" status: 200 len: 1407 microversion: 2.20 time: 0.154450 Aug 24 12:55:10.245719 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1662/3330] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:55:10 2022] GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:55:10.323350 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7418e783-4918-4b92-9ef8-1293735fa3ba tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:10.323893 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7418e783-4918-4b92-9ef8-1293735fa3ba tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:10.329772 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7418e783-4918-4b92-9ef8-1293735fa3ba tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:10.330253 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7418e783-4918-4b92-9ef8-1293735fa3ba tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:10.330711 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7418e783-4918-4b92-9ef8-1293735fa3ba tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:10.331388 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7418e783-4918-4b92-9ef8-1293735fa3ba tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:10.331838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7418e783-4918-4b92-9ef8-1293735fa3ba tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:10.332261 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7418e783-4918-4b92-9ef8-1293735fa3ba tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:10.460986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7418e783-4918-4b92-9ef8-1293735fa3ba tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:10.469109 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7418e783-4918-4b92-9ef8-1293735fa3ba tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150190 Aug 24 12:55:10.469666 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1663/3331] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:10 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:10.474028 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-be3eae30-eb23-4bbb-9657-f95806b0d541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:10.474629 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-be3eae30-eb23-4bbb-9657-f95806b0d541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:10.480093 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be3eae30-eb23-4bbb-9657-f95806b0d541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:10.480576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be3eae30-eb23-4bbb-9657-f95806b0d541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:10.481014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be3eae30-eb23-4bbb-9657-f95806b0d541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:10.481695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be3eae30-eb23-4bbb-9657-f95806b0d541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:10.482150 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be3eae30-eb23-4bbb-9657-f95806b0d541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:10.482579 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be3eae30-eb23-4bbb-9657-f95806b0d541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:10.504818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [req-3615d844-008a-4dc5-998a-60ffae49c991 req-9038ebd1-1162-4141-9285-2deafdf32384 service nova] [8e7a7ce7-00a0-492b-b53b-62a71173bff0] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 44854. Aug 24 12:55:10.508307 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-3615d844-008a-4dc5-998a-60ffae49c991 req-9038ebd1-1162-4141-9285-2deafdf32384 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.045759 Aug 24 12:55:10.508905 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1669/3332] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:55:10.544003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-be3eae30-eb23-4bbb-9657-f95806b0d541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:10.552201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-be3eae30-eb23-4bbb-9657-f95806b0d541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081605 Aug 24 12:55:10.552764 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1664/3333] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:10 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:10.627549 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4e8e306a-dffd-4cf5-885e-e2f7b7710784 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:10.628172 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4e8e306a-dffd-4cf5-885e-e2f7b7710784 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:10.634417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e8e306a-dffd-4cf5-885e-e2f7b7710784 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:10.634923 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e8e306a-dffd-4cf5-885e-e2f7b7710784 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:10.635407 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e8e306a-dffd-4cf5-885e-e2f7b7710784 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:10.636116 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e8e306a-dffd-4cf5-885e-e2f7b7710784 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:10.636583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e8e306a-dffd-4cf5-885e-e2f7b7710784 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:10.636989 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4e8e306a-dffd-4cf5-885e-e2f7b7710784 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:10.767140 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4e8e306a-dffd-4cf5-885e-e2f7b7710784 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:10.775323 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4e8e306a-dffd-4cf5-885e-e2f7b7710784 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152291 Aug 24 12:55:10.775872 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1670/3334] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:10 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:11.267146 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a74284b7-9785-44ac-b288-b60832bb794f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:11.267756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a74284b7-9785-44ac-b288-b60832bb794f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:11.274122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a74284b7-9785-44ac-b288-b60832bb794f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:11.274602 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a74284b7-9785-44ac-b288-b60832bb794f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:11.275071 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a74284b7-9785-44ac-b288-b60832bb794f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:11.275757 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a74284b7-9785-44ac-b288-b60832bb794f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:11.276209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a74284b7-9785-44ac-b288-b60832bb794f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:11.276635 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a74284b7-9785-44ac-b288-b60832bb794f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:11.402106 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a74284b7-9785-44ac-b288-b60832bb794f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:11.410111 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a74284b7-9785-44ac-b288-b60832bb794f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:11.411638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a74284b7-9785-44ac-b288-b60832bb794f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:11.412746 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a74284b7-9785-44ac-b288-b60832bb794f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124" status: 200 len: 1407 microversion: 2.20 time: 0.149529 Aug 24 12:55:11.413301 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1665/3335] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:55:11 2022] GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:55:11.489588 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bb164a68-e25c-45b5-9a4d-bf950c762ccb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:11.490195 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bb164a68-e25c-45b5-9a4d-bf950c762ccb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:11.496627 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb164a68-e25c-45b5-9a4d-bf950c762ccb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:11.497110 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb164a68-e25c-45b5-9a4d-bf950c762ccb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:11.497541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb164a68-e25c-45b5-9a4d-bf950c762ccb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:11.498248 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb164a68-e25c-45b5-9a4d-bf950c762ccb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:11.498719 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb164a68-e25c-45b5-9a4d-bf950c762ccb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:11.499144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb164a68-e25c-45b5-9a4d-bf950c762ccb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:11.574695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-20f25a10-af75-48e5-94b0-8cc56e4ec6a7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:11.575254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-20f25a10-af75-48e5-94b0-8cc56e4ec6a7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:11.581039 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20f25a10-af75-48e5-94b0-8cc56e4ec6a7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:11.581517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20f25a10-af75-48e5-94b0-8cc56e4ec6a7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:11.581945 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20f25a10-af75-48e5-94b0-8cc56e4ec6a7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:11.582621 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20f25a10-af75-48e5-94b0-8cc56e4ec6a7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:11.583118 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20f25a10-af75-48e5-94b0-8cc56e4ec6a7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:11.583545 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20f25a10-af75-48e5-94b0-8cc56e4ec6a7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:11.632437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bb164a68-e25c-45b5-9a4d-bf950c762ccb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:11.640748 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bb164a68-e25c-45b5-9a4d-bf950c762ccb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.155256 Aug 24 12:55:11.641349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1671/3336] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:11 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:11.649543 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-20f25a10-af75-48e5-94b0-8cc56e4ec6a7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:11.658358 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-20f25a10-af75-48e5-94b0-8cc56e4ec6a7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.087610 Aug 24 12:55:11.658928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1666/3337] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:11 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:11.797842 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ea96d767-55d7-477c-bb91-00517fd57e5b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:11.798452 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ea96d767-55d7-477c-bb91-00517fd57e5b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:11.804682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea96d767-55d7-477c-bb91-00517fd57e5b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:11.805200 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea96d767-55d7-477c-bb91-00517fd57e5b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:11.805637 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea96d767-55d7-477c-bb91-00517fd57e5b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:11.806330 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea96d767-55d7-477c-bb91-00517fd57e5b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:11.806845 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea96d767-55d7-477c-bb91-00517fd57e5b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:11.807274 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea96d767-55d7-477c-bb91-00517fd57e5b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:11.939895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ea96d767-55d7-477c-bb91-00517fd57e5b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:11.947915 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ea96d767-55d7-477c-bb91-00517fd57e5b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.155501 Aug 24 12:55:11.948481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1672/3338] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:11 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:12.435873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1608c19a-d673-4e28-8454-3249971be9fc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:12.436481 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1608c19a-d673-4e28-8454-3249971be9fc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:12.443672 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1608c19a-d673-4e28-8454-3249971be9fc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:12.444291 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1608c19a-d673-4e28-8454-3249971be9fc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:12.444733 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1608c19a-d673-4e28-8454-3249971be9fc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:12.445434 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1608c19a-d673-4e28-8454-3249971be9fc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:12.446016 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1608c19a-d673-4e28-8454-3249971be9fc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:12.446447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1608c19a-d673-4e28-8454-3249971be9fc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:12.662980 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6bbe1476-b11b-4ff1-9563-1317e008a94e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:12.664277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6bbe1476-b11b-4ff1-9563-1317e008a94e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:12.665192 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1608c19a-d673-4e28-8454-3249971be9fc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:12.671890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6bbe1476-b11b-4ff1-9563-1317e008a94e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:12.672471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6bbe1476-b11b-4ff1-9563-1317e008a94e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:12.672977 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6bbe1476-b11b-4ff1-9563-1317e008a94e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:12.673952 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6bbe1476-b11b-4ff1-9563-1317e008a94e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:12.674496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6bbe1476-b11b-4ff1-9563-1317e008a94e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:12.675074 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6bbe1476-b11b-4ff1-9563-1317e008a94e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:12.676552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1608c19a-d673-4e28-8454-3249971be9fc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:12.678155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1608c19a-d673-4e28-8454-3249971be9fc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:12.680537 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1608c19a-d673-4e28-8454-3249971be9fc tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124" status: 200 len: 1407 microversion: 2.20 time: 0.247556 Aug 24 12:55:12.680719 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:55:12.691632 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1667/3339] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:55:12 2022] GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:55:12.697482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-80da6dfa-06ee-4ad2-ab22-d1cbca4fca56 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:12.698331 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-80da6dfa-06ee-4ad2-ab22-d1cbca4fca56 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:12.704587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80da6dfa-06ee-4ad2-ab22-d1cbca4fca56 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:12.705180 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80da6dfa-06ee-4ad2-ab22-d1cbca4fca56 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:12.705686 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80da6dfa-06ee-4ad2-ab22-d1cbca4fca56 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:12.706454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80da6dfa-06ee-4ad2-ab22-d1cbca4fca56 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:12.707164 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80da6dfa-06ee-4ad2-ab22-d1cbca4fca56 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:12.707539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-80da6dfa-06ee-4ad2-ab22-d1cbca4fca56 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:12.789993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-80da6dfa-06ee-4ad2-ab22-d1cbca4fca56 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:12.799334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-80da6dfa-06ee-4ad2-ab22-d1cbca4fca56 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.106177 Aug 24 12:55:12.800099 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1668/3340] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:12 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:12.812155 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6bbe1476-b11b-4ff1-9563-1317e008a94e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:12.820568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6bbe1476-b11b-4ff1-9563-1317e008a94e tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.161577 Aug 24 12:55:12.821210 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1673/3341] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:12 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:12.969992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-626490b1-5ed7-43f1-84cc-b96e667c4bc4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:12.970520 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-626490b1-5ed7-43f1-84cc-b96e667c4bc4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:12.976438 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-626490b1-5ed7-43f1-84cc-b96e667c4bc4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:12.976915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-626490b1-5ed7-43f1-84cc-b96e667c4bc4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:12.977353 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-626490b1-5ed7-43f1-84cc-b96e667c4bc4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:12.978027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-626490b1-5ed7-43f1-84cc-b96e667c4bc4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:12.978479 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-626490b1-5ed7-43f1-84cc-b96e667c4bc4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:12.978940 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-626490b1-5ed7-43f1-84cc-b96e667c4bc4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:13.103071 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-626490b1-5ed7-43f1-84cc-b96e667c4bc4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:13.111129 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-626490b1-5ed7-43f1-84cc-b96e667c4bc4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.145715 Aug 24 12:55:13.111948 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1669/3342] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:12 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:13.701589 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9d3fcfd8-ed38-44bb-b298-5a05c9b8eb2f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:13.702169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9d3fcfd8-ed38-44bb-b298-5a05c9b8eb2f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:13.708611 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9d3fcfd8-ed38-44bb-b298-5a05c9b8eb2f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:13.709101 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9d3fcfd8-ed38-44bb-b298-5a05c9b8eb2f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:13.709591 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9d3fcfd8-ed38-44bb-b298-5a05c9b8eb2f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:13.710270 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9d3fcfd8-ed38-44bb-b298-5a05c9b8eb2f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:13.710750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9d3fcfd8-ed38-44bb-b298-5a05c9b8eb2f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:13.711174 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9d3fcfd8-ed38-44bb-b298-5a05c9b8eb2f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:13.821987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a3b11bfa-1863-4cf7-bc84-7209b992e02e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:13.822716 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a3b11bfa-1863-4cf7-bc84-7209b992e02e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:13.829039 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a3b11bfa-1863-4cf7-bc84-7209b992e02e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:13.829553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a3b11bfa-1863-4cf7-bc84-7209b992e02e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:13.829993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a3b11bfa-1863-4cf7-bc84-7209b992e02e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:13.830711 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a3b11bfa-1863-4cf7-bc84-7209b992e02e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:13.831171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a3b11bfa-1863-4cf7-bc84-7209b992e02e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:13.831600 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a3b11bfa-1863-4cf7-bc84-7209b992e02e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:13.844346 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9d3fcfd8-ed38-44bb-b298-5a05c9b8eb2f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:13.852491 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9d3fcfd8-ed38-44bb-b298-5a05c9b8eb2f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:13.854056 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9d3fcfd8-ed38-44bb-b298-5a05c9b8eb2f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:13.855213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9d3fcfd8-ed38-44bb-b298-5a05c9b8eb2f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124" status: 200 len: 1407 microversion: 2.20 time: 0.157776 Aug 24 12:55:13.855764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1674/3343] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:55:13 2022] GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:55:13.860590 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-51f631ce-280c-4f66-bdde-af0e4e20dc58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:13.861204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-51f631ce-280c-4f66-bdde-af0e4e20dc58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:13.867202 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51f631ce-280c-4f66-bdde-af0e4e20dc58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:13.868789 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51f631ce-280c-4f66-bdde-af0e4e20dc58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:13.868789 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51f631ce-280c-4f66-bdde-af0e4e20dc58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:13.868789 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51f631ce-280c-4f66-bdde-af0e4e20dc58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:13.869156 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51f631ce-280c-4f66-bdde-af0e4e20dc58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:13.869572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51f631ce-280c-4f66-bdde-af0e4e20dc58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:13.899481 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a3b11bfa-1863-4cf7-bc84-7209b992e02e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:13.908245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a3b11bfa-1863-4cf7-bc84-7209b992e02e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.091578 Aug 24 12:55:13.908800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1670/3344] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:13 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:13.998801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-51f631ce-280c-4f66-bdde-af0e4e20dc58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:14.006865 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-51f631ce-280c-4f66-bdde-af0e4e20dc58 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149634 Aug 24 12:55:14.007432 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1675/3345] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:13 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:14.132475 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-36ca787a-a97d-4ab1-8333-76a287d9ece0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:14.133074 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-36ca787a-a97d-4ab1-8333-76a287d9ece0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:14.138964 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36ca787a-a97d-4ab1-8333-76a287d9ece0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:14.139447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36ca787a-a97d-4ab1-8333-76a287d9ece0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:14.139865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36ca787a-a97d-4ab1-8333-76a287d9ece0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:14.140531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36ca787a-a97d-4ab1-8333-76a287d9ece0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:14.140977 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36ca787a-a97d-4ab1-8333-76a287d9ece0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:14.141401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36ca787a-a97d-4ab1-8333-76a287d9ece0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:14.268248 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-36ca787a-a97d-4ab1-8333-76a287d9ece0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:14.276317 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-36ca787a-a97d-4ab1-8333-76a287d9ece0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.147715 Aug 24 12:55:14.276875 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1671/3346] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:14 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:14.878249 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-038b42c9-36dc-41e6-b289-dcfa2ba790e5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:14.878886 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-038b42c9-36dc-41e6-b289-dcfa2ba790e5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:14.885216 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-038b42c9-36dc-41e6-b289-dcfa2ba790e5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:14.885691 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-038b42c9-36dc-41e6-b289-dcfa2ba790e5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:14.886121 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-038b42c9-36dc-41e6-b289-dcfa2ba790e5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:14.886835 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-038b42c9-36dc-41e6-b289-dcfa2ba790e5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:14.887289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-038b42c9-36dc-41e6-b289-dcfa2ba790e5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:14.888350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-038b42c9-36dc-41e6-b289-dcfa2ba790e5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:14.929179 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5fbdd690-f6d9-4836-99b3-f9501bcbddd9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:14.929853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5fbdd690-f6d9-4836-99b3-f9501bcbddd9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:14.936760 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5fbdd690-f6d9-4836-99b3-f9501bcbddd9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:14.937241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5fbdd690-f6d9-4836-99b3-f9501bcbddd9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:14.937672 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5fbdd690-f6d9-4836-99b3-f9501bcbddd9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:14.938352 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5fbdd690-f6d9-4836-99b3-f9501bcbddd9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:14.938837 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5fbdd690-f6d9-4836-99b3-f9501bcbddd9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:14.939261 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5fbdd690-f6d9-4836-99b3-f9501bcbddd9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:15.002635 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5fbdd690-f6d9-4836-99b3-f9501bcbddd9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:15.010688 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5fbdd690-f6d9-4836-99b3-f9501bcbddd9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085294 Aug 24 12:55:15.011268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1672/3347] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:14 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:15.022150 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-038b42c9-36dc-41e6-b289-dcfa2ba790e5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:15.028087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-00f5fecf-6c98-4ed6-b3b9-1855e6311093 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:15.028700 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-00f5fecf-6c98-4ed6-b3b9-1855e6311093 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:15.029316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-038b42c9-36dc-41e6-b289-dcfa2ba790e5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:15.031102 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-038b42c9-36dc-41e6-b289-dcfa2ba790e5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:15.032212 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-038b42c9-36dc-41e6-b289-dcfa2ba790e5 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124" status: 200 len: 1407 microversion: 2.20 time: 0.157843 Aug 24 12:55:15.032767 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1676/3348] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:55:14 2022] GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:55:15.035148 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00f5fecf-6c98-4ed6-b3b9-1855e6311093 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:15.037422 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00f5fecf-6c98-4ed6-b3b9-1855e6311093 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:15.037422 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00f5fecf-6c98-4ed6-b3b9-1855e6311093 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:15.037422 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00f5fecf-6c98-4ed6-b3b9-1855e6311093 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:15.037422 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00f5fecf-6c98-4ed6-b3b9-1855e6311093 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:15.038186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00f5fecf-6c98-4ed6-b3b9-1855e6311093 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:15.174546 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-00f5fecf-6c98-4ed6-b3b9-1855e6311093 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:15.182837 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-00f5fecf-6c98-4ed6-b3b9-1855e6311093 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.158503 Aug 24 12:55:15.183627 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1673/3349] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:15 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:15.297711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-578245d5-2128-455c-acbe-a5ec0c1382a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:15.298320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-578245d5-2128-455c-acbe-a5ec0c1382a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:15.304163 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-578245d5-2128-455c-acbe-a5ec0c1382a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:15.304648 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-578245d5-2128-455c-acbe-a5ec0c1382a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:15.305084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-578245d5-2128-455c-acbe-a5ec0c1382a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:15.305765 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-578245d5-2128-455c-acbe-a5ec0c1382a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:15.306220 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-578245d5-2128-455c-acbe-a5ec0c1382a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:15.306674 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-578245d5-2128-455c-acbe-a5ec0c1382a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:15.640978 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-578245d5-2128-455c-acbe-a5ec0c1382a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:15.649031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-578245d5-2128-455c-acbe-a5ec0c1382a6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.355678 Aug 24 12:55:15.649588 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1677/3350] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:15 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:16.031477 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-59f961f1-22fc-461b-93fa-c3ec4289bb4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:16.032039 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-59f961f1-22fc-461b-93fa-c3ec4289bb4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:16.034004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=2 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:55:16.034707 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=12 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:55:16.039416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59f961f1-22fc-461b-93fa-c3ec4289bb4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:16.039892 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59f961f1-22fc-461b-93fa-c3ec4289bb4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:16.040323 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59f961f1-22fc-461b-93fa-c3ec4289bb4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:16.040996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59f961f1-22fc-461b-93fa-c3ec4289bb4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:16.041493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59f961f1-22fc-461b-93fa-c3ec4289bb4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:16.041910 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-59f961f1-22fc-461b-93fa-c3ec4289bb4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:16.103201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-59f961f1-22fc-461b-93fa-c3ec4289bb4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:16.112073 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-59f961f1-22fc-461b-93fa-c3ec4289bb4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084680 Aug 24 12:55:16.112641 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1674/3351] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:16 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:16.117563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a95cf5fe-5e3d-4646-ac17-69b331a9ebac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:16.118209 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a95cf5fe-5e3d-4646-ac17-69b331a9ebac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:16.125212 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a95cf5fe-5e3d-4646-ac17-69b331a9ebac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:16.125700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a95cf5fe-5e3d-4646-ac17-69b331a9ebac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:16.127567 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a95cf5fe-5e3d-4646-ac17-69b331a9ebac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:16.127567 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a95cf5fe-5e3d-4646-ac17-69b331a9ebac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:16.127567 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a95cf5fe-5e3d-4646-ac17-69b331a9ebac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:16.127922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a95cf5fe-5e3d-4646-ac17-69b331a9ebac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:16.204335 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3596ad0a-5d75-4c34-9532-c34df361006a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:16.204950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3596ad0a-5d75-4c34-9532-c34df361006a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:16.211245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3596ad0a-5d75-4c34-9532-c34df361006a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:16.211722 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3596ad0a-5d75-4c34-9532-c34df361006a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:16.212153 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3596ad0a-5d75-4c34-9532-c34df361006a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:16.212855 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3596ad0a-5d75-4c34-9532-c34df361006a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:16.213328 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3596ad0a-5d75-4c34-9532-c34df361006a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:16.213870 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3596ad0a-5d75-4c34-9532-c34df361006a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:16.218370 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:55:16.255704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a95cf5fe-5e3d-4646-ac17-69b331a9ebac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:16.263968 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a95cf5fe-5e3d-4646-ac17-69b331a9ebac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:16.265473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a95cf5fe-5e3d-4646-ac17-69b331a9ebac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:16.266616 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a95cf5fe-5e3d-4646-ac17-69b331a9ebac tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124" status: 200 len: 1407 microversion: 2.20 time: 0.152845 Aug 24 12:55:16.267205 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1678/3352] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:55:16 2022] GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:55:16.350477 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3596ad0a-5d75-4c34-9532-c34df361006a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:16.359683 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3596ad0a-5d75-4c34-9532-c34df361006a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.159715 Aug 24 12:55:16.360247 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1675/3353] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:16 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:16.669584 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-cd889ff2-9e38-4446-97e2-e98e22de4df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:16.670336 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-cd889ff2-9e38-4446-97e2-e98e22de4df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:16.676447 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd889ff2-9e38-4446-97e2-e98e22de4df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:16.676936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd889ff2-9e38-4446-97e2-e98e22de4df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:16.677378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd889ff2-9e38-4446-97e2-e98e22de4df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:16.678108 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd889ff2-9e38-4446-97e2-e98e22de4df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:16.678570 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd889ff2-9e38-4446-97e2-e98e22de4df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:16.679047 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd889ff2-9e38-4446-97e2-e98e22de4df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:16.761785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-a2d55667-7086-492c-8971-34cb6bbbbbbf req-4d04eb12-1493-41c8-8c7a-26300cd08352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ac9d8b8-cbcb-4861-9139-e5d6f7c97124", "name": "network-vif-plugged", "status": "completed", "tag": "4f158522-8fdb-41d0-82a1-ac1110e72623"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:55:16.771670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-a2d55667-7086-492c-8971-34cb6bbbbbbf req-4d04eb12-1493-41c8-8c7a-26300cd08352 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:16.776151 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-a2d55667-7086-492c-8971-34cb6bbbbbbf req-4d04eb12-1493-41c8-8c7a-26300cd08352 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:16.776151 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-a2d55667-7086-492c-8971-34cb6bbbbbbf req-4d04eb12-1493-41c8-8c7a-26300cd08352 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:16.784378 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-a2d55667-7086-492c-8971-34cb6bbbbbbf req-4d04eb12-1493-41c8-8c7a-26300cd08352 service nova] Creating event network-vif-plugged:4f158522-8fdb-41d0-82a1-ac1110e72623 for instance 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 on hv-cinder-84889 Aug 24 12:55:16.789442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-a2d55667-7086-492c-8971-34cb6bbbbbbf req-4d04eb12-1493-41c8-8c7a-26300cd08352 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086965 Aug 24 12:55:16.790018 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1676/3354] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:55:16.812801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-cd889ff2-9e38-4446-97e2-e98e22de4df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:16.821274 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-cd889ff2-9e38-4446-97e2-e98e22de4df9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.155614 Aug 24 12:55:16.827134 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1679/3355] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:16 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:17.134816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-12911a8f-62ce-411b-a363-2ac540996502 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:17.135416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-12911a8f-62ce-411b-a363-2ac540996502 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:17.141499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12911a8f-62ce-411b-a363-2ac540996502 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:17.141977 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12911a8f-62ce-411b-a363-2ac540996502 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:17.142411 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12911a8f-62ce-411b-a363-2ac540996502 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:17.143113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12911a8f-62ce-411b-a363-2ac540996502 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:17.143559 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12911a8f-62ce-411b-a363-2ac540996502 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:17.143979 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12911a8f-62ce-411b-a363-2ac540996502 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:17.214484 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-12911a8f-62ce-411b-a363-2ac540996502 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:17.223124 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-12911a8f-62ce-411b-a363-2ac540996502 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.093148 Aug 24 12:55:17.223716 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1677/3356] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:17 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:17.289353 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-745f6645-22ad-4902-9ab6-4cd19626440e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:17.289960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-745f6645-22ad-4902-9ab6-4cd19626440e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:17.296385 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-745f6645-22ad-4902-9ab6-4cd19626440e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:17.296867 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-745f6645-22ad-4902-9ab6-4cd19626440e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:17.297302 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-745f6645-22ad-4902-9ab6-4cd19626440e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:17.297982 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-745f6645-22ad-4902-9ab6-4cd19626440e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:17.298439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-745f6645-22ad-4902-9ab6-4cd19626440e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:17.298894 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-745f6645-22ad-4902-9ab6-4cd19626440e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:17.380685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c50493a6-3350-4e89-9f3a-0d8c2cbb08c5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:17.381294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c50493a6-3350-4e89-9f3a-0d8c2cbb08c5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:17.387760 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c50493a6-3350-4e89-9f3a-0d8c2cbb08c5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:17.388475 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c50493a6-3350-4e89-9f3a-0d8c2cbb08c5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:17.388915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c50493a6-3350-4e89-9f3a-0d8c2cbb08c5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:17.389606 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c50493a6-3350-4e89-9f3a-0d8c2cbb08c5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:17.390065 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c50493a6-3350-4e89-9f3a-0d8c2cbb08c5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:17.390490 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c50493a6-3350-4e89-9f3a-0d8c2cbb08c5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:17.426773 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-745f6645-22ad-4902-9ab6-4cd19626440e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:17.435956 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-745f6645-22ad-4902-9ab6-4cd19626440e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:17.437446 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-745f6645-22ad-4902-9ab6-4cd19626440e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:17.438554 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-745f6645-22ad-4902-9ab6-4cd19626440e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124" status: 200 len: 1407 microversion: 2.20 time: 0.153178 Aug 24 12:55:17.439139 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1680/3357] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:55:17 2022] GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:55:17.521630 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c50493a6-3350-4e89-9f3a-0d8c2cbb08c5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:17.530733 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c50493a6-3350-4e89-9f3a-0d8c2cbb08c5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.153691 Aug 24 12:55:17.531330 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1678/3358] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:17 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:17.843199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a7e1a021-01d2-4d28-aefa-29a8c218aa3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:17.843811 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a7e1a021-01d2-4d28-aefa-29a8c218aa3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:17.849730 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7e1a021-01d2-4d28-aefa-29a8c218aa3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:17.850221 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7e1a021-01d2-4d28-aefa-29a8c218aa3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:17.850667 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7e1a021-01d2-4d28-aefa-29a8c218aa3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:17.851368 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7e1a021-01d2-4d28-aefa-29a8c218aa3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:17.851824 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7e1a021-01d2-4d28-aefa-29a8c218aa3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:17.852251 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7e1a021-01d2-4d28-aefa-29a8c218aa3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:17.986799 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a7e1a021-01d2-4d28-aefa-29a8c218aa3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:17.994989 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a7e1a021-01d2-4d28-aefa-29a8c218aa3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.155690 Aug 24 12:55:17.995544 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1681/3359] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:17 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:18.244566 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d8d8e85a-0338-4427-8a19-effffbc9f5fd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:18.245171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d8d8e85a-0338-4427-8a19-effffbc9f5fd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:18.252223 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8d8e85a-0338-4427-8a19-effffbc9f5fd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:18.252699 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8d8e85a-0338-4427-8a19-effffbc9f5fd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:18.253132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8d8e85a-0338-4427-8a19-effffbc9f5fd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:18.253833 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8d8e85a-0338-4427-8a19-effffbc9f5fd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:18.254288 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8d8e85a-0338-4427-8a19-effffbc9f5fd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:18.254737 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8d8e85a-0338-4427-8a19-effffbc9f5fd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:18.317867 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d8d8e85a-0338-4427-8a19-effffbc9f5fd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:18.326385 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d8d8e85a-0338-4427-8a19-effffbc9f5fd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085680 Aug 24 12:55:18.326982 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1679/3360] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:18 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:18.460744 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-110fe2f6-518a-4dbc-bf8c-cc875d16c85e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:18.461414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-110fe2f6-518a-4dbc-bf8c-cc875d16c85e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:18.468380 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-110fe2f6-518a-4dbc-bf8c-cc875d16c85e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:18.468864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-110fe2f6-518a-4dbc-bf8c-cc875d16c85e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:18.469306 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-110fe2f6-518a-4dbc-bf8c-cc875d16c85e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:18.469994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-110fe2f6-518a-4dbc-bf8c-cc875d16c85e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:18.470448 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-110fe2f6-518a-4dbc-bf8c-cc875d16c85e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:18.470900 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-110fe2f6-518a-4dbc-bf8c-cc875d16c85e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:18.552035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-eb3c16f8-fda1-4241-8eb4-3c5368cce383 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:18.552759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-eb3c16f8-fda1-4241-8eb4-3c5368cce383 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:18.558753 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb3c16f8-fda1-4241-8eb4-3c5368cce383 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:18.559237 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb3c16f8-fda1-4241-8eb4-3c5368cce383 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:18.559673 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb3c16f8-fda1-4241-8eb4-3c5368cce383 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:18.560358 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb3c16f8-fda1-4241-8eb4-3c5368cce383 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:18.560807 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb3c16f8-fda1-4241-8eb4-3c5368cce383 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:18.561225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eb3c16f8-fda1-4241-8eb4-3c5368cce383 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:18.598129 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-110fe2f6-518a-4dbc-bf8c-cc875d16c85e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:18.606950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-110fe2f6-518a-4dbc-bf8c-cc875d16c85e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:18.608463 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-110fe2f6-518a-4dbc-bf8c-cc875d16c85e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:18.609577 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-110fe2f6-518a-4dbc-bf8c-cc875d16c85e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124" status: 200 len: 1407 microversion: 2.20 time: 0.152872 Aug 24 12:55:18.610141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1682/3361] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:55:18 2022] GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:55:18.689381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-eb3c16f8-fda1-4241-8eb4-3c5368cce383 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:18.697640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-eb3c16f8-fda1-4241-8eb4-3c5368cce383 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.149396 Aug 24 12:55:18.698254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1680/3362] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:18 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:19.016450 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-40cfadcd-5f98-4ccf-94df-206bb39d1be6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:19.017057 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-40cfadcd-5f98-4ccf-94df-206bb39d1be6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:19.022928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40cfadcd-5f98-4ccf-94df-206bb39d1be6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:19.023412 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40cfadcd-5f98-4ccf-94df-206bb39d1be6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:19.023847 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40cfadcd-5f98-4ccf-94df-206bb39d1be6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:19.024521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40cfadcd-5f98-4ccf-94df-206bb39d1be6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:19.024980 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40cfadcd-5f98-4ccf-94df-206bb39d1be6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:19.025401 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-40cfadcd-5f98-4ccf-94df-206bb39d1be6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:19.151456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-40cfadcd-5f98-4ccf-94df-206bb39d1be6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:19.159772 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-40cfadcd-5f98-4ccf-94df-206bb39d1be6 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.147696 Aug 24 12:55:19.160334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1683/3363] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:19 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:19.346790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-81cbfc38-e39c-418a-92ea-9744ac06d323 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:19.347448 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-81cbfc38-e39c-418a-92ea-9744ac06d323 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:19.353887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81cbfc38-e39c-418a-92ea-9744ac06d323 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:19.358180 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81cbfc38-e39c-418a-92ea-9744ac06d323 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:19.358180 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81cbfc38-e39c-418a-92ea-9744ac06d323 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:19.358180 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81cbfc38-e39c-418a-92ea-9744ac06d323 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:19.358180 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81cbfc38-e39c-418a-92ea-9744ac06d323 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:19.358620 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81cbfc38-e39c-418a-92ea-9744ac06d323 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:19.418785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-81cbfc38-e39c-418a-92ea-9744ac06d323 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:19.427217 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-81cbfc38-e39c-418a-92ea-9744ac06d323 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084361 Aug 24 12:55:19.428042 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1681/3364] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:19 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:19.632306 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3d344e8c-f2fd-4cc2-9097-753f8aa43483 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:19.632917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3d344e8c-f2fd-4cc2-9097-753f8aa43483 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:19.639658 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d344e8c-f2fd-4cc2-9097-753f8aa43483 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:19.640147 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d344e8c-f2fd-4cc2-9097-753f8aa43483 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:19.640588 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d344e8c-f2fd-4cc2-9097-753f8aa43483 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:19.641289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d344e8c-f2fd-4cc2-9097-753f8aa43483 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:19.641768 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d344e8c-f2fd-4cc2-9097-753f8aa43483 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:19.642197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3d344e8c-f2fd-4cc2-9097-753f8aa43483 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:19.718267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-818e9c57-a73d-4e51-a1ab-2c6da45021c7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:19.718889 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-818e9c57-a73d-4e51-a1ab-2c6da45021c7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:19.724712 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-818e9c57-a73d-4e51-a1ab-2c6da45021c7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:19.725216 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-818e9c57-a73d-4e51-a1ab-2c6da45021c7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:19.725609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-818e9c57-a73d-4e51-a1ab-2c6da45021c7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:19.726291 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-818e9c57-a73d-4e51-a1ab-2c6da45021c7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:19.726761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-818e9c57-a73d-4e51-a1ab-2c6da45021c7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:19.727181 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-818e9c57-a73d-4e51-a1ab-2c6da45021c7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:19.781504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3d344e8c-f2fd-4cc2-9097-753f8aa43483 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:19.789708 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3d344e8c-f2fd-4cc2-9097-753f8aa43483 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:19.793360 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3d344e8c-f2fd-4cc2-9097-753f8aa43483 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:19.793360 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3d344e8c-f2fd-4cc2-9097-753f8aa43483 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124" status: 200 len: 1599 microversion: 2.20 time: 0.164735 Aug 24 12:55:19.793895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1684/3365] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 12:55:19 2022] GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:55:19.816522 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-483a0203-0667-4576-b68b-57b0b0b62428 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:19.817258 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-483a0203-0667-4576-b68b-57b0b0b62428 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:19.823714 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-483a0203-0667-4576-b68b-57b0b0b62428 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:19.828869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-483a0203-0667-4576-b68b-57b0b0b62428 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:19.828869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-483a0203-0667-4576-b68b-57b0b0b62428 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:19.828869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-483a0203-0667-4576-b68b-57b0b0b62428 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:19.828869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-483a0203-0667-4576-b68b-57b0b0b62428 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:19.829301 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-483a0203-0667-4576-b68b-57b0b0b62428 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:19.863355 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-818e9c57-a73d-4e51-a1ab-2c6da45021c7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:19.871794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-818e9c57-a73d-4e51-a1ab-2c6da45021c7 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.157334 Aug 24 12:55:19.872373 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1682/3366] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:19 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:19.905139 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-483a0203-0667-4576-b68b-57b0b0b62428 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091073 Aug 24 12:55:19.905139 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1685/3367] 10.222.0.45 () {60 vars in 1316 bytes} [Wed Aug 24 12:55:19 2022] GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:55:20.180135 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-93baf0b5-d639-4839-ae55-66572e2ca7f1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:20.180830 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-93baf0b5-d639-4839-ae55-66572e2ca7f1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:20.187065 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-93baf0b5-d639-4839-ae55-66572e2ca7f1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:20.187552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-93baf0b5-d639-4839-ae55-66572e2ca7f1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:20.187987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-93baf0b5-d639-4839-ae55-66572e2ca7f1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:20.188681 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-93baf0b5-d639-4839-ae55-66572e2ca7f1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:20.189133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-93baf0b5-d639-4839-ae55-66572e2ca7f1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:20.189553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-93baf0b5-d639-4839-ae55-66572e2ca7f1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:20.448755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-be302ed7-6432-432d-bdd3-064d7df5b4d3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:20.449458 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-be302ed7-6432-432d-bdd3-064d7df5b4d3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:20.456999 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be302ed7-6432-432d-bdd3-064d7df5b4d3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:20.457826 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be302ed7-6432-432d-bdd3-064d7df5b4d3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:20.458519 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be302ed7-6432-432d-bdd3-064d7df5b4d3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:20.459631 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be302ed7-6432-432d-bdd3-064d7df5b4d3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:20.460339 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be302ed7-6432-432d-bdd3-064d7df5b4d3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:20.461032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be302ed7-6432-432d-bdd3-064d7df5b4d3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:20.523206 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-be302ed7-6432-432d-bdd3-064d7df5b4d3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:20.532250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-be302ed7-6432-432d-bdd3-064d7df5b4d3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.087536 Aug 24 12:55:20.532834 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1686/3368] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:20 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:20.587481 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-93baf0b5-d639-4839-ae55-66572e2ca7f1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:20.596321 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-93baf0b5-d639-4839-ae55-66572e2ca7f1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.420120 Aug 24 12:55:20.597119 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1683/3369] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:20 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:20.893626 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ec3f66a4-fca6-42f5-870a-18686e485375 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:20.894226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ec3f66a4-fca6-42f5-870a-18686e485375 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:20.900513 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec3f66a4-fca6-42f5-870a-18686e485375 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:20.900995 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec3f66a4-fca6-42f5-870a-18686e485375 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:20.901435 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec3f66a4-fca6-42f5-870a-18686e485375 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:20.902119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec3f66a4-fca6-42f5-870a-18686e485375 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:20.902566 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec3f66a4-fca6-42f5-870a-18686e485375 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:20.903019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec3f66a4-fca6-42f5-870a-18686e485375 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:21.034001 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ec3f66a4-fca6-42f5-870a-18686e485375 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:21.042107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ec3f66a4-fca6-42f5-870a-18686e485375 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.152355 Aug 24 12:55:21.042674 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1687/3370] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:20 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:21.181290 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-eb2f05ee-5d3f-4ecf-a182-f9763879d9ed req-4db1523a-88eb-4fc3-b1c7-886adb6a55d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ac9d8b8-cbcb-4861-9139-e5d6f7c97124", "tag": "4f158522-8fdb-41d0-82a1-ac1110e72623"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:55:21.191277 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-eb2f05ee-5d3f-4ecf-a182-f9763879d9ed req-4db1523a-88eb-4fc3-b1c7-886adb6a55d3 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:21.191752 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-eb2f05ee-5d3f-4ecf-a182-f9763879d9ed req-4db1523a-88eb-4fc3-b1c7-886adb6a55d3 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:21.192180 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-eb2f05ee-5d3f-4ecf-a182-f9763879d9ed req-4db1523a-88eb-4fc3-b1c7-886adb6a55d3 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:21.203484 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-eb2f05ee-5d3f-4ecf-a182-f9763879d9ed req-4db1523a-88eb-4fc3-b1c7-886adb6a55d3 service nova] Creating event network-changed:4f158522-8fdb-41d0-82a1-ac1110e72623 for instance 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 on hv-cinder-84889 Aug 24 12:55:21.208923 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-eb2f05ee-5d3f-4ecf-a182-f9763879d9ed req-4db1523a-88eb-4fc3-b1c7-886adb6a55d3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031239 Aug 24 12:55:21.209518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1684/3371] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:55:21.553636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d8f41b3e-77a3-43ab-8231-471d2a86ccf4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:21.554427 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d8f41b3e-77a3-43ab-8231-471d2a86ccf4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:21.560891 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d8f41b3e-77a3-43ab-8231-471d2a86ccf4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:21.565590 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d8f41b3e-77a3-43ab-8231-471d2a86ccf4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:21.565590 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d8f41b3e-77a3-43ab-8231-471d2a86ccf4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:21.565590 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d8f41b3e-77a3-43ab-8231-471d2a86ccf4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:21.565590 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d8f41b3e-77a3-43ab-8231-471d2a86ccf4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:21.566141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d8f41b3e-77a3-43ab-8231-471d2a86ccf4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:21.620087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b6d75505-7b22-48f8-96bf-ffa89c7d5d99 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:21.621696 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b6d75505-7b22-48f8-96bf-ffa89c7d5d99 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:21.632001 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d8f41b3e-77a3-43ab-8231-471d2a86ccf4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:21.634249 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6d75505-7b22-48f8-96bf-ffa89c7d5d99 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:21.635307 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6d75505-7b22-48f8-96bf-ffa89c7d5d99 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:21.636064 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6d75505-7b22-48f8-96bf-ffa89c7d5d99 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:21.637105 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6d75505-7b22-48f8-96bf-ffa89c7d5d99 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:21.637732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6d75505-7b22-48f8-96bf-ffa89c7d5d99 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:21.638363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b6d75505-7b22-48f8-96bf-ffa89c7d5d99 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:21.647278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d8f41b3e-77a3-43ab-8231-471d2a86ccf4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.097286 Aug 24 12:55:21.649680 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1688/3372] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:21 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:21.865670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b6d75505-7b22-48f8-96bf-ffa89c7d5d99 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:21.879110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b6d75505-7b22-48f8-96bf-ffa89c7d5d99 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.265226 Aug 24 12:55:21.879719 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1685/3373] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:21 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:22.064582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-db9bcbea-02a1-4c41-aa79-0c2d88745719 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:22.065193 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-db9bcbea-02a1-4c41-aa79-0c2d88745719 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:22.071797 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db9bcbea-02a1-4c41-aa79-0c2d88745719 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:22.072279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db9bcbea-02a1-4c41-aa79-0c2d88745719 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:22.072712 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db9bcbea-02a1-4c41-aa79-0c2d88745719 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:22.073415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db9bcbea-02a1-4c41-aa79-0c2d88745719 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:22.073862 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db9bcbea-02a1-4c41-aa79-0c2d88745719 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:22.074283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-db9bcbea-02a1-4c41-aa79-0c2d88745719 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:22.203381 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-db9bcbea-02a1-4c41-aa79-0c2d88745719 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:22.211606 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-db9bcbea-02a1-4c41-aa79-0c2d88745719 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150953 Aug 24 12:55:22.212167 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1689/3374] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:22 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:22.670656 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1419187e-e728-4679-9d34-3572125f002c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:22.671269 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1419187e-e728-4679-9d34-3572125f002c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:22.677596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1419187e-e728-4679-9d34-3572125f002c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:22.678118 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1419187e-e728-4679-9d34-3572125f002c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:22.678500 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1419187e-e728-4679-9d34-3572125f002c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:22.679196 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1419187e-e728-4679-9d34-3572125f002c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:22.679641 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1419187e-e728-4679-9d34-3572125f002c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:22.680059 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1419187e-e728-4679-9d34-3572125f002c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:22.742286 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1419187e-e728-4679-9d34-3572125f002c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:22.750284 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1419187e-e728-4679-9d34-3572125f002c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083610 Aug 24 12:55:22.750865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1686/3375] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:22 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:22.900941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e3edc60c-d041-45ce-9b5d-d81e7b940a6a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:22.901602 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e3edc60c-d041-45ce-9b5d-d81e7b940a6a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:22.907501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3edc60c-d041-45ce-9b5d-d81e7b940a6a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:22.908009 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3edc60c-d041-45ce-9b5d-d81e7b940a6a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:22.908420 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3edc60c-d041-45ce-9b5d-d81e7b940a6a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:22.909102 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3edc60c-d041-45ce-9b5d-d81e7b940a6a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:22.909560 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3edc60c-d041-45ce-9b5d-d81e7b940a6a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:22.909987 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3edc60c-d041-45ce-9b5d-d81e7b940a6a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:22.912477 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:55:23.038000 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e3edc60c-d041-45ce-9b5d-d81e7b940a6a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:23.046027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e3edc60c-d041-45ce-9b5d-d81e7b940a6a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148944 Aug 24 12:55:23.046592 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1690/3376] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:22 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:23.233061 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d7b006b5-795d-4119-bac3-f226c91af8d8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:23.233666 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d7b006b5-795d-4119-bac3-f226c91af8d8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:23.240392 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7b006b5-795d-4119-bac3-f226c91af8d8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:23.240804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7b006b5-795d-4119-bac3-f226c91af8d8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:23.241261 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7b006b5-795d-4119-bac3-f226c91af8d8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:23.241933 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7b006b5-795d-4119-bac3-f226c91af8d8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:23.242376 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7b006b5-795d-4119-bac3-f226c91af8d8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:23.242828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7b006b5-795d-4119-bac3-f226c91af8d8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:23.367044 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d7b006b5-795d-4119-bac3-f226c91af8d8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:23.375674 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d7b006b5-795d-4119-bac3-f226c91af8d8 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.145765 Aug 24 12:55:23.376222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1687/3377] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:23 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:23.770919 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b1cfee7e-74f3-416d-a782-d8cd97f5cd6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:23.774121 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b1cfee7e-74f3-416d-a782-d8cd97f5cd6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:23.777991 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1cfee7e-74f3-416d-a782-d8cd97f5cd6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:23.778479 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1cfee7e-74f3-416d-a782-d8cd97f5cd6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:23.778945 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1cfee7e-74f3-416d-a782-d8cd97f5cd6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:23.779630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1cfee7e-74f3-416d-a782-d8cd97f5cd6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:23.780093 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1cfee7e-74f3-416d-a782-d8cd97f5cd6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:23.780518 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1cfee7e-74f3-416d-a782-d8cd97f5cd6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:23.843478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b1cfee7e-74f3-416d-a782-d8cd97f5cd6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:23.852388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b1cfee7e-74f3-416d-a782-d8cd97f5cd6f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085403 Aug 24 12:55:23.852936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1691/3378] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:23 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:24.066790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cc3ea850-ef2d-4b84-a0c1-d2bf773fdb46 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:24.067345 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cc3ea850-ef2d-4b84-a0c1-d2bf773fdb46 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:24.073619 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc3ea850-ef2d-4b84-a0c1-d2bf773fdb46 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:24.074100 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc3ea850-ef2d-4b84-a0c1-d2bf773fdb46 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:24.074573 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc3ea850-ef2d-4b84-a0c1-d2bf773fdb46 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:24.075579 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc3ea850-ef2d-4b84-a0c1-d2bf773fdb46 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:24.075899 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc3ea850-ef2d-4b84-a0c1-d2bf773fdb46 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:24.076311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cc3ea850-ef2d-4b84-a0c1-d2bf773fdb46 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:24.210756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cc3ea850-ef2d-4b84-a0c1-d2bf773fdb46 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:24.219677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cc3ea850-ef2d-4b84-a0c1-d2bf773fdb46 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.156348 Aug 24 12:55:24.220259 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1688/3379] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:24 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:24.396799 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7a40728e-e65b-4f9f-9006-1f54e202af5a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:24.397409 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7a40728e-e65b-4f9f-9006-1f54e202af5a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:24.403266 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a40728e-e65b-4f9f-9006-1f54e202af5a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:24.403747 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a40728e-e65b-4f9f-9006-1f54e202af5a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:24.404182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a40728e-e65b-4f9f-9006-1f54e202af5a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:24.404855 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a40728e-e65b-4f9f-9006-1f54e202af5a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:24.405307 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a40728e-e65b-4f9f-9006-1f54e202af5a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:24.405727 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a40728e-e65b-4f9f-9006-1f54e202af5a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:24.531952 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7a40728e-e65b-4f9f-9006-1f54e202af5a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:24.539926 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7a40728e-e65b-4f9f-9006-1f54e202af5a tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.146934 Aug 24 12:55:24.540485 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1692/3380] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:24 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:24.873298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d3070a01-9551-447c-9550-329fd778df4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:24.873909 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d3070a01-9551-447c-9550-329fd778df4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:24.879841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3070a01-9551-447c-9550-329fd778df4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:24.880324 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3070a01-9551-447c-9550-329fd778df4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:24.880765 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3070a01-9551-447c-9550-329fd778df4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:24.881441 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3070a01-9551-447c-9550-329fd778df4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:24.881897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3070a01-9551-447c-9550-329fd778df4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:24.882318 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3070a01-9551-447c-9550-329fd778df4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:24.941917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d3070a01-9551-447c-9550-329fd778df4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:24.950016 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d3070a01-9551-447c-9550-329fd778df4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.080538 Aug 24 12:55:24.950607 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1689/3381] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:24 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:25.240378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-56d33d12-08ec-40ce-a3c4-fef367e6812d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:25.240970 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-56d33d12-08ec-40ce-a3c4-fef367e6812d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:25.247331 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-56d33d12-08ec-40ce-a3c4-fef367e6812d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:25.247808 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-56d33d12-08ec-40ce-a3c4-fef367e6812d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:25.248240 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-56d33d12-08ec-40ce-a3c4-fef367e6812d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:25.248914 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-56d33d12-08ec-40ce-a3c4-fef367e6812d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:25.249367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-56d33d12-08ec-40ce-a3c4-fef367e6812d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:25.249786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-56d33d12-08ec-40ce-a3c4-fef367e6812d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:25.379747 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-56d33d12-08ec-40ce-a3c4-fef367e6812d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:25.387953 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-56d33d12-08ec-40ce-a3c4-fef367e6812d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151681 Aug 24 12:55:25.388513 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1693/3382] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:25 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:25.560677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c92abf5a-fce6-417d-a1a1-138275a9e856 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:25.561228 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c92abf5a-fce6-417d-a1a1-138275a9e856 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:25.568316 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c92abf5a-fce6-417d-a1a1-138275a9e856 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:25.568792 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c92abf5a-fce6-417d-a1a1-138275a9e856 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:25.569227 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c92abf5a-fce6-417d-a1a1-138275a9e856 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:25.569906 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c92abf5a-fce6-417d-a1a1-138275a9e856 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:25.570362 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c92abf5a-fce6-417d-a1a1-138275a9e856 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:25.570885 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c92abf5a-fce6-417d-a1a1-138275a9e856 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:25.700381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c92abf5a-fce6-417d-a1a1-138275a9e856 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:25.708500 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c92abf5a-fce6-417d-a1a1-138275a9e856 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151719 Aug 24 12:55:25.709058 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1690/3383] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:25 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:25.972413 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6e35a1db-edf9-4daa-b079-5d7097aa4f57 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:25.976426 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6e35a1db-edf9-4daa-b079-5d7097aa4f57 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:25.978861 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e35a1db-edf9-4daa-b079-5d7097aa4f57 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:25.979349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e35a1db-edf9-4daa-b079-5d7097aa4f57 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:25.979788 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e35a1db-edf9-4daa-b079-5d7097aa4f57 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:25.980475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e35a1db-edf9-4daa-b079-5d7097aa4f57 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:25.980931 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e35a1db-edf9-4daa-b079-5d7097aa4f57 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:25.981359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e35a1db-edf9-4daa-b079-5d7097aa4f57 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:26.044777 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6e35a1db-edf9-4daa-b079-5d7097aa4f57 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:26.053819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6e35a1db-edf9-4daa-b079-5d7097aa4f57 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085778 Aug 24 12:55:26.054382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1694/3384] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:25 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:26.409626 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4f9fe8bc-2efe-4a7b-bce2-b7e23dd27835 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:26.410251 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4f9fe8bc-2efe-4a7b-bce2-b7e23dd27835 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:26.416308 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f9fe8bc-2efe-4a7b-bce2-b7e23dd27835 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:26.416787 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f9fe8bc-2efe-4a7b-bce2-b7e23dd27835 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:26.417222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f9fe8bc-2efe-4a7b-bce2-b7e23dd27835 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:26.417905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f9fe8bc-2efe-4a7b-bce2-b7e23dd27835 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:26.418350 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f9fe8bc-2efe-4a7b-bce2-b7e23dd27835 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:26.418805 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f9fe8bc-2efe-4a7b-bce2-b7e23dd27835 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:26.545950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4f9fe8bc-2efe-4a7b-bce2-b7e23dd27835 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:26.553950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4f9fe8bc-2efe-4a7b-bce2-b7e23dd27835 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148784 Aug 24 12:55:26.554545 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1691/3385] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:26 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:26.729296 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ab0dd044-0a53-4e99-92ce-b6583b9b8aa5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:26.729866 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ab0dd044-0a53-4e99-92ce-b6583b9b8aa5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:26.736181 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab0dd044-0a53-4e99-92ce-b6583b9b8aa5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:26.736971 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab0dd044-0a53-4e99-92ce-b6583b9b8aa5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:26.737410 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab0dd044-0a53-4e99-92ce-b6583b9b8aa5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:26.738098 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab0dd044-0a53-4e99-92ce-b6583b9b8aa5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:26.738553 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab0dd044-0a53-4e99-92ce-b6583b9b8aa5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:26.739007 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab0dd044-0a53-4e99-92ce-b6583b9b8aa5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:26.869272 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ab0dd044-0a53-4e99-92ce-b6583b9b8aa5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:26.877357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ab0dd044-0a53-4e99-92ce-b6583b9b8aa5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151979 Aug 24 12:55:26.878513 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1695/3386] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:26 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:27.074424 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5bfa8646-e58e-4772-acc7-8d40ec9b60d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:27.075098 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5bfa8646-e58e-4772-acc7-8d40ec9b60d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:27.081521 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5bfa8646-e58e-4772-acc7-8d40ec9b60d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:27.082001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5bfa8646-e58e-4772-acc7-8d40ec9b60d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:27.082466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5bfa8646-e58e-4772-acc7-8d40ec9b60d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:27.083177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5bfa8646-e58e-4772-acc7-8d40ec9b60d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:27.083630 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5bfa8646-e58e-4772-acc7-8d40ec9b60d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:27.084057 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5bfa8646-e58e-4772-acc7-8d40ec9b60d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:27.144803 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5bfa8646-e58e-4772-acc7-8d40ec9b60d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:27.153043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5bfa8646-e58e-4772-acc7-8d40ec9b60d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082388 Aug 24 12:55:27.153593 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1692/3387] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:27 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:27.575254 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-673094c8-c801-44b8-a630-5506ea2e9248 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:27.575864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-673094c8-c801-44b8-a630-5506ea2e9248 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:27.582417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-673094c8-c801-44b8-a630-5506ea2e9248 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:27.582920 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-673094c8-c801-44b8-a630-5506ea2e9248 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:27.583354 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-673094c8-c801-44b8-a630-5506ea2e9248 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:27.584032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-673094c8-c801-44b8-a630-5506ea2e9248 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:27.584486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-673094c8-c801-44b8-a630-5506ea2e9248 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:27.584965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-673094c8-c801-44b8-a630-5506ea2e9248 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:27.710627 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-673094c8-c801-44b8-a630-5506ea2e9248 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:27.718779 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-673094c8-c801-44b8-a630-5506ea2e9248 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.147391 Aug 24 12:55:27.719339 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1696/3388] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:27 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:27.898974 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5e3e988b-3c01-4e00-b12e-dc56970b1aa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:27.899612 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5e3e988b-3c01-4e00-b12e-dc56970b1aa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:27.905775 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5e3e988b-3c01-4e00-b12e-dc56970b1aa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:27.906268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5e3e988b-3c01-4e00-b12e-dc56970b1aa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:27.906735 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5e3e988b-3c01-4e00-b12e-dc56970b1aa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:27.907448 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5e3e988b-3c01-4e00-b12e-dc56970b1aa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:27.907883 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5e3e988b-3c01-4e00-b12e-dc56970b1aa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:27.908306 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5e3e988b-3c01-4e00-b12e-dc56970b1aa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:27.911832 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:55:28.038515 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5e3e988b-3c01-4e00-b12e-dc56970b1aa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:28.046594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5e3e988b-3c01-4e00-b12e-dc56970b1aa6 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151455 Aug 24 12:55:28.047175 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1693/3389] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:27 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:28.173302 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-adbb5d0a-8f7c-4e37-a772-24b5e845bd19 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:28.173914 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-adbb5d0a-8f7c-4e37-a772-24b5e845bd19 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:28.180325 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-adbb5d0a-8f7c-4e37-a772-24b5e845bd19 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:28.180805 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-adbb5d0a-8f7c-4e37-a772-24b5e845bd19 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:28.181241 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-adbb5d0a-8f7c-4e37-a772-24b5e845bd19 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:28.181925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-adbb5d0a-8f7c-4e37-a772-24b5e845bd19 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:28.182384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-adbb5d0a-8f7c-4e37-a772-24b5e845bd19 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:28.182842 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-adbb5d0a-8f7c-4e37-a772-24b5e845bd19 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:28.243721 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-adbb5d0a-8f7c-4e37-a772-24b5e845bd19 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:28.251656 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-adbb5d0a-8f7c-4e37-a772-24b5e845bd19 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082278 Aug 24 12:55:28.252219 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1697/3390] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:28 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:28.740745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cdfa7447-e2c0-4cdb-a0f9-764ec63f522e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:28.741358 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cdfa7447-e2c0-4cdb-a0f9-764ec63f522e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:28.747690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cdfa7447-e2c0-4cdb-a0f9-764ec63f522e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:28.748165 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cdfa7447-e2c0-4cdb-a0f9-764ec63f522e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:28.748597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cdfa7447-e2c0-4cdb-a0f9-764ec63f522e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:28.749269 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cdfa7447-e2c0-4cdb-a0f9-764ec63f522e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:28.749717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cdfa7447-e2c0-4cdb-a0f9-764ec63f522e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:28.750140 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cdfa7447-e2c0-4cdb-a0f9-764ec63f522e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:28.876066 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cdfa7447-e2c0-4cdb-a0f9-764ec63f522e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:28.884056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cdfa7447-e2c0-4cdb-a0f9-764ec63f522e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148026 Aug 24 12:55:28.884633 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1694/3391] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:28 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:29.067908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1ff15c19-75da-4780-880e-66960b172717 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:29.068455 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1ff15c19-75da-4780-880e-66960b172717 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:29.074720 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1ff15c19-75da-4780-880e-66960b172717 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:29.075233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1ff15c19-75da-4780-880e-66960b172717 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:29.075667 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1ff15c19-75da-4780-880e-66960b172717 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:29.076399 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1ff15c19-75da-4780-880e-66960b172717 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:29.076854 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1ff15c19-75da-4780-880e-66960b172717 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:29.077277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1ff15c19-75da-4780-880e-66960b172717 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:29.205244 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1ff15c19-75da-4780-880e-66960b172717 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:29.213884 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1ff15c19-75da-4780-880e-66960b172717 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.150041 Aug 24 12:55:29.214439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1698/3392] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:29 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:29.273562 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a54c044e-3194-429e-a948-3adcccbe3965 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:29.274162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a54c044e-3194-429e-a948-3adcccbe3965 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:29.280205 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a54c044e-3194-429e-a948-3adcccbe3965 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:29.280681 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a54c044e-3194-429e-a948-3adcccbe3965 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:29.281111 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a54c044e-3194-429e-a948-3adcccbe3965 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:29.281784 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a54c044e-3194-429e-a948-3adcccbe3965 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:29.282232 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a54c044e-3194-429e-a948-3adcccbe3965 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:29.282674 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a54c044e-3194-429e-a948-3adcccbe3965 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:29.342280 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a54c044e-3194-429e-a948-3adcccbe3965 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:29.350976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a54c044e-3194-429e-a948-3adcccbe3965 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081247 Aug 24 12:55:29.351528 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1695/3393] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:29 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:29.904637 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6cfc602d-019a-4c98-b260-e3b5f46f28b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:29.905167 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6cfc602d-019a-4c98-b260-e3b5f46f28b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:29.911657 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6cfc602d-019a-4c98-b260-e3b5f46f28b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:29.912169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6cfc602d-019a-4c98-b260-e3b5f46f28b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:29.912597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6cfc602d-019a-4c98-b260-e3b5f46f28b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:29.913275 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6cfc602d-019a-4c98-b260-e3b5f46f28b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:29.913739 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6cfc602d-019a-4c98-b260-e3b5f46f28b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:29.914162 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6cfc602d-019a-4c98-b260-e3b5f46f28b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:30.040235 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6cfc602d-019a-4c98-b260-e3b5f46f28b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:30.048400 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6cfc602d-019a-4c98-b260-e3b5f46f28b4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.147754 Aug 24 12:55:30.048959 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1699/3394] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:29 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:30.235187 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-376b3db6-024a-4a91-9dc5-e61912059bbb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:30.235795 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-376b3db6-024a-4a91-9dc5-e61912059bbb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:30.242998 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-376b3db6-024a-4a91-9dc5-e61912059bbb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:30.243474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-376b3db6-024a-4a91-9dc5-e61912059bbb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:30.243905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-376b3db6-024a-4a91-9dc5-e61912059bbb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:30.244573 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-376b3db6-024a-4a91-9dc5-e61912059bbb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:30.245019 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-376b3db6-024a-4a91-9dc5-e61912059bbb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:30.245471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-376b3db6-024a-4a91-9dc5-e61912059bbb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:30.372901 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a99bb47b-dc13-4321-b932-ec948e3ca74a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:30.373506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a99bb47b-dc13-4321-b932-ec948e3ca74a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:30.379411 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a99bb47b-dc13-4321-b932-ec948e3ca74a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:30.379895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a99bb47b-dc13-4321-b932-ec948e3ca74a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:30.380327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a99bb47b-dc13-4321-b932-ec948e3ca74a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:30.380890 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-376b3db6-024a-4a91-9dc5-e61912059bbb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:30.381051 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a99bb47b-dc13-4321-b932-ec948e3ca74a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:30.381550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a99bb47b-dc13-4321-b932-ec948e3ca74a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:30.381976 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a99bb47b-dc13-4321-b932-ec948e3ca74a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:30.389274 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-376b3db6-024a-4a91-9dc5-e61912059bbb tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.157932 Aug 24 12:55:30.399267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1696/3395] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:30 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:30.443616 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a99bb47b-dc13-4321-b932-ec948e3ca74a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:30.451773 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a99bb47b-dc13-4321-b932-ec948e3ca74a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083299 Aug 24 12:55:30.452329 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1700/3396] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:30 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:31.069543 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1fc9dd45-e5ca-4775-8b40-54536226dbdf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:31.070145 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1fc9dd45-e5ca-4775-8b40-54536226dbdf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:31.076051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1fc9dd45-e5ca-4775-8b40-54536226dbdf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:31.076532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1fc9dd45-e5ca-4775-8b40-54536226dbdf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:31.076963 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1fc9dd45-e5ca-4775-8b40-54536226dbdf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:31.077668 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1fc9dd45-e5ca-4775-8b40-54536226dbdf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:31.078116 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1fc9dd45-e5ca-4775-8b40-54536226dbdf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:31.078535 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1fc9dd45-e5ca-4775-8b40-54536226dbdf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:31.205082 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1fc9dd45-e5ca-4775-8b40-54536226dbdf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:31.213195 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1fc9dd45-e5ca-4775-8b40-54536226dbdf tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.147564 Aug 24 12:55:31.213743 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1697/3397] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:31 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:31.411617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-15730c92-7199-470b-8fdc-8fdfb60d08b5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:31.412148 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-15730c92-7199-470b-8fdc-8fdfb60d08b5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:31.418570 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15730c92-7199-470b-8fdc-8fdfb60d08b5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:31.419086 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15730c92-7199-470b-8fdc-8fdfb60d08b5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:31.419577 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15730c92-7199-470b-8fdc-8fdfb60d08b5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:31.420207 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15730c92-7199-470b-8fdc-8fdfb60d08b5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:31.420661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15730c92-7199-470b-8fdc-8fdfb60d08b5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:31.421088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15730c92-7199-470b-8fdc-8fdfb60d08b5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:31.472155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-14842373-0add-4953-9183-1374bacdac9b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:31.472769 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-14842373-0add-4953-9183-1374bacdac9b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:31.479285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14842373-0add-4953-9183-1374bacdac9b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:31.479778 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14842373-0add-4953-9183-1374bacdac9b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:31.480218 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14842373-0add-4953-9183-1374bacdac9b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:31.480913 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14842373-0add-4953-9183-1374bacdac9b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:31.481367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14842373-0add-4953-9183-1374bacdac9b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:31.481802 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14842373-0add-4953-9183-1374bacdac9b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:31.544418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-14842373-0add-4953-9183-1374bacdac9b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:31.553392 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-14842373-0add-4953-9183-1374bacdac9b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085099 Aug 24 12:55:31.556422 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-15730c92-7199-470b-8fdc-8fdfb60d08b5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:31.556558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1698/3398] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:31 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:31.561943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-15730c92-7199-470b-8fdc-8fdfb60d08b5 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.154894 Aug 24 12:55:31.562579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1701/3399] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:31 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:32.234569 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9d6bdf4f-f7df-4ef2-b23e-4268feb275c3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:32.235206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9d6bdf4f-f7df-4ef2-b23e-4268feb275c3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:32.241436 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9d6bdf4f-f7df-4ef2-b23e-4268feb275c3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:32.241917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9d6bdf4f-f7df-4ef2-b23e-4268feb275c3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:32.242355 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9d6bdf4f-f7df-4ef2-b23e-4268feb275c3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:32.243058 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9d6bdf4f-f7df-4ef2-b23e-4268feb275c3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:32.243513 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9d6bdf4f-f7df-4ef2-b23e-4268feb275c3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:32.243943 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9d6bdf4f-f7df-4ef2-b23e-4268feb275c3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:32.374367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9d6bdf4f-f7df-4ef2-b23e-4268feb275c3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:32.382478 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9d6bdf4f-f7df-4ef2-b23e-4268feb275c3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151813 Aug 24 12:55:32.383059 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1699/3400] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:32 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:32.576104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-548af770-6b0c-4052-9f63-1956a4855aea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:32.576632 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-548af770-6b0c-4052-9f63-1956a4855aea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:32.582498 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-56df9722-fdfe-4439-b0a9-e92feb30c4e4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:32.583134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-56df9722-fdfe-4439-b0a9-e92feb30c4e4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:32.583262 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-548af770-6b0c-4052-9f63-1956a4855aea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:32.583631 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-548af770-6b0c-4052-9f63-1956a4855aea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:32.584067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-548af770-6b0c-4052-9f63-1956a4855aea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:32.584768 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-548af770-6b0c-4052-9f63-1956a4855aea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:32.585238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-548af770-6b0c-4052-9f63-1956a4855aea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:32.585663 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-548af770-6b0c-4052-9f63-1956a4855aea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:32.589502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-56df9722-fdfe-4439-b0a9-e92feb30c4e4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:32.589979 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-56df9722-fdfe-4439-b0a9-e92feb30c4e4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:32.590412 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-56df9722-fdfe-4439-b0a9-e92feb30c4e4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:32.591136 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-56df9722-fdfe-4439-b0a9-e92feb30c4e4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:32.591576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-56df9722-fdfe-4439-b0a9-e92feb30c4e4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:32.591994 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-56df9722-fdfe-4439-b0a9-e92feb30c4e4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:32.655511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-548af770-6b0c-4052-9f63-1956a4855aea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:32.663911 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-548af770-6b0c-4052-9f63-1956a4855aea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.091661 Aug 24 12:55:32.664673 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1702/3401] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:32 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:32.722161 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-56df9722-fdfe-4439-b0a9-e92feb30c4e4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:32.730221 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-56df9722-fdfe-4439-b0a9-e92feb30c4e4 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.151529 Aug 24 12:55:32.730797 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1700/3402] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:32 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:33.403649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5182bd55-3b0a-4e8a-940f-9f5b1f263196 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:33.404259 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5182bd55-3b0a-4e8a-940f-9f5b1f263196 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:33.410165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5182bd55-3b0a-4e8a-940f-9f5b1f263196 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:33.410667 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5182bd55-3b0a-4e8a-940f-9f5b1f263196 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:33.411111 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5182bd55-3b0a-4e8a-940f-9f5b1f263196 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:33.412310 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5182bd55-3b0a-4e8a-940f-9f5b1f263196 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:33.412775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5182bd55-3b0a-4e8a-940f-9f5b1f263196 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:33.413203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5182bd55-3b0a-4e8a-940f-9f5b1f263196 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:33.538707 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5182bd55-3b0a-4e8a-940f-9f5b1f263196 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:33.546801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5182bd55-3b0a-4e8a-940f-9f5b1f263196 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.146985 Aug 24 12:55:33.547365 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1703/3403] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:33 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:33.685442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-152bce81-3940-4f9b-85b8-dfc0b8d561a4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:33.685978 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-152bce81-3940-4f9b-85b8-dfc0b8d561a4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:33.692333 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-152bce81-3940-4f9b-85b8-dfc0b8d561a4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:33.696574 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-152bce81-3940-4f9b-85b8-dfc0b8d561a4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:33.696574 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-152bce81-3940-4f9b-85b8-dfc0b8d561a4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:33.696574 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-152bce81-3940-4f9b-85b8-dfc0b8d561a4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:33.696574 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-152bce81-3940-4f9b-85b8-dfc0b8d561a4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:33.696969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-152bce81-3940-4f9b-85b8-dfc0b8d561a4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:33.751547 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-373843ea-e0ec-4a00-a2a3-e4b532d71bc0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:33.752397 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-373843ea-e0ec-4a00-a2a3-e4b532d71bc0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:33.756178 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-152bce81-3940-4f9b-85b8-dfc0b8d561a4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:33.758879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-373843ea-e0ec-4a00-a2a3-e4b532d71bc0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:33.759791 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-373843ea-e0ec-4a00-a2a3-e4b532d71bc0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:33.759791 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-373843ea-e0ec-4a00-a2a3-e4b532d71bc0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:33.760549 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-373843ea-e0ec-4a00-a2a3-e4b532d71bc0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:33.761008 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-373843ea-e0ec-4a00-a2a3-e4b532d71bc0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:33.761436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-373843ea-e0ec-4a00-a2a3-e4b532d71bc0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:33.764330 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-152bce81-3940-4f9b-85b8-dfc0b8d561a4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083316 Aug 24 12:55:33.764887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1701/3404] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:33 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:33.891787 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-373843ea-e0ec-4a00-a2a3-e4b532d71bc0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:33.900626 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-373843ea-e0ec-4a00-a2a3-e4b532d71bc0 tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.153069 Aug 24 12:55:33.901194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1704/3405] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:33 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:34.567624 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1fe19b40-57f0-486b-a2d6-ebc0b7ad762f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:34.568812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1fe19b40-57f0-486b-a2d6-ebc0b7ad762f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:34.574677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1fe19b40-57f0-486b-a2d6-ebc0b7ad762f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:34.575160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1fe19b40-57f0-486b-a2d6-ebc0b7ad762f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:34.575590 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1fe19b40-57f0-486b-a2d6-ebc0b7ad762f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:34.576263 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1fe19b40-57f0-486b-a2d6-ebc0b7ad762f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:34.576710 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1fe19b40-57f0-486b-a2d6-ebc0b7ad762f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:34.577128 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1fe19b40-57f0-486b-a2d6-ebc0b7ad762f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:34.705544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1fe19b40-57f0-486b-a2d6-ebc0b7ad762f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:34.810422 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1fe19b40-57f0-486b-a2d6-ebc0b7ad762f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149875 Aug 24 12:55:34.810422 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1702/3406] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:34 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:34.810996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-832b3177-27ec-48ed-9550-f189b62df480 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:34.810996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-832b3177-27ec-48ed-9550-f189b62df480 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:34.810996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-832b3177-27ec-48ed-9550-f189b62df480 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:34.810996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-832b3177-27ec-48ed-9550-f189b62df480 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:34.811830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-832b3177-27ec-48ed-9550-f189b62df480 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:34.811830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-832b3177-27ec-48ed-9550-f189b62df480 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:34.811830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-832b3177-27ec-48ed-9550-f189b62df480 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:34.811830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-832b3177-27ec-48ed-9550-f189b62df480 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:34.864096 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-832b3177-27ec-48ed-9550-f189b62df480 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:34.874367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-832b3177-27ec-48ed-9550-f189b62df480 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.092780 Aug 24 12:55:34.874934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1705/3407] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:34 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:34.922002 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6841d722-ff51-4bb7-a32c-2bb164376eda tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:34.922547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6841d722-ff51-4bb7-a32c-2bb164376eda tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] [instance: 29ce2c0c-40e5-45d1-b2a6-ad30617badb4] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:34.929056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6841d722-ff51-4bb7-a32c-2bb164376eda tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:34.929663 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6841d722-ff51-4bb7-a32c-2bb164376eda tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:34.930312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6841d722-ff51-4bb7-a32c-2bb164376eda tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:34.931022 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6841d722-ff51-4bb7-a32c-2bb164376eda tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:34.931476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6841d722-ff51-4bb7-a32c-2bb164376eda tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:34.931894 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6841d722-ff51-4bb7-a32c-2bb164376eda tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:35.066603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6841d722-ff51-4bb7-a32c-2bb164376eda tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb6acf487864a41ba1628e9093b8773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d75e4de32444e2813b11b29553d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:35.075485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6841d722-ff51-4bb7-a32c-2bb164376eda tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4" status: 200 len: 1600 microversion: 2.1 time: 0.157581 Aug 24 12:55:35.086724 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1703/3408] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:34 2022] GET /compute/v2.1/servers/29ce2c0c-40e5-45d1-b2a6-ad30617badb4 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:35.096006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3ceca3ba-ac98-4f9e-9986-997ffe07aa8f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] Calling method '.version_select at 0x7f76f5efb3a0>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:35.175688 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3ceca3ba-ac98-4f9e-9986-997ffe07aa8f tempest-TestMinimumBasicScenario-453850903 tempest-TestMinimumBasicScenario-453850903-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1936027620" status: 202 len: 0 microversion: 2.1 time: 0.083346 Aug 24 12:55:35.176267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1706/3409] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Aug 24 12:55:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1936027620 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:55:35.735038 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ab68762b-7532-4838-b8ee-d549a0d3b84f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:35.735453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ab68762b-7532-4838-b8ee-d549a0d3b84f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:35.742058 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab68762b-7532-4838-b8ee-d549a0d3b84f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:35.742540 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab68762b-7532-4838-b8ee-d549a0d3b84f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:35.743015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab68762b-7532-4838-b8ee-d549a0d3b84f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:35.743697 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab68762b-7532-4838-b8ee-d549a0d3b84f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:35.744147 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab68762b-7532-4838-b8ee-d549a0d3b84f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:35.744568 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ab68762b-7532-4838-b8ee-d549a0d3b84f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:35.876271 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ab68762b-7532-4838-b8ee-d549a0d3b84f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:35.884968 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ab68762b-7532-4838-b8ee-d549a0d3b84f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.154109 Aug 24 12:55:35.885585 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1704/3410] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:35 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:35.899581 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5e81c8c4-df6d-4290-9727-c32f03eb482b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:35.900195 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5e81c8c4-df6d-4290-9727-c32f03eb482b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:35.908478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e81c8c4-df6d-4290-9727-c32f03eb482b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:35.909133 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e81c8c4-df6d-4290-9727-c32f03eb482b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:35.909570 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e81c8c4-df6d-4290-9727-c32f03eb482b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:35.913483 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e81c8c4-df6d-4290-9727-c32f03eb482b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:35.913483 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e81c8c4-df6d-4290-9727-c32f03eb482b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:35.913483 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5e81c8c4-df6d-4290-9727-c32f03eb482b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:35.972589 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5e81c8c4-df6d-4290-9727-c32f03eb482b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:35.974820 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:55:35.981633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5e81c8c4-df6d-4290-9727-c32f03eb482b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.088272 Aug 24 12:55:35.982247 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1707/3411] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:35 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:36.905137 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-51921290-40c0-4b50-9ac4-b636e907e20d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:36.906054 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-51921290-40c0-4b50-9ac4-b636e907e20d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:36.912388 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51921290-40c0-4b50-9ac4-b636e907e20d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:36.912952 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51921290-40c0-4b50-9ac4-b636e907e20d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:36.913467 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51921290-40c0-4b50-9ac4-b636e907e20d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:36.914150 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51921290-40c0-4b50-9ac4-b636e907e20d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:36.914597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51921290-40c0-4b50-9ac4-b636e907e20d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:36.915048 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51921290-40c0-4b50-9ac4-b636e907e20d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:37.003314 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-229dd8a8-7d6b-45e9-ab86-cb21a38bbdfd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:37.003934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-229dd8a8-7d6b-45e9-ab86-cb21a38bbdfd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:37.010844 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-229dd8a8-7d6b-45e9-ab86-cb21a38bbdfd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:37.011333 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-229dd8a8-7d6b-45e9-ab86-cb21a38bbdfd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:37.011772 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-229dd8a8-7d6b-45e9-ab86-cb21a38bbdfd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:37.012460 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-229dd8a8-7d6b-45e9-ab86-cb21a38bbdfd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:37.012920 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-229dd8a8-7d6b-45e9-ab86-cb21a38bbdfd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:37.013355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-229dd8a8-7d6b-45e9-ab86-cb21a38bbdfd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:37.077550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-229dd8a8-7d6b-45e9-ab86-cb21a38bbdfd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:37.086607 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-229dd8a8-7d6b-45e9-ab86-cb21a38bbdfd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.087322 Aug 24 12:55:37.087288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1708/3412] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:36 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:37.176516 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-51921290-40c0-4b50-9ac4-b636e907e20d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:37.185030 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-51921290-40c0-4b50-9ac4-b636e907e20d tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.283560 Aug 24 12:55:37.185805 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1705/3413] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:36 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:38.107888 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-10da6f28-03d2-428d-a6d4-250d68dc674b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:38.108506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-10da6f28-03d2-428d-a6d4-250d68dc674b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:38.115103 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-10da6f28-03d2-428d-a6d4-250d68dc674b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:38.115588 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-10da6f28-03d2-428d-a6d4-250d68dc674b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:38.116091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-10da6f28-03d2-428d-a6d4-250d68dc674b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:38.116781 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-10da6f28-03d2-428d-a6d4-250d68dc674b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:38.117241 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-10da6f28-03d2-428d-a6d4-250d68dc674b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:38.117669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-10da6f28-03d2-428d-a6d4-250d68dc674b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:38.189915 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-10da6f28-03d2-428d-a6d4-250d68dc674b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:38.198151 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-10da6f28-03d2-428d-a6d4-250d68dc674b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.094158 Aug 24 12:55:38.200346 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1709/3414] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:38 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:38.205220 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fdd18b95-1241-4355-81a6-1e31c2087f6b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:38.205840 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fdd18b95-1241-4355-81a6-1e31c2087f6b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:38.209710 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:55:38.215250 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fdd18b95-1241-4355-81a6-1e31c2087f6b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:38.215994 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fdd18b95-1241-4355-81a6-1e31c2087f6b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:38.216671 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fdd18b95-1241-4355-81a6-1e31c2087f6b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:38.217738 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fdd18b95-1241-4355-81a6-1e31c2087f6b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:38.218445 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fdd18b95-1241-4355-81a6-1e31c2087f6b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:38.219145 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fdd18b95-1241-4355-81a6-1e31c2087f6b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:38.436938 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fdd18b95-1241-4355-81a6-1e31c2087f6b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:38.446607 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fdd18b95-1241-4355-81a6-1e31c2087f6b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.245076 Aug 24 12:55:38.447398 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1706/3415] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:38 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:39.219880 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fbde7cd4-6445-483b-aabf-1bbd2112be1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:39.220501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fbde7cd4-6445-483b-aabf-1bbd2112be1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:39.222853 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:55:39.228038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fbde7cd4-6445-483b-aabf-1bbd2112be1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:39.228530 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fbde7cd4-6445-483b-aabf-1bbd2112be1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:39.230716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fbde7cd4-6445-483b-aabf-1bbd2112be1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:39.230716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fbde7cd4-6445-483b-aabf-1bbd2112be1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:39.230716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fbde7cd4-6445-483b-aabf-1bbd2112be1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:39.230716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fbde7cd4-6445-483b-aabf-1bbd2112be1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:39.341165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fbde7cd4-6445-483b-aabf-1bbd2112be1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:39.350384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fbde7cd4-6445-483b-aabf-1bbd2112be1c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.134363 Aug 24 12:55:39.351012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1710/3416] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:39 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:39.467683 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0dd6a8c2-0dc4-4da1-bc50-29d3b678fe9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:39.468291 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0dd6a8c2-0dc4-4da1-bc50-29d3b678fe9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:39.475245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0dd6a8c2-0dc4-4da1-bc50-29d3b678fe9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:39.482871 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0dd6a8c2-0dc4-4da1-bc50-29d3b678fe9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:39.482871 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0dd6a8c2-0dc4-4da1-bc50-29d3b678fe9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:39.482871 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0dd6a8c2-0dc4-4da1-bc50-29d3b678fe9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:39.482871 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0dd6a8c2-0dc4-4da1-bc50-29d3b678fe9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:39.483167 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0dd6a8c2-0dc4-4da1-bc50-29d3b678fe9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:39.614287 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0dd6a8c2-0dc4-4da1-bc50-29d3b678fe9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:39.623630 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0dd6a8c2-0dc4-4da1-bc50-29d3b678fe9b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.159472 Aug 24 12:55:39.628607 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1707/3417] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:39 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:40.373513 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-63da90f9-8559-487e-b4c7-34f6ddda38a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:40.374675 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-63da90f9-8559-487e-b4c7-34f6ddda38a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:40.381796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63da90f9-8559-487e-b4c7-34f6ddda38a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:40.382288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63da90f9-8559-487e-b4c7-34f6ddda38a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:40.382757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63da90f9-8559-487e-b4c7-34f6ddda38a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:40.383455 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63da90f9-8559-487e-b4c7-34f6ddda38a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:40.383914 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63da90f9-8559-487e-b4c7-34f6ddda38a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:40.384341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-63da90f9-8559-487e-b4c7-34f6ddda38a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:40.448074 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-63da90f9-8559-487e-b4c7-34f6ddda38a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:40.456241 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-63da90f9-8559-487e-b4c7-34f6ddda38a6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.086979 Aug 24 12:55:40.456797 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1711/3418] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:40 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:40.644781 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2e2efa5c-e9a5-4194-88de-d333921d39cc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:40.645345 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2e2efa5c-e9a5-4194-88de-d333921d39cc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:40.651757 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2e2efa5c-e9a5-4194-88de-d333921d39cc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:40.652231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2e2efa5c-e9a5-4194-88de-d333921d39cc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:40.652659 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2e2efa5c-e9a5-4194-88de-d333921d39cc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:40.653332 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2e2efa5c-e9a5-4194-88de-d333921d39cc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:40.653779 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2e2efa5c-e9a5-4194-88de-d333921d39cc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:40.654201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2e2efa5c-e9a5-4194-88de-d333921d39cc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:40.784677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2e2efa5c-e9a5-4194-88de-d333921d39cc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:40.794786 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2e2efa5c-e9a5-4194-88de-d333921d39cc tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153795 Aug 24 12:55:40.795411 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1708/3419] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:40 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:41.476527 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-09d6c6ba-262c-4970-a009-a1daebfd4e81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:41.477140 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-09d6c6ba-262c-4970-a009-a1daebfd4e81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:41.483499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09d6c6ba-262c-4970-a009-a1daebfd4e81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:41.483980 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09d6c6ba-262c-4970-a009-a1daebfd4e81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:41.484417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09d6c6ba-262c-4970-a009-a1daebfd4e81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:41.485102 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09d6c6ba-262c-4970-a009-a1daebfd4e81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:41.485559 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09d6c6ba-262c-4970-a009-a1daebfd4e81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:41.485986 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09d6c6ba-262c-4970-a009-a1daebfd4e81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:41.546550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-09d6c6ba-262c-4970-a009-a1daebfd4e81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:41.554566 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-09d6c6ba-262c-4970-a009-a1daebfd4e81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081984 Aug 24 12:55:41.555160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1712/3420] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:41 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:41.816368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-876fa935-d2b8-4b17-a2c7-460bdfcbb4c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:41.817003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-876fa935-d2b8-4b17-a2c7-460bdfcbb4c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:41.823971 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-876fa935-d2b8-4b17-a2c7-460bdfcbb4c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:41.824456 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-876fa935-d2b8-4b17-a2c7-460bdfcbb4c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:41.824889 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-876fa935-d2b8-4b17-a2c7-460bdfcbb4c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:41.825569 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-876fa935-d2b8-4b17-a2c7-460bdfcbb4c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:41.826025 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-876fa935-d2b8-4b17-a2c7-460bdfcbb4c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:41.826450 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-876fa935-d2b8-4b17-a2c7-460bdfcbb4c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:41.955635 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-876fa935-d2b8-4b17-a2c7-460bdfcbb4c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:41.957796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:55:41.964272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-876fa935-d2b8-4b17-a2c7-460bdfcbb4c9 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151774 Aug 24 12:55:41.964831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1709/3421] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:41 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:42.575852 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d5aa4d8c-63b1-42c7-992f-ce43232cf53a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:42.576463 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d5aa4d8c-63b1-42c7-992f-ce43232cf53a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:42.582820 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d5aa4d8c-63b1-42c7-992f-ce43232cf53a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:42.583818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d5aa4d8c-63b1-42c7-992f-ce43232cf53a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:42.584254 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d5aa4d8c-63b1-42c7-992f-ce43232cf53a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:42.584936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d5aa4d8c-63b1-42c7-992f-ce43232cf53a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:42.585394 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d5aa4d8c-63b1-42c7-992f-ce43232cf53a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:42.585823 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d5aa4d8c-63b1-42c7-992f-ce43232cf53a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:42.648943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d5aa4d8c-63b1-42c7-992f-ce43232cf53a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:42.657062 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d5aa4d8c-63b1-42c7-992f-ce43232cf53a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085042 Aug 24 12:55:42.657630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1713/3422] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:42 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:42.984543 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0a70254d-b7ce-440a-91c1-09b3ec3c34e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:42.985152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0a70254d-b7ce-440a-91c1-09b3ec3c34e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:42.992343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a70254d-b7ce-440a-91c1-09b3ec3c34e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:42.992823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a70254d-b7ce-440a-91c1-09b3ec3c34e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:42.993260 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a70254d-b7ce-440a-91c1-09b3ec3c34e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:42.993936 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a70254d-b7ce-440a-91c1-09b3ec3c34e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:42.994387 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a70254d-b7ce-440a-91c1-09b3ec3c34e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:42.994846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a70254d-b7ce-440a-91c1-09b3ec3c34e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:43.120324 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0a70254d-b7ce-440a-91c1-09b3ec3c34e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:43.128409 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0a70254d-b7ce-440a-91c1-09b3ec3c34e3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.147890 Aug 24 12:55:43.131421 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1710/3423] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:42 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:43.677911 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c5536869-af20-488d-9a98-bd0185afe338 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:43.678565 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c5536869-af20-488d-9a98-bd0185afe338 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:43.685055 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c5536869-af20-488d-9a98-bd0185afe338 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:43.685543 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c5536869-af20-488d-9a98-bd0185afe338 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:43.685982 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c5536869-af20-488d-9a98-bd0185afe338 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:43.686682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c5536869-af20-488d-9a98-bd0185afe338 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:43.687143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c5536869-af20-488d-9a98-bd0185afe338 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:43.687596 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c5536869-af20-488d-9a98-bd0185afe338 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:43.748934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c5536869-af20-488d-9a98-bd0185afe338 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:43.756997 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c5536869-af20-488d-9a98-bd0185afe338 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083513 Aug 24 12:55:43.757533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1714/3424] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:43 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:44.149776 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b367d5c2-6271-45fa-8b94-eb8f55adcc63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:44.150389 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b367d5c2-6271-45fa-8b94-eb8f55adcc63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:44.156896 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b367d5c2-6271-45fa-8b94-eb8f55adcc63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:44.157382 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b367d5c2-6271-45fa-8b94-eb8f55adcc63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:44.157822 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b367d5c2-6271-45fa-8b94-eb8f55adcc63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:44.158509 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b367d5c2-6271-45fa-8b94-eb8f55adcc63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:44.158994 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b367d5c2-6271-45fa-8b94-eb8f55adcc63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:44.159427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b367d5c2-6271-45fa-8b94-eb8f55adcc63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:44.284514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b367d5c2-6271-45fa-8b94-eb8f55adcc63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:44.293128 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b367d5c2-6271-45fa-8b94-eb8f55adcc63 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.147733 Aug 24 12:55:44.293684 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1711/3425] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:44 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:44.777790 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e9c3c508-ffd8-410b-80b6-6c4f0f02a62c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:44.778399 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e9c3c508-ffd8-410b-80b6-6c4f0f02a62c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:44.784768 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9c3c508-ffd8-410b-80b6-6c4f0f02a62c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:44.785254 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9c3c508-ffd8-410b-80b6-6c4f0f02a62c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:44.785687 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9c3c508-ffd8-410b-80b6-6c4f0f02a62c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:44.786405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9c3c508-ffd8-410b-80b6-6c4f0f02a62c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:44.786886 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9c3c508-ffd8-410b-80b6-6c4f0f02a62c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:44.787312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9c3c508-ffd8-410b-80b6-6c4f0f02a62c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:44.847226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e9c3c508-ffd8-410b-80b6-6c4f0f02a62c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:44.855688 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e9c3c508-ffd8-410b-80b6-6c4f0f02a62c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081805 Aug 24 12:55:44.856237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1715/3426] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:44 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:45.313259 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d48e8245-02c6-4f81-88fe-9c604ec85e34 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:45.313867 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d48e8245-02c6-4f81-88fe-9c604ec85e34 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:45.320224 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d48e8245-02c6-4f81-88fe-9c604ec85e34 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:45.320719 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d48e8245-02c6-4f81-88fe-9c604ec85e34 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:45.321153 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d48e8245-02c6-4f81-88fe-9c604ec85e34 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:45.321831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d48e8245-02c6-4f81-88fe-9c604ec85e34 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:45.322283 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d48e8245-02c6-4f81-88fe-9c604ec85e34 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:45.322730 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d48e8245-02c6-4f81-88fe-9c604ec85e34 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:45.453463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d48e8245-02c6-4f81-88fe-9c604ec85e34 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:45.461535 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d48e8245-02c6-4f81-88fe-9c604ec85e34 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152093 Aug 24 12:55:45.462100 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1712/3427] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:45 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:45.877438 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-03d584df-d539-45b8-8d9e-2db5bda6c1e0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:45.878043 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-03d584df-d539-45b8-8d9e-2db5bda6c1e0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:45.885530 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03d584df-d539-45b8-8d9e-2db5bda6c1e0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:45.886007 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03d584df-d539-45b8-8d9e-2db5bda6c1e0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:45.886499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03d584df-d539-45b8-8d9e-2db5bda6c1e0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:45.887204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03d584df-d539-45b8-8d9e-2db5bda6c1e0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:45.887660 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03d584df-d539-45b8-8d9e-2db5bda6c1e0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:45.888083 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-03d584df-d539-45b8-8d9e-2db5bda6c1e0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:45.948235 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-03d584df-d539-45b8-8d9e-2db5bda6c1e0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:45.956325 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-03d584df-d539-45b8-8d9e-2db5bda6c1e0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083002 Aug 24 12:55:45.956883 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1716/3428] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:45 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:46.482634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8a8329ea-18a0-4d68-9d17-bad3702ad18f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:46.483292 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8a8329ea-18a0-4d68-9d17-bad3702ad18f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:46.489920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8a8329ea-18a0-4d68-9d17-bad3702ad18f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:46.490397 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8a8329ea-18a0-4d68-9d17-bad3702ad18f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:46.490867 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8a8329ea-18a0-4d68-9d17-bad3702ad18f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:46.491541 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8a8329ea-18a0-4d68-9d17-bad3702ad18f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:46.492023 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8a8329ea-18a0-4d68-9d17-bad3702ad18f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:46.492447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8a8329ea-18a0-4d68-9d17-bad3702ad18f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:46.617191 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8a8329ea-18a0-4d68-9d17-bad3702ad18f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:46.625112 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8a8329ea-18a0-4d68-9d17-bad3702ad18f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.146439 Aug 24 12:55:46.625666 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1713/3429] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:46 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:46.977687 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2232640b-49d0-4a53-ad25-7c0685b643aa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:46.978300 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2232640b-49d0-4a53-ad25-7c0685b643aa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:46.984570 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2232640b-49d0-4a53-ad25-7c0685b643aa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:46.985047 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2232640b-49d0-4a53-ad25-7c0685b643aa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:46.985477 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2232640b-49d0-4a53-ad25-7c0685b643aa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:46.986150 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2232640b-49d0-4a53-ad25-7c0685b643aa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:46.986890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2232640b-49d0-4a53-ad25-7c0685b643aa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:46.987312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2232640b-49d0-4a53-ad25-7c0685b643aa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:47.052555 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2232640b-49d0-4a53-ad25-7c0685b643aa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:47.060673 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2232640b-49d0-4a53-ad25-7c0685b643aa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.087297 Aug 24 12:55:47.061265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1717/3430] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:46 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:47.646798 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4b326653-4072-4c7d-a29d-9e9829587a28 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:47.647402 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4b326653-4072-4c7d-a29d-9e9829587a28 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:47.653827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b326653-4072-4c7d-a29d-9e9829587a28 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:47.654304 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b326653-4072-4c7d-a29d-9e9829587a28 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:47.654762 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b326653-4072-4c7d-a29d-9e9829587a28 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:47.655441 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b326653-4072-4c7d-a29d-9e9829587a28 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:47.655891 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b326653-4072-4c7d-a29d-9e9829587a28 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:47.656317 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b326653-4072-4c7d-a29d-9e9829587a28 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:47.791324 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4b326653-4072-4c7d-a29d-9e9829587a28 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:47.799343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4b326653-4072-4c7d-a29d-9e9829587a28 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.157108 Aug 24 12:55:47.799902 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1714/3431] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:47 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:48.082139 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f8dc70f7-6be8-4da3-8f0d-0d81bdf7526a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:48.082663 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f8dc70f7-6be8-4da3-8f0d-0d81bdf7526a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:48.089528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f8dc70f7-6be8-4da3-8f0d-0d81bdf7526a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:48.090012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f8dc70f7-6be8-4da3-8f0d-0d81bdf7526a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:48.090450 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f8dc70f7-6be8-4da3-8f0d-0d81bdf7526a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:48.091160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f8dc70f7-6be8-4da3-8f0d-0d81bdf7526a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:48.091620 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f8dc70f7-6be8-4da3-8f0d-0d81bdf7526a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:48.092043 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f8dc70f7-6be8-4da3-8f0d-0d81bdf7526a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:48.152724 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f8dc70f7-6be8-4da3-8f0d-0d81bdf7526a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:48.160831 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f8dc70f7-6be8-4da3-8f0d-0d81bdf7526a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082711 Aug 24 12:55:48.161393 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1718/3432] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:48 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:48.821093 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4ae4f563-67f5-4137-b810-2e08c71be9ea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:48.821730 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4ae4f563-67f5-4137-b810-2e08c71be9ea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:48.828130 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ae4f563-67f5-4137-b810-2e08c71be9ea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:48.828610 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ae4f563-67f5-4137-b810-2e08c71be9ea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:48.829046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ae4f563-67f5-4137-b810-2e08c71be9ea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:48.830536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ae4f563-67f5-4137-b810-2e08c71be9ea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:48.830536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ae4f563-67f5-4137-b810-2e08c71be9ea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:48.830696 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ae4f563-67f5-4137-b810-2e08c71be9ea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:48.960279 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4ae4f563-67f5-4137-b810-2e08c71be9ea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:48.968456 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4ae4f563-67f5-4137-b810-2e08c71be9ea tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151860 Aug 24 12:55:48.969011 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1715/3433] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:48 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:49.182282 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2dde44c8-2f06-4104-80ae-ef421567be84 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:49.182841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2dde44c8-2f06-4104-80ae-ef421567be84 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:49.189246 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2dde44c8-2f06-4104-80ae-ef421567be84 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:49.189721 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2dde44c8-2f06-4104-80ae-ef421567be84 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:49.190153 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2dde44c8-2f06-4104-80ae-ef421567be84 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:49.190864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2dde44c8-2f06-4104-80ae-ef421567be84 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:49.191321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2dde44c8-2f06-4104-80ae-ef421567be84 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:49.191750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2dde44c8-2f06-4104-80ae-ef421567be84 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:49.252598 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2dde44c8-2f06-4104-80ae-ef421567be84 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:49.261258 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2dde44c8-2f06-4104-80ae-ef421567be84 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082881 Aug 24 12:55:49.261806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1719/3434] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:49 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:49.990131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1e97348c-4324-44df-93c8-8a752d0f1a26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:49.990777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1e97348c-4324-44df-93c8-8a752d0f1a26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:49.997556 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1e97348c-4324-44df-93c8-8a752d0f1a26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:49.998045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1e97348c-4324-44df-93c8-8a752d0f1a26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:49.998483 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1e97348c-4324-44df-93c8-8a752d0f1a26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:49.999217 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1e97348c-4324-44df-93c8-8a752d0f1a26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:49.999709 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1e97348c-4324-44df-93c8-8a752d0f1a26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:50.000133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1e97348c-4324-44df-93c8-8a752d0f1a26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:50.130426 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1e97348c-4324-44df-93c8-8a752d0f1a26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:50.138505 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1e97348c-4324-44df-93c8-8a752d0f1a26 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153124 Aug 24 12:55:50.139092 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1716/3435] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:49 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:50.282619 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5dac90c3-0007-437c-af3b-ad60b2707a42 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:50.283234 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5dac90c3-0007-437c-af3b-ad60b2707a42 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:50.290298 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5dac90c3-0007-437c-af3b-ad60b2707a42 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:50.293568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5dac90c3-0007-437c-af3b-ad60b2707a42 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:50.293568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5dac90c3-0007-437c-af3b-ad60b2707a42 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:50.293568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5dac90c3-0007-437c-af3b-ad60b2707a42 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:50.293568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5dac90c3-0007-437c-af3b-ad60b2707a42 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:50.293884 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5dac90c3-0007-437c-af3b-ad60b2707a42 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:50.354059 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5dac90c3-0007-437c-af3b-ad60b2707a42 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:50.362417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5dac90c3-0007-437c-af3b-ad60b2707a42 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083780 Aug 24 12:55:50.363009 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1720/3436] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:50 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:51.204962 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b069cd06-8b2e-45d3-8c23-88494bc2f64b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:51.205780 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b069cd06-8b2e-45d3-8c23-88494bc2f64b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:51.212555 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b069cd06-8b2e-45d3-8c23-88494bc2f64b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:51.213040 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b069cd06-8b2e-45d3-8c23-88494bc2f64b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:51.213477 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b069cd06-8b2e-45d3-8c23-88494bc2f64b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:51.214200 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b069cd06-8b2e-45d3-8c23-88494bc2f64b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:51.214748 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b069cd06-8b2e-45d3-8c23-88494bc2f64b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:51.215180 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b069cd06-8b2e-45d3-8c23-88494bc2f64b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:51.343604 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b069cd06-8b2e-45d3-8c23-88494bc2f64b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:51.351785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b069cd06-8b2e-45d3-8c23-88494bc2f64b tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.195480 Aug 24 12:55:51.352351 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1717/3437] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:51 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:51.383683 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-30ab325c-751e-478f-93fc-91aaf9956882 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:51.384288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-30ab325c-751e-478f-93fc-91aaf9956882 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:51.390700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30ab325c-751e-478f-93fc-91aaf9956882 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:51.391184 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30ab325c-751e-478f-93fc-91aaf9956882 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:51.391615 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30ab325c-751e-478f-93fc-91aaf9956882 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:51.392289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30ab325c-751e-478f-93fc-91aaf9956882 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:51.392738 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30ab325c-751e-478f-93fc-91aaf9956882 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:51.393158 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30ab325c-751e-478f-93fc-91aaf9956882 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:51.455766 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-30ab325c-751e-478f-93fc-91aaf9956882 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:51.464418 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-30ab325c-751e-478f-93fc-91aaf9956882 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085083 Aug 24 12:55:51.464971 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1721/3438] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:51 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:52.372583 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9b7da542-69dc-4ba6-b0b6-9b5e00707404 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:52.373194 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9b7da542-69dc-4ba6-b0b6-9b5e00707404 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:52.379558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b7da542-69dc-4ba6-b0b6-9b5e00707404 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:52.380034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b7da542-69dc-4ba6-b0b6-9b5e00707404 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:52.380464 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b7da542-69dc-4ba6-b0b6-9b5e00707404 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:52.381147 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b7da542-69dc-4ba6-b0b6-9b5e00707404 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:52.381599 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b7da542-69dc-4ba6-b0b6-9b5e00707404 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:52.382024 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b7da542-69dc-4ba6-b0b6-9b5e00707404 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:52.485183 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-afd2c10d-6426-47c5-ab58-ecdba12a13d6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:52.485790 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-afd2c10d-6426-47c5-ab58-ecdba12a13d6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:52.492360 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-afd2c10d-6426-47c5-ab58-ecdba12a13d6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:52.492840 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-afd2c10d-6426-47c5-ab58-ecdba12a13d6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:52.493275 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-afd2c10d-6426-47c5-ab58-ecdba12a13d6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:52.493953 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-afd2c10d-6426-47c5-ab58-ecdba12a13d6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:52.494403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-afd2c10d-6426-47c5-ab58-ecdba12a13d6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:52.494860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-afd2c10d-6426-47c5-ab58-ecdba12a13d6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:52.509719 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9b7da542-69dc-4ba6-b0b6-9b5e00707404 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:52.518774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9b7da542-69dc-4ba6-b0b6-9b5e00707404 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149913 Aug 24 12:55:52.519766 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1718/3439] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:52 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:52.556541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-afd2c10d-6426-47c5-ab58-ecdba12a13d6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:52.564844 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-afd2c10d-6426-47c5-ab58-ecdba12a13d6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083486 Aug 24 12:55:52.565395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1722/3440] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:52 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:53.539770 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d856b4c7-50ce-47e5-88bc-311458fc35d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:53.540382 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d856b4c7-50ce-47e5-88bc-311458fc35d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:53.546967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d856b4c7-50ce-47e5-88bc-311458fc35d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:53.547452 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d856b4c7-50ce-47e5-88bc-311458fc35d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:53.547887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d856b4c7-50ce-47e5-88bc-311458fc35d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:53.548566 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d856b4c7-50ce-47e5-88bc-311458fc35d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:53.549020 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d856b4c7-50ce-47e5-88bc-311458fc35d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:53.549446 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d856b4c7-50ce-47e5-88bc-311458fc35d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:53.585042 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-30fee265-cfb2-4cec-9f48-46f937bea358 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:53.585652 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-30fee265-cfb2-4cec-9f48-46f937bea358 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:53.592632 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30fee265-cfb2-4cec-9f48-46f937bea358 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:53.593166 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30fee265-cfb2-4cec-9f48-46f937bea358 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:53.593593 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30fee265-cfb2-4cec-9f48-46f937bea358 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:53.594292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30fee265-cfb2-4cec-9f48-46f937bea358 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:53.594780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30fee265-cfb2-4cec-9f48-46f937bea358 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:53.595208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30fee265-cfb2-4cec-9f48-46f937bea358 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:53.663199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-30fee265-cfb2-4cec-9f48-46f937bea358 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:53.671837 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-30fee265-cfb2-4cec-9f48-46f937bea358 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.090480 Aug 24 12:55:53.672628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1723/3441] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:53 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:55:53.934698 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d856b4c7-50ce-47e5-88bc-311458fc35d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:53.942926 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d856b4c7-50ce-47e5-88bc-311458fc35d3 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.407462 Aug 24 12:55:53.943494 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1719/3442] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:53 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:54.693934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-20d7cecc-2679-4cbc-89b5-d53414d83b1e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:54.694493 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-20d7cecc-2679-4cbc-89b5-d53414d83b1e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:54.700827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-20d7cecc-2679-4cbc-89b5-d53414d83b1e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:54.701302 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-20d7cecc-2679-4cbc-89b5-d53414d83b1e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:54.701733 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-20d7cecc-2679-4cbc-89b5-d53414d83b1e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:54.702408 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-20d7cecc-2679-4cbc-89b5-d53414d83b1e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:54.702905 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-20d7cecc-2679-4cbc-89b5-d53414d83b1e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:54.703327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-20d7cecc-2679-4cbc-89b5-d53414d83b1e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:54.719609 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:55:54.765977 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-20d7cecc-2679-4cbc-89b5-d53414d83b1e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:54.774027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-20d7cecc-2679-4cbc-89b5-d53414d83b1e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084610 Aug 24 12:55:54.774575 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1724/3443] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:54 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:54.963812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4b3c9bea-5700-424d-bbac-8542db809f09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:54.964353 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4b3c9bea-5700-424d-bbac-8542db809f09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:54.970682 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b3c9bea-5700-424d-bbac-8542db809f09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:54.971163 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b3c9bea-5700-424d-bbac-8542db809f09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:54.971595 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b3c9bea-5700-424d-bbac-8542db809f09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:54.972273 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b3c9bea-5700-424d-bbac-8542db809f09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:54.972723 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b3c9bea-5700-424d-bbac-8542db809f09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:54.973645 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b3c9bea-5700-424d-bbac-8542db809f09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:55.101276 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4b3c9bea-5700-424d-bbac-8542db809f09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:55.109428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4b3c9bea-5700-424d-bbac-8542db809f09 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149539 Aug 24 12:55:55.109984 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1720/3444] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:54 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:55.794980 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-96e48f88-b536-4827-acc2-502f1e5948ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:55.795601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-96e48f88-b536-4827-acc2-502f1e5948ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:55.802048 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96e48f88-b536-4827-acc2-502f1e5948ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:55.802531 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96e48f88-b536-4827-acc2-502f1e5948ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:55.803015 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96e48f88-b536-4827-acc2-502f1e5948ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:55.803699 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96e48f88-b536-4827-acc2-502f1e5948ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:55.804162 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96e48f88-b536-4827-acc2-502f1e5948ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:55.804591 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96e48f88-b536-4827-acc2-502f1e5948ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:55.867685 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-96e48f88-b536-4827-acc2-502f1e5948ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:55.875755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-96e48f88-b536-4827-acc2-502f1e5948ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084716 Aug 24 12:55:55.876314 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1725/3445] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:55 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:56.131560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d8ceab5e-53da-4ee7-80d0-2daede72e72a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:56.132092 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d8ceab5e-53da-4ee7-80d0-2daede72e72a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:56.138474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8ceab5e-53da-4ee7-80d0-2daede72e72a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:56.138987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8ceab5e-53da-4ee7-80d0-2daede72e72a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:56.139425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8ceab5e-53da-4ee7-80d0-2daede72e72a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:56.140107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8ceab5e-53da-4ee7-80d0-2daede72e72a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:56.140559 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8ceab5e-53da-4ee7-80d0-2daede72e72a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:56.141009 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d8ceab5e-53da-4ee7-80d0-2daede72e72a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:56.270692 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d8ceab5e-53da-4ee7-80d0-2daede72e72a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:56.283890 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d8ceab5e-53da-4ee7-80d0-2daede72e72a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.156859 Aug 24 12:55:56.284480 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1721/3446] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:56 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:56.896880 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8979727f-08aa-4030-bfd8-959a89c92d57 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:56.897488 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8979727f-08aa-4030-bfd8-959a89c92d57 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:56.903908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8979727f-08aa-4030-bfd8-959a89c92d57 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:56.904394 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8979727f-08aa-4030-bfd8-959a89c92d57 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:56.904833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8979727f-08aa-4030-bfd8-959a89c92d57 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:56.905518 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8979727f-08aa-4030-bfd8-959a89c92d57 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:56.905975 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8979727f-08aa-4030-bfd8-959a89c92d57 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:56.906401 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8979727f-08aa-4030-bfd8-959a89c92d57 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:56.966970 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8979727f-08aa-4030-bfd8-959a89c92d57 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:56.975015 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8979727f-08aa-4030-bfd8-959a89c92d57 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081928 Aug 24 12:55:56.975729 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1726/3447] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:56 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:57.305128 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e2112d74-8c0e-429c-869a-4b8301961658 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:57.305758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e2112d74-8c0e-429c-869a-4b8301961658 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:57.312197 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2112d74-8c0e-429c-869a-4b8301961658 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:57.312669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2112d74-8c0e-429c-869a-4b8301961658 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:57.313096 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2112d74-8c0e-429c-869a-4b8301961658 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:57.313768 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2112d74-8c0e-429c-869a-4b8301961658 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:57.314212 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2112d74-8c0e-429c-869a-4b8301961658 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:57.314628 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2112d74-8c0e-429c-869a-4b8301961658 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:57.456204 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e2112d74-8c0e-429c-869a-4b8301961658 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:57.465100 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e2112d74-8c0e-429c-869a-4b8301961658 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.164494 Aug 24 12:55:57.465666 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1722/3448] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:57 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:57.996656 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c985ecf2-f356-4ce0-8910-9767ae76db78 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:57.997273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c985ecf2-f356-4ce0-8910-9767ae76db78 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:58.003667 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c985ecf2-f356-4ce0-8910-9767ae76db78 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:58.004157 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c985ecf2-f356-4ce0-8910-9767ae76db78 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:58.004712 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c985ecf2-f356-4ce0-8910-9767ae76db78 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:58.005295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c985ecf2-f356-4ce0-8910-9767ae76db78 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:58.005756 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c985ecf2-f356-4ce0-8910-9767ae76db78 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:58.006180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c985ecf2-f356-4ce0-8910-9767ae76db78 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:58.067152 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c985ecf2-f356-4ce0-8910-9767ae76db78 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:58.075399 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c985ecf2-f356-4ce0-8910-9767ae76db78 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082636 Aug 24 12:55:58.075972 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1727/3449] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:57 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:58.485993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4a50f2f7-e371-4714-936b-184cb915f04c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:58.486875 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4a50f2f7-e371-4714-936b-184cb915f04c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:58.493523 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a50f2f7-e371-4714-936b-184cb915f04c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:58.494031 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a50f2f7-e371-4714-936b-184cb915f04c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:58.494466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a50f2f7-e371-4714-936b-184cb915f04c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:58.495179 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a50f2f7-e371-4714-936b-184cb915f04c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:58.495682 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a50f2f7-e371-4714-936b-184cb915f04c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:58.496108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a50f2f7-e371-4714-936b-184cb915f04c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:58.625312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4a50f2f7-e371-4714-936b-184cb915f04c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:58.634083 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4a50f2f7-e371-4714-936b-184cb915f04c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152050 Aug 24 12:55:58.634638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1723/3450] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:58 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:59.096190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-232d0dc5-b663-4742-ad1e-9f1b43eb6a7c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:59.096798 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-232d0dc5-b663-4742-ad1e-9f1b43eb6a7c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:59.103149 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-232d0dc5-b663-4742-ad1e-9f1b43eb6a7c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:59.103639 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-232d0dc5-b663-4742-ad1e-9f1b43eb6a7c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:59.104080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-232d0dc5-b663-4742-ad1e-9f1b43eb6a7c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:59.104765 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-232d0dc5-b663-4742-ad1e-9f1b43eb6a7c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:59.105226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-232d0dc5-b663-4742-ad1e-9f1b43eb6a7c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:59.105653 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-232d0dc5-b663-4742-ad1e-9f1b43eb6a7c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:59.165198 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-232d0dc5-b663-4742-ad1e-9f1b43eb6a7c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:59.173226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-232d0dc5-b663-4742-ad1e-9f1b43eb6a7c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.080985 Aug 24 12:55:59.173785 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1728/3451] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:59 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:55:59.655268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-04ea0b9a-e176-425c-8768-a101a18d4222 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:55:59.655876 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-04ea0b9a-e176-425c-8768-a101a18d4222 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:55:59.662197 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04ea0b9a-e176-425c-8768-a101a18d4222 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:59.662711 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04ea0b9a-e176-425c-8768-a101a18d4222 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:59.663153 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04ea0b9a-e176-425c-8768-a101a18d4222 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:59.663834 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04ea0b9a-e176-425c-8768-a101a18d4222 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:55:59.664294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04ea0b9a-e176-425c-8768-a101a18d4222 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:55:59.664721 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-04ea0b9a-e176-425c-8768-a101a18d4222 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:55:59.792976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-04ea0b9a-e176-425c-8768-a101a18d4222 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:55:59.801255 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-04ea0b9a-e176-425c-8768-a101a18d4222 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149840 Aug 24 12:55:59.801812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1724/3452] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:55:59 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:00.193369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-afcc8dd9-2cda-4122-9e01-8e18ba68b678 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:00.193897 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-afcc8dd9-2cda-4122-9e01-8e18ba68b678 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:00.200323 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-afcc8dd9-2cda-4122-9e01-8e18ba68b678 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:00.200814 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-afcc8dd9-2cda-4122-9e01-8e18ba68b678 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:00.201225 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-afcc8dd9-2cda-4122-9e01-8e18ba68b678 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:00.201898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-afcc8dd9-2cda-4122-9e01-8e18ba68b678 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:00.202349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-afcc8dd9-2cda-4122-9e01-8e18ba68b678 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:00.202799 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-afcc8dd9-2cda-4122-9e01-8e18ba68b678 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:00.265395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-afcc8dd9-2cda-4122-9e01-8e18ba68b678 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:00.273753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-afcc8dd9-2cda-4122-9e01-8e18ba68b678 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084152 Aug 24 12:56:00.274313 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1729/3453] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:00 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:00.826473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f64d1e6c-2272-42d7-989a-60ce3ab77eab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:00.827114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f64d1e6c-2272-42d7-989a-60ce3ab77eab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:00.833994 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f64d1e6c-2272-42d7-989a-60ce3ab77eab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:00.834474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f64d1e6c-2272-42d7-989a-60ce3ab77eab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:00.835010 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f64d1e6c-2272-42d7-989a-60ce3ab77eab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:00.835693 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f64d1e6c-2272-42d7-989a-60ce3ab77eab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:00.836151 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f64d1e6c-2272-42d7-989a-60ce3ab77eab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:00.836576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f64d1e6c-2272-42d7-989a-60ce3ab77eab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:00.965708 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f64d1e6c-2272-42d7-989a-60ce3ab77eab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:00.973807 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f64d1e6c-2272-42d7-989a-60ce3ab77eab tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151266 Aug 24 12:56:00.974380 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1725/3454] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:00 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:01.295672 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3a7e0d07-72dc-43fb-9b9e-57f26fdfa70e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:01.296282 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3a7e0d07-72dc-43fb-9b9e-57f26fdfa70e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:01.302697 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a7e0d07-72dc-43fb-9b9e-57f26fdfa70e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:01.303181 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a7e0d07-72dc-43fb-9b9e-57f26fdfa70e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:01.303622 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a7e0d07-72dc-43fb-9b9e-57f26fdfa70e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:01.304300 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a7e0d07-72dc-43fb-9b9e-57f26fdfa70e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:01.304761 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a7e0d07-72dc-43fb-9b9e-57f26fdfa70e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:01.305182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a7e0d07-72dc-43fb-9b9e-57f26fdfa70e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:01.367538 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3a7e0d07-72dc-43fb-9b9e-57f26fdfa70e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:01.375484 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3a7e0d07-72dc-43fb-9b9e-57f26fdfa70e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083698 Aug 24 12:56:01.376049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1730/3455] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:01 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:01.994562 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7a04b4ca-1caf-4de3-ae7a-a2a48df17b18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:01.995200 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7a04b4ca-1caf-4de3-ae7a-a2a48df17b18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:02.001496 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a04b4ca-1caf-4de3-ae7a-a2a48df17b18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:02.001969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a04b4ca-1caf-4de3-ae7a-a2a48df17b18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:02.002403 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a04b4ca-1caf-4de3-ae7a-a2a48df17b18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:02.003111 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a04b4ca-1caf-4de3-ae7a-a2a48df17b18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:02.003564 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a04b4ca-1caf-4de3-ae7a-a2a48df17b18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:02.003992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a04b4ca-1caf-4de3-ae7a-a2a48df17b18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:02.018839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:56:02.133731 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7a04b4ca-1caf-4de3-ae7a-a2a48df17b18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:02.141818 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7a04b4ca-1caf-4de3-ae7a-a2a48df17b18 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.151145 Aug 24 12:56:02.142373 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1726/3456] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:01 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:02.395758 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d1dc47ef-066c-4146-97b9-3fddde53e96b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:02.396370 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d1dc47ef-066c-4146-97b9-3fddde53e96b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:02.402999 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1dc47ef-066c-4146-97b9-3fddde53e96b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:02.403485 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1dc47ef-066c-4146-97b9-3fddde53e96b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:02.403926 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1dc47ef-066c-4146-97b9-3fddde53e96b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:02.404606 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1dc47ef-066c-4146-97b9-3fddde53e96b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:02.405058 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1dc47ef-066c-4146-97b9-3fddde53e96b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:02.405484 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1dc47ef-066c-4146-97b9-3fddde53e96b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:02.466193 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d1dc47ef-066c-4146-97b9-3fddde53e96b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:02.475059 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d1dc47ef-066c-4146-97b9-3fddde53e96b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083189 Aug 24 12:56:02.475613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1731/3457] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:02 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:03.162704 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-20121f83-4dbe-4854-81e8-c94f98d81fdb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:03.163314 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-20121f83-4dbe-4854-81e8-c94f98d81fdb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:03.169645 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20121f83-4dbe-4854-81e8-c94f98d81fdb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:03.170129 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20121f83-4dbe-4854-81e8-c94f98d81fdb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:03.170567 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20121f83-4dbe-4854-81e8-c94f98d81fdb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:03.171277 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20121f83-4dbe-4854-81e8-c94f98d81fdb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:03.171730 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20121f83-4dbe-4854-81e8-c94f98d81fdb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:03.172213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20121f83-4dbe-4854-81e8-c94f98d81fdb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:03.300495 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-20121f83-4dbe-4854-81e8-c94f98d81fdb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:03.309142 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-20121f83-4dbe-4854-81e8-c94f98d81fdb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.150911 Aug 24 12:56:03.309702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1727/3458] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:03 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:03.496905 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fb034474-04ab-46e6-88a6-d771c0babf3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:03.497537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fb034474-04ab-46e6-88a6-d771c0babf3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:03.504006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fb034474-04ab-46e6-88a6-d771c0babf3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:03.504420 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fb034474-04ab-46e6-88a6-d771c0babf3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:03.504860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fb034474-04ab-46e6-88a6-d771c0babf3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:03.505548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fb034474-04ab-46e6-88a6-d771c0babf3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:03.506007 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fb034474-04ab-46e6-88a6-d771c0babf3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:03.506434 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fb034474-04ab-46e6-88a6-d771c0babf3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:03.566412 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fb034474-04ab-46e6-88a6-d771c0babf3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:03.574407 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fb034474-04ab-46e6-88a6-d771c0babf3d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081414 Aug 24 12:56:03.574999 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1732/3459] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:03 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:04.329209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-21700256-dbfa-4d49-88c5-1a4d62ac77e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:04.329815 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-21700256-dbfa-4d49-88c5-1a4d62ac77e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:04.336399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-21700256-dbfa-4d49-88c5-1a4d62ac77e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:04.336877 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-21700256-dbfa-4d49-88c5-1a4d62ac77e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:04.337306 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-21700256-dbfa-4d49-88c5-1a4d62ac77e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:04.337979 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-21700256-dbfa-4d49-88c5-1a4d62ac77e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:04.338428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-21700256-dbfa-4d49-88c5-1a4d62ac77e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:04.338893 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-21700256-dbfa-4d49-88c5-1a4d62ac77e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:04.476609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-21700256-dbfa-4d49-88c5-1a4d62ac77e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:04.484618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-21700256-dbfa-4d49-88c5-1a4d62ac77e4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.159221 Aug 24 12:56:04.485169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1728/3460] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:04 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:04.595394 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-909246fd-5f6a-4d0d-81e9-c61794a2e293 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:04.595924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-909246fd-5f6a-4d0d-81e9-c61794a2e293 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:04.602762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-909246fd-5f6a-4d0d-81e9-c61794a2e293 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:04.603259 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-909246fd-5f6a-4d0d-81e9-c61794a2e293 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:04.603679 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-909246fd-5f6a-4d0d-81e9-c61794a2e293 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:04.604365 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-909246fd-5f6a-4d0d-81e9-c61794a2e293 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:04.604824 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-909246fd-5f6a-4d0d-81e9-c61794a2e293 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:04.605252 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-909246fd-5f6a-4d0d-81e9-c61794a2e293 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:04.668189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-909246fd-5f6a-4d0d-81e9-c61794a2e293 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:04.676165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-909246fd-5f6a-4d0d-81e9-c61794a2e293 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084684 Aug 24 12:56:04.676720 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1733/3461] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:04 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:05.505960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e47d52fb-c5a9-43c6-ad71-181ff0824f98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:05.506570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e47d52fb-c5a9-43c6-ad71-181ff0824f98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:05.512902 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e47d52fb-c5a9-43c6-ad71-181ff0824f98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:05.513384 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e47d52fb-c5a9-43c6-ad71-181ff0824f98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:05.513821 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e47d52fb-c5a9-43c6-ad71-181ff0824f98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:05.514499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e47d52fb-c5a9-43c6-ad71-181ff0824f98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:05.514980 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e47d52fb-c5a9-43c6-ad71-181ff0824f98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:05.515409 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e47d52fb-c5a9-43c6-ad71-181ff0824f98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:05.642087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e47d52fb-c5a9-43c6-ad71-181ff0824f98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:05.650364 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e47d52fb-c5a9-43c6-ad71-181ff0824f98 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148318 Aug 24 12:56:05.651003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1729/3462] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:05 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:05.697242 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-73609c5b-fa0d-40b2-aba7-7741a0a21d39 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:05.697789 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-73609c5b-fa0d-40b2-aba7-7741a0a21d39 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:05.704472 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-73609c5b-fa0d-40b2-aba7-7741a0a21d39 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:05.704961 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-73609c5b-fa0d-40b2-aba7-7741a0a21d39 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:05.705403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-73609c5b-fa0d-40b2-aba7-7741a0a21d39 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:05.706098 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-73609c5b-fa0d-40b2-aba7-7741a0a21d39 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:05.706559 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-73609c5b-fa0d-40b2-aba7-7741a0a21d39 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:05.707020 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-73609c5b-fa0d-40b2-aba7-7741a0a21d39 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:05.767773 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-73609c5b-fa0d-40b2-aba7-7741a0a21d39 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:05.776333 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-73609c5b-fa0d-40b2-aba7-7741a0a21d39 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082967 Aug 24 12:56:05.776892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1734/3463] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:05 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:06.671575 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e4426368-6ecd-45b3-ae3d-6c9cb1f7f77c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:06.672145 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e4426368-6ecd-45b3-ae3d-6c9cb1f7f77c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:06.679005 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4426368-6ecd-45b3-ae3d-6c9cb1f7f77c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:06.679481 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4426368-6ecd-45b3-ae3d-6c9cb1f7f77c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:06.679913 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4426368-6ecd-45b3-ae3d-6c9cb1f7f77c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:06.680587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4426368-6ecd-45b3-ae3d-6c9cb1f7f77c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:06.681034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4426368-6ecd-45b3-ae3d-6c9cb1f7f77c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:06.681455 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4426368-6ecd-45b3-ae3d-6c9cb1f7f77c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:06.797372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9605960d-83ab-4edc-beda-69037f7368a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:06.798086 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9605960d-83ab-4edc-beda-69037f7368a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:06.804788 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9605960d-83ab-4edc-beda-69037f7368a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:06.805314 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9605960d-83ab-4edc-beda-69037f7368a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:06.805760 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9605960d-83ab-4edc-beda-69037f7368a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:06.806460 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9605960d-83ab-4edc-beda-69037f7368a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:06.806944 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9605960d-83ab-4edc-beda-69037f7368a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:06.807383 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9605960d-83ab-4edc-beda-69037f7368a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:06.808922 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e4426368-6ecd-45b3-ae3d-6c9cb1f7f77c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:06.817043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e4426368-6ecd-45b3-ae3d-6c9cb1f7f77c tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.149392 Aug 24 12:56:06.818399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1730/3464] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:06 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:06.869077 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9605960d-83ab-4edc-beda-69037f7368a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:06.877181 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9605960d-83ab-4edc-beda-69037f7368a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083666 Aug 24 12:56:06.877728 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1735/3465] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:06 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:56:07.837823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b9ff6316-59cd-49e2-ba5f-23ecd5c5abc1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:07.838455 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b9ff6316-59cd-49e2-ba5f-23ecd5c5abc1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:07.844752 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b9ff6316-59cd-49e2-ba5f-23ecd5c5abc1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:07.845228 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b9ff6316-59cd-49e2-ba5f-23ecd5c5abc1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:07.845658 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b9ff6316-59cd-49e2-ba5f-23ecd5c5abc1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:07.846329 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b9ff6316-59cd-49e2-ba5f-23ecd5c5abc1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:07.846810 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b9ff6316-59cd-49e2-ba5f-23ecd5c5abc1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:07.847234 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b9ff6316-59cd-49e2-ba5f-23ecd5c5abc1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:07.897896 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-53710e5f-9a47-44cf-a8fa-8cb47ca73997 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:07.898531 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-53710e5f-9a47-44cf-a8fa-8cb47ca73997 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:07.904947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-53710e5f-9a47-44cf-a8fa-8cb47ca73997 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:07.905428 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-53710e5f-9a47-44cf-a8fa-8cb47ca73997 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:07.905862 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-53710e5f-9a47-44cf-a8fa-8cb47ca73997 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:07.906562 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-53710e5f-9a47-44cf-a8fa-8cb47ca73997 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:07.908207 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-53710e5f-9a47-44cf-a8fa-8cb47ca73997 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:07.908653 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-53710e5f-9a47-44cf-a8fa-8cb47ca73997 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:07.969288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-53710e5f-9a47-44cf-a8fa-8cb47ca73997 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:07.977416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-53710e5f-9a47-44cf-a8fa-8cb47ca73997 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084048 Aug 24 12:56:07.977991 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1736/3466] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:07 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:56:07.980033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b9ff6316-59cd-49e2-ba5f-23ecd5c5abc1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:07.988381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b9ff6316-59cd-49e2-ba5f-23ecd5c5abc1 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.154968 Aug 24 12:56:07.988922 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1731/3467] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:07 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:08.999873 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4cdc44d2-ac13-4354-ad12-7a1a88fb2fa7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:09.000507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4cdc44d2-ac13-4354-ad12-7a1a88fb2fa7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:09.007014 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4cdc44d2-ac13-4354-ad12-7a1a88fb2fa7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:09.007496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4cdc44d2-ac13-4354-ad12-7a1a88fb2fa7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:09.007926 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4cdc44d2-ac13-4354-ad12-7a1a88fb2fa7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:09.008601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4cdc44d2-ac13-4354-ad12-7a1a88fb2fa7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:09.009040 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-773373cf-a364-444b-8944-65631436c3d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:09.009405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4cdc44d2-ac13-4354-ad12-7a1a88fb2fa7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:09.009493 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4cdc44d2-ac13-4354-ad12-7a1a88fb2fa7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:09.009653 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-773373cf-a364-444b-8944-65631436c3d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:09.012070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=52 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:56:09.016663 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-773373cf-a364-444b-8944-65631436c3d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:09.017143 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-773373cf-a364-444b-8944-65631436c3d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:09.017580 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-773373cf-a364-444b-8944-65631436c3d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:09.018260 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-773373cf-a364-444b-8944-65631436c3d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:09.018733 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-773373cf-a364-444b-8944-65631436c3d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:09.019161 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-773373cf-a364-444b-8944-65631436c3d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:09.074582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4cdc44d2-ac13-4354-ad12-7a1a88fb2fa7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:09.082911 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4cdc44d2-ac13-4354-ad12-7a1a88fb2fa7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.086852 Aug 24 12:56:09.083988 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1737/3468] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:08 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:09.149984 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-773373cf-a364-444b-8944-65631436c3d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:09.158117 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-773373cf-a364-444b-8944-65631436c3d4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152911 Aug 24 12:56:09.158686 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1732/3469] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:09 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:56:10.104395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8fe04d14-c331-44b5-8c69-50fa2a00d171 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:10.105006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8fe04d14-c331-44b5-8c69-50fa2a00d171 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:10.111672 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8fe04d14-c331-44b5-8c69-50fa2a00d171 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:10.112157 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8fe04d14-c331-44b5-8c69-50fa2a00d171 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:10.112593 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8fe04d14-c331-44b5-8c69-50fa2a00d171 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:10.113288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8fe04d14-c331-44b5-8c69-50fa2a00d171 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:10.113742 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8fe04d14-c331-44b5-8c69-50fa2a00d171 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:10.114168 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8fe04d14-c331-44b5-8c69-50fa2a00d171 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:10.175886 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8fe04d14-c331-44b5-8c69-50fa2a00d171 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:10.180100 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4f24ced2-b9e2-4643-944b-d2e812111a6a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:10.180712 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4f24ced2-b9e2-4643-944b-d2e812111a6a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:10.184896 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8fe04d14-c331-44b5-8c69-50fa2a00d171 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084391 Aug 24 12:56:10.185694 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1738/3470] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:10 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:10.187107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f24ced2-b9e2-4643-944b-d2e812111a6a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:10.187592 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f24ced2-b9e2-4643-944b-d2e812111a6a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:10.188034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f24ced2-b9e2-4643-944b-d2e812111a6a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:10.188793 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f24ced2-b9e2-4643-944b-d2e812111a6a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:10.189280 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f24ced2-b9e2-4643-944b-d2e812111a6a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:10.189705 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f24ced2-b9e2-4643-944b-d2e812111a6a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:10.321372 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4f24ced2-b9e2-4643-944b-d2e812111a6a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:10.329541 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4f24ced2-b9e2-4643-944b-d2e812111a6a tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.153907 Aug 24 12:56:10.330107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1733/3471] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:10 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:56:11.205867 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-580f4042-ce68-45a7-b61e-4d125ae73f52 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:11.206475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-580f4042-ce68-45a7-b61e-4d125ae73f52 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:11.208913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=58 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:56:11.213593 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-580f4042-ce68-45a7-b61e-4d125ae73f52 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:11.214074 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-580f4042-ce68-45a7-b61e-4d125ae73f52 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:11.214513 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-580f4042-ce68-45a7-b61e-4d125ae73f52 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:11.215218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-580f4042-ce68-45a7-b61e-4d125ae73f52 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:11.215676 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-580f4042-ce68-45a7-b61e-4d125ae73f52 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:11.216100 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-580f4042-ce68-45a7-b61e-4d125ae73f52 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:11.276969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-580f4042-ce68-45a7-b61e-4d125ae73f52 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:11.284951 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-580f4042-ce68-45a7-b61e-4d125ae73f52 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082996 Aug 24 12:56:11.285508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1739/3472] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:11 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:11.351418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9b075cb8-7218-49d1-8345-82e1dd3b9885 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:11.352032 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9b075cb8-7218-49d1-8345-82e1dd3b9885 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:11.358386 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b075cb8-7218-49d1-8345-82e1dd3b9885 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:11.358912 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b075cb8-7218-49d1-8345-82e1dd3b9885 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:11.359352 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b075cb8-7218-49d1-8345-82e1dd3b9885 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:11.360033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b075cb8-7218-49d1-8345-82e1dd3b9885 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:11.360489 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b075cb8-7218-49d1-8345-82e1dd3b9885 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:11.360916 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b075cb8-7218-49d1-8345-82e1dd3b9885 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:11.487954 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9b075cb8-7218-49d1-8345-82e1dd3b9885 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:11.496009 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9b075cb8-7218-49d1-8345-82e1dd3b9885 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.148969 Aug 24 12:56:11.496570 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1734/3473] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:11 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:56:12.305974 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a4e4625f-f425-4424-aac5-ec447e20fb23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:12.306582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a4e4625f-f425-4424-aac5-ec447e20fb23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:12.312954 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a4e4625f-f425-4424-aac5-ec447e20fb23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:12.313436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a4e4625f-f425-4424-aac5-ec447e20fb23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:12.313863 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a4e4625f-f425-4424-aac5-ec447e20fb23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:12.314535 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a4e4625f-f425-4424-aac5-ec447e20fb23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:12.315017 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a4e4625f-f425-4424-aac5-ec447e20fb23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:12.315439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a4e4625f-f425-4424-aac5-ec447e20fb23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:12.376317 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a4e4625f-f425-4424-aac5-ec447e20fb23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:12.384466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a4e4625f-f425-4424-aac5-ec447e20fb23 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083047 Aug 24 12:56:12.385022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1740/3474] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:12 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:12.516948 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fb005b77-53da-4efe-b9ec-54842c28bc45 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:12.517564 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fb005b77-53da-4efe-b9ec-54842c28bc45 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 50cb23a1-9864-46ef-ae19-411f522e9f10] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:12.524450 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fb005b77-53da-4efe-b9ec-54842c28bc45 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:12.524927 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fb005b77-53da-4efe-b9ec-54842c28bc45 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:12.525363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fb005b77-53da-4efe-b9ec-54842c28bc45 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:12.526040 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fb005b77-53da-4efe-b9ec-54842c28bc45 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:12.526494 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fb005b77-53da-4efe-b9ec-54842c28bc45 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:12.526947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fb005b77-53da-4efe-b9ec-54842c28bc45 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:12.657173 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fb005b77-53da-4efe-b9ec-54842c28bc45 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:12.665241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fb005b77-53da-4efe-b9ec-54842c28bc45 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10" status: 200 len: 1736 microversion: 2.1 time: 0.152151 Aug 24 12:56:12.665794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1735/3475] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:12 2022] GET /compute/v2.1/servers/50cb23a1-9864-46ef-ae19-411f522e9f10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:12.685270 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-91eee087-eaac-4eb0-afc6-ad29fe5a544f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '.version_select at 0x7f76f5d67820>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:12.796591 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-91eee087-eaac-4eb0-afc6-ad29fe5a544f tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797036082" status: 202 len: 0 microversion: 2.1 time: 0.115041 Aug 24 12:56:12.797171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1741/3476] 10.222.0.45 () {58 vars in 1221 bytes} [Wed Aug 24 12:56:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797036082 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:56:13.405044 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-38ca7887-0698-46ed-8a5e-b5833168ee9e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:13.405708 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-38ca7887-0698-46ed-8a5e-b5833168ee9e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:13.412201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-38ca7887-0698-46ed-8a5e-b5833168ee9e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:13.412691 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-38ca7887-0698-46ed-8a5e-b5833168ee9e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:13.413130 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-38ca7887-0698-46ed-8a5e-b5833168ee9e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:13.413819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-38ca7887-0698-46ed-8a5e-b5833168ee9e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:13.414460 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-38ca7887-0698-46ed-8a5e-b5833168ee9e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:13.414720 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-38ca7887-0698-46ed-8a5e-b5833168ee9e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:13.476856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-38ca7887-0698-46ed-8a5e-b5833168ee9e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:13.484896 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-38ca7887-0698-46ed-8a5e-b5833168ee9e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083731 Aug 24 12:56:13.485449 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1736/3477] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:13 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:13.961762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-780d727c-e557-42af-8c70-924b3008a1d5 req-c8787e54-da76-4ef0-9a25-1fb9c4037f2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50cb23a1-9864-46ef-ae19-411f522e9f10", "tag": "4fe23f91-93ad-4bd1-9b29-2d302a44a9c9"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:56:13.972481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-780d727c-e557-42af-8c70-924b3008a1d5 req-c8787e54-da76-4ef0-9a25-1fb9c4037f2a service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:13.972967 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-780d727c-e557-42af-8c70-924b3008a1d5 req-c8787e54-da76-4ef0-9a25-1fb9c4037f2a service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:13.973401 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-780d727c-e557-42af-8c70-924b3008a1d5 req-c8787e54-da76-4ef0-9a25-1fb9c4037f2a service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:13.976035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=100 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:56:13.985311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-780d727c-e557-42af-8c70-924b3008a1d5 req-c8787e54-da76-4ef0-9a25-1fb9c4037f2a service nova] Creating event network-changed:4fe23f91-93ad-4bd1-9b29-2d302a44a9c9 for instance 50cb23a1-9864-46ef-ae19-411f522e9f10 on hv-cinder-84889 Aug 24 12:56:13.991567 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-780d727c-e557-42af-8c70-924b3008a1d5 req-c8787e54-da76-4ef0-9a25-1fb9c4037f2a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035188 Aug 24 12:56:13.993611 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1742/3478] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:56:14.579217 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b026dca7-2add-4d66-8421-aa87ee84920a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:14.580341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b026dca7-2add-4d66-8421-aa87ee84920a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:14.587003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b026dca7-2add-4d66-8421-aa87ee84920a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:14.587501 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b026dca7-2add-4d66-8421-aa87ee84920a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:14.587944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b026dca7-2add-4d66-8421-aa87ee84920a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:14.588643 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b026dca7-2add-4d66-8421-aa87ee84920a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:14.589106 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b026dca7-2add-4d66-8421-aa87ee84920a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:14.589534 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b026dca7-2add-4d66-8421-aa87ee84920a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:14.676199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b026dca7-2add-4d66-8421-aa87ee84920a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:14.684529 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b026dca7-2add-4d66-8421-aa87ee84920a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.181962 Aug 24 12:56:14.685104 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1737/3479] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:14 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:15.707032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b0f9be88-8534-4c71-94b6-fa9d37e00947 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:15.707682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b0f9be88-8534-4c71-94b6-fa9d37e00947 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:15.714438 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0f9be88-8534-4c71-94b6-fa9d37e00947 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:15.714965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0f9be88-8534-4c71-94b6-fa9d37e00947 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:15.715407 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0f9be88-8534-4c71-94b6-fa9d37e00947 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:15.716091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0f9be88-8534-4c71-94b6-fa9d37e00947 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:15.716550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0f9be88-8534-4c71-94b6-fa9d37e00947 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:15.716979 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0f9be88-8534-4c71-94b6-fa9d37e00947 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:15.778875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b0f9be88-8534-4c71-94b6-fa9d37e00947 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:15.787765 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b0f9be88-8534-4c71-94b6-fa9d37e00947 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085930 Aug 24 12:56:15.788324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1743/3480] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:15 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:16.808648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ce48e8c7-f4ce-4e42-9a93-553e400529d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:16.809276 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ce48e8c7-f4ce-4e42-9a93-553e400529d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:16.815345 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce48e8c7-f4ce-4e42-9a93-553e400529d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:16.815826 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce48e8c7-f4ce-4e42-9a93-553e400529d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:16.816261 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce48e8c7-f4ce-4e42-9a93-553e400529d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:16.816936 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce48e8c7-f4ce-4e42-9a93-553e400529d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:16.817428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce48e8c7-f4ce-4e42-9a93-553e400529d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:16.817852 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ce48e8c7-f4ce-4e42-9a93-553e400529d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:16.880474 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ce48e8c7-f4ce-4e42-9a93-553e400529d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:16.888510 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ce48e8c7-f4ce-4e42-9a93-553e400529d0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083701 Aug 24 12:56:16.889068 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1738/3481] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:16 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:17.908980 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7b7451ef-733c-454e-89a5-aa58c132e89d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:17.909593 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7b7451ef-733c-454e-89a5-aa58c132e89d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:17.916541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b7451ef-733c-454e-89a5-aa58c132e89d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:17.917022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b7451ef-733c-454e-89a5-aa58c132e89d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:17.917455 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b7451ef-733c-454e-89a5-aa58c132e89d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:17.918130 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b7451ef-733c-454e-89a5-aa58c132e89d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:17.918583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b7451ef-733c-454e-89a5-aa58c132e89d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:17.919029 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7b7451ef-733c-454e-89a5-aa58c132e89d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:17.978828 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7b7451ef-733c-454e-89a5-aa58c132e89d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:17.987289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7b7451ef-733c-454e-89a5-aa58c132e89d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082157 Aug 24 12:56:17.987883 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1744/3482] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:17 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:19.009260 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-53d35798-de57-4a78-8b11-b6594442a583 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:19.009862 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-53d35798-de57-4a78-8b11-b6594442a583 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:19.016430 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-53d35798-de57-4a78-8b11-b6594442a583 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:19.016913 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-53d35798-de57-4a78-8b11-b6594442a583 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:19.017368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-53d35798-de57-4a78-8b11-b6594442a583 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:19.018054 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-53d35798-de57-4a78-8b11-b6594442a583 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:19.018507 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-53d35798-de57-4a78-8b11-b6594442a583 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:19.018965 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-53d35798-de57-4a78-8b11-b6594442a583 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:19.082346 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-53d35798-de57-4a78-8b11-b6594442a583 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:19.091064 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-53d35798-de57-4a78-8b11-b6594442a583 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.086148 Aug 24 12:56:19.091615 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1739/3483] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:19 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:20.110739 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4eb965b1-998f-41ab-b59e-ffc281d5dfe9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:20.111649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4eb965b1-998f-41ab-b59e-ffc281d5dfe9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:20.118439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4eb965b1-998f-41ab-b59e-ffc281d5dfe9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:20.118952 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4eb965b1-998f-41ab-b59e-ffc281d5dfe9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:20.119400 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4eb965b1-998f-41ab-b59e-ffc281d5dfe9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:20.120087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4eb965b1-998f-41ab-b59e-ffc281d5dfe9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:20.120550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4eb965b1-998f-41ab-b59e-ffc281d5dfe9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:20.120971 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4eb965b1-998f-41ab-b59e-ffc281d5dfe9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:20.183287 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4eb965b1-998f-41ab-b59e-ffc281d5dfe9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:20.191524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4eb965b1-998f-41ab-b59e-ffc281d5dfe9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084600 Aug 24 12:56:20.192766 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1745/3484] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:20 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:21.213092 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-690a51c1-94d7-49b9-9f04-5920e451fc04 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:21.213694 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-690a51c1-94d7-49b9-9f04-5920e451fc04 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:21.220170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-690a51c1-94d7-49b9-9f04-5920e451fc04 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:21.220644 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-690a51c1-94d7-49b9-9f04-5920e451fc04 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:21.221071 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-690a51c1-94d7-49b9-9f04-5920e451fc04 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:21.221748 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-690a51c1-94d7-49b9-9f04-5920e451fc04 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:21.222293 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-690a51c1-94d7-49b9-9f04-5920e451fc04 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:21.222742 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-690a51c1-94d7-49b9-9f04-5920e451fc04 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:21.283722 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-690a51c1-94d7-49b9-9f04-5920e451fc04 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:21.291716 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-690a51c1-94d7-49b9-9f04-5920e451fc04 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082517 Aug 24 12:56:21.292509 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1740/3485] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:21 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:22.314937 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-efe2bad5-f968-4785-95e3-c7949c882f8d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:22.315549 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-efe2bad5-f968-4785-95e3-c7949c882f8d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:22.322110 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-efe2bad5-f968-4785-95e3-c7949c882f8d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:22.322900 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-efe2bad5-f968-4785-95e3-c7949c882f8d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:22.323327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-efe2bad5-f968-4785-95e3-c7949c882f8d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:22.324008 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-efe2bad5-f968-4785-95e3-c7949c882f8d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:22.324458 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-efe2bad5-f968-4785-95e3-c7949c882f8d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:22.324880 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-efe2bad5-f968-4785-95e3-c7949c882f8d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:22.388550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-efe2bad5-f968-4785-95e3-c7949c882f8d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:22.397176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-efe2bad5-f968-4785-95e3-c7949c882f8d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.086122 Aug 24 12:56:22.397726 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1746/3486] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:22 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:23.417843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0139401e-d4bb-4c0c-a6a5-f74b392af9c7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:23.418377 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0139401e-d4bb-4c0c-a6a5-f74b392af9c7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:23.425049 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0139401e-d4bb-4c0c-a6a5-f74b392af9c7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:23.425533 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0139401e-d4bb-4c0c-a6a5-f74b392af9c7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:23.425971 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0139401e-d4bb-4c0c-a6a5-f74b392af9c7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:23.427284 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0139401e-d4bb-4c0c-a6a5-f74b392af9c7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:23.427742 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0139401e-d4bb-4c0c-a6a5-f74b392af9c7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:23.428167 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0139401e-d4bb-4c0c-a6a5-f74b392af9c7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:23.489628 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0139401e-d4bb-4c0c-a6a5-f74b392af9c7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:23.497691 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0139401e-d4bb-4c0c-a6a5-f74b392af9c7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083761 Aug 24 12:56:23.498249 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1741/3487] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:23 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:24.517651 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e66782f5-cd0e-44b4-87ec-cdb5cc221d92 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:24.518255 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e66782f5-cd0e-44b4-87ec-cdb5cc221d92 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:24.525202 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e66782f5-cd0e-44b4-87ec-cdb5cc221d92 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:24.525680 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e66782f5-cd0e-44b4-87ec-cdb5cc221d92 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:24.526114 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e66782f5-cd0e-44b4-87ec-cdb5cc221d92 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:24.526820 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e66782f5-cd0e-44b4-87ec-cdb5cc221d92 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:24.527413 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e66782f5-cd0e-44b4-87ec-cdb5cc221d92 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:24.532089 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e66782f5-cd0e-44b4-87ec-cdb5cc221d92 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:24.593703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e66782f5-cd0e-44b4-87ec-cdb5cc221d92 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:24.602501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e66782f5-cd0e-44b4-87ec-cdb5cc221d92 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.088756 Aug 24 12:56:24.603117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1747/3488] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:24 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:25.623596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-17245643-2e2a-4d76-8cda-568d32cf0efa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:25.624198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-17245643-2e2a-4d76-8cda-568d32cf0efa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:25.630466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-17245643-2e2a-4d76-8cda-568d32cf0efa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:25.630982 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-17245643-2e2a-4d76-8cda-568d32cf0efa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:25.631409 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-17245643-2e2a-4d76-8cda-568d32cf0efa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:25.632082 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-17245643-2e2a-4d76-8cda-568d32cf0efa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:25.632528 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-17245643-2e2a-4d76-8cda-568d32cf0efa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:25.632944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-17245643-2e2a-4d76-8cda-568d32cf0efa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:25.693311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-17245643-2e2a-4d76-8cda-568d32cf0efa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:25.701228 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-17245643-2e2a-4d76-8cda-568d32cf0efa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081440 Aug 24 12:56:25.701774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1742/3489] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:25 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:25.805582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-97036852-aff3-4869-9943-5c5d2eb7ccb3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:25.806068 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-97036852-aff3-4869-9943-5c5d2eb7ccb3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:25.812349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97036852-aff3-4869-9943-5c5d2eb7ccb3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:25.812858 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97036852-aff3-4869-9943-5c5d2eb7ccb3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:25.813297 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97036852-aff3-4869-9943-5c5d2eb7ccb3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:25.813969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97036852-aff3-4869-9943-5c5d2eb7ccb3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:25.814420 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97036852-aff3-4869-9943-5c5d2eb7ccb3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:25.814866 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97036852-aff3-4869-9943-5c5d2eb7ccb3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:25.836481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-97036852-aff3-4869-9943-5c5d2eb7ccb3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124/ips" status: 200 len: 152 microversion: 2.20 time: 0.035408 Aug 24 12:56:25.837020 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1748/3490] 10.222.0.45 () {60 vars in 1289 bytes} [Wed Aug 24 12:56:25 2022] GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:56:26.721438 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c05f4182-c79d-4fa6-aaea-39a0cae19977 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:26.721969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c05f4182-c79d-4fa6-aaea-39a0cae19977 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:26.728899 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c05f4182-c79d-4fa6-aaea-39a0cae19977 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:26.729407 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c05f4182-c79d-4fa6-aaea-39a0cae19977 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:26.729843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c05f4182-c79d-4fa6-aaea-39a0cae19977 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:26.730518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c05f4182-c79d-4fa6-aaea-39a0cae19977 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:26.731009 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c05f4182-c79d-4fa6-aaea-39a0cae19977 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:26.731438 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c05f4182-c79d-4fa6-aaea-39a0cae19977 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:26.735266 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:56:26.795236 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c05f4182-c79d-4fa6-aaea-39a0cae19977 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:26.803252 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c05f4182-c79d-4fa6-aaea-39a0cae19977 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085771 Aug 24 12:56:26.803808 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1743/3491] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:26 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:27.824041 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ffa3cc77-c15e-48af-894d-eddd021e6623 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:27.824655 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ffa3cc77-c15e-48af-894d-eddd021e6623 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:27.831063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ffa3cc77-c15e-48af-894d-eddd021e6623 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:27.831541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ffa3cc77-c15e-48af-894d-eddd021e6623 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:27.831980 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ffa3cc77-c15e-48af-894d-eddd021e6623 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:27.832666 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ffa3cc77-c15e-48af-894d-eddd021e6623 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:27.833119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ffa3cc77-c15e-48af-894d-eddd021e6623 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:27.833545 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ffa3cc77-c15e-48af-894d-eddd021e6623 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:27.896982 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ffa3cc77-c15e-48af-894d-eddd021e6623 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:27.905016 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ffa3cc77-c15e-48af-894d-eddd021e6623 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084803 Aug 24 12:56:27.905568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1749/3492] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:27 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:28.925568 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c164ce2f-63f9-4519-a869-035cc3dae355 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:28.926774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c164ce2f-63f9-4519-a869-035cc3dae355 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:28.933223 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c164ce2f-63f9-4519-a869-035cc3dae355 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:28.933708 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c164ce2f-63f9-4519-a869-035cc3dae355 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:28.934143 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c164ce2f-63f9-4519-a869-035cc3dae355 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:28.934852 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c164ce2f-63f9-4519-a869-035cc3dae355 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:28.935306 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c164ce2f-63f9-4519-a869-035cc3dae355 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:28.935728 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c164ce2f-63f9-4519-a869-035cc3dae355 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:28.996282 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c164ce2f-63f9-4519-a869-035cc3dae355 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:29.004286 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c164ce2f-63f9-4519-a869-035cc3dae355 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082579 Aug 24 12:56:29.004846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1744/3493] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:28 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:30.025194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3b069be6-e59d-41d9-995e-18f4b158c282 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:30.025797 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3b069be6-e59d-41d9-995e-18f4b158c282 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:30.032184 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b069be6-e59d-41d9-995e-18f4b158c282 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:30.032662 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b069be6-e59d-41d9-995e-18f4b158c282 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:30.033096 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b069be6-e59d-41d9-995e-18f4b158c282 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:30.033768 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b069be6-e59d-41d9-995e-18f4b158c282 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:30.034220 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b069be6-e59d-41d9-995e-18f4b158c282 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:30.034640 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b069be6-e59d-41d9-995e-18f4b158c282 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:30.095756 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3b069be6-e59d-41d9-995e-18f4b158c282 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:30.104584 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3b069be6-e59d-41d9-995e-18f4b158c282 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083264 Aug 24 12:56:30.105135 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1750/3494] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:30 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:31.125318 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6523ca1f-7e2e-4fc5-a287-6e956a716f6c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:31.125924 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6523ca1f-7e2e-4fc5-a287-6e956a716f6c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:31.132477 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6523ca1f-7e2e-4fc5-a287-6e956a716f6c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:31.132956 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6523ca1f-7e2e-4fc5-a287-6e956a716f6c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:31.133392 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6523ca1f-7e2e-4fc5-a287-6e956a716f6c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:31.134069 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6523ca1f-7e2e-4fc5-a287-6e956a716f6c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:31.134519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6523ca1f-7e2e-4fc5-a287-6e956a716f6c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:31.134964 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6523ca1f-7e2e-4fc5-a287-6e956a716f6c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:31.196850 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6523ca1f-7e2e-4fc5-a287-6e956a716f6c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:31.204858 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6523ca1f-7e2e-4fc5-a287-6e956a716f6c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083423 Aug 24 12:56:31.205414 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1745/3495] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:31 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:32.225826 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-163207dd-1918-48b7-a417-92477489d926 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:32.226436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-163207dd-1918-48b7-a417-92477489d926 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:32.232784 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-163207dd-1918-48b7-a417-92477489d926 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:32.233265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-163207dd-1918-48b7-a417-92477489d926 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:32.233730 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-163207dd-1918-48b7-a417-92477489d926 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:32.234415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-163207dd-1918-48b7-a417-92477489d926 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:32.234909 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-163207dd-1918-48b7-a417-92477489d926 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:32.235340 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-163207dd-1918-48b7-a417-92477489d926 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:32.298833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-163207dd-1918-48b7-a417-92477489d926 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:32.306946 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-163207dd-1918-48b7-a417-92477489d926 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085553 Aug 24 12:56:32.307513 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1751/3496] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:32 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:33.327601 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ee119e8e-0ac6-41c9-9556-8e96fa88406c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:33.328215 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ee119e8e-0ac6-41c9-9556-8e96fa88406c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:33.335233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee119e8e-0ac6-41c9-9556-8e96fa88406c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:33.335716 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee119e8e-0ac6-41c9-9556-8e96fa88406c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:33.336152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee119e8e-0ac6-41c9-9556-8e96fa88406c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:33.336828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee119e8e-0ac6-41c9-9556-8e96fa88406c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:33.337282 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee119e8e-0ac6-41c9-9556-8e96fa88406c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:33.337703 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ee119e8e-0ac6-41c9-9556-8e96fa88406c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:33.398326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ee119e8e-0ac6-41c9-9556-8e96fa88406c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:33.406317 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ee119e8e-0ac6-41c9-9556-8e96fa88406c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082642 Aug 24 12:56:33.406914 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1746/3497] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:33 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:34.427496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-32c35f07-6618-4ede-aaa3-3d1e2113113c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:34.428418 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-32c35f07-6618-4ede-aaa3-3d1e2113113c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:34.434514 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-32c35f07-6618-4ede-aaa3-3d1e2113113c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:34.435021 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-32c35f07-6618-4ede-aaa3-3d1e2113113c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:34.435456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-32c35f07-6618-4ede-aaa3-3d1e2113113c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:34.436170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-32c35f07-6618-4ede-aaa3-3d1e2113113c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:34.436622 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-32c35f07-6618-4ede-aaa3-3d1e2113113c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:34.437043 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-32c35f07-6618-4ede-aaa3-3d1e2113113c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:34.499068 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-32c35f07-6618-4ede-aaa3-3d1e2113113c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:34.507675 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-32c35f07-6618-4ede-aaa3-3d1e2113113c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084657 Aug 24 12:56:34.508234 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1752/3498] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:34 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:35.528184 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c160f7f6-55ea-4629-bc67-2f6d2908db77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:35.528787 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c160f7f6-55ea-4629-bc67-2f6d2908db77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:35.535154 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c160f7f6-55ea-4629-bc67-2f6d2908db77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:35.535628 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c160f7f6-55ea-4629-bc67-2f6d2908db77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:35.536058 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c160f7f6-55ea-4629-bc67-2f6d2908db77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:35.536727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c160f7f6-55ea-4629-bc67-2f6d2908db77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:35.537172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c160f7f6-55ea-4629-bc67-2f6d2908db77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:35.537590 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c160f7f6-55ea-4629-bc67-2f6d2908db77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:35.600140 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c160f7f6-55ea-4629-bc67-2f6d2908db77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:35.608364 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c160f7f6-55ea-4629-bc67-2f6d2908db77 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083998 Aug 24 12:56:35.608918 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1747/3499] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:35 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:56:36.629826 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5607e95f-b9a1-4aee-bb06-5c357b0b7e16 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:36.630371 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5607e95f-b9a1-4aee-bb06-5c357b0b7e16 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:36.636578 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5607e95f-b9a1-4aee-bb06-5c357b0b7e16 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:36.637061 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5607e95f-b9a1-4aee-bb06-5c357b0b7e16 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:36.637497 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5607e95f-b9a1-4aee-bb06-5c357b0b7e16 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:36.638180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5607e95f-b9a1-4aee-bb06-5c357b0b7e16 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:36.638636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5607e95f-b9a1-4aee-bb06-5c357b0b7e16 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:36.639082 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5607e95f-b9a1-4aee-bb06-5c357b0b7e16 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:36.698748 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5607e95f-b9a1-4aee-bb06-5c357b0b7e16 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:36.706760 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5607e95f-b9a1-4aee-bb06-5c357b0b7e16 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.080909 Aug 24 12:56:36.707320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1753/3500] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:36 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:37.727993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-060c05cf-261a-4818-8bc0-03bb0e94e252 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:37.728530 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-060c05cf-261a-4818-8bc0-03bb0e94e252 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:37.734804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-060c05cf-261a-4818-8bc0-03bb0e94e252 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:37.735281 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-060c05cf-261a-4818-8bc0-03bb0e94e252 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:37.735716 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-060c05cf-261a-4818-8bc0-03bb0e94e252 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:37.736644 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-060c05cf-261a-4818-8bc0-03bb0e94e252 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:37.737090 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-060c05cf-261a-4818-8bc0-03bb0e94e252 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:37.737508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-060c05cf-261a-4818-8bc0-03bb0e94e252 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:37.797678 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-060c05cf-261a-4818-8bc0-03bb0e94e252 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:37.805649 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-060c05cf-261a-4818-8bc0-03bb0e94e252 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081584 Aug 24 12:56:37.806199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1748/3501] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:37 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:38.826839 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c440a8a1-68ad-4ba4-8b7b-1ce28bdce5bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:38.827460 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c440a8a1-68ad-4ba4-8b7b-1ce28bdce5bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:38.834358 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c440a8a1-68ad-4ba4-8b7b-1ce28bdce5bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:38.834881 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c440a8a1-68ad-4ba4-8b7b-1ce28bdce5bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:38.835325 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c440a8a1-68ad-4ba4-8b7b-1ce28bdce5bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:38.836018 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c440a8a1-68ad-4ba4-8b7b-1ce28bdce5bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:38.836484 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c440a8a1-68ad-4ba4-8b7b-1ce28bdce5bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:38.836916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c440a8a1-68ad-4ba4-8b7b-1ce28bdce5bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:38.898311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c440a8a1-68ad-4ba4-8b7b-1ce28bdce5bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:38.906455 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c440a8a1-68ad-4ba4-8b7b-1ce28bdce5bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083558 Aug 24 12:56:38.907051 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1754/3502] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:38 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:39.933056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-860233d0-8f8c-457d-bf85-9be6756dc0cb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:39.933665 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-860233d0-8f8c-457d-bf85-9be6756dc0cb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:39.935944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=34 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:56:39.940801 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-860233d0-8f8c-457d-bf85-9be6756dc0cb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:39.941282 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-860233d0-8f8c-457d-bf85-9be6756dc0cb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:39.941713 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-860233d0-8f8c-457d-bf85-9be6756dc0cb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:39.942460 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-860233d0-8f8c-457d-bf85-9be6756dc0cb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:39.942944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-860233d0-8f8c-457d-bf85-9be6756dc0cb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:39.948491 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-860233d0-8f8c-457d-bf85-9be6756dc0cb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:40.004468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-860233d0-8f8c-457d-bf85-9be6756dc0cb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:40.012528 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-860233d0-8f8c-457d-bf85-9be6756dc0cb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083355 Aug 24 12:56:40.013078 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1749/3503] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:39 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:41.032908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-20d75d9c-753b-44be-98ae-e457ebc6df0b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:41.033540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-20d75d9c-753b-44be-98ae-e457ebc6df0b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:41.039988 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-20d75d9c-753b-44be-98ae-e457ebc6df0b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:41.040464 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-20d75d9c-753b-44be-98ae-e457ebc6df0b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:41.040896 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-20d75d9c-753b-44be-98ae-e457ebc6df0b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:41.041571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-20d75d9c-753b-44be-98ae-e457ebc6df0b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:41.042021 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-20d75d9c-753b-44be-98ae-e457ebc6df0b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:41.042442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-20d75d9c-753b-44be-98ae-e457ebc6df0b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:41.105176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-20d75d9c-753b-44be-98ae-e457ebc6df0b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:41.113411 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-20d75d9c-753b-44be-98ae-e457ebc6df0b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084398 Aug 24 12:56:41.113966 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1755/3504] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:41 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:42.135714 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b32b1888-89fb-4e19-a0bd-baa64a633c99 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:42.136326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b32b1888-89fb-4e19-a0bd-baa64a633c99 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:42.142758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b32b1888-89fb-4e19-a0bd-baa64a633c99 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:42.143243 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b32b1888-89fb-4e19-a0bd-baa64a633c99 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:42.143680 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b32b1888-89fb-4e19-a0bd-baa64a633c99 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:42.144359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b32b1888-89fb-4e19-a0bd-baa64a633c99 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:42.144812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b32b1888-89fb-4e19-a0bd-baa64a633c99 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:42.145257 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b32b1888-89fb-4e19-a0bd-baa64a633c99 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:42.205399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b32b1888-89fb-4e19-a0bd-baa64a633c99 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:42.214061 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b32b1888-89fb-4e19-a0bd-baa64a633c99 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082281 Aug 24 12:56:42.214606 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1750/3505] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:42 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:43.234851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0bffa41d-7bab-4ca5-86a8-e0faf83fc2f7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:43.235471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0bffa41d-7bab-4ca5-86a8-e0faf83fc2f7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:43.238105 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:56:43.242801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bffa41d-7bab-4ca5-86a8-e0faf83fc2f7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:43.243291 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bffa41d-7bab-4ca5-86a8-e0faf83fc2f7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:43.243734 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bffa41d-7bab-4ca5-86a8-e0faf83fc2f7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:43.244424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bffa41d-7bab-4ca5-86a8-e0faf83fc2f7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:43.244892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bffa41d-7bab-4ca5-86a8-e0faf83fc2f7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:43.245322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0bffa41d-7bab-4ca5-86a8-e0faf83fc2f7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:43.305318 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0bffa41d-7bab-4ca5-86a8-e0faf83fc2f7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:43.313356 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0bffa41d-7bab-4ca5-86a8-e0faf83fc2f7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082375 Aug 24 12:56:43.313878 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1756/3506] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:43 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:44.334472 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7356a059-f4ef-4278-ae2e-ecaa64aab794 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:44.335099 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7356a059-f4ef-4278-ae2e-ecaa64aab794 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:44.341480 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7356a059-f4ef-4278-ae2e-ecaa64aab794 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:44.341966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7356a059-f4ef-4278-ae2e-ecaa64aab794 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:44.342402 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7356a059-f4ef-4278-ae2e-ecaa64aab794 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:44.343107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7356a059-f4ef-4278-ae2e-ecaa64aab794 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:44.343559 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7356a059-f4ef-4278-ae2e-ecaa64aab794 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:44.343980 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7356a059-f4ef-4278-ae2e-ecaa64aab794 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:44.410643 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7356a059-f4ef-4278-ae2e-ecaa64aab794 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:44.419269 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7356a059-f4ef-4278-ae2e-ecaa64aab794 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.089811 Aug 24 12:56:44.419895 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1751/3507] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:44 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:45.440263 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fc436c37-f78f-41cf-bee5-ec58aeed43fa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:45.440902 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fc436c37-f78f-41cf-bee5-ec58aeed43fa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:45.447938 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc436c37-f78f-41cf-bee5-ec58aeed43fa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:45.448426 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc436c37-f78f-41cf-bee5-ec58aeed43fa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:45.448865 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc436c37-f78f-41cf-bee5-ec58aeed43fa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:45.449551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc436c37-f78f-41cf-bee5-ec58aeed43fa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:45.450006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc436c37-f78f-41cf-bee5-ec58aeed43fa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:45.450433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fc436c37-f78f-41cf-bee5-ec58aeed43fa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:45.511931 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fc436c37-f78f-41cf-bee5-ec58aeed43fa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:45.519909 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fc436c37-f78f-41cf-bee5-ec58aeed43fa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083745 Aug 24 12:56:45.520465 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1757/3508] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:45 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:46.541692 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8c2b59de-87f0-46e1-8ae0-cf4e9beeb962 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:46.542345 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8c2b59de-87f0-46e1-8ae0-cf4e9beeb962 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:46.548365 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c2b59de-87f0-46e1-8ae0-cf4e9beeb962 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:46.548846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c2b59de-87f0-46e1-8ae0-cf4e9beeb962 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:46.549287 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c2b59de-87f0-46e1-8ae0-cf4e9beeb962 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:46.549975 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c2b59de-87f0-46e1-8ae0-cf4e9beeb962 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:46.550444 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c2b59de-87f0-46e1-8ae0-cf4e9beeb962 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:46.550890 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8c2b59de-87f0-46e1-8ae0-cf4e9beeb962 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:46.611964 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8c2b59de-87f0-46e1-8ae0-cf4e9beeb962 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:46.620789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8c2b59de-87f0-46e1-8ae0-cf4e9beeb962 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083702 Aug 24 12:56:46.621343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1752/3509] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:46 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:47.641496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-51e666f2-cf72-4ee2-9c87-ba85efc8bb60 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:47.642118 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-51e666f2-cf72-4ee2-9c87-ba85efc8bb60 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:47.649291 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51e666f2-cf72-4ee2-9c87-ba85efc8bb60 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:47.649779 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51e666f2-cf72-4ee2-9c87-ba85efc8bb60 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:47.650220 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51e666f2-cf72-4ee2-9c87-ba85efc8bb60 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:47.650941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51e666f2-cf72-4ee2-9c87-ba85efc8bb60 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:47.651407 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51e666f2-cf72-4ee2-9c87-ba85efc8bb60 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:47.651836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-51e666f2-cf72-4ee2-9c87-ba85efc8bb60 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:47.654332 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=90 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:56:47.712834 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-51e666f2-cf72-4ee2-9c87-ba85efc8bb60 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:47.720835 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-51e666f2-cf72-4ee2-9c87-ba85efc8bb60 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083320 Aug 24 12:56:47.721390 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1758/3510] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:47 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:48.742104 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9e954f60-d4d9-4bd1-97c1-f1269730c512 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:48.742741 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9e954f60-d4d9-4bd1-97c1-f1269730c512 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:48.749198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9e954f60-d4d9-4bd1-97c1-f1269730c512 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:48.749678 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9e954f60-d4d9-4bd1-97c1-f1269730c512 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:48.750113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9e954f60-d4d9-4bd1-97c1-f1269730c512 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:48.750821 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9e954f60-d4d9-4bd1-97c1-f1269730c512 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:48.751274 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9e954f60-d4d9-4bd1-97c1-f1269730c512 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:48.751696 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9e954f60-d4d9-4bd1-97c1-f1269730c512 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:48.811953 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9e954f60-d4d9-4bd1-97c1-f1269730c512 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:48.819990 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9e954f60-d4d9-4bd1-97c1-f1269730c512 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081761 Aug 24 12:56:48.821093 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1753/3511] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:48 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:49.841526 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0b902e01-eb1f-45f5-b127-40a9af4cf42b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:49.842159 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0b902e01-eb1f-45f5-b127-40a9af4cf42b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:49.848480 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b902e01-eb1f-45f5-b127-40a9af4cf42b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:49.848957 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b902e01-eb1f-45f5-b127-40a9af4cf42b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:49.849395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b902e01-eb1f-45f5-b127-40a9af4cf42b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:49.850064 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b902e01-eb1f-45f5-b127-40a9af4cf42b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:49.850517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b902e01-eb1f-45f5-b127-40a9af4cf42b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:49.850960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b902e01-eb1f-45f5-b127-40a9af4cf42b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:49.915590 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0b902e01-eb1f-45f5-b127-40a9af4cf42b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:49.923574 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0b902e01-eb1f-45f5-b127-40a9af4cf42b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.086526 Aug 24 12:56:49.924126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1759/3512] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:49 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:50.943973 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3c459735-1ae9-47a8-80fd-49e6737a6037 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:50.944581 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3c459735-1ae9-47a8-80fd-49e6737a6037 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:50.950997 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c459735-1ae9-47a8-80fd-49e6737a6037 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:50.951473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c459735-1ae9-47a8-80fd-49e6737a6037 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:50.951906 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c459735-1ae9-47a8-80fd-49e6737a6037 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:50.952579 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c459735-1ae9-47a8-80fd-49e6737a6037 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:50.953028 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c459735-1ae9-47a8-80fd-49e6737a6037 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:50.953449 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c459735-1ae9-47a8-80fd-49e6737a6037 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:51.014538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3c459735-1ae9-47a8-80fd-49e6737a6037 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:51.022749 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3c459735-1ae9-47a8-80fd-49e6737a6037 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082647 Aug 24 12:56:51.023308 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1754/3513] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:50 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:52.043995 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b99a34b5-3510-43ca-84cf-7c99d23d9fab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:52.044606 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b99a34b5-3510-43ca-84cf-7c99d23d9fab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:52.051017 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b99a34b5-3510-43ca-84cf-7c99d23d9fab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:52.051496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b99a34b5-3510-43ca-84cf-7c99d23d9fab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:52.051934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b99a34b5-3510-43ca-84cf-7c99d23d9fab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:52.052622 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b99a34b5-3510-43ca-84cf-7c99d23d9fab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:52.053084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b99a34b5-3510-43ca-84cf-7c99d23d9fab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:52.053505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b99a34b5-3510-43ca-84cf-7c99d23d9fab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:52.081733 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:56:52.083762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 12:56:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 (ip 10.222.0.45) !!! Aug 24 12:56:52.116250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b99a34b5-3510-43ca-84cf-7c99d23d9fab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:52.124428 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b99a34b5-3510-43ca-84cf-7c99d23d9fab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084784 Aug 24 12:56:52.124990 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1760/3514] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:52 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:53.144926 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e41b3a83-a3e6-4393-b42f-c05ee37f8879 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:53.145529 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e41b3a83-a3e6-4393-b42f-c05ee37f8879 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:53.152030 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e41b3a83-a3e6-4393-b42f-c05ee37f8879 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:53.152506 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e41b3a83-a3e6-4393-b42f-c05ee37f8879 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:53.152935 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e41b3a83-a3e6-4393-b42f-c05ee37f8879 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:53.153608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e41b3a83-a3e6-4393-b42f-c05ee37f8879 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:53.154081 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e41b3a83-a3e6-4393-b42f-c05ee37f8879 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:53.154501 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e41b3a83-a3e6-4393-b42f-c05ee37f8879 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:53.217687 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e41b3a83-a3e6-4393-b42f-c05ee37f8879 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:53.225769 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e41b3a83-a3e6-4393-b42f-c05ee37f8879 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084655 Aug 24 12:56:53.226326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1755/3515] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:53 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:54.247708 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-eec3f31c-95f4-4e00-88cc-0438dc7bdec7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:54.248321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-eec3f31c-95f4-4e00-88cc-0438dc7bdec7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:54.254814 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eec3f31c-95f4-4e00-88cc-0438dc7bdec7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:54.255308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eec3f31c-95f4-4e00-88cc-0438dc7bdec7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:54.255746 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eec3f31c-95f4-4e00-88cc-0438dc7bdec7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:54.256431 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eec3f31c-95f4-4e00-88cc-0438dc7bdec7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:54.256888 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eec3f31c-95f4-4e00-88cc-0438dc7bdec7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:54.257315 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eec3f31c-95f4-4e00-88cc-0438dc7bdec7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:54.319971 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-eec3f31c-95f4-4e00-88cc-0438dc7bdec7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:54.331432 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-eec3f31c-95f4-4e00-88cc-0438dc7bdec7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.087981 Aug 24 12:56:54.332262 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1761/3516] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:54 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:56:55.360178 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d4a25b98-70d6-443a-a1f5-2d937455a3de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:55.360780 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d4a25b98-70d6-443a-a1f5-2d937455a3de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:55.367482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d4a25b98-70d6-443a-a1f5-2d937455a3de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:55.367969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d4a25b98-70d6-443a-a1f5-2d937455a3de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:55.369065 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d4a25b98-70d6-443a-a1f5-2d937455a3de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:55.369981 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d4a25b98-70d6-443a-a1f5-2d937455a3de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:55.370515 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d4a25b98-70d6-443a-a1f5-2d937455a3de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:55.370993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d4a25b98-70d6-443a-a1f5-2d937455a3de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:55.433192 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d4a25b98-70d6-443a-a1f5-2d937455a3de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:55.441393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d4a25b98-70d6-443a-a1f5-2d937455a3de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085074 Aug 24 12:56:55.441955 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1756/3517] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:55 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:56.462724 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-25787ddb-a4c8-40d7-8ea9-ffb75dfcce06 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:56.463337 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-25787ddb-a4c8-40d7-8ea9-ffb75dfcce06 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:56.469646 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-25787ddb-a4c8-40d7-8ea9-ffb75dfcce06 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:56.470129 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-25787ddb-a4c8-40d7-8ea9-ffb75dfcce06 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:56.470582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-25787ddb-a4c8-40d7-8ea9-ffb75dfcce06 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:56.471270 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-25787ddb-a4c8-40d7-8ea9-ffb75dfcce06 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:56.471726 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-25787ddb-a4c8-40d7-8ea9-ffb75dfcce06 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:56.472154 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-25787ddb-a4c8-40d7-8ea9-ffb75dfcce06 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:56.532224 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-25787ddb-a4c8-40d7-8ea9-ffb75dfcce06 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:56.540781 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-25787ddb-a4c8-40d7-8ea9-ffb75dfcce06 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081459 Aug 24 12:56:56.541331 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1762/3518] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:56 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:57.561737 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-85a99b9b-3596-4ea8-8d93-6b138be7ec6b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:57.562349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-85a99b9b-3596-4ea8-8d93-6b138be7ec6b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:57.568721 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-85a99b9b-3596-4ea8-8d93-6b138be7ec6b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:57.569205 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-85a99b9b-3596-4ea8-8d93-6b138be7ec6b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:57.569645 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-85a99b9b-3596-4ea8-8d93-6b138be7ec6b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:57.570332 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-85a99b9b-3596-4ea8-8d93-6b138be7ec6b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:57.570821 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-85a99b9b-3596-4ea8-8d93-6b138be7ec6b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:57.571883 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-85a99b9b-3596-4ea8-8d93-6b138be7ec6b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:57.574395 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=84 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:56:57.632636 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-85a99b9b-3596-4ea8-8d93-6b138be7ec6b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:57.642306 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-85a99b9b-3596-4ea8-8d93-6b138be7ec6b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084435 Aug 24 12:56:57.642900 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1757/3519] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:57 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:58.663424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7c702c6d-8381-4aee-bc2f-1dc6ff0b0696 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:58.663976 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7c702c6d-8381-4aee-bc2f-1dc6ff0b0696 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:58.670463 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7c702c6d-8381-4aee-bc2f-1dc6ff0b0696 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:58.670976 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7c702c6d-8381-4aee-bc2f-1dc6ff0b0696 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:58.671420 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7c702c6d-8381-4aee-bc2f-1dc6ff0b0696 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:58.672098 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7c702c6d-8381-4aee-bc2f-1dc6ff0b0696 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:58.672555 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7c702c6d-8381-4aee-bc2f-1dc6ff0b0696 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:58.672978 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7c702c6d-8381-4aee-bc2f-1dc6ff0b0696 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:58.735422 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7c702c6d-8381-4aee-bc2f-1dc6ff0b0696 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:58.744117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7c702c6d-8381-4aee-bc2f-1dc6ff0b0696 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084656 Aug 24 12:56:58.744682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1763/3520] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:58 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:56:59.764804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ad9daa4f-6781-4bed-a9cd-88bd8bc1738f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:56:59.765418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ad9daa4f-6781-4bed-a9cd-88bd8bc1738f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:56:59.771959 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ad9daa4f-6781-4bed-a9cd-88bd8bc1738f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:59.772442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ad9daa4f-6781-4bed-a9cd-88bd8bc1738f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:59.772882 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ad9daa4f-6781-4bed-a9cd-88bd8bc1738f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:59.773571 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ad9daa4f-6781-4bed-a9cd-88bd8bc1738f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:56:59.774025 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ad9daa4f-6781-4bed-a9cd-88bd8bc1738f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:56:59.775046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ad9daa4f-6781-4bed-a9cd-88bd8bc1738f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:56:59.839461 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ad9daa4f-6781-4bed-a9cd-88bd8bc1738f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:56:59.847918 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ad9daa4f-6781-4bed-a9cd-88bd8bc1738f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.087061 Aug 24 12:56:59.848470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1758/3521] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:56:59 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:00.870770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-711ddb6b-c7cf-4744-a965-7692a1e23f8a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:00.871374 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-711ddb6b-c7cf-4744-a965-7692a1e23f8a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:00.877657 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-711ddb6b-c7cf-4744-a965-7692a1e23f8a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:00.878135 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-711ddb6b-c7cf-4744-a965-7692a1e23f8a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:00.878565 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-711ddb6b-c7cf-4744-a965-7692a1e23f8a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:00.879264 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-711ddb6b-c7cf-4744-a965-7692a1e23f8a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:00.879716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-711ddb6b-c7cf-4744-a965-7692a1e23f8a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:00.880135 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-711ddb6b-c7cf-4744-a965-7692a1e23f8a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:00.939921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-711ddb6b-c7cf-4744-a965-7692a1e23f8a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:00.948596 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-711ddb6b-c7cf-4744-a965-7692a1e23f8a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081872 Aug 24 12:57:00.949148 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1764/3522] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:00 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:01.969225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ef1641bd-7bc9-444d-a031-26e17deaf469 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:01.969827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ef1641bd-7bc9-444d-a031-26e17deaf469 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:01.976132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef1641bd-7bc9-444d-a031-26e17deaf469 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:01.976602 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef1641bd-7bc9-444d-a031-26e17deaf469 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:01.977028 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef1641bd-7bc9-444d-a031-26e17deaf469 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:01.978336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef1641bd-7bc9-444d-a031-26e17deaf469 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:01.978850 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef1641bd-7bc9-444d-a031-26e17deaf469 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:01.979278 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef1641bd-7bc9-444d-a031-26e17deaf469 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:02.042495 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ef1641bd-7bc9-444d-a031-26e17deaf469 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:02.050498 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ef1641bd-7bc9-444d-a031-26e17deaf469 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085150 Aug 24 12:57:02.051087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1759/3523] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:01 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:03.070267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4c87cc84-ca3c-4eec-8f4a-7d2c6f7fea5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:03.070913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4c87cc84-ca3c-4eec-8f4a-7d2c6f7fea5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:03.077549 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4c87cc84-ca3c-4eec-8f4a-7d2c6f7fea5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:03.078039 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4c87cc84-ca3c-4eec-8f4a-7d2c6f7fea5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:03.078479 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4c87cc84-ca3c-4eec-8f4a-7d2c6f7fea5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:03.079192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4c87cc84-ca3c-4eec-8f4a-7d2c6f7fea5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:03.079666 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4c87cc84-ca3c-4eec-8f4a-7d2c6f7fea5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:03.080094 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4c87cc84-ca3c-4eec-8f4a-7d2c6f7fea5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:03.142486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4c87cc84-ca3c-4eec-8f4a-7d2c6f7fea5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:03.150529 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4c87cc84-ca3c-4eec-8f4a-7d2c6f7fea5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084142 Aug 24 12:57:03.151107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1765/3524] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:03 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:04.171508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-eaa750fa-03c8-4b9b-a873-e4bf2a8e4a35 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:04.172115 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-eaa750fa-03c8-4b9b-a873-e4bf2a8e4a35 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:04.178468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eaa750fa-03c8-4b9b-a873-e4bf2a8e4a35 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:04.178977 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eaa750fa-03c8-4b9b-a873-e4bf2a8e4a35 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:04.179413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eaa750fa-03c8-4b9b-a873-e4bf2a8e4a35 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:04.180116 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eaa750fa-03c8-4b9b-a873-e4bf2a8e4a35 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:04.180564 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eaa750fa-03c8-4b9b-a873-e4bf2a8e4a35 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:04.181051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-eaa750fa-03c8-4b9b-a873-e4bf2a8e4a35 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:04.241441 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-eaa750fa-03c8-4b9b-a873-e4bf2a8e4a35 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:04.249490 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-eaa750fa-03c8-4b9b-a873-e4bf2a8e4a35 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081773 Aug 24 12:57:04.250039 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1760/3525] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:04 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:05.269359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6c06eb92-adaf-4d8e-85ed-d85bb0c2916a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:05.269992 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6c06eb92-adaf-4d8e-85ed-d85bb0c2916a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:05.276452 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6c06eb92-adaf-4d8e-85ed-d85bb0c2916a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:05.276926 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6c06eb92-adaf-4d8e-85ed-d85bb0c2916a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:05.277359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6c06eb92-adaf-4d8e-85ed-d85bb0c2916a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:05.278038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6c06eb92-adaf-4d8e-85ed-d85bb0c2916a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:05.278499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6c06eb92-adaf-4d8e-85ed-d85bb0c2916a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:05.278943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6c06eb92-adaf-4d8e-85ed-d85bb0c2916a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:05.339039 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6c06eb92-adaf-4d8e-85ed-d85bb0c2916a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:05.347210 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6c06eb92-adaf-4d8e-85ed-d85bb0c2916a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081705 Aug 24 12:57:05.347770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1766/3526] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:05 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:06.368867 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-972f9f3b-969c-4e27-b259-8936a977354d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:06.369506 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-972f9f3b-969c-4e27-b259-8936a977354d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:06.376589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-972f9f3b-969c-4e27-b259-8936a977354d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:06.377075 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-972f9f3b-969c-4e27-b259-8936a977354d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:06.377517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-972f9f3b-969c-4e27-b259-8936a977354d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:06.378208 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-972f9f3b-969c-4e27-b259-8936a977354d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:06.378688 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-972f9f3b-969c-4e27-b259-8936a977354d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:06.379122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-972f9f3b-969c-4e27-b259-8936a977354d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:06.439861 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-972f9f3b-969c-4e27-b259-8936a977354d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:06.448735 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-972f9f3b-969c-4e27-b259-8936a977354d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084217 Aug 24 12:57:06.449293 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1761/3527] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:06 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:07.470029 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7f744c8e-6a33-4924-8c3a-1a10b5ead5d4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:07.470736 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7f744c8e-6a33-4924-8c3a-1a10b5ead5d4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:07.477829 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7f744c8e-6a33-4924-8c3a-1a10b5ead5d4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:07.478321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7f744c8e-6a33-4924-8c3a-1a10b5ead5d4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:07.478787 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7f744c8e-6a33-4924-8c3a-1a10b5ead5d4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:07.479489 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7f744c8e-6a33-4924-8c3a-1a10b5ead5d4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:07.479941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7f744c8e-6a33-4924-8c3a-1a10b5ead5d4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:07.480367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7f744c8e-6a33-4924-8c3a-1a10b5ead5d4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:07.550955 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7f744c8e-6a33-4924-8c3a-1a10b5ead5d4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:07.559252 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7f744c8e-6a33-4924-8c3a-1a10b5ead5d4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.093431 Aug 24 12:57:07.559805 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1767/3528] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:07 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:08.580721 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ece7718f-cb43-4cd5-9fe9-16850dd74d91 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:08.581322 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ece7718f-cb43-4cd5-9fe9-16850dd74d91 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:08.587723 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ece7718f-cb43-4cd5-9fe9-16850dd74d91 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:08.588250 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ece7718f-cb43-4cd5-9fe9-16850dd74d91 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:08.588685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ece7718f-cb43-4cd5-9fe9-16850dd74d91 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:08.589374 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ece7718f-cb43-4cd5-9fe9-16850dd74d91 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:08.589827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ece7718f-cb43-4cd5-9fe9-16850dd74d91 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:08.590255 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ece7718f-cb43-4cd5-9fe9-16850dd74d91 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:08.678062 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ece7718f-cb43-4cd5-9fe9-16850dd74d91 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:08.686575 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ece7718f-cb43-4cd5-9fe9-16850dd74d91 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.109876 Aug 24 12:57:08.687164 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1762/3529] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:08 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:08.993504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-e4516039-3883-4080-9d1e-18af762bb897 req-ff5ef08a-7e9d-446e-b431-d40c8ecdb5a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e5a10ee-202a-453e-b3ff-6c5c05ec72f3", "name": "network-vif-deleted", "tag": "65aeb21b-342d-4c27-963d-8c021915548c"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:57:09.004476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-e4516039-3883-4080-9d1e-18af762bb897 req-ff5ef08a-7e9d-446e-b431-d40c8ecdb5a5 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:09.004976 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-e4516039-3883-4080-9d1e-18af762bb897 req-ff5ef08a-7e9d-446e-b431-d40c8ecdb5a5 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:09.005405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-e4516039-3883-4080-9d1e-18af762bb897 req-ff5ef08a-7e9d-446e-b431-d40c8ecdb5a5 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:09.017292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-e4516039-3883-4080-9d1e-18af762bb897 req-ff5ef08a-7e9d-446e-b431-d40c8ecdb5a5 service nova] Creating event network-vif-deleted:65aeb21b-342d-4c27-963d-8c021915548c for instance 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 on hv-cinder-84889 Aug 24 12:57:09.022534 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-e4516039-3883-4080-9d1e-18af762bb897 req-ff5ef08a-7e9d-446e-b431-d40c8ecdb5a5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032806 Aug 24 12:57:09.024519 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1768/3530] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 12:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:57:09.709696 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fea13180-6110-4d86-b819-7bbef5a19e55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:09.710211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fea13180-6110-4d86-b819-7bbef5a19e55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:09.717111 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fea13180-6110-4d86-b819-7bbef5a19e55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:09.717588 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fea13180-6110-4d86-b819-7bbef5a19e55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:09.718017 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fea13180-6110-4d86-b819-7bbef5a19e55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:09.718706 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fea13180-6110-4d86-b819-7bbef5a19e55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:09.719156 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fea13180-6110-4d86-b819-7bbef5a19e55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:09.719575 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fea13180-6110-4d86-b819-7bbef5a19e55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:09.779757 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fea13180-6110-4d86-b819-7bbef5a19e55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:09.787789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fea13180-6110-4d86-b819-7bbef5a19e55 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082092 Aug 24 12:57:09.788343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1763/3531] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:09 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:10.809982 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c68937b5-e69c-49e7-ae66-bc6501307efe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:10.810669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c68937b5-e69c-49e7-ae66-bc6501307efe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:10.817164 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c68937b5-e69c-49e7-ae66-bc6501307efe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:10.817639 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c68937b5-e69c-49e7-ae66-bc6501307efe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:10.818073 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c68937b5-e69c-49e7-ae66-bc6501307efe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:10.818846 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c68937b5-e69c-49e7-ae66-bc6501307efe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:10.819303 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c68937b5-e69c-49e7-ae66-bc6501307efe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:10.819724 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c68937b5-e69c-49e7-ae66-bc6501307efe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:10.881791 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c68937b5-e69c-49e7-ae66-bc6501307efe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:10.889942 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c68937b5-e69c-49e7-ae66-bc6501307efe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084713 Aug 24 12:57:10.890491 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1769/3532] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:10 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:11.911076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a97f66aa-4413-4d40-bc17-4c63bc0c15ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:11.911702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a97f66aa-4413-4d40-bc17-4c63bc0c15ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:11.913961 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=30 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:57:11.918843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a97f66aa-4413-4d40-bc17-4c63bc0c15ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:11.919336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a97f66aa-4413-4d40-bc17-4c63bc0c15ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:11.919774 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a97f66aa-4413-4d40-bc17-4c63bc0c15ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:11.920457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a97f66aa-4413-4d40-bc17-4c63bc0c15ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:11.920912 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a97f66aa-4413-4d40-bc17-4c63bc0c15ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:11.921341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a97f66aa-4413-4d40-bc17-4c63bc0c15ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:11.984559 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a97f66aa-4413-4d40-bc17-4c63bc0c15ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:11.992777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a97f66aa-4413-4d40-bc17-4c63bc0c15ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085567 Aug 24 12:57:11.993329 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1764/3533] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:11 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:13.014516 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1e039c7f-ea51-4832-b674-d2827ea76fe5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:13.015337 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1e039c7f-ea51-4832-b674-d2827ea76fe5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:13.021658 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e039c7f-ea51-4832-b674-d2827ea76fe5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:13.022142 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e039c7f-ea51-4832-b674-d2827ea76fe5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:13.022580 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e039c7f-ea51-4832-b674-d2827ea76fe5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:13.023297 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e039c7f-ea51-4832-b674-d2827ea76fe5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:13.023854 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e039c7f-ea51-4832-b674-d2827ea76fe5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:13.024283 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1e039c7f-ea51-4832-b674-d2827ea76fe5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:13.084454 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1e039c7f-ea51-4832-b674-d2827ea76fe5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:13.092409 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1e039c7f-ea51-4832-b674-d2827ea76fe5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082969 Aug 24 12:57:13.092966 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1770/3534] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:13 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:14.112923 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3f7dac10-4ebe-4d02-9c90-a2d70a5ee968 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:14.113534 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3f7dac10-4ebe-4d02-9c90-a2d70a5ee968 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:14.120487 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f7dac10-4ebe-4d02-9c90-a2d70a5ee968 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:14.120969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f7dac10-4ebe-4d02-9c90-a2d70a5ee968 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:14.121404 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f7dac10-4ebe-4d02-9c90-a2d70a5ee968 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:14.122090 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f7dac10-4ebe-4d02-9c90-a2d70a5ee968 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:14.122546 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f7dac10-4ebe-4d02-9c90-a2d70a5ee968 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:14.123002 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f7dac10-4ebe-4d02-9c90-a2d70a5ee968 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:14.185289 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3f7dac10-4ebe-4d02-9c90-a2d70a5ee968 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:14.193440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3f7dac10-4ebe-4d02-9c90-a2d70a5ee968 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084598 Aug 24 12:57:14.194170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1765/3535] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:14 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:15.214920 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-04161987-0b29-4b15-9641-0f2ca35c3eee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:15.215478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-04161987-0b29-4b15-9641-0f2ca35c3eee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:15.221863 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-04161987-0b29-4b15-9641-0f2ca35c3eee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:15.222396 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-04161987-0b29-4b15-9641-0f2ca35c3eee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:15.222858 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-04161987-0b29-4b15-9641-0f2ca35c3eee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:15.223547 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-04161987-0b29-4b15-9641-0f2ca35c3eee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:15.224008 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-04161987-0b29-4b15-9641-0f2ca35c3eee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:15.224436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-04161987-0b29-4b15-9641-0f2ca35c3eee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:15.285614 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-04161987-0b29-4b15-9641-0f2ca35c3eee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:15.293957 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-04161987-0b29-4b15-9641-0f2ca35c3eee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083688 Aug 24 12:57:15.294527 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1771/3536] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:15 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:16.315651 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-89de61f9-afc6-4126-9ef2-e8d2269ab8f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:16.316160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-89de61f9-afc6-4126-9ef2-e8d2269ab8f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:16.322178 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-89de61f9-afc6-4126-9ef2-e8d2269ab8f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:16.322682 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-89de61f9-afc6-4126-9ef2-e8d2269ab8f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:16.323119 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-89de61f9-afc6-4126-9ef2-e8d2269ab8f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:16.323786 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-89de61f9-afc6-4126-9ef2-e8d2269ab8f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:16.324232 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-89de61f9-afc6-4126-9ef2-e8d2269ab8f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:16.324649 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-89de61f9-afc6-4126-9ef2-e8d2269ab8f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:16.385732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-89de61f9-afc6-4126-9ef2-e8d2269ab8f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:16.393733 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-89de61f9-afc6-4126-9ef2-e8d2269ab8f9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081988 Aug 24 12:57:16.394292 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1766/3537] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:16 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:17.414807 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e0cca129-e0fb-4cf4-92ec-23037d2197c1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:17.415414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e0cca129-e0fb-4cf4-92ec-23037d2197c1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:17.418356 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=32 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:57:17.423151 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0cca129-e0fb-4cf4-92ec-23037d2197c1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:17.423634 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0cca129-e0fb-4cf4-92ec-23037d2197c1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:17.424136 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0cca129-e0fb-4cf4-92ec-23037d2197c1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:17.424761 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0cca129-e0fb-4cf4-92ec-23037d2197c1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:17.425211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0cca129-e0fb-4cf4-92ec-23037d2197c1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:17.425630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e0cca129-e0fb-4cf4-92ec-23037d2197c1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:17.490186 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e0cca129-e0fb-4cf4-92ec-23037d2197c1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:17.498883 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e0cca129-e0fb-4cf4-92ec-23037d2197c1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.087864 Aug 24 12:57:17.499438 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1772/3538] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:17 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:18.519458 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fdf66227-656b-404b-a05e-5c0d42a3a296 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:18.520066 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fdf66227-656b-404b-a05e-5c0d42a3a296 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:18.527080 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fdf66227-656b-404b-a05e-5c0d42a3a296 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:18.527558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fdf66227-656b-404b-a05e-5c0d42a3a296 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:18.527995 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fdf66227-656b-404b-a05e-5c0d42a3a296 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:18.528665 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fdf66227-656b-404b-a05e-5c0d42a3a296 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:18.529111 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fdf66227-656b-404b-a05e-5c0d42a3a296 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:18.529528 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fdf66227-656b-404b-a05e-5c0d42a3a296 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:18.607859 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fdf66227-656b-404b-a05e-5c0d42a3a296 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:18.616575 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fdf66227-656b-404b-a05e-5c0d42a3a296 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.100870 Aug 24 12:57:18.617344 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1767/3539] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:18 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:19.637874 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f43e2dff-1966-4f6d-bf8e-1d2932c3076c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:19.638520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f43e2dff-1966-4f6d-bf8e-1d2932c3076c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:19.644994 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f43e2dff-1966-4f6d-bf8e-1d2932c3076c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:19.645484 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f43e2dff-1966-4f6d-bf8e-1d2932c3076c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:19.645929 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f43e2dff-1966-4f6d-bf8e-1d2932c3076c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:19.646616 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f43e2dff-1966-4f6d-bf8e-1d2932c3076c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:19.647098 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f43e2dff-1966-4f6d-bf8e-1d2932c3076c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:19.647526 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f43e2dff-1966-4f6d-bf8e-1d2932c3076c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:19.650007 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=86 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:57:19.710671 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f43e2dff-1966-4f6d-bf8e-1d2932c3076c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:19.718743 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f43e2dff-1966-4f6d-bf8e-1d2932c3076c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084906 Aug 24 12:57:19.719311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1773/3540] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:19 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:20.740003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6d6084cb-cac0-453e-8801-f4115d7ecd7d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:20.740609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6d6084cb-cac0-453e-8801-f4115d7ecd7d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:20.747515 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d6084cb-cac0-453e-8801-f4115d7ecd7d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:20.747991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d6084cb-cac0-453e-8801-f4115d7ecd7d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:20.748426 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d6084cb-cac0-453e-8801-f4115d7ecd7d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:20.749100 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d6084cb-cac0-453e-8801-f4115d7ecd7d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:20.749550 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d6084cb-cac0-453e-8801-f4115d7ecd7d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:20.749973 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d6084cb-cac0-453e-8801-f4115d7ecd7d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:20.812989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6d6084cb-cac0-453e-8801-f4115d7ecd7d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:20.821045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6d6084cb-cac0-453e-8801-f4115d7ecd7d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085182 Aug 24 12:57:20.821596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1768/3541] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:20 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:21.843393 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5b6c8709-9ded-4f50-93fc-26546118e712 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:21.844005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5b6c8709-9ded-4f50-93fc-26546118e712 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:21.850299 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b6c8709-9ded-4f50-93fc-26546118e712 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:21.850825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b6c8709-9ded-4f50-93fc-26546118e712 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:21.851261 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b6c8709-9ded-4f50-93fc-26546118e712 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:21.851935 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b6c8709-9ded-4f50-93fc-26546118e712 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:21.852381 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b6c8709-9ded-4f50-93fc-26546118e712 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:21.852799 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b6c8709-9ded-4f50-93fc-26546118e712 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:21.912537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5b6c8709-9ded-4f50-93fc-26546118e712 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:21.920658 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5b6c8709-9ded-4f50-93fc-26546118e712 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081827 Aug 24 12:57:21.921220 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1774/3542] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:21 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:22.941254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-46366481-536e-448e-a605-f20ef86b0ebb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:22.941856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-46366481-536e-448e-a605-f20ef86b0ebb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:22.948936 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46366481-536e-448e-a605-f20ef86b0ebb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:22.949412 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46366481-536e-448e-a605-f20ef86b0ebb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:22.949848 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46366481-536e-448e-a605-f20ef86b0ebb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:22.950526 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46366481-536e-448e-a605-f20ef86b0ebb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:22.951019 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46366481-536e-448e-a605-f20ef86b0ebb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:22.951443 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46366481-536e-448e-a605-f20ef86b0ebb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:23.012429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-46366481-536e-448e-a605-f20ef86b0ebb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:23.020589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-46366481-536e-448e-a605-f20ef86b0ebb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083174 Aug 24 12:57:23.021150 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1769/3543] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:22 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:24.041376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-17bbf4af-8816-439a-bff3-add2466e2cae tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:24.041998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-17bbf4af-8816-439a-bff3-add2466e2cae tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:24.048400 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-17bbf4af-8816-439a-bff3-add2466e2cae tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:24.048888 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-17bbf4af-8816-439a-bff3-add2466e2cae tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:24.049338 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-17bbf4af-8816-439a-bff3-add2466e2cae tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:24.050026 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-17bbf4af-8816-439a-bff3-add2466e2cae tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:24.050486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-17bbf4af-8816-439a-bff3-add2466e2cae tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:24.050944 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-17bbf4af-8816-439a-bff3-add2466e2cae tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:24.112728 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-17bbf4af-8816-439a-bff3-add2466e2cae tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:24.121105 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-17bbf4af-8816-439a-bff3-add2466e2cae tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083601 Aug 24 12:57:24.124984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1775/3544] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:24 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:25.142177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-890a1278-e733-43f7-9f4b-e6cf6c9e118b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:25.142821 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-890a1278-e733-43f7-9f4b-e6cf6c9e118b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:25.149544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-890a1278-e733-43f7-9f4b-e6cf6c9e118b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:25.150040 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-890a1278-e733-43f7-9f4b-e6cf6c9e118b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:25.150483 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-890a1278-e733-43f7-9f4b-e6cf6c9e118b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:25.151237 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-890a1278-e733-43f7-9f4b-e6cf6c9e118b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:25.151698 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-890a1278-e733-43f7-9f4b-e6cf6c9e118b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:25.152130 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-890a1278-e733-43f7-9f4b-e6cf6c9e118b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:25.226268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-890a1278-e733-43f7-9f4b-e6cf6c9e118b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:25.234917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-890a1278-e733-43f7-9f4b-e6cf6c9e118b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.096577 Aug 24 12:57:25.235479 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1770/3545] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:25 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:26.256558 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3ea55d8e-5631-441c-9b26-f162f6658092 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:26.257175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3ea55d8e-5631-441c-9b26-f162f6658092 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:26.264019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ea55d8e-5631-441c-9b26-f162f6658092 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:26.264502 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ea55d8e-5631-441c-9b26-f162f6658092 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:26.264941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ea55d8e-5631-441c-9b26-f162f6658092 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:26.265631 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ea55d8e-5631-441c-9b26-f162f6658092 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:26.266086 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ea55d8e-5631-441c-9b26-f162f6658092 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:26.266528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ea55d8e-5631-441c-9b26-f162f6658092 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:26.329133 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3ea55d8e-5631-441c-9b26-f162f6658092 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:26.337192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3ea55d8e-5631-441c-9b26-f162f6658092 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084519 Aug 24 12:57:26.337745 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1776/3546] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:26 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:27.358635 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d56cc04c-c7bb-461c-99c8-973a5029a229 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:27.359266 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d56cc04c-c7bb-461c-99c8-973a5029a229 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:27.365903 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d56cc04c-c7bb-461c-99c8-973a5029a229 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:27.366385 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d56cc04c-c7bb-461c-99c8-973a5029a229 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:27.366861 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d56cc04c-c7bb-461c-99c8-973a5029a229 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:27.367539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d56cc04c-c7bb-461c-99c8-973a5029a229 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:27.367993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d56cc04c-c7bb-461c-99c8-973a5029a229 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:27.368418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d56cc04c-c7bb-461c-99c8-973a5029a229 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:27.431624 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d56cc04c-c7bb-461c-99c8-973a5029a229 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:27.440140 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d56cc04c-c7bb-461c-99c8-973a5029a229 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085395 Aug 24 12:57:27.440699 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1771/3547] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:27 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:28.461265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4a9acf91-275f-4567-88f6-bd44283e8357 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:28.461877 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4a9acf91-275f-4567-88f6-bd44283e8357 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:28.468887 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a9acf91-275f-4567-88f6-bd44283e8357 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:28.469365 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a9acf91-275f-4567-88f6-bd44283e8357 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:28.469800 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a9acf91-275f-4567-88f6-bd44283e8357 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:28.470484 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a9acf91-275f-4567-88f6-bd44283e8357 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:28.470963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a9acf91-275f-4567-88f6-bd44283e8357 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:28.471390 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a9acf91-275f-4567-88f6-bd44283e8357 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:28.531349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4a9acf91-275f-4567-88f6-bd44283e8357 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:28.539421 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4a9acf91-275f-4567-88f6-bd44283e8357 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082030 Aug 24 12:57:28.539982 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1777/3548] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:28 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:29.560355 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fa0dff35-33fd-494f-94c4-97bd54b55db6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:29.560966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fa0dff35-33fd-494f-94c4-97bd54b55db6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:29.567470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa0dff35-33fd-494f-94c4-97bd54b55db6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:29.567978 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa0dff35-33fd-494f-94c4-97bd54b55db6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:29.568418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa0dff35-33fd-494f-94c4-97bd54b55db6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:29.569102 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa0dff35-33fd-494f-94c4-97bd54b55db6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:29.569555 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa0dff35-33fd-494f-94c4-97bd54b55db6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:29.569983 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fa0dff35-33fd-494f-94c4-97bd54b55db6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:29.572607 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=90 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:57:29.634388 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fa0dff35-33fd-494f-94c4-97bd54b55db6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:29.645951 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fa0dff35-33fd-494f-94c4-97bd54b55db6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.089281 Aug 24 12:57:29.646946 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1772/3549] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:29 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:30.668163 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dedfc471-c160-4d95-9c3e-9d0e7a3065e3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:30.668708 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dedfc471-c160-4d95-9c3e-9d0e7a3065e3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:30.675235 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dedfc471-c160-4d95-9c3e-9d0e7a3065e3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:30.675714 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dedfc471-c160-4d95-9c3e-9d0e7a3065e3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:30.676153 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dedfc471-c160-4d95-9c3e-9d0e7a3065e3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:30.676839 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dedfc471-c160-4d95-9c3e-9d0e7a3065e3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:30.677304 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dedfc471-c160-4d95-9c3e-9d0e7a3065e3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:30.677734 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dedfc471-c160-4d95-9c3e-9d0e7a3065e3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:30.737887 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-dedfc471-c160-4d95-9c3e-9d0e7a3065e3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:30.745922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dedfc471-c160-4d95-9c3e-9d0e7a3065e3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082304 Aug 24 12:57:30.746484 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1778/3550] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:30 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:31.766754 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-98d888b5-20a0-49d8-a912-676400408fc9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:31.767363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-98d888b5-20a0-49d8-a912-676400408fc9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:31.773870 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98d888b5-20a0-49d8-a912-676400408fc9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:31.774347 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98d888b5-20a0-49d8-a912-676400408fc9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:31.774808 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98d888b5-20a0-49d8-a912-676400408fc9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:31.776096 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98d888b5-20a0-49d8-a912-676400408fc9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:31.776551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98d888b5-20a0-49d8-a912-676400408fc9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:31.776974 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98d888b5-20a0-49d8-a912-676400408fc9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:31.836325 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-98d888b5-20a0-49d8-a912-676400408fc9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:31.844835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-98d888b5-20a0-49d8-a912-676400408fc9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082024 Aug 24 12:57:31.845391 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1773/3551] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:31 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:32.867353 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fe3d5ef1-706c-4cac-8a07-960d404abf19 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:32.867962 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fe3d5ef1-706c-4cac-8a07-960d404abf19 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:32.874818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe3d5ef1-706c-4cac-8a07-960d404abf19 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:32.875301 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe3d5ef1-706c-4cac-8a07-960d404abf19 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:32.875732 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe3d5ef1-706c-4cac-8a07-960d404abf19 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:32.876413 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe3d5ef1-706c-4cac-8a07-960d404abf19 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:32.876865 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe3d5ef1-706c-4cac-8a07-960d404abf19 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:32.877282 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe3d5ef1-706c-4cac-8a07-960d404abf19 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:32.940429 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fe3d5ef1-706c-4cac-8a07-960d404abf19 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:32.948787 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fe3d5ef1-706c-4cac-8a07-960d404abf19 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.086539 Aug 24 12:57:32.949338 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1779/3552] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:32 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:33.969996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-900599bc-5e46-41d9-8e95-68c27db19177 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:33.970603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-900599bc-5e46-41d9-8e95-68c27db19177 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:33.977033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-900599bc-5e46-41d9-8e95-68c27db19177 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:33.977504 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-900599bc-5e46-41d9-8e95-68c27db19177 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:33.977932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-900599bc-5e46-41d9-8e95-68c27db19177 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:33.978603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-900599bc-5e46-41d9-8e95-68c27db19177 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:33.979112 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-900599bc-5e46-41d9-8e95-68c27db19177 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:33.979530 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-900599bc-5e46-41d9-8e95-68c27db19177 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:34.040280 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-900599bc-5e46-41d9-8e95-68c27db19177 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:34.048347 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-900599bc-5e46-41d9-8e95-68c27db19177 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082300 Aug 24 12:57:34.048900 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1774/3553] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:33 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:35.069356 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-cd1cd63f-509f-4108-b76a-f366c85d55e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:35.069962 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-cd1cd63f-509f-4108-b76a-f366c85d55e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:35.076910 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd1cd63f-509f-4108-b76a-f366c85d55e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:35.077389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd1cd63f-509f-4108-b76a-f366c85d55e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:35.077821 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd1cd63f-509f-4108-b76a-f366c85d55e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:35.078495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd1cd63f-509f-4108-b76a-f366c85d55e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:35.078976 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd1cd63f-509f-4108-b76a-f366c85d55e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:35.079396 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cd1cd63f-509f-4108-b76a-f366c85d55e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:35.142312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-cd1cd63f-509f-4108-b76a-f366c85d55e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:35.150595 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-cd1cd63f-509f-4108-b76a-f366c85d55e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085115 Aug 24 12:57:35.151185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1780/3554] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:35 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:36.171253 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4e4ab2d2-febd-48c2-9ddf-364896bec403 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:36.171858 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4e4ab2d2-febd-48c2-9ddf-364896bec403 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:36.178232 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4e4ab2d2-febd-48c2-9ddf-364896bec403 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:36.178742 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4e4ab2d2-febd-48c2-9ddf-364896bec403 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:36.179176 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4e4ab2d2-febd-48c2-9ddf-364896bec403 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:36.179849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4e4ab2d2-febd-48c2-9ddf-364896bec403 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:36.180295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4e4ab2d2-febd-48c2-9ddf-364896bec403 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:36.180715 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4e4ab2d2-febd-48c2-9ddf-364896bec403 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:36.240714 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4e4ab2d2-febd-48c2-9ddf-364896bec403 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:36.248698 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4e4ab2d2-febd-48c2-9ddf-364896bec403 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081268 Aug 24 12:57:36.249251 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1775/3555] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:36 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:37.269438 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8eb56f10-d2d4-454b-a618-5954b50faa89 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:37.270073 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8eb56f10-d2d4-454b-a618-5954b50faa89 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:37.275934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8eb56f10-d2d4-454b-a618-5954b50faa89 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:37.276418 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8eb56f10-d2d4-454b-a618-5954b50faa89 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:37.276859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8eb56f10-d2d4-454b-a618-5954b50faa89 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:37.277544 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8eb56f10-d2d4-454b-a618-5954b50faa89 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:37.278001 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8eb56f10-d2d4-454b-a618-5954b50faa89 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:37.278431 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8eb56f10-d2d4-454b-a618-5954b50faa89 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:37.338405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8eb56f10-d2d4-454b-a618-5954b50faa89 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:37.346518 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8eb56f10-d2d4-454b-a618-5954b50faa89 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081123 Aug 24 12:57:37.347102 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1781/3556] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:37 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:38.367438 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ca98ef85-f164-404c-868d-85778c654256 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:38.368040 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ca98ef85-f164-404c-868d-85778c654256 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:38.375080 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca98ef85-f164-404c-868d-85778c654256 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:38.375558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca98ef85-f164-404c-868d-85778c654256 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:38.375992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca98ef85-f164-404c-868d-85778c654256 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:38.376668 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca98ef85-f164-404c-868d-85778c654256 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:38.377123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca98ef85-f164-404c-868d-85778c654256 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:38.377544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ca98ef85-f164-404c-868d-85778c654256 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:38.441030 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ca98ef85-f164-404c-868d-85778c654256 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:38.449187 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ca98ef85-f164-404c-868d-85778c654256 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085603 Aug 24 12:57:38.449747 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1776/3557] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:38 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:39.469712 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-291a0e10-5aa9-4138-8cbe-818429264dc8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:39.470333 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-291a0e10-5aa9-4138-8cbe-818429264dc8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:39.476730 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-291a0e10-5aa9-4138-8cbe-818429264dc8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:39.477213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-291a0e10-5aa9-4138-8cbe-818429264dc8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:39.477653 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-291a0e10-5aa9-4138-8cbe-818429264dc8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:39.479002 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-291a0e10-5aa9-4138-8cbe-818429264dc8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:39.479459 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-291a0e10-5aa9-4138-8cbe-818429264dc8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:39.479885 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-291a0e10-5aa9-4138-8cbe-818429264dc8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:39.540013 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-291a0e10-5aa9-4138-8cbe-818429264dc8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:39.548630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-291a0e10-5aa9-4138-8cbe-818429264dc8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082897 Aug 24 12:57:39.549184 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1782/3558] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:39 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:40.568825 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-220d014d-2ae2-43a4-81fe-e30e9634765d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:40.569434 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-220d014d-2ae2-43a4-81fe-e30e9634765d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:40.576525 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-220d014d-2ae2-43a4-81fe-e30e9634765d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:40.577083 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-220d014d-2ae2-43a4-81fe-e30e9634765d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:40.577588 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-220d014d-2ae2-43a4-81fe-e30e9634765d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:40.578269 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-220d014d-2ae2-43a4-81fe-e30e9634765d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:40.578753 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-220d014d-2ae2-43a4-81fe-e30e9634765d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:40.579182 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-220d014d-2ae2-43a4-81fe-e30e9634765d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:40.642017 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-220d014d-2ae2-43a4-81fe-e30e9634765d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:40.650130 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-220d014d-2ae2-43a4-81fe-e30e9634765d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085279 Aug 24 12:57:40.650716 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1777/3559] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:40 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:41.672068 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-46b57121-1901-47f0-af94-b6a46a6d86fb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:41.672697 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-46b57121-1901-47f0-af94-b6a46a6d86fb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:41.679137 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46b57121-1901-47f0-af94-b6a46a6d86fb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:41.679571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46b57121-1901-47f0-af94-b6a46a6d86fb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:41.680004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46b57121-1901-47f0-af94-b6a46a6d86fb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:41.680684 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46b57121-1901-47f0-af94-b6a46a6d86fb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:41.681136 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46b57121-1901-47f0-af94-b6a46a6d86fb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:41.681561 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46b57121-1901-47f0-af94-b6a46a6d86fb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:41.742451 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-46b57121-1901-47f0-af94-b6a46a6d86fb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:41.750661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-46b57121-1901-47f0-af94-b6a46a6d86fb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082496 Aug 24 12:57:41.751227 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1783/3560] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:41 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:42.771932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bc505da9-1daa-4836-b0b9-c511875b452c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:42.772532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-bc505da9-1daa-4836-b0b9-c511875b452c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:42.774791 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=28 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:57:42.779407 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bc505da9-1daa-4836-b0b9-c511875b452c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:42.779879 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bc505da9-1daa-4836-b0b9-c511875b452c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:42.780306 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bc505da9-1daa-4836-b0b9-c511875b452c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:42.780973 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bc505da9-1daa-4836-b0b9-c511875b452c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:42.781420 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bc505da9-1daa-4836-b0b9-c511875b452c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:42.781836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bc505da9-1daa-4836-b0b9-c511875b452c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:42.841761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-bc505da9-1daa-4836-b0b9-c511875b452c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:42.849812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bc505da9-1daa-4836-b0b9-c511875b452c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081764 Aug 24 12:57:42.850364 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1778/3561] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:42 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:43.871969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5b963bdf-cd57-4603-a426-76da4457ff32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:43.872586 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5b963bdf-cd57-4603-a426-76da4457ff32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:43.879180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b963bdf-cd57-4603-a426-76da4457ff32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:43.879664 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b963bdf-cd57-4603-a426-76da4457ff32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:43.880105 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b963bdf-cd57-4603-a426-76da4457ff32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:43.880793 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b963bdf-cd57-4603-a426-76da4457ff32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:43.881255 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b963bdf-cd57-4603-a426-76da4457ff32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:43.881686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5b963bdf-cd57-4603-a426-76da4457ff32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:43.945042 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5b963bdf-cd57-4603-a426-76da4457ff32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:43.953304 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5b963bdf-cd57-4603-a426-76da4457ff32 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085949 Aug 24 12:57:43.953867 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1784/3562] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:43 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:44.973906 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0ee94020-da64-474e-86fc-0a421ad59e1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:44.974514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0ee94020-da64-474e-86fc-0a421ad59e1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:44.980878 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ee94020-da64-474e-86fc-0a421ad59e1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:44.981356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ee94020-da64-474e-86fc-0a421ad59e1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:44.981791 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ee94020-da64-474e-86fc-0a421ad59e1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:44.982470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ee94020-da64-474e-86fc-0a421ad59e1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:44.982945 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ee94020-da64-474e-86fc-0a421ad59e1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:44.983372 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ee94020-da64-474e-86fc-0a421ad59e1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:45.043602 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0ee94020-da64-474e-86fc-0a421ad59e1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:45.051677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0ee94020-da64-474e-86fc-0a421ad59e1b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081626 Aug 24 12:57:45.052236 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1779/3563] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:44 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:46.072870 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ea4dc36c-03ac-4cd9-a9cb-9fa47d8cf0a2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:46.073486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ea4dc36c-03ac-4cd9-a9cb-9fa47d8cf0a2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:46.080271 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea4dc36c-03ac-4cd9-a9cb-9fa47d8cf0a2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:46.080754 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea4dc36c-03ac-4cd9-a9cb-9fa47d8cf0a2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:46.081188 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea4dc36c-03ac-4cd9-a9cb-9fa47d8cf0a2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:46.081863 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea4dc36c-03ac-4cd9-a9cb-9fa47d8cf0a2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:46.082311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea4dc36c-03ac-4cd9-a9cb-9fa47d8cf0a2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:46.082757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ea4dc36c-03ac-4cd9-a9cb-9fa47d8cf0a2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:46.143671 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ea4dc36c-03ac-4cd9-a9cb-9fa47d8cf0a2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:46.151572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ea4dc36c-03ac-4cd9-a9cb-9fa47d8cf0a2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082618 Aug 24 12:57:46.152121 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1785/3564] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:46 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:47.172646 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cf08678b-5448-425c-b5f7-8ec17bdac8fa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:47.173285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cf08678b-5448-425c-b5f7-8ec17bdac8fa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:47.187905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf08678b-5448-425c-b5f7-8ec17bdac8fa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:47.188384 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf08678b-5448-425c-b5f7-8ec17bdac8fa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:47.188818 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf08678b-5448-425c-b5f7-8ec17bdac8fa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:47.189498 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf08678b-5448-425c-b5f7-8ec17bdac8fa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:47.189947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf08678b-5448-425c-b5f7-8ec17bdac8fa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:47.190372 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cf08678b-5448-425c-b5f7-8ec17bdac8fa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:47.253828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cf08678b-5448-425c-b5f7-8ec17bdac8fa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:47.261993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cf08678b-5448-425c-b5f7-8ec17bdac8fa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.093798 Aug 24 12:57:47.262545 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1780/3565] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:47 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:48.282737 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-52db4a9a-7376-4196-9b0d-0f7bc233f6d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:48.283349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-52db4a9a-7376-4196-9b0d-0f7bc233f6d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:48.285606 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=28 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:57:48.290220 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52db4a9a-7376-4196-9b0d-0f7bc233f6d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:48.290796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52db4a9a-7376-4196-9b0d-0f7bc233f6d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:48.291241 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52db4a9a-7376-4196-9b0d-0f7bc233f6d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:48.291923 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52db4a9a-7376-4196-9b0d-0f7bc233f6d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:48.292380 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52db4a9a-7376-4196-9b0d-0f7bc233f6d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:48.292807 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52db4a9a-7376-4196-9b0d-0f7bc233f6d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:48.355754 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-52db4a9a-7376-4196-9b0d-0f7bc233f6d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:48.364731 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-52db4a9a-7376-4196-9b0d-0f7bc233f6d1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085825 Aug 24 12:57:48.365287 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1786/3566] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:48 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:49.385228 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-54fbcea8-211d-48d0-a3c0-55d0457c6c5e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:49.385841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-54fbcea8-211d-48d0-a3c0-55d0457c6c5e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:49.392911 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-54fbcea8-211d-48d0-a3c0-55d0457c6c5e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:49.393385 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-54fbcea8-211d-48d0-a3c0-55d0457c6c5e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:49.393822 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-54fbcea8-211d-48d0-a3c0-55d0457c6c5e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:49.394498 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-54fbcea8-211d-48d0-a3c0-55d0457c6c5e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:49.394979 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-54fbcea8-211d-48d0-a3c0-55d0457c6c5e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:49.395437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-54fbcea8-211d-48d0-a3c0-55d0457c6c5e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:49.456652 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-54fbcea8-211d-48d0-a3c0-55d0457c6c5e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:49.464820 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-54fbcea8-211d-48d0-a3c0-55d0457c6c5e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083441 Aug 24 12:57:49.465378 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1781/3567] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:49 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:50.485347 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c8529884-36d5-4dcb-901c-6163c4058d1a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:50.486232 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c8529884-36d5-4dcb-901c-6163c4058d1a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:50.492548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c8529884-36d5-4dcb-901c-6163c4058d1a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:50.493022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c8529884-36d5-4dcb-901c-6163c4058d1a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:50.493457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c8529884-36d5-4dcb-901c-6163c4058d1a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:50.494127 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c8529884-36d5-4dcb-901c-6163c4058d1a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:50.494719 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c8529884-36d5-4dcb-901c-6163c4058d1a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:50.495145 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c8529884-36d5-4dcb-901c-6163c4058d1a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:50.497603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=84 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:57:50.556473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c8529884-36d5-4dcb-901c-6163c4058d1a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:50.564479 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c8529884-36d5-4dcb-901c-6163c4058d1a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083084 Aug 24 12:57:50.565028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1787/3568] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:50 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:51.585575 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-452dd414-aee7-4e86-b56a-58e2b4159b82 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:51.586149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-452dd414-aee7-4e86-b56a-58e2b4159b82 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:51.593006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-452dd414-aee7-4e86-b56a-58e2b4159b82 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:51.593486 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-452dd414-aee7-4e86-b56a-58e2b4159b82 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:51.593921 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-452dd414-aee7-4e86-b56a-58e2b4159b82 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:51.594598 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-452dd414-aee7-4e86-b56a-58e2b4159b82 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:51.595075 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-452dd414-aee7-4e86-b56a-58e2b4159b82 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:51.595497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-452dd414-aee7-4e86-b56a-58e2b4159b82 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:51.656768 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-452dd414-aee7-4e86-b56a-58e2b4159b82 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:51.665104 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-452dd414-aee7-4e86-b56a-58e2b4159b82 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083486 Aug 24 12:57:51.665667 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1782/3569] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:51 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:52.686995 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-679ec357-54b1-4ad5-93f7-09d65de2f51b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:52.687543 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-679ec357-54b1-4ad5-93f7-09d65de2f51b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:52.693917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-679ec357-54b1-4ad5-93f7-09d65de2f51b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:52.694402 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-679ec357-54b1-4ad5-93f7-09d65de2f51b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:52.694872 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-679ec357-54b1-4ad5-93f7-09d65de2f51b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:52.695561 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-679ec357-54b1-4ad5-93f7-09d65de2f51b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:52.696007 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-679ec357-54b1-4ad5-93f7-09d65de2f51b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:52.696436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-679ec357-54b1-4ad5-93f7-09d65de2f51b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:52.760423 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-679ec357-54b1-4ad5-93f7-09d65de2f51b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:52.768519 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-679ec357-54b1-4ad5-93f7-09d65de2f51b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085994 Aug 24 12:57:52.769068 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1788/3570] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:52 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:53.789104 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a051659b-237e-477e-b3cc-a49925fa08a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:53.789819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a051659b-237e-477e-b3cc-a49925fa08a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:53.796325 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a051659b-237e-477e-b3cc-a49925fa08a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:53.796810 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a051659b-237e-477e-b3cc-a49925fa08a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:53.797243 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a051659b-237e-477e-b3cc-a49925fa08a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:53.797948 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a051659b-237e-477e-b3cc-a49925fa08a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:53.798399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a051659b-237e-477e-b3cc-a49925fa08a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:53.798867 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a051659b-237e-477e-b3cc-a49925fa08a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:53.859142 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a051659b-237e-477e-b3cc-a49925fa08a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:53.867980 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a051659b-237e-477e-b3cc-a49925fa08a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082710 Aug 24 12:57:53.868507 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1783/3571] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:53 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:54.889684 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-de8448a0-3622-446f-888f-be3dc42139a4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:54.890294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-de8448a0-3622-446f-888f-be3dc42139a4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:54.896701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de8448a0-3622-446f-888f-be3dc42139a4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:54.897181 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de8448a0-3622-446f-888f-be3dc42139a4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:54.897621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de8448a0-3622-446f-888f-be3dc42139a4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:54.898298 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de8448a0-3622-446f-888f-be3dc42139a4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:54.898779 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de8448a0-3622-446f-888f-be3dc42139a4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:54.899210 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-de8448a0-3622-446f-888f-be3dc42139a4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:54.959107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-de8448a0-3622-446f-888f-be3dc42139a4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:54.967165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-de8448a0-3622-446f-888f-be3dc42139a4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081905 Aug 24 12:57:54.967721 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1789/3572] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:54 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:55.988175 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-913537ae-a576-421c-a1bb-f317732a73a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:55.998590 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-913537ae-a576-421c-a1bb-f317732a73a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:55.998590 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-913537ae-a576-421c-a1bb-f317732a73a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:55.998590 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-913537ae-a576-421c-a1bb-f317732a73a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:55.998590 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-913537ae-a576-421c-a1bb-f317732a73a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:55.999006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-913537ae-a576-421c-a1bb-f317732a73a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:55.999006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-913537ae-a576-421c-a1bb-f317732a73a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:55.999006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-913537ae-a576-421c-a1bb-f317732a73a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:56.067142 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-913537ae-a576-421c-a1bb-f317732a73a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:56.075344 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-913537ae-a576-421c-a1bb-f317732a73a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.091370 Aug 24 12:57:56.076487 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1784/3573] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:55 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:57.096816 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f7eac009-48e2-40bb-94c7-ef733240c2eb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:57.097426 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f7eac009-48e2-40bb-94c7-ef733240c2eb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:57.103761 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7eac009-48e2-40bb-94c7-ef733240c2eb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:57.104247 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7eac009-48e2-40bb-94c7-ef733240c2eb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:57.104685 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7eac009-48e2-40bb-94c7-ef733240c2eb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:57.105366 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7eac009-48e2-40bb-94c7-ef733240c2eb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:57.105826 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7eac009-48e2-40bb-94c7-ef733240c2eb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:57.106248 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7eac009-48e2-40bb-94c7-ef733240c2eb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:57.166522 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f7eac009-48e2-40bb-94c7-ef733240c2eb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:57.175447 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f7eac009-48e2-40bb-94c7-ef733240c2eb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082481 Aug 24 12:57:57.176007 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1790/3574] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:57 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:58.195881 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b5647d17-3ff5-44d6-835c-8b53e1799aa7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:58.196508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b5647d17-3ff5-44d6-835c-8b53e1799aa7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:58.202867 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b5647d17-3ff5-44d6-835c-8b53e1799aa7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:58.203341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b5647d17-3ff5-44d6-835c-8b53e1799aa7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:58.203803 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b5647d17-3ff5-44d6-835c-8b53e1799aa7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:58.204476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b5647d17-3ff5-44d6-835c-8b53e1799aa7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:58.204921 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b5647d17-3ff5-44d6-835c-8b53e1799aa7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:58.205339 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b5647d17-3ff5-44d6-835c-8b53e1799aa7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:58.265278 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b5647d17-3ff5-44d6-835c-8b53e1799aa7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:58.273423 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b5647d17-3ff5-44d6-835c-8b53e1799aa7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081326 Aug 24 12:57:58.273981 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1785/3575] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:58 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:57:59.294533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-cbe7a3d2-9b3e-4f9d-90bd-57f5a7e6b0a1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:57:59.295168 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-cbe7a3d2-9b3e-4f9d-90bd-57f5a7e6b0a1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:57:59.301506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cbe7a3d2-9b3e-4f9d-90bd-57f5a7e6b0a1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:59.301987 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cbe7a3d2-9b3e-4f9d-90bd-57f5a7e6b0a1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:59.302416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cbe7a3d2-9b3e-4f9d-90bd-57f5a7e6b0a1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:59.303134 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cbe7a3d2-9b3e-4f9d-90bd-57f5a7e6b0a1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:57:59.303586 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cbe7a3d2-9b3e-4f9d-90bd-57f5a7e6b0a1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:57:59.304007 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cbe7a3d2-9b3e-4f9d-90bd-57f5a7e6b0a1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:57:59.370234 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-cbe7a3d2-9b3e-4f9d-90bd-57f5a7e6b0a1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:57:59.378930 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-cbe7a3d2-9b3e-4f9d-90bd-57f5a7e6b0a1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.088232 Aug 24 12:57:59.379493 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1791/3576] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:57:59 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:00.401192 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-36449cea-199f-4b63-9cca-7c0ef3008da8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:00.401800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-36449cea-199f-4b63-9cca-7c0ef3008da8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:00.408652 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36449cea-199f-4b63-9cca-7c0ef3008da8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:00.409141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36449cea-199f-4b63-9cca-7c0ef3008da8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:00.409580 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36449cea-199f-4b63-9cca-7c0ef3008da8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:00.410260 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36449cea-199f-4b63-9cca-7c0ef3008da8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:00.410745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36449cea-199f-4b63-9cca-7c0ef3008da8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:00.411174 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-36449cea-199f-4b63-9cca-7c0ef3008da8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:00.413696 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=84 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:58:00.475919 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-36449cea-199f-4b63-9cca-7c0ef3008da8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:00.484668 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-36449cea-199f-4b63-9cca-7c0ef3008da8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.087389 Aug 24 12:58:00.485229 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1786/3577] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:00 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:01.505312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c7ff1264-d9a5-4341-8392-abe8b29b62be tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:01.505922 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c7ff1264-d9a5-4341-8392-abe8b29b62be tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:01.512325 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7ff1264-d9a5-4341-8392-abe8b29b62be tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:01.512800 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7ff1264-d9a5-4341-8392-abe8b29b62be tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:01.513234 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7ff1264-d9a5-4341-8392-abe8b29b62be tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:01.513906 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7ff1264-d9a5-4341-8392-abe8b29b62be tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:01.514356 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7ff1264-d9a5-4341-8392-abe8b29b62be tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:01.514804 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7ff1264-d9a5-4341-8392-abe8b29b62be tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:01.579509 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c7ff1264-d9a5-4341-8392-abe8b29b62be tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:01.587592 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c7ff1264-d9a5-4341-8392-abe8b29b62be tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.086099 Aug 24 12:58:01.588201 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1792/3578] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:01 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:02.608187 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-af0e179b-9a08-4317-a584-86828d6d1a8c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:02.608814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-af0e179b-9a08-4317-a584-86828d6d1a8c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:02.615463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af0e179b-9a08-4317-a584-86828d6d1a8c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:02.615941 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af0e179b-9a08-4317-a584-86828d6d1a8c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:02.616376 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af0e179b-9a08-4317-a584-86828d6d1a8c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:02.617054 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af0e179b-9a08-4317-a584-86828d6d1a8c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:02.617508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af0e179b-9a08-4317-a584-86828d6d1a8c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:02.617931 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af0e179b-9a08-4317-a584-86828d6d1a8c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:02.678959 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-af0e179b-9a08-4317-a584-86828d6d1a8c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:02.687451 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-af0e179b-9a08-4317-a584-86828d6d1a8c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083143 Aug 24 12:58:02.688003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1787/3579] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:02 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:03.708215 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-290c768b-fd15-4006-aa59-6b7e01b1787e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:03.708748 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-290c768b-fd15-4006-aa59-6b7e01b1787e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:03.715294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-290c768b-fd15-4006-aa59-6b7e01b1787e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:03.719466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-290c768b-fd15-4006-aa59-6b7e01b1787e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:03.719466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-290c768b-fd15-4006-aa59-6b7e01b1787e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:03.719466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-290c768b-fd15-4006-aa59-6b7e01b1787e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:03.719466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-290c768b-fd15-4006-aa59-6b7e01b1787e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:03.719795 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-290c768b-fd15-4006-aa59-6b7e01b1787e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:03.778180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-290c768b-fd15-4006-aa59-6b7e01b1787e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:03.786858 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-290c768b-fd15-4006-aa59-6b7e01b1787e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082584 Aug 24 12:58:03.787414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1793/3580] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:03 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:04.807391 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3f6b336f-fed9-4246-bf74-6cf97b786b33 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:04.807991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3f6b336f-fed9-4246-bf74-6cf97b786b33 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:04.814260 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f6b336f-fed9-4246-bf74-6cf97b786b33 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:04.814760 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f6b336f-fed9-4246-bf74-6cf97b786b33 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:04.815193 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f6b336f-fed9-4246-bf74-6cf97b786b33 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:04.815865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f6b336f-fed9-4246-bf74-6cf97b786b33 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:04.816312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f6b336f-fed9-4246-bf74-6cf97b786b33 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:04.816730 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3f6b336f-fed9-4246-bf74-6cf97b786b33 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:04.881692 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3f6b336f-fed9-4246-bf74-6cf97b786b33 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:04.889750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3f6b336f-fed9-4246-bf74-6cf97b786b33 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.086221 Aug 24 12:58:04.890308 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1788/3581] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:04 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:05.910706 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c87fce91-6cac-4e26-afe2-e22397e3f8e6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:05.911315 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c87fce91-6cac-4e26-afe2-e22397e3f8e6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:05.917905 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c87fce91-6cac-4e26-afe2-e22397e3f8e6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:05.918382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c87fce91-6cac-4e26-afe2-e22397e3f8e6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:05.918845 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c87fce91-6cac-4e26-afe2-e22397e3f8e6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:05.920089 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c87fce91-6cac-4e26-afe2-e22397e3f8e6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:05.920540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c87fce91-6cac-4e26-afe2-e22397e3f8e6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:05.920963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c87fce91-6cac-4e26-afe2-e22397e3f8e6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:05.982405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c87fce91-6cac-4e26-afe2-e22397e3f8e6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:05.990761 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c87fce91-6cac-4e26-afe2-e22397e3f8e6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083911 Aug 24 12:58:05.991316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1794/3582] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:05 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:07.011498 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-98c570c8-1172-4d28-be51-299d5fbe34d4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:07.012103 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-98c570c8-1172-4d28-be51-299d5fbe34d4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:07.019007 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98c570c8-1172-4d28-be51-299d5fbe34d4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:07.019488 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98c570c8-1172-4d28-be51-299d5fbe34d4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:07.019921 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98c570c8-1172-4d28-be51-299d5fbe34d4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:07.020598 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98c570c8-1172-4d28-be51-299d5fbe34d4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:07.021048 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98c570c8-1172-4d28-be51-299d5fbe34d4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:07.021477 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98c570c8-1172-4d28-be51-299d5fbe34d4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:07.081018 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-98c570c8-1172-4d28-be51-299d5fbe34d4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:07.088957 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-98c570c8-1172-4d28-be51-299d5fbe34d4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081350 Aug 24 12:58:07.089533 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1789/3583] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:07 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:08.109402 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-827fe648-b2b0-495d-b6a1-f8a566331a3e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:08.110046 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-827fe648-b2b0-495d-b6a1-f8a566331a3e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:08.116380 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-827fe648-b2b0-495d-b6a1-f8a566331a3e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:08.116864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-827fe648-b2b0-495d-b6a1-f8a566331a3e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:08.117303 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-827fe648-b2b0-495d-b6a1-f8a566331a3e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:08.117981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-827fe648-b2b0-495d-b6a1-f8a566331a3e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:08.118444 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-827fe648-b2b0-495d-b6a1-f8a566331a3e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:08.118899 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-827fe648-b2b0-495d-b6a1-f8a566331a3e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:08.178086 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-827fe648-b2b0-495d-b6a1-f8a566331a3e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:08.186122 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-827fe648-b2b0-495d-b6a1-f8a566331a3e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.080798 Aug 24 12:58:08.186694 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1795/3584] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:08 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:09.206480 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a7c5f5ce-bbbc-46a9-8006-c41440884777 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:09.207117 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a7c5f5ce-bbbc-46a9-8006-c41440884777 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:09.213723 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a7c5f5ce-bbbc-46a9-8006-c41440884777 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:09.214208 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a7c5f5ce-bbbc-46a9-8006-c41440884777 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:09.214661 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a7c5f5ce-bbbc-46a9-8006-c41440884777 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:09.215351 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a7c5f5ce-bbbc-46a9-8006-c41440884777 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:09.215813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a7c5f5ce-bbbc-46a9-8006-c41440884777 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:09.216753 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a7c5f5ce-bbbc-46a9-8006-c41440884777 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:09.276988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a7c5f5ce-bbbc-46a9-8006-c41440884777 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:09.285685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a7c5f5ce-bbbc-46a9-8006-c41440884777 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083066 Aug 24 12:58:09.286236 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1790/3585] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:09 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:58:10.306719 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-50a7eda7-b534-4246-af75-7853aa84587e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:10.307333 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-50a7eda7-b534-4246-af75-7853aa84587e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:10.313688 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50a7eda7-b534-4246-af75-7853aa84587e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:10.316783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50a7eda7-b534-4246-af75-7853aa84587e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:10.316783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50a7eda7-b534-4246-af75-7853aa84587e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:10.316783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50a7eda7-b534-4246-af75-7853aa84587e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:10.316783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50a7eda7-b534-4246-af75-7853aa84587e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:10.317113 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50a7eda7-b534-4246-af75-7853aa84587e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:10.380104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-50a7eda7-b534-4246-af75-7853aa84587e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:10.389036 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-50a7eda7-b534-4246-af75-7853aa84587e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.086234 Aug 24 12:58:10.389592 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1796/3586] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:10 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:11.409231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d887fc6f-5fbf-41c3-b06b-dbea78947249 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:11.409834 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d887fc6f-5fbf-41c3-b06b-dbea78947249 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:11.416453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d887fc6f-5fbf-41c3-b06b-dbea78947249 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:11.417108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d887fc6f-5fbf-41c3-b06b-dbea78947249 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:11.417748 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d887fc6f-5fbf-41c3-b06b-dbea78947249 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:11.418840 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d887fc6f-5fbf-41c3-b06b-dbea78947249 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:11.420051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d887fc6f-5fbf-41c3-b06b-dbea78947249 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:11.420701 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d887fc6f-5fbf-41c3-b06b-dbea78947249 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:11.489977 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d887fc6f-5fbf-41c3-b06b-dbea78947249 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:11.497944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d887fc6f-5fbf-41c3-b06b-dbea78947249 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.092794 Aug 24 12:58:11.498495 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1791/3587] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:11 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:58:12.519219 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-94a351d2-3204-4684-a02a-1f8b25c530de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:12.519824 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-94a351d2-3204-4684-a02a-1f8b25c530de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:12.526145 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94a351d2-3204-4684-a02a-1f8b25c530de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:12.526623 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94a351d2-3204-4684-a02a-1f8b25c530de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:12.527084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94a351d2-3204-4684-a02a-1f8b25c530de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:12.527755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94a351d2-3204-4684-a02a-1f8b25c530de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:12.528206 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94a351d2-3204-4684-a02a-1f8b25c530de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:12.528628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-94a351d2-3204-4684-a02a-1f8b25c530de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:12.588372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-94a351d2-3204-4684-a02a-1f8b25c530de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:12.596284 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-94a351d2-3204-4684-a02a-1f8b25c530de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081005 Aug 24 12:58:12.596836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1797/3588] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:12 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:13.617567 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-dd010f8c-8892-4925-8946-89795644f6ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:13.618173 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-dd010f8c-8892-4925-8946-89795644f6ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:13.620473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=28 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:58:13.625116 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd010f8c-8892-4925-8946-89795644f6ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:13.625594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd010f8c-8892-4925-8946-89795644f6ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:13.626030 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd010f8c-8892-4925-8946-89795644f6ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:13.626745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd010f8c-8892-4925-8946-89795644f6ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:13.627197 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd010f8c-8892-4925-8946-89795644f6ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:13.627621 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dd010f8c-8892-4925-8946-89795644f6ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:13.690326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-dd010f8c-8892-4925-8946-89795644f6ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:13.698323 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-dd010f8c-8892-4925-8946-89795644f6ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084585 Aug 24 12:58:13.698906 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1792/3589] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:13 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:14.719275 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4a8d019e-441e-404b-979d-f44e6876026a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:14.719819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4a8d019e-441e-404b-979d-f44e6876026a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:14.726400 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a8d019e-441e-404b-979d-f44e6876026a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:14.726914 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a8d019e-441e-404b-979d-f44e6876026a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:14.727357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a8d019e-441e-404b-979d-f44e6876026a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:14.728041 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a8d019e-441e-404b-979d-f44e6876026a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:14.728494 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a8d019e-441e-404b-979d-f44e6876026a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:14.728920 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4a8d019e-441e-404b-979d-f44e6876026a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:14.789053 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4a8d019e-441e-404b-979d-f44e6876026a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:14.797655 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4a8d019e-441e-404b-979d-f44e6876026a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082260 Aug 24 12:58:14.798220 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1798/3590] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:14 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:15.817426 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1d00ef4b-d30a-4301-aeb8-3f4dad9039bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:15.818034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1d00ef4b-d30a-4301-aeb8-3f4dad9039bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:15.824059 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1d00ef4b-d30a-4301-aeb8-3f4dad9039bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:15.824532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1d00ef4b-d30a-4301-aeb8-3f4dad9039bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:15.824966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1d00ef4b-d30a-4301-aeb8-3f4dad9039bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:15.825640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1d00ef4b-d30a-4301-aeb8-3f4dad9039bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:15.826096 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1d00ef4b-d30a-4301-aeb8-3f4dad9039bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:15.827050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1d00ef4b-d30a-4301-aeb8-3f4dad9039bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:15.885827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1d00ef4b-d30a-4301-aeb8-3f4dad9039bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:15.894275 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1d00ef4b-d30a-4301-aeb8-3f4dad9039bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.080677 Aug 24 12:58:15.894864 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1793/3591] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:15 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:16.915521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-58ff6103-9f3e-4634-a9ea-d0a15124ab62 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:16.916133 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-58ff6103-9f3e-4634-a9ea-d0a15124ab62 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:16.923149 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58ff6103-9f3e-4634-a9ea-d0a15124ab62 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:16.923633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58ff6103-9f3e-4634-a9ea-d0a15124ab62 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:16.924083 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58ff6103-9f3e-4634-a9ea-d0a15124ab62 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:16.924750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58ff6103-9f3e-4634-a9ea-d0a15124ab62 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:16.925205 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58ff6103-9f3e-4634-a9ea-d0a15124ab62 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:16.925631 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58ff6103-9f3e-4634-a9ea-d0a15124ab62 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:17.112618 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-58ff6103-9f3e-4634-a9ea-d0a15124ab62 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:17.120719 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-58ff6103-9f3e-4634-a9ea-d0a15124ab62 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.209095 Aug 24 12:58:17.121273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1799/3592] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:16 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:58:18.141340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b3cb8e87-4121-441a-bc56-8f815f40c9cb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:18.141977 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b3cb8e87-4121-441a-bc56-8f815f40c9cb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:18.148313 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b3cb8e87-4121-441a-bc56-8f815f40c9cb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:18.148787 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b3cb8e87-4121-441a-bc56-8f815f40c9cb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:18.149218 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b3cb8e87-4121-441a-bc56-8f815f40c9cb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:18.149893 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b3cb8e87-4121-441a-bc56-8f815f40c9cb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:18.150342 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b3cb8e87-4121-441a-bc56-8f815f40c9cb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:18.150788 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b3cb8e87-4121-441a-bc56-8f815f40c9cb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:18.255814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b3cb8e87-4121-441a-bc56-8f815f40c9cb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:18.264049 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b3cb8e87-4121-441a-bc56-8f815f40c9cb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.126549 Aug 24 12:58:18.264611 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1794/3593] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:18 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:19.251470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:58:19.252014 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 12:58:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:58:19.285424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-168b0483-7e6c-412b-bc38-e2740445f648 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:19.286032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-168b0483-7e6c-412b-bc38-e2740445f648 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:19.288330 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=28 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:58:19.292979 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-168b0483-7e6c-412b-bc38-e2740445f648 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:19.293462 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-168b0483-7e6c-412b-bc38-e2740445f648 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:19.293896 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-168b0483-7e6c-412b-bc38-e2740445f648 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:19.294582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-168b0483-7e6c-412b-bc38-e2740445f648 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:19.295671 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-168b0483-7e6c-412b-bc38-e2740445f648 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:19.296122 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-168b0483-7e6c-412b-bc38-e2740445f648 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:19.361792 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-168b0483-7e6c-412b-bc38-e2740445f648 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:19.370685 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-168b0483-7e6c-412b-bc38-e2740445f648 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.089046 Aug 24 12:58:19.373786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1800/3594] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:19 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:58:20.391615 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-88a15e15-6dbb-4375-9fce-097730a07c36 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:20.392121 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-88a15e15-6dbb-4375-9fce-097730a07c36 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:20.398729 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88a15e15-6dbb-4375-9fce-097730a07c36 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:20.399209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88a15e15-6dbb-4375-9fce-097730a07c36 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:20.399640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88a15e15-6dbb-4375-9fce-097730a07c36 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:20.400372 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88a15e15-6dbb-4375-9fce-097730a07c36 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:20.400818 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88a15e15-6dbb-4375-9fce-097730a07c36 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:20.401237 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-88a15e15-6dbb-4375-9fce-097730a07c36 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:20.465153 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-88a15e15-6dbb-4375-9fce-097730a07c36 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:20.473721 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-88a15e15-6dbb-4375-9fce-097730a07c36 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.086104 Aug 24 12:58:20.474248 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1795/3595] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:20 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:21.495247 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-aac00557-0980-4831-826c-fa9ce0110243 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:21.495863 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-aac00557-0980-4831-826c-fa9ce0110243 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:21.502865 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aac00557-0980-4831-826c-fa9ce0110243 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:21.503350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aac00557-0980-4831-826c-fa9ce0110243 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:21.503786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aac00557-0980-4831-826c-fa9ce0110243 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:21.504467 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aac00557-0980-4831-826c-fa9ce0110243 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:21.504924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aac00557-0980-4831-826c-fa9ce0110243 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:21.505348 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aac00557-0980-4831-826c-fa9ce0110243 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:21.507858 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=84 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:58:21.566741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-aac00557-0980-4831-826c-fa9ce0110243 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:21.574713 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-aac00557-0980-4831-826c-fa9ce0110243 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083351 Aug 24 12:58:21.575259 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1801/3596] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:21 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:22.596106 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8264943d-59f5-463b-88fa-2f9d4e1638fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:22.596713 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8264943d-59f5-463b-88fa-2f9d4e1638fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:22.603026 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8264943d-59f5-463b-88fa-2f9d4e1638fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:22.603507 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8264943d-59f5-463b-88fa-2f9d4e1638fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:22.603941 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8264943d-59f5-463b-88fa-2f9d4e1638fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:22.604647 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8264943d-59f5-463b-88fa-2f9d4e1638fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:22.605104 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8264943d-59f5-463b-88fa-2f9d4e1638fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:22.605527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8264943d-59f5-463b-88fa-2f9d4e1638fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:22.665907 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8264943d-59f5-463b-88fa-2f9d4e1638fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:22.674220 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8264943d-59f5-463b-88fa-2f9d4e1638fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082669 Aug 24 12:58:22.674795 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1796/3597] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:22 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:23.695477 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ae58d1db-6b6b-4913-91a1-6d1ca4fc6542 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:23.696005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ae58d1db-6b6b-4913-91a1-6d1ca4fc6542 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:23.702263 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae58d1db-6b6b-4913-91a1-6d1ca4fc6542 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:23.708682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae58d1db-6b6b-4913-91a1-6d1ca4fc6542 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:23.708682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae58d1db-6b6b-4913-91a1-6d1ca4fc6542 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:23.708682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae58d1db-6b6b-4913-91a1-6d1ca4fc6542 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:23.708682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae58d1db-6b6b-4913-91a1-6d1ca4fc6542 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:23.709140 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ae58d1db-6b6b-4913-91a1-6d1ca4fc6542 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:23.767192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ae58d1db-6b6b-4913-91a1-6d1ca4fc6542 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:23.775287 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ae58d1db-6b6b-4913-91a1-6d1ca4fc6542 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083774 Aug 24 12:58:23.775839 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1802/3598] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:23 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:24.796887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0e9485c1-0abe-40e4-9ee5-821cf9556b64 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:24.797521 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0e9485c1-0abe-40e4-9ee5-821cf9556b64 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:24.804047 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0e9485c1-0abe-40e4-9ee5-821cf9556b64 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:24.804537 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0e9485c1-0abe-40e4-9ee5-821cf9556b64 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:24.804969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0e9485c1-0abe-40e4-9ee5-821cf9556b64 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:24.805669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0e9485c1-0abe-40e4-9ee5-821cf9556b64 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:24.806122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0e9485c1-0abe-40e4-9ee5-821cf9556b64 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:24.806544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0e9485c1-0abe-40e4-9ee5-821cf9556b64 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:24.867687 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0e9485c1-0abe-40e4-9ee5-821cf9556b64 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:24.875682 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0e9485c1-0abe-40e4-9ee5-821cf9556b64 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082693 Aug 24 12:58:24.876239 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1797/3599] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:24 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:25.896976 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d360fe09-4f20-4a9f-926e-fc1d863c734c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:25.897583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d360fe09-4f20-4a9f-926e-fc1d863c734c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:25.904036 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d360fe09-4f20-4a9f-926e-fc1d863c734c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:25.905030 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d360fe09-4f20-4a9f-926e-fc1d863c734c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:25.905464 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d360fe09-4f20-4a9f-926e-fc1d863c734c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:25.906144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d360fe09-4f20-4a9f-926e-fc1d863c734c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:25.906595 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d360fe09-4f20-4a9f-926e-fc1d863c734c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:25.907045 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d360fe09-4f20-4a9f-926e-fc1d863c734c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:25.966265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d360fe09-4f20-4a9f-926e-fc1d863c734c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:25.974757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d360fe09-4f20-4a9f-926e-fc1d863c734c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081728 Aug 24 12:58:25.975321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1803/3600] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:25 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:26.996349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a6d1d173-a222-4519-9d9e-b482ac24f567 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:26.996956 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a6d1d173-a222-4519-9d9e-b482ac24f567 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:27.003887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a6d1d173-a222-4519-9d9e-b482ac24f567 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:27.004365 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a6d1d173-a222-4519-9d9e-b482ac24f567 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:27.004797 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a6d1d173-a222-4519-9d9e-b482ac24f567 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:27.005477 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a6d1d173-a222-4519-9d9e-b482ac24f567 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:27.005928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a6d1d173-a222-4519-9d9e-b482ac24f567 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:27.006350 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a6d1d173-a222-4519-9d9e-b482ac24f567 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:27.067811 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a6d1d173-a222-4519-9d9e-b482ac24f567 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:27.075765 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a6d1d173-a222-4519-9d9e-b482ac24f567 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083238 Aug 24 12:58:27.076351 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1798/3601] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:26 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:28.097171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-48bc6c1d-e7bd-4d99-a909-ccf4c5fb7784 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:28.097772 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-48bc6c1d-e7bd-4d99-a909-ccf4c5fb7784 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:28.104100 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-48bc6c1d-e7bd-4d99-a909-ccf4c5fb7784 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:28.104579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-48bc6c1d-e7bd-4d99-a909-ccf4c5fb7784 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:28.105014 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-48bc6c1d-e7bd-4d99-a909-ccf4c5fb7784 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:28.105685 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-48bc6c1d-e7bd-4d99-a909-ccf4c5fb7784 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:28.106138 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-48bc6c1d-e7bd-4d99-a909-ccf4c5fb7784 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:28.106557 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-48bc6c1d-e7bd-4d99-a909-ccf4c5fb7784 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:28.169089 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-48bc6c1d-e7bd-4d99-a909-ccf4c5fb7784 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:28.177136 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-48bc6c1d-e7bd-4d99-a909-ccf4c5fb7784 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083831 Aug 24 12:58:28.177691 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1804/3602] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:28 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:58:29.197518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1b3adf3a-2777-49d5-b0cc-946ee5685a81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:29.198123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1b3adf3a-2777-49d5-b0cc-946ee5685a81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:29.205167 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b3adf3a-2777-49d5-b0cc-946ee5685a81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:29.205645 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b3adf3a-2777-49d5-b0cc-946ee5685a81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:29.206080 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b3adf3a-2777-49d5-b0cc-946ee5685a81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:29.206782 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b3adf3a-2777-49d5-b0cc-946ee5685a81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:29.207238 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b3adf3a-2777-49d5-b0cc-946ee5685a81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:29.207664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1b3adf3a-2777-49d5-b0cc-946ee5685a81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:29.270618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1b3adf3a-2777-49d5-b0cc-946ee5685a81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:29.278707 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1b3adf3a-2777-49d5-b0cc-946ee5685a81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085041 Aug 24 12:58:29.279315 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1799/3603] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:29 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:30.299719 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dae47f3d-c816-4bb2-bb49-d786eccf67de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:30.300305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dae47f3d-c816-4bb2-bb49-d786eccf67de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:30.306977 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dae47f3d-c816-4bb2-bb49-d786eccf67de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:30.307458 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dae47f3d-c816-4bb2-bb49-d786eccf67de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:30.307892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dae47f3d-c816-4bb2-bb49-d786eccf67de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:30.308569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dae47f3d-c816-4bb2-bb49-d786eccf67de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:30.309024 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dae47f3d-c816-4bb2-bb49-d786eccf67de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:30.309484 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dae47f3d-c816-4bb2-bb49-d786eccf67de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:30.372973 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-dae47f3d-c816-4bb2-bb49-d786eccf67de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:30.381211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dae47f3d-c816-4bb2-bb49-d786eccf67de tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085306 Aug 24 12:58:30.381763 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1805/3604] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:30 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:31.402173 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b11756d0-669a-497e-855b-bbc223760669 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:31.402817 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b11756d0-669a-497e-855b-bbc223760669 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:31.409765 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b11756d0-669a-497e-855b-bbc223760669 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:31.410250 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b11756d0-669a-497e-855b-bbc223760669 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:31.410744 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b11756d0-669a-497e-855b-bbc223760669 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:31.411431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b11756d0-669a-497e-855b-bbc223760669 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:31.411887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b11756d0-669a-497e-855b-bbc223760669 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:31.412319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b11756d0-669a-497e-855b-bbc223760669 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:31.414871 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=84 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:58:31.474878 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b11756d0-669a-497e-855b-bbc223760669 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:31.483410 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b11756d0-669a-497e-855b-bbc223760669 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085062 Aug 24 12:58:31.483958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1800/3605] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:31 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:32.504142 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5a2b430d-76e4-4649-b77a-770579e2f52f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:32.504754 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5a2b430d-76e4-4649-b77a-770579e2f52f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:32.511118 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5a2b430d-76e4-4649-b77a-770579e2f52f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:32.511614 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5a2b430d-76e4-4649-b77a-770579e2f52f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:32.512054 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5a2b430d-76e4-4649-b77a-770579e2f52f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:32.512744 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5a2b430d-76e4-4649-b77a-770579e2f52f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:32.513199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5a2b430d-76e4-4649-b77a-770579e2f52f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:32.513630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5a2b430d-76e4-4649-b77a-770579e2f52f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:32.573213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5a2b430d-76e4-4649-b77a-770579e2f52f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:32.583785 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5a2b430d-76e4-4649-b77a-770579e2f52f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083241 Aug 24 12:58:32.584622 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1806/3606] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:32 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:33.613081 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3e3a33b1-1798-41a1-9ee8-14531aaf5e72 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:33.613587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3e3a33b1-1798-41a1-9ee8-14531aaf5e72 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:33.619969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e3a33b1-1798-41a1-9ee8-14531aaf5e72 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:33.620444 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e3a33b1-1798-41a1-9ee8-14531aaf5e72 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:33.620871 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e3a33b1-1798-41a1-9ee8-14531aaf5e72 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:33.621543 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e3a33b1-1798-41a1-9ee8-14531aaf5e72 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:33.621987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e3a33b1-1798-41a1-9ee8-14531aaf5e72 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:33.622404 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3e3a33b1-1798-41a1-9ee8-14531aaf5e72 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:33.685214 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3e3a33b1-1798-41a1-9ee8-14531aaf5e72 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:33.693724 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3e3a33b1-1798-41a1-9ee8-14531aaf5e72 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084788 Aug 24 12:58:33.694276 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1801/3607] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:33 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:34.714962 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-816ce341-4619-4bb5-96ab-210977c536a5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:34.715513 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-816ce341-4619-4bb5-96ab-210977c536a5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:34.721703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-816ce341-4619-4bb5-96ab-210977c536a5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:34.722191 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-816ce341-4619-4bb5-96ab-210977c536a5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:34.722675 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-816ce341-4619-4bb5-96ab-210977c536a5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:34.723357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-816ce341-4619-4bb5-96ab-210977c536a5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:34.723820 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-816ce341-4619-4bb5-96ab-210977c536a5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:34.724251 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-816ce341-4619-4bb5-96ab-210977c536a5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:34.784668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-816ce341-4619-4bb5-96ab-210977c536a5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:34.793056 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-816ce341-4619-4bb5-96ab-210977c536a5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082034 Aug 24 12:58:34.793648 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1807/3608] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:34 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:35.814540 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-774770b4-4b00-4544-b0b7-a6f9dab23ae4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:35.815871 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-774770b4-4b00-4544-b0b7-a6f9dab23ae4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:35.822739 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-774770b4-4b00-4544-b0b7-a6f9dab23ae4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:35.823415 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-774770b4-4b00-4544-b0b7-a6f9dab23ae4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:35.823848 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-774770b4-4b00-4544-b0b7-a6f9dab23ae4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:35.824560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-774770b4-4b00-4544-b0b7-a6f9dab23ae4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:35.825011 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-774770b4-4b00-4544-b0b7-a6f9dab23ae4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:35.825469 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-774770b4-4b00-4544-b0b7-a6f9dab23ae4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:35.887408 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-774770b4-4b00-4544-b0b7-a6f9dab23ae4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:35.895612 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-774770b4-4b00-4544-b0b7-a6f9dab23ae4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084993 Aug 24 12:58:35.896169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1802/3609] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:35 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:36.916790 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dfdf392c-c4bb-4b6f-972e-f5fdce95d9bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:36.917403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dfdf392c-c4bb-4b6f-972e-f5fdce95d9bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:36.924095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dfdf392c-c4bb-4b6f-972e-f5fdce95d9bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:36.924582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dfdf392c-c4bb-4b6f-972e-f5fdce95d9bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:36.925024 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dfdf392c-c4bb-4b6f-972e-f5fdce95d9bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:36.925711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dfdf392c-c4bb-4b6f-972e-f5fdce95d9bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:36.926170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dfdf392c-c4bb-4b6f-972e-f5fdce95d9bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:36.926599 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dfdf392c-c4bb-4b6f-972e-f5fdce95d9bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:36.988878 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-dfdf392c-c4bb-4b6f-972e-f5fdce95d9bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:36.996943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dfdf392c-c4bb-4b6f-972e-f5fdce95d9bf tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083999 Aug 24 12:58:36.997505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1808/3610] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:36 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:38.017729 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e2969f25-9b8b-40cb-a084-8fc37efdf850 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:38.018326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e2969f25-9b8b-40cb-a084-8fc37efdf850 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:38.024625 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2969f25-9b8b-40cb-a084-8fc37efdf850 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:38.025201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2969f25-9b8b-40cb-a084-8fc37efdf850 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:38.025698 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2969f25-9b8b-40cb-a084-8fc37efdf850 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:38.026450 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2969f25-9b8b-40cb-a084-8fc37efdf850 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:38.026997 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2969f25-9b8b-40cb-a084-8fc37efdf850 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:38.027488 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2969f25-9b8b-40cb-a084-8fc37efdf850 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:38.092320 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e2969f25-9b8b-40cb-a084-8fc37efdf850 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:38.100508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e2969f25-9b8b-40cb-a084-8fc37efdf850 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.087024 Aug 24 12:58:38.101146 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1803/3611] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:38 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:39.122047 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-13f22e69-41d9-4fc6-bc8b-efdacae52a37 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:39.122677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-13f22e69-41d9-4fc6-bc8b-efdacae52a37 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:39.128984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13f22e69-41d9-4fc6-bc8b-efdacae52a37 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:39.129470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13f22e69-41d9-4fc6-bc8b-efdacae52a37 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:39.129906 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13f22e69-41d9-4fc6-bc8b-efdacae52a37 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:39.130587 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13f22e69-41d9-4fc6-bc8b-efdacae52a37 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:39.131070 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13f22e69-41d9-4fc6-bc8b-efdacae52a37 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:39.131554 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-13f22e69-41d9-4fc6-bc8b-efdacae52a37 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:39.191340 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-13f22e69-41d9-4fc6-bc8b-efdacae52a37 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:39.199265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-13f22e69-41d9-4fc6-bc8b-efdacae52a37 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081059 Aug 24 12:58:39.199817 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1809/3612] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:39 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:58:40.220208 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9bb4daa0-d7ec-4789-8835-f7c78be95ba0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:40.220811 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9bb4daa0-d7ec-4789-8835-f7c78be95ba0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:40.227157 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bb4daa0-d7ec-4789-8835-f7c78be95ba0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:40.227670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bb4daa0-d7ec-4789-8835-f7c78be95ba0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:40.228108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bb4daa0-d7ec-4789-8835-f7c78be95ba0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:40.228785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bb4daa0-d7ec-4789-8835-f7c78be95ba0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:40.229237 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bb4daa0-d7ec-4789-8835-f7c78be95ba0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:40.229662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9bb4daa0-d7ec-4789-8835-f7c78be95ba0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:40.293846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9bb4daa0-d7ec-4789-8835-f7c78be95ba0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:40.303154 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9bb4daa0-d7ec-4789-8835-f7c78be95ba0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.086684 Aug 24 12:58:40.303717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1804/3613] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:40 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:41.323862 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fe60a085-c23f-4c03-9920-f2e354738cfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:41.324478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fe60a085-c23f-4c03-9920-f2e354738cfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:41.331474 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe60a085-c23f-4c03-9920-f2e354738cfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:41.331961 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe60a085-c23f-4c03-9920-f2e354738cfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:41.332403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe60a085-c23f-4c03-9920-f2e354738cfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:41.333089 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe60a085-c23f-4c03-9920-f2e354738cfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:41.333551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe60a085-c23f-4c03-9920-f2e354738cfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:41.333981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe60a085-c23f-4c03-9920-f2e354738cfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:41.394144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fe60a085-c23f-4c03-9920-f2e354738cfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:41.402269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fe60a085-c23f-4c03-9920-f2e354738cfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082268 Aug 24 12:58:41.402862 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1810/3614] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:41 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:42.423142 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b455f82b-15ac-4764-b72e-4feaceeb15d8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:42.423770 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b455f82b-15ac-4764-b72e-4feaceeb15d8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:42.430209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b455f82b-15ac-4764-b72e-4feaceeb15d8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:42.430705 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b455f82b-15ac-4764-b72e-4feaceeb15d8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:42.431137 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b455f82b-15ac-4764-b72e-4feaceeb15d8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:42.431811 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b455f82b-15ac-4764-b72e-4feaceeb15d8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:42.432260 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b455f82b-15ac-4764-b72e-4feaceeb15d8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:42.432678 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b455f82b-15ac-4764-b72e-4feaceeb15d8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:42.492672 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b455f82b-15ac-4764-b72e-4feaceeb15d8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:42.500822 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b455f82b-15ac-4764-b72e-4feaceeb15d8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081560 Aug 24 12:58:42.501368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1805/3615] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:42 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:43.521184 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e1e2ff9a-ac69-4094-8667-309813a1cbad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:43.521789 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e1e2ff9a-ac69-4094-8667-309813a1cbad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:43.528192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e1e2ff9a-ac69-4094-8667-309813a1cbad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:43.528671 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e1e2ff9a-ac69-4094-8667-309813a1cbad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:43.529103 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e1e2ff9a-ac69-4094-8667-309813a1cbad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:43.530317 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e1e2ff9a-ac69-4094-8667-309813a1cbad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:43.530800 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e1e2ff9a-ac69-4094-8667-309813a1cbad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:43.531225 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e1e2ff9a-ac69-4094-8667-309813a1cbad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:43.590213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e1e2ff9a-ac69-4094-8667-309813a1cbad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:43.598687 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e1e2ff9a-ac69-4094-8667-309813a1cbad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081330 Aug 24 12:58:43.599233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1811/3616] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:43 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:44.620192 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-526f1dff-3922-4de4-a5d3-857da5c84ba0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:44.620798 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-526f1dff-3922-4de4-a5d3-857da5c84ba0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:44.623696 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=28 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:58:44.628317 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-526f1dff-3922-4de4-a5d3-857da5c84ba0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:44.628795 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-526f1dff-3922-4de4-a5d3-857da5c84ba0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:44.629231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-526f1dff-3922-4de4-a5d3-857da5c84ba0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:44.629907 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-526f1dff-3922-4de4-a5d3-857da5c84ba0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:44.630360 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-526f1dff-3922-4de4-a5d3-857da5c84ba0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:44.630817 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-526f1dff-3922-4de4-a5d3-857da5c84ba0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:44.691172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-526f1dff-3922-4de4-a5d3-857da5c84ba0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:44.699159 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-526f1dff-3922-4de4-a5d3-857da5c84ba0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082868 Aug 24 12:58:44.699708 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1806/3617] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:44 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:45.719730 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ac64b7b9-93b2-4013-adeb-c5cfe8e60e02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:45.720267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ac64b7b9-93b2-4013-adeb-c5cfe8e60e02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:45.726591 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac64b7b9-93b2-4013-adeb-c5cfe8e60e02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:45.727108 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac64b7b9-93b2-4013-adeb-c5cfe8e60e02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:45.727543 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac64b7b9-93b2-4013-adeb-c5cfe8e60e02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:45.728224 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac64b7b9-93b2-4013-adeb-c5cfe8e60e02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:45.728683 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac64b7b9-93b2-4013-adeb-c5cfe8e60e02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:45.729107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac64b7b9-93b2-4013-adeb-c5cfe8e60e02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:45.793813 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ac64b7b9-93b2-4013-adeb-c5cfe8e60e02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:45.801920 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ac64b7b9-93b2-4013-adeb-c5cfe8e60e02 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.086187 Aug 24 12:58:45.802476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1812/3618] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:45 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:46.822259 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ffea46b9-07f5-4226-9788-f144a90b2bed tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:46.822899 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ffea46b9-07f5-4226-9788-f144a90b2bed tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:46.828825 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ffea46b9-07f5-4226-9788-f144a90b2bed tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:46.829309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ffea46b9-07f5-4226-9788-f144a90b2bed tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:46.829778 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ffea46b9-07f5-4226-9788-f144a90b2bed tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:46.830459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ffea46b9-07f5-4226-9788-f144a90b2bed tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:46.830941 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ffea46b9-07f5-4226-9788-f144a90b2bed tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:46.831369 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ffea46b9-07f5-4226-9788-f144a90b2bed tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:46.894204 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ffea46b9-07f5-4226-9788-f144a90b2bed tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:46.902219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ffea46b9-07f5-4226-9788-f144a90b2bed tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084012 Aug 24 12:58:46.902807 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1807/3619] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:46 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:47.923416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-736d1259-03b7-4066-a03a-2ec718d5e8e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:47.924029 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-736d1259-03b7-4066-a03a-2ec718d5e8e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:47.930486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-736d1259-03b7-4066-a03a-2ec718d5e8e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:47.931017 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-736d1259-03b7-4066-a03a-2ec718d5e8e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:47.931460 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-736d1259-03b7-4066-a03a-2ec718d5e8e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:47.932150 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-736d1259-03b7-4066-a03a-2ec718d5e8e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:47.932610 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-736d1259-03b7-4066-a03a-2ec718d5e8e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:47.933037 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-736d1259-03b7-4066-a03a-2ec718d5e8e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:47.992923 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-736d1259-03b7-4066-a03a-2ec718d5e8e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:48.000993 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-736d1259-03b7-4066-a03a-2ec718d5e8e5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082076 Aug 24 12:58:48.001554 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1813/3620] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:47 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:49.021778 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4f8940f0-fdd1-4c90-aca9-5123b210bd76 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:49.022378 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4f8940f0-fdd1-4c90-aca9-5123b210bd76 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:49.028745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f8940f0-fdd1-4c90-aca9-5123b210bd76 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:49.029221 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f8940f0-fdd1-4c90-aca9-5123b210bd76 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:49.029652 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f8940f0-fdd1-4c90-aca9-5123b210bd76 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:49.030327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f8940f0-fdd1-4c90-aca9-5123b210bd76 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:49.030802 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f8940f0-fdd1-4c90-aca9-5123b210bd76 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:49.031222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f8940f0-fdd1-4c90-aca9-5123b210bd76 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:49.092573 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4f8940f0-fdd1-4c90-aca9-5123b210bd76 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:49.100662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4f8940f0-fdd1-4c90-aca9-5123b210bd76 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082794 Aug 24 12:58:49.101215 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1808/3621] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:49 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:50.122214 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fac8b4b3-e800-4518-bca0-a5ea7a38e49a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:50.122855 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fac8b4b3-e800-4518-bca0-a5ea7a38e49a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:50.125097 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=28 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:58:50.129808 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fac8b4b3-e800-4518-bca0-a5ea7a38e49a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:50.130293 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fac8b4b3-e800-4518-bca0-a5ea7a38e49a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:50.130766 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fac8b4b3-e800-4518-bca0-a5ea7a38e49a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:50.131451 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fac8b4b3-e800-4518-bca0-a5ea7a38e49a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:50.131911 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fac8b4b3-e800-4518-bca0-a5ea7a38e49a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:50.132337 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fac8b4b3-e800-4518-bca0-a5ea7a38e49a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:50.193161 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fac8b4b3-e800-4518-bca0-a5ea7a38e49a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:50.201244 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fac8b4b3-e800-4518-bca0-a5ea7a38e49a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082870 Aug 24 12:58:50.204124 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1814/3622] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:50 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:51.221324 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b32d63df-334b-47b0-878d-9d0e415c2a4b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:51.222021 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b32d63df-334b-47b0-878d-9d0e415c2a4b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:51.229186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b32d63df-334b-47b0-878d-9d0e415c2a4b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:51.229660 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b32d63df-334b-47b0-878d-9d0e415c2a4b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:51.230090 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b32d63df-334b-47b0-878d-9d0e415c2a4b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:51.230796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b32d63df-334b-47b0-878d-9d0e415c2a4b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:51.231243 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b32d63df-334b-47b0-878d-9d0e415c2a4b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:51.231659 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b32d63df-334b-47b0-878d-9d0e415c2a4b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:51.293089 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b32d63df-334b-47b0-878d-9d0e415c2a4b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:51.301703 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b32d63df-334b-47b0-878d-9d0e415c2a4b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084286 Aug 24 12:58:51.302257 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1809/3623] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:51 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:52.323008 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7381be4f-8e4d-4952-bd9e-ecd97330a73c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:52.323622 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7381be4f-8e4d-4952-bd9e-ecd97330a73c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:52.330642 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7381be4f-8e4d-4952-bd9e-ecd97330a73c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:52.331160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7381be4f-8e4d-4952-bd9e-ecd97330a73c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:52.331601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7381be4f-8e4d-4952-bd9e-ecd97330a73c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:52.332293 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7381be4f-8e4d-4952-bd9e-ecd97330a73c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:52.332754 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7381be4f-8e4d-4952-bd9e-ecd97330a73c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:52.333188 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7381be4f-8e4d-4952-bd9e-ecd97330a73c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:52.337036 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=84 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:58:52.396452 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7381be4f-8e4d-4952-bd9e-ecd97330a73c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:52.404491 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7381be4f-8e4d-4952-bd9e-ecd97330a73c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085325 Aug 24 12:58:52.405042 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1815/3624] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:52 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:53.425636 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6d0426a7-5b0f-4582-8844-87a81baaa045 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:53.426265 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6d0426a7-5b0f-4582-8844-87a81baaa045 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:53.432778 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d0426a7-5b0f-4582-8844-87a81baaa045 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:53.433259 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d0426a7-5b0f-4582-8844-87a81baaa045 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:53.433697 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d0426a7-5b0f-4582-8844-87a81baaa045 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:53.434380 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d0426a7-5b0f-4582-8844-87a81baaa045 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:53.434868 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d0426a7-5b0f-4582-8844-87a81baaa045 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:53.435934 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6d0426a7-5b0f-4582-8844-87a81baaa045 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:53.502357 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6d0426a7-5b0f-4582-8844-87a81baaa045 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:53.510532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6d0426a7-5b0f-4582-8844-87a81baaa045 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.088771 Aug 24 12:58:53.511121 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1810/3625] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:53 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:54.532022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-83072dd1-d4c6-4e6f-9b78-4fcbc0d43006 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:54.532633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-83072dd1-d4c6-4e6f-9b78-4fcbc0d43006 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:54.539010 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83072dd1-d4c6-4e6f-9b78-4fcbc0d43006 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:54.539496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83072dd1-d4c6-4e6f-9b78-4fcbc0d43006 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:54.539938 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83072dd1-d4c6-4e6f-9b78-4fcbc0d43006 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:54.540620 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83072dd1-d4c6-4e6f-9b78-4fcbc0d43006 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:54.541079 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83072dd1-d4c6-4e6f-9b78-4fcbc0d43006 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:54.541536 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-83072dd1-d4c6-4e6f-9b78-4fcbc0d43006 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:54.603957 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-83072dd1-d4c6-4e6f-9b78-4fcbc0d43006 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:54.612200 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-83072dd1-d4c6-4e6f-9b78-4fcbc0d43006 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084654 Aug 24 12:58:54.612757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1816/3626] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:54 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:55.633346 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9b3fab60-1ae5-470c-885c-a628ff7a43d7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:55.633879 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9b3fab60-1ae5-470c-885c-a628ff7a43d7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:55.640885 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b3fab60-1ae5-470c-885c-a628ff7a43d7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:55.641362 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b3fab60-1ae5-470c-885c-a628ff7a43d7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:55.641790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b3fab60-1ae5-470c-885c-a628ff7a43d7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:55.642460 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b3fab60-1ae5-470c-885c-a628ff7a43d7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:55.642935 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b3fab60-1ae5-470c-885c-a628ff7a43d7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:55.643358 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b3fab60-1ae5-470c-885c-a628ff7a43d7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:55.720618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-9b3fab60-1ae5-470c-885c-a628ff7a43d7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:55.728818 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9b3fab60-1ae5-470c-885c-a628ff7a43d7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.099396 Aug 24 12:58:55.729379 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1811/3627] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:55 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:56.750039 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-586a198d-a6ae-4f08-a9e5-41b2e0e44ed1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:56.750672 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-586a198d-a6ae-4f08-a9e5-41b2e0e44ed1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:56.757007 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-586a198d-a6ae-4f08-a9e5-41b2e0e44ed1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:56.757491 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-586a198d-a6ae-4f08-a9e5-41b2e0e44ed1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:56.757923 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-586a198d-a6ae-4f08-a9e5-41b2e0e44ed1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:56.758600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-586a198d-a6ae-4f08-a9e5-41b2e0e44ed1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:56.759083 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-586a198d-a6ae-4f08-a9e5-41b2e0e44ed1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:56.759504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-586a198d-a6ae-4f08-a9e5-41b2e0e44ed1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:56.818865 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-586a198d-a6ae-4f08-a9e5-41b2e0e44ed1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:56.826877 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-586a198d-a6ae-4f08-a9e5-41b2e0e44ed1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081239 Aug 24 12:58:56.827424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1817/3628] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:56 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:57.847533 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-37756f8e-caec-44b0-a51c-88e0d809e5a3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:57.848162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-37756f8e-caec-44b0-a51c-88e0d809e5a3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:57.854544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37756f8e-caec-44b0-a51c-88e0d809e5a3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:57.855047 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37756f8e-caec-44b0-a51c-88e0d809e5a3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:57.855479 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37756f8e-caec-44b0-a51c-88e0d809e5a3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:57.856147 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37756f8e-caec-44b0-a51c-88e0d809e5a3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:57.856592 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37756f8e-caec-44b0-a51c-88e0d809e5a3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:57.857014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37756f8e-caec-44b0-a51c-88e0d809e5a3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:57.916647 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-37756f8e-caec-44b0-a51c-88e0d809e5a3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:57.925085 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-37756f8e-caec-44b0-a51c-88e0d809e5a3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081414 Aug 24 12:58:57.925636 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1812/3629] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:57 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:58:58.946102 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7e5a3934-d250-4468-aea5-2b4fc23d34a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:58:58.946738 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7e5a3934-d250-4468-aea5-2b4fc23d34a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:58:58.953187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e5a3934-d250-4468-aea5-2b4fc23d34a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:58.953663 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e5a3934-d250-4468-aea5-2b4fc23d34a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:58.954094 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e5a3934-d250-4468-aea5-2b4fc23d34a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:58.954802 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e5a3934-d250-4468-aea5-2b4fc23d34a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:58:58.955256 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e5a3934-d250-4468-aea5-2b4fc23d34a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:58:58.955678 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7e5a3934-d250-4468-aea5-2b4fc23d34a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:58:59.017901 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7e5a3934-d250-4468-aea5-2b4fc23d34a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:58:59.025954 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7e5a3934-d250-4468-aea5-2b4fc23d34a0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083761 Aug 24 12:58:59.026505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1818/3630] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:58:58 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:00.047799 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e4698764-070a-4eb5-9452-1f02fdb3d8dd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:00.048411 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e4698764-070a-4eb5-9452-1f02fdb3d8dd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:00.054823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4698764-070a-4eb5-9452-1f02fdb3d8dd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:00.055310 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4698764-070a-4eb5-9452-1f02fdb3d8dd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:00.055754 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4698764-070a-4eb5-9452-1f02fdb3d8dd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:00.056434 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4698764-070a-4eb5-9452-1f02fdb3d8dd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:00.056889 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4698764-070a-4eb5-9452-1f02fdb3d8dd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:00.057318 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e4698764-070a-4eb5-9452-1f02fdb3d8dd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:00.117822 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e4698764-070a-4eb5-9452-1f02fdb3d8dd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:00.126015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e4698764-070a-4eb5-9452-1f02fdb3d8dd tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082715 Aug 24 12:59:00.126578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1813/3631] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:00 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:01.147895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6144a820-f82c-4a00-9379-8bb34683682e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:01.148494 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6144a820-f82c-4a00-9379-8bb34683682e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:01.154887 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6144a820-f82c-4a00-9379-8bb34683682e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:01.155367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6144a820-f82c-4a00-9379-8bb34683682e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:01.155801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6144a820-f82c-4a00-9379-8bb34683682e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:01.156474 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6144a820-f82c-4a00-9379-8bb34683682e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:01.156921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6144a820-f82c-4a00-9379-8bb34683682e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:01.157338 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6144a820-f82c-4a00-9379-8bb34683682e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:01.217293 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6144a820-f82c-4a00-9379-8bb34683682e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:01.225544 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6144a820-f82c-4a00-9379-8bb34683682e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081616 Aug 24 12:59:01.226117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1819/3632] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:01 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:02.246921 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7a37ee06-f236-4057-a13b-ba24012fd385 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:02.248061 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7a37ee06-f236-4057-a13b-ba24012fd385 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:02.254463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a37ee06-f236-4057-a13b-ba24012fd385 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:02.254975 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a37ee06-f236-4057-a13b-ba24012fd385 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:02.255417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a37ee06-f236-4057-a13b-ba24012fd385 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:02.256100 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a37ee06-f236-4057-a13b-ba24012fd385 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:02.256558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a37ee06-f236-4057-a13b-ba24012fd385 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:02.256985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7a37ee06-f236-4057-a13b-ba24012fd385 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:02.259527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=84 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:02.317876 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7a37ee06-f236-4057-a13b-ba24012fd385 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:02.326532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7a37ee06-f236-4057-a13b-ba24012fd385 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082897 Aug 24 12:59:02.327123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1814/3633] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:02 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:03.347416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3be9f25d-8fe5-4d8f-88fe-001062e5f4b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:03.348019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3be9f25d-8fe5-4d8f-88fe-001062e5f4b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:03.354321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3be9f25d-8fe5-4d8f-88fe-001062e5f4b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:03.354841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3be9f25d-8fe5-4d8f-88fe-001062e5f4b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:03.355276 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3be9f25d-8fe5-4d8f-88fe-001062e5f4b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:03.355951 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3be9f25d-8fe5-4d8f-88fe-001062e5f4b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:03.356401 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3be9f25d-8fe5-4d8f-88fe-001062e5f4b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:03.356819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3be9f25d-8fe5-4d8f-88fe-001062e5f4b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:03.421037 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3be9f25d-8fe5-4d8f-88fe-001062e5f4b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:03.429250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3be9f25d-8fe5-4d8f-88fe-001062e5f4b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085763 Aug 24 12:59:03.429805 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1820/3634] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:03 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:04.450347 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f7ffbd14-5482-431f-b2d2-018722430d96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:04.451542 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f7ffbd14-5482-431f-b2d2-018722430d96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:04.457950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f7ffbd14-5482-431f-b2d2-018722430d96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:04.458427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f7ffbd14-5482-431f-b2d2-018722430d96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:04.458890 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f7ffbd14-5482-431f-b2d2-018722430d96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:04.459566 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f7ffbd14-5482-431f-b2d2-018722430d96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:04.460013 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f7ffbd14-5482-431f-b2d2-018722430d96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:04.460455 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f7ffbd14-5482-431f-b2d2-018722430d96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:04.523314 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f7ffbd14-5482-431f-b2d2-018722430d96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:04.531345 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f7ffbd14-5482-431f-b2d2-018722430d96 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084882 Aug 24 12:59:04.531902 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1815/3635] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:04 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:05.551645 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-09f7babe-b633-46a7-bc07-72fe6abc9446 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:05.552189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-09f7babe-b633-46a7-bc07-72fe6abc9446 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:05.558504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09f7babe-b633-46a7-bc07-72fe6abc9446 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:05.559014 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09f7babe-b633-46a7-bc07-72fe6abc9446 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:05.559447 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09f7babe-b633-46a7-bc07-72fe6abc9446 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:05.560120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09f7babe-b633-46a7-bc07-72fe6abc9446 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:05.560571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09f7babe-b633-46a7-bc07-72fe6abc9446 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:05.560996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09f7babe-b633-46a7-bc07-72fe6abc9446 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:05.620828 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-09f7babe-b633-46a7-bc07-72fe6abc9446 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:05.628744 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-09f7babe-b633-46a7-bc07-72fe6abc9446 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081072 Aug 24 12:59:05.629296 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1821/3636] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:05 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:06.649728 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-900f84b1-3363-4105-aee7-7596530498dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:06.650337 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-900f84b1-3363-4105-aee7-7596530498dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:06.656785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-900f84b1-3363-4105-aee7-7596530498dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:06.657261 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-900f84b1-3363-4105-aee7-7596530498dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:06.657694 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-900f84b1-3363-4105-aee7-7596530498dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:06.658371 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-900f84b1-3363-4105-aee7-7596530498dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:06.658852 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-900f84b1-3363-4105-aee7-7596530498dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:06.659277 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-900f84b1-3363-4105-aee7-7596530498dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:06.718576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-900f84b1-3363-4105-aee7-7596530498dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:06.726937 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-900f84b1-3363-4105-aee7-7596530498dc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.080997 Aug 24 12:59:06.727492 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1816/3637] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:06 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:07.747913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-735f0bc2-f53c-4194-a54d-5020d5aa378d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:07.748527 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-735f0bc2-f53c-4194-a54d-5020d5aa378d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:07.754403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-735f0bc2-f53c-4194-a54d-5020d5aa378d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:07.754915 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-735f0bc2-f53c-4194-a54d-5020d5aa378d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:07.755355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-735f0bc2-f53c-4194-a54d-5020d5aa378d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:07.756035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-735f0bc2-f53c-4194-a54d-5020d5aa378d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:07.756489 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-735f0bc2-f53c-4194-a54d-5020d5aa378d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:07.756929 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-735f0bc2-f53c-4194-a54d-5020d5aa378d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:07.829102 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-735f0bc2-f53c-4194-a54d-5020d5aa378d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:07.834230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-735f0bc2-f53c-4194-a54d-5020d5aa378d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.090383 Aug 24 12:59:07.834976 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1822/3638] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:07 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:59:08.855630 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a814caee-bbdc-41b6-a34e-f088d60fb8fc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:08.856220 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a814caee-bbdc-41b6-a34e-f088d60fb8fc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:08.863951 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a814caee-bbdc-41b6-a34e-f088d60fb8fc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:08.864427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a814caee-bbdc-41b6-a34e-f088d60fb8fc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:08.864855 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a814caee-bbdc-41b6-a34e-f088d60fb8fc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:08.865532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a814caee-bbdc-41b6-a34e-f088d60fb8fc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:08.865977 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a814caee-bbdc-41b6-a34e-f088d60fb8fc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:08.866401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a814caee-bbdc-41b6-a34e-f088d60fb8fc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:08.929208 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a814caee-bbdc-41b6-a34e-f088d60fb8fc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:08.937171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a814caee-bbdc-41b6-a34e-f088d60fb8fc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085432 Aug 24 12:59:08.937725 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1817/3639] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:08 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:09.957688 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7dd87fd7-d1cc-433e-ad4e-f95fef62695d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:09.958327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7dd87fd7-d1cc-433e-ad4e-f95fef62695d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:09.964785 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7dd87fd7-d1cc-433e-ad4e-f95fef62695d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:09.965267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7dd87fd7-d1cc-433e-ad4e-f95fef62695d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:09.965703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7dd87fd7-d1cc-433e-ad4e-f95fef62695d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:09.966382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7dd87fd7-d1cc-433e-ad4e-f95fef62695d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:09.966867 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7dd87fd7-d1cc-433e-ad4e-f95fef62695d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:09.967298 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7dd87fd7-d1cc-433e-ad4e-f95fef62695d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:10.027331 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7dd87fd7-d1cc-433e-ad4e-f95fef62695d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:10.035325 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7dd87fd7-d1cc-433e-ad4e-f95fef62695d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081472 Aug 24 12:59:10.035881 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1823/3640] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:09 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:11.056445 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0a4b1b75-8b50-40c4-beac-f36f943ff185 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:11.057053 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0a4b1b75-8b50-40c4-beac-f36f943ff185 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:11.064326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a4b1b75-8b50-40c4-beac-f36f943ff185 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:11.064805 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a4b1b75-8b50-40c4-beac-f36f943ff185 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:11.065239 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a4b1b75-8b50-40c4-beac-f36f943ff185 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:11.065913 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a4b1b75-8b50-40c4-beac-f36f943ff185 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:11.066362 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a4b1b75-8b50-40c4-beac-f36f943ff185 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:11.066809 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0a4b1b75-8b50-40c4-beac-f36f943ff185 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:11.129925 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0a4b1b75-8b50-40c4-beac-f36f943ff185 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:11.138635 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0a4b1b75-8b50-40c4-beac-f36f943ff185 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085373 Aug 24 12:59:11.139201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1818/3641] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:11 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:12.159104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c842c789-fcae-44ff-84b1-7fee31de17b3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:12.159703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c842c789-fcae-44ff-84b1-7fee31de17b3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:12.166221 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c842c789-fcae-44ff-84b1-7fee31de17b3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:12.166722 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c842c789-fcae-44ff-84b1-7fee31de17b3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:12.167156 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c842c789-fcae-44ff-84b1-7fee31de17b3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:12.167827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c842c789-fcae-44ff-84b1-7fee31de17b3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:12.168282 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c842c789-fcae-44ff-84b1-7fee31de17b3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:12.168699 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c842c789-fcae-44ff-84b1-7fee31de17b3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:12.232327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c842c789-fcae-44ff-84b1-7fee31de17b3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:12.240713 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c842c789-fcae-44ff-84b1-7fee31de17b3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085434 Aug 24 12:59:12.241267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1824/3642] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:12 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:13.261251 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-40ebab9a-d52b-41c5-8bc6-641897a88d88 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:13.261857 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-40ebab9a-d52b-41c5-8bc6-641897a88d88 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:13.268626 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-40ebab9a-d52b-41c5-8bc6-641897a88d88 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:13.269102 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-40ebab9a-d52b-41c5-8bc6-641897a88d88 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:13.269534 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-40ebab9a-d52b-41c5-8bc6-641897a88d88 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:13.270204 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-40ebab9a-d52b-41c5-8bc6-641897a88d88 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:13.270669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-40ebab9a-d52b-41c5-8bc6-641897a88d88 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:13.271095 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-40ebab9a-d52b-41c5-8bc6-641897a88d88 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:13.334971 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-40ebab9a-d52b-41c5-8bc6-641897a88d88 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:13.342962 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-40ebab9a-d52b-41c5-8bc6-641897a88d88 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.085505 Aug 24 12:59:13.343518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1819/3643] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:13 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:14.363438 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-132145ec-99d8-4cba-a766-bc3e4a14d79e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:14.364077 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-132145ec-99d8-4cba-a766-bc3e4a14d79e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:14.370482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-132145ec-99d8-4cba-a766-bc3e4a14d79e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:14.371001 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-132145ec-99d8-4cba-a766-bc3e4a14d79e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:14.371447 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-132145ec-99d8-4cba-a766-bc3e4a14d79e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:14.372135 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-132145ec-99d8-4cba-a766-bc3e4a14d79e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:14.372599 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-132145ec-99d8-4cba-a766-bc3e4a14d79e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:14.373037 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-132145ec-99d8-4cba-a766-bc3e4a14d79e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:14.435996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-132145ec-99d8-4cba-a766-bc3e4a14d79e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:14.444146 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-132145ec-99d8-4cba-a766-bc3e4a14d79e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084841 Aug 24 12:59:14.444718 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1825/3644] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:14 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:15.464207 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-dc2266f9-458c-47c6-b5bc-8cca31f8d464 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:15.464844 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-dc2266f9-458c-47c6-b5bc-8cca31f8d464 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:15.467847 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=28 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:15.472504 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dc2266f9-458c-47c6-b5bc-8cca31f8d464 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:15.479155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dc2266f9-458c-47c6-b5bc-8cca31f8d464 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:15.479155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dc2266f9-458c-47c6-b5bc-8cca31f8d464 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:15.479155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dc2266f9-458c-47c6-b5bc-8cca31f8d464 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:15.479155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dc2266f9-458c-47c6-b5bc-8cca31f8d464 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:15.479549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-dc2266f9-458c-47c6-b5bc-8cca31f8d464 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:15.535808 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-dc2266f9-458c-47c6-b5bc-8cca31f8d464 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:15.544006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-dc2266f9-458c-47c6-b5bc-8cca31f8d464 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083598 Aug 24 12:59:15.544609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1820/3645] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:15 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:16.564323 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-88932163-27c4-47b1-ab8c-734441b268ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:16.564872 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-88932163-27c4-47b1-ab8c-734441b268ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:16.571329 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-88932163-27c4-47b1-ab8c-734441b268ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:16.571817 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-88932163-27c4-47b1-ab8c-734441b268ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:16.572259 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-88932163-27c4-47b1-ab8c-734441b268ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:16.572945 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-88932163-27c4-47b1-ab8c-734441b268ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:16.573406 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-88932163-27c4-47b1-ab8c-734441b268ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:16.573838 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-88932163-27c4-47b1-ab8c-734441b268ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:16.634201 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-88932163-27c4-47b1-ab8c-734441b268ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:16.642425 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-88932163-27c4-47b1-ab8c-734441b268ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081968 Aug 24 12:59:16.643025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1826/3646] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:16 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:17.663902 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4176a127-fbea-4978-9cfd-d76eb89dba88 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:17.664513 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4176a127-fbea-4978-9cfd-d76eb89dba88 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:17.671102 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4176a127-fbea-4978-9cfd-d76eb89dba88 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:17.671609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4176a127-fbea-4978-9cfd-d76eb89dba88 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:17.672040 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4176a127-fbea-4978-9cfd-d76eb89dba88 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:17.672716 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4176a127-fbea-4978-9cfd-d76eb89dba88 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:17.673162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4176a127-fbea-4978-9cfd-d76eb89dba88 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:17.673580 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4176a127-fbea-4978-9cfd-d76eb89dba88 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:17.733351 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4176a127-fbea-4978-9cfd-d76eb89dba88 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:17.741686 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4176a127-fbea-4978-9cfd-d76eb89dba88 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081851 Aug 24 12:59:17.742245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1821/3647] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:17 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:18.763597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-86cee8c9-b72a-4a43-b312-df1c26087436 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:18.764209 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-86cee8c9-b72a-4a43-b312-df1c26087436 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:18.770560 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86cee8c9-b72a-4a43-b312-df1c26087436 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:18.771070 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86cee8c9-b72a-4a43-b312-df1c26087436 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:18.771507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86cee8c9-b72a-4a43-b312-df1c26087436 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:18.772187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86cee8c9-b72a-4a43-b312-df1c26087436 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:18.772656 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86cee8c9-b72a-4a43-b312-df1c26087436 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:18.773078 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-86cee8c9-b72a-4a43-b312-df1c26087436 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:18.833175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-86cee8c9-b72a-4a43-b312-df1c26087436 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:18.841170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-86cee8c9-b72a-4a43-b312-df1c26087436 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082012 Aug 24 12:59:18.841738 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1827/3648] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:18 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:19.862036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6e6ab124-ab0a-4762-a02c-ba8b4015c440 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:19.862643 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6e6ab124-ab0a-4762-a02c-ba8b4015c440 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:19.869210 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e6ab124-ab0a-4762-a02c-ba8b4015c440 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:19.869686 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e6ab124-ab0a-4762-a02c-ba8b4015c440 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:19.870117 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e6ab124-ab0a-4762-a02c-ba8b4015c440 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:19.870831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e6ab124-ab0a-4762-a02c-ba8b4015c440 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:19.871276 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e6ab124-ab0a-4762-a02c-ba8b4015c440 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:19.871695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e6ab124-ab0a-4762-a02c-ba8b4015c440 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:19.933311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6e6ab124-ab0a-4762-a02c-ba8b4015c440 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:19.942101 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6e6ab124-ab0a-4762-a02c-ba8b4015c440 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084128 Aug 24 12:59:19.942669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1822/3649] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:19 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:20.962775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2722c060-eaa3-4f24-876c-a26dc3084618 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:20.963268 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2722c060-eaa3-4f24-876c-a26dc3084618 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:20.965565 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=28 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:20.970165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2722c060-eaa3-4f24-876c-a26dc3084618 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:20.970639 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2722c060-eaa3-4f24-876c-a26dc3084618 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:20.971106 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2722c060-eaa3-4f24-876c-a26dc3084618 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:20.971778 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2722c060-eaa3-4f24-876c-a26dc3084618 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:20.972227 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2722c060-eaa3-4f24-876c-a26dc3084618 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:20.972646 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2722c060-eaa3-4f24-876c-a26dc3084618 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:21.036643 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2722c060-eaa3-4f24-876c-a26dc3084618 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:21.044721 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2722c060-eaa3-4f24-876c-a26dc3084618 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.086010 Aug 24 12:59:21.045281 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1828/3650] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:20 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:22.065161 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4f8813e4-5a61-4045-bbb0-2fd3a337f5f3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:22.065762 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4f8813e4-5a61-4045-bbb0-2fd3a337f5f3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:22.072117 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f8813e4-5a61-4045-bbb0-2fd3a337f5f3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:22.072591 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f8813e4-5a61-4045-bbb0-2fd3a337f5f3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:22.073022 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f8813e4-5a61-4045-bbb0-2fd3a337f5f3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:22.073694 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f8813e4-5a61-4045-bbb0-2fd3a337f5f3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:22.074141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f8813e4-5a61-4045-bbb0-2fd3a337f5f3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:22.074560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4f8813e4-5a61-4045-bbb0-2fd3a337f5f3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:22.139839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4f8813e4-5a61-4045-bbb0-2fd3a337f5f3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:22.147921 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4f8813e4-5a61-4045-bbb0-2fd3a337f5f3 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.086594 Aug 24 12:59:22.148478 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1823/3651] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:22 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:23.169350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-50c70b8b-c3fc-4ceb-a2fb-8b039cdf24cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:23.169955 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-50c70b8b-c3fc-4ceb-a2fb-8b039cdf24cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:23.176308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50c70b8b-c3fc-4ceb-a2fb-8b039cdf24cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:23.176782 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50c70b8b-c3fc-4ceb-a2fb-8b039cdf24cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:23.177210 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50c70b8b-c3fc-4ceb-a2fb-8b039cdf24cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:23.177911 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50c70b8b-c3fc-4ceb-a2fb-8b039cdf24cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:23.178362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50c70b8b-c3fc-4ceb-a2fb-8b039cdf24cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:23.178811 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-50c70b8b-c3fc-4ceb-a2fb-8b039cdf24cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:23.181242 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=84 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:23.240230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-50c70b8b-c3fc-4ceb-a2fb-8b039cdf24cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:23.248830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-50c70b8b-c3fc-4ceb-a2fb-8b039cdf24cc tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083367 Aug 24 12:59:23.249393 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1829/3652] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:23 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:24.269923 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e7e54959-30b3-4e15-95a7-e3adf286a7b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:24.270553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e7e54959-30b3-4e15-95a7-e3adf286a7b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:24.276936 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7e54959-30b3-4e15-95a7-e3adf286a7b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:24.277412 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7e54959-30b3-4e15-95a7-e3adf286a7b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:24.277843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7e54959-30b3-4e15-95a7-e3adf286a7b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:24.278514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7e54959-30b3-4e15-95a7-e3adf286a7b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:24.279650 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7e54959-30b3-4e15-95a7-e3adf286a7b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:24.280074 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e7e54959-30b3-4e15-95a7-e3adf286a7b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:24.342439 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e7e54959-30b3-4e15-95a7-e3adf286a7b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:24.350766 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e7e54959-30b3-4e15-95a7-e3adf286a7b0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084722 Aug 24 12:59:24.351416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1824/3653] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:24 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:25.371848 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-74fa26e4-e961-4647-bf75-533ff34c193d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:25.372452 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-74fa26e4-e961-4647-bf75-533ff34c193d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:25.378940 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-74fa26e4-e961-4647-bf75-533ff34c193d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:25.379444 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-74fa26e4-e961-4647-bf75-533ff34c193d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:25.379886 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-74fa26e4-e961-4647-bf75-533ff34c193d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:25.380574 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-74fa26e4-e961-4647-bf75-533ff34c193d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:25.381054 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-74fa26e4-e961-4647-bf75-533ff34c193d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:25.381483 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-74fa26e4-e961-4647-bf75-533ff34c193d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:25.443111 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-74fa26e4-e961-4647-bf75-533ff34c193d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:25.451274 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-74fa26e4-e961-4647-bf75-533ff34c193d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083378 Aug 24 12:59:25.451839 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1830/3654] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:25 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:26.472725 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a030eb3d-c340-4047-b53a-143e1363c0b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:26.473365 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a030eb3d-c340-4047-b53a-143e1363c0b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:26.484036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a030eb3d-c340-4047-b53a-143e1363c0b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:26.484834 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a030eb3d-c340-4047-b53a-143e1363c0b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:26.485297 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a030eb3d-c340-4047-b53a-143e1363c0b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:26.486264 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a030eb3d-c340-4047-b53a-143e1363c0b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:26.486747 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a030eb3d-c340-4047-b53a-143e1363c0b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:26.487176 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a030eb3d-c340-4047-b53a-143e1363c0b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:26.550015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a030eb3d-c340-4047-b53a-143e1363c0b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:26.557943 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a030eb3d-c340-4047-b53a-143e1363c0b4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.089057 Aug 24 12:59:26.558506 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1825/3655] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:26 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:27.579228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e2fdebba-49cb-46dc-8843-5256f876f014 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:27.579858 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e2fdebba-49cb-46dc-8843-5256f876f014 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:27.586129 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2fdebba-49cb-46dc-8843-5256f876f014 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:27.586611 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2fdebba-49cb-46dc-8843-5256f876f014 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:27.587073 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2fdebba-49cb-46dc-8843-5256f876f014 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:27.587753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2fdebba-49cb-46dc-8843-5256f876f014 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:27.588207 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2fdebba-49cb-46dc-8843-5256f876f014 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:27.588632 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2fdebba-49cb-46dc-8843-5256f876f014 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:27.648592 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e2fdebba-49cb-46dc-8843-5256f876f014 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:27.656686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e2fdebba-49cb-46dc-8843-5256f876f014 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081928 Aug 24 12:59:27.657238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1831/3656] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:27 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:28.677113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-82641660-f810-4073-979a-8eb8a55a35ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:28.677764 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-82641660-f810-4073-979a-8eb8a55a35ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:28.684331 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82641660-f810-4073-979a-8eb8a55a35ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:28.684844 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82641660-f810-4073-979a-8eb8a55a35ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:28.685284 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82641660-f810-4073-979a-8eb8a55a35ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:28.685973 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82641660-f810-4073-979a-8eb8a55a35ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:28.686431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82641660-f810-4073-979a-8eb8a55a35ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:28.686896 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-82641660-f810-4073-979a-8eb8a55a35ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:28.747532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-82641660-f810-4073-979a-8eb8a55a35ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:28.755627 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-82641660-f810-4073-979a-8eb8a55a35ec tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082377 Aug 24 12:59:28.756191 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1826/3657] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:28 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:29.776490 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9966e2fd-e4cf-4048-8d9d-9ccf7d430751 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:29.777102 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9966e2fd-e4cf-4048-8d9d-9ccf7d430751 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:29.783981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9966e2fd-e4cf-4048-8d9d-9ccf7d430751 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:29.784460 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9966e2fd-e4cf-4048-8d9d-9ccf7d430751 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:29.784894 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9966e2fd-e4cf-4048-8d9d-9ccf7d430751 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:29.785575 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9966e2fd-e4cf-4048-8d9d-9ccf7d430751 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:29.786032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9966e2fd-e4cf-4048-8d9d-9ccf7d430751 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:29.786456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9966e2fd-e4cf-4048-8d9d-9ccf7d430751 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:29.850287 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9966e2fd-e4cf-4048-8d9d-9ccf7d430751 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:29.859010 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9966e2fd-e4cf-4048-8d9d-9ccf7d430751 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.086335 Aug 24 12:59:29.859568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1832/3658] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:29 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:59:30.879986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c638047d-533f-4f2e-aab1-7fabbf2d0a81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:30.880598 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c638047d-533f-4f2e-aab1-7fabbf2d0a81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:30.887030 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c638047d-533f-4f2e-aab1-7fabbf2d0a81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:30.887512 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c638047d-533f-4f2e-aab1-7fabbf2d0a81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:30.888568 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c638047d-533f-4f2e-aab1-7fabbf2d0a81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:30.889250 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c638047d-533f-4f2e-aab1-7fabbf2d0a81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:30.889702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c638047d-533f-4f2e-aab1-7fabbf2d0a81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:30.890125 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c638047d-533f-4f2e-aab1-7fabbf2d0a81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:30.952785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c638047d-533f-4f2e-aab1-7fabbf2d0a81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:30.960860 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c638047d-533f-4f2e-aab1-7fabbf2d0a81 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084786 Aug 24 12:59:30.961423 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1827/3659] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:30 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:31.981437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7270cae6-69f6-43e3-8f6e-3c7f9aad7d48 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:31.982043 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7270cae6-69f6-43e3-8f6e-3c7f9aad7d48 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:31.988805 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7270cae6-69f6-43e3-8f6e-3c7f9aad7d48 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:31.989288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7270cae6-69f6-43e3-8f6e-3c7f9aad7d48 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:31.989727 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7270cae6-69f6-43e3-8f6e-3c7f9aad7d48 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:31.990409 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7270cae6-69f6-43e3-8f6e-3c7f9aad7d48 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:31.990892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7270cae6-69f6-43e3-8f6e-3c7f9aad7d48 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:31.991321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7270cae6-69f6-43e3-8f6e-3c7f9aad7d48 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:32.051431 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7270cae6-69f6-43e3-8f6e-3c7f9aad7d48 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:32.059367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7270cae6-69f6-43e3-8f6e-3c7f9aad7d48 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081803 Aug 24 12:59:32.060462 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1833/3660] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:31 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:33.080899 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-69a6918e-dd13-4cd0-b545-44bca787f18f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:33.081497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-69a6918e-dd13-4cd0-b545-44bca787f18f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:33.087837 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69a6918e-dd13-4cd0-b545-44bca787f18f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:33.088314 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69a6918e-dd13-4cd0-b545-44bca787f18f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:33.088754 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69a6918e-dd13-4cd0-b545-44bca787f18f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:33.089423 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69a6918e-dd13-4cd0-b545-44bca787f18f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:33.089872 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69a6918e-dd13-4cd0-b545-44bca787f18f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:33.090290 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-69a6918e-dd13-4cd0-b545-44bca787f18f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:33.092841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=84 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:33.151610 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-69a6918e-dd13-4cd0-b545-44bca787f18f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:33.159629 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-69a6918e-dd13-4cd0-b545-44bca787f18f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082538 Aug 24 12:59:33.160180 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1828/3661] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:33 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:34.234299 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9630642a-eb14-4ac1-8266-368682a65c33 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:34.234929 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9630642a-eb14-4ac1-8266-368682a65c33 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:34.241553 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9630642a-eb14-4ac1-8266-368682a65c33 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:34.242034 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9630642a-eb14-4ac1-8266-368682a65c33 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:34.242470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9630642a-eb14-4ac1-8266-368682a65c33 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:34.243183 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9630642a-eb14-4ac1-8266-368682a65c33 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:34.243639 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9630642a-eb14-4ac1-8266-368682a65c33 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:34.244066 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9630642a-eb14-4ac1-8266-368682a65c33 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:34.304157 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9630642a-eb14-4ac1-8266-368682a65c33 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:34.312932 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9630642a-eb14-4ac1-8266-368682a65c33 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082488 Aug 24 12:59:34.313580 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1834/3662] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:34 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:35.333482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-19bd8fec-620a-4982-93fa-a32ea823ff44 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:35.334128 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-19bd8fec-620a-4982-93fa-a32ea823ff44 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:35.341156 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19bd8fec-620a-4982-93fa-a32ea823ff44 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:35.341639 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19bd8fec-620a-4982-93fa-a32ea823ff44 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:35.342073 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19bd8fec-620a-4982-93fa-a32ea823ff44 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:35.342783 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19bd8fec-620a-4982-93fa-a32ea823ff44 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:35.343240 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19bd8fec-620a-4982-93fa-a32ea823ff44 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:35.343719 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-19bd8fec-620a-4982-93fa-a32ea823ff44 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:35.405978 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-19bd8fec-620a-4982-93fa-a32ea823ff44 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:35.414134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-19bd8fec-620a-4982-93fa-a32ea823ff44 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084675 Aug 24 12:59:35.417586 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1829/3663] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:35 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:36.434835 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d7a2ee69-e77a-42d1-ab59-bc478f4e2022 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:36.435454 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d7a2ee69-e77a-42d1-ab59-bc478f4e2022 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:36.441500 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7a2ee69-e77a-42d1-ab59-bc478f4e2022 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:36.441982 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7a2ee69-e77a-42d1-ab59-bc478f4e2022 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:36.442420 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7a2ee69-e77a-42d1-ab59-bc478f4e2022 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:36.443142 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7a2ee69-e77a-42d1-ab59-bc478f4e2022 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:36.443601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7a2ee69-e77a-42d1-ab59-bc478f4e2022 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:36.444033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d7a2ee69-e77a-42d1-ab59-bc478f4e2022 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:36.504719 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d7a2ee69-e77a-42d1-ab59-bc478f4e2022 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:36.513470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d7a2ee69-e77a-42d1-ab59-bc478f4e2022 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081868 Aug 24 12:59:36.514030 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1835/3664] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:36 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:37.533854 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-98506709-f9b3-4afc-8ad7-d49bb9f8133a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:37.534459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-98506709-f9b3-4afc-8ad7-d49bb9f8133a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:37.540938 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98506709-f9b3-4afc-8ad7-d49bb9f8133a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:37.541425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98506709-f9b3-4afc-8ad7-d49bb9f8133a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:37.541862 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98506709-f9b3-4afc-8ad7-d49bb9f8133a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:37.542539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98506709-f9b3-4afc-8ad7-d49bb9f8133a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:37.543023 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98506709-f9b3-4afc-8ad7-d49bb9f8133a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:37.543449 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-98506709-f9b3-4afc-8ad7-d49bb9f8133a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:37.603413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-98506709-f9b3-4afc-8ad7-d49bb9f8133a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:37.611615 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-98506709-f9b3-4afc-8ad7-d49bb9f8133a tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081664 Aug 24 12:59:37.612170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1830/3665] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:37 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:38.632608 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a24d6e07-c7fa-4021-9e7f-07b18e081166 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:38.633266 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a24d6e07-c7fa-4021-9e7f-07b18e081166 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:38.639636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a24d6e07-c7fa-4021-9e7f-07b18e081166 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:38.640118 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a24d6e07-c7fa-4021-9e7f-07b18e081166 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:38.640556 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a24d6e07-c7fa-4021-9e7f-07b18e081166 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:38.641236 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a24d6e07-c7fa-4021-9e7f-07b18e081166 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:38.641692 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a24d6e07-c7fa-4021-9e7f-07b18e081166 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:38.642122 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a24d6e07-c7fa-4021-9e7f-07b18e081166 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:38.704850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a24d6e07-c7fa-4021-9e7f-07b18e081166 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:38.712857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a24d6e07-c7fa-4021-9e7f-07b18e081166 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084149 Aug 24 12:59:38.713411 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1836/3666] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:38 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:39.733478 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4a84d56a-7650-4f12-afe7-fb0967e0aae2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:39.734122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4a84d56a-7650-4f12-afe7-fb0967e0aae2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:39.740877 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a84d56a-7650-4f12-afe7-fb0967e0aae2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:39.741387 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a84d56a-7650-4f12-afe7-fb0967e0aae2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:39.741827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a84d56a-7650-4f12-afe7-fb0967e0aae2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:39.742508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a84d56a-7650-4f12-afe7-fb0967e0aae2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:39.742991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a84d56a-7650-4f12-afe7-fb0967e0aae2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:39.743421 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4a84d56a-7650-4f12-afe7-fb0967e0aae2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:39.808209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4a84d56a-7650-4f12-afe7-fb0967e0aae2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:39.816820 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4a84d56a-7650-4f12-afe7-fb0967e0aae2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.087321 Aug 24 12:59:39.817383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1831/3667] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:39 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:40.838079 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ec342959-7799-487a-aa98-63161629f8ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:40.838712 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ec342959-7799-487a-aa98-63161629f8ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:40.845716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec342959-7799-487a-aa98-63161629f8ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:40.846205 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec342959-7799-487a-aa98-63161629f8ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:40.846677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec342959-7799-487a-aa98-63161629f8ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:40.847356 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec342959-7799-487a-aa98-63161629f8ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:40.847815 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec342959-7799-487a-aa98-63161629f8ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:40.848242 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ec342959-7799-487a-aa98-63161629f8ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:41.116510 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ec342959-7799-487a-aa98-63161629f8ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:41.125221 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ec342959-7799-487a-aa98-63161629f8ea tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.291115 Aug 24 12:59:41.125783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1837/3668] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:40 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:42.146770 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-11ae92c2-2632-4aa4-b643-076feac72f65 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:42.147379 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-11ae92c2-2632-4aa4-b643-076feac72f65 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:42.153884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-11ae92c2-2632-4aa4-b643-076feac72f65 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:42.154367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-11ae92c2-2632-4aa4-b643-076feac72f65 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:42.154852 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-11ae92c2-2632-4aa4-b643-076feac72f65 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:42.155564 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-11ae92c2-2632-4aa4-b643-076feac72f65 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:42.156019 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-11ae92c2-2632-4aa4-b643-076feac72f65 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:42.156459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-11ae92c2-2632-4aa4-b643-076feac72f65 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:42.217412 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-11ae92c2-2632-4aa4-b643-076feac72f65 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:42.225381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-11ae92c2-2632-4aa4-b643-076feac72f65 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082517 Aug 24 12:59:42.225931 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1832/3669] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:42 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:43.249039 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ef4b16f3-7eda-4a42-ae3f-5f7de65037ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:43.249652 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ef4b16f3-7eda-4a42-ae3f-5f7de65037ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:43.256114 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef4b16f3-7eda-4a42-ae3f-5f7de65037ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:43.256594 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef4b16f3-7eda-4a42-ae3f-5f7de65037ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:43.257028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef4b16f3-7eda-4a42-ae3f-5f7de65037ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:43.257706 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef4b16f3-7eda-4a42-ae3f-5f7de65037ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:43.258173 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef4b16f3-7eda-4a42-ae3f-5f7de65037ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:43.258598 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ef4b16f3-7eda-4a42-ae3f-5f7de65037ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:43.318259 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ef4b16f3-7eda-4a42-ae3f-5f7de65037ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:43.326891 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ef4b16f3-7eda-4a42-ae3f-5f7de65037ff tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083211 Aug 24 12:59:43.327440 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1838/3670] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:43 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:44.347664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4c03aaf4-07ab-4214-acb9-c5ef841d3243 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:44.348266 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4c03aaf4-07ab-4214-acb9-c5ef841d3243 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:44.354554 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4c03aaf4-07ab-4214-acb9-c5ef841d3243 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:44.355059 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4c03aaf4-07ab-4214-acb9-c5ef841d3243 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:44.355496 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4c03aaf4-07ab-4214-acb9-c5ef841d3243 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:44.356166 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4c03aaf4-07ab-4214-acb9-c5ef841d3243 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:44.357222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4c03aaf4-07ab-4214-acb9-c5ef841d3243 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:44.357640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4c03aaf4-07ab-4214-acb9-c5ef841d3243 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:44.417913 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4c03aaf4-07ab-4214-acb9-c5ef841d3243 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:44.426008 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4c03aaf4-07ab-4214-acb9-c5ef841d3243 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082140 Aug 24 12:59:44.426555 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1833/3671] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:44 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:59:45.446234 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6e20b5a4-f0d6-47a7-a146-5bc5df062518 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:45.446869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6e20b5a4-f0d6-47a7-a146-5bc5df062518 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:45.453828 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e20b5a4-f0d6-47a7-a146-5bc5df062518 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:45.454311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e20b5a4-f0d6-47a7-a146-5bc5df062518 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:45.454772 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e20b5a4-f0d6-47a7-a146-5bc5df062518 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:45.455449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e20b5a4-f0d6-47a7-a146-5bc5df062518 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:45.455900 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e20b5a4-f0d6-47a7-a146-5bc5df062518 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:45.456319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6e20b5a4-f0d6-47a7-a146-5bc5df062518 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:45.518557 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6e20b5a4-f0d6-47a7-a146-5bc5df062518 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:45.526676 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6e20b5a4-f0d6-47a7-a146-5bc5df062518 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084582 Aug 24 12:59:45.527186 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1839/3672] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:45 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:46.547170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-908b54a9-3afa-4f23-b5e4-76c74eace1f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:46.547775 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-908b54a9-3afa-4f23-b5e4-76c74eace1f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:46.549780 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=28 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:46.554389 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-908b54a9-3afa-4f23-b5e4-76c74eace1f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:46.554901 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-908b54a9-3afa-4f23-b5e4-76c74eace1f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:46.555368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-908b54a9-3afa-4f23-b5e4-76c74eace1f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:46.556050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-908b54a9-3afa-4f23-b5e4-76c74eace1f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:46.556505 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-908b54a9-3afa-4f23-b5e4-76c74eace1f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:46.556931 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-908b54a9-3afa-4f23-b5e4-76c74eace1f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:46.617347 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-908b54a9-3afa-4f23-b5e4-76c74eace1f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:46.625900 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-908b54a9-3afa-4f23-b5e4-76c74eace1f0 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082580 Aug 24 12:59:46.626464 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1834/3673] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:46 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:47.647210 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-df9db6bc-5df9-4f10-8ff0-f292ad319b9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:47.647818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-df9db6bc-5df9-4f10-8ff0-f292ad319b9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:47.654868 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df9db6bc-5df9-4f10-8ff0-f292ad319b9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:47.655351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df9db6bc-5df9-4f10-8ff0-f292ad319b9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:47.655782 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df9db6bc-5df9-4f10-8ff0-f292ad319b9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:47.656486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df9db6bc-5df9-4f10-8ff0-f292ad319b9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:47.656939 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df9db6bc-5df9-4f10-8ff0-f292ad319b9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:47.657362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-df9db6bc-5df9-4f10-8ff0-f292ad319b9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:47.717056 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-df9db6bc-5df9-4f10-8ff0-f292ad319b9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:47.724987 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-df9db6bc-5df9-4f10-8ff0-f292ad319b9f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081725 Aug 24 12:59:47.725533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1840/3674] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:47 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:48.745410 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7ee14323-17dc-4513-81f4-e916dde942fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:48.746014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7ee14323-17dc-4513-81f4-e916dde942fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:48.752461 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7ee14323-17dc-4513-81f4-e916dde942fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:48.752939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7ee14323-17dc-4513-81f4-e916dde942fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:48.753367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7ee14323-17dc-4513-81f4-e916dde942fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:48.754062 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7ee14323-17dc-4513-81f4-e916dde942fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:48.754505 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7ee14323-17dc-4513-81f4-e916dde942fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:48.754944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7ee14323-17dc-4513-81f4-e916dde942fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:48.818328 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7ee14323-17dc-4513-81f4-e916dde942fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:48.826357 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7ee14323-17dc-4513-81f4-e916dde942fe tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084900 Aug 24 12:59:48.826938 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1835/3675] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:48 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:49.846626 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-be53bec5-ba98-4385-b832-02d87dc256b5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:49.847251 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-be53bec5-ba98-4385-b832-02d87dc256b5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:49.853633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be53bec5-ba98-4385-b832-02d87dc256b5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:49.854109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be53bec5-ba98-4385-b832-02d87dc256b5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:49.854538 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be53bec5-ba98-4385-b832-02d87dc256b5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:49.855249 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be53bec5-ba98-4385-b832-02d87dc256b5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:49.855700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be53bec5-ba98-4385-b832-02d87dc256b5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:49.856126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be53bec5-ba98-4385-b832-02d87dc256b5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:49.917516 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-be53bec5-ba98-4385-b832-02d87dc256b5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:49.925496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-be53bec5-ba98-4385-b832-02d87dc256b5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082725 Aug 24 12:59:49.926051 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1841/3676] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:49 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:50.945667 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f88c283c-6156-4d47-9387-e8145f26b111 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:50.946269 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f88c283c-6156-4d47-9387-e8145f26b111 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:50.953177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f88c283c-6156-4d47-9387-e8145f26b111 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:50.953657 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f88c283c-6156-4d47-9387-e8145f26b111 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:50.954087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f88c283c-6156-4d47-9387-e8145f26b111 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:50.954779 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f88c283c-6156-4d47-9387-e8145f26b111 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:50.955231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f88c283c-6156-4d47-9387-e8145f26b111 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:50.955646 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f88c283c-6156-4d47-9387-e8145f26b111 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:51.016745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f88c283c-6156-4d47-9387-e8145f26b111 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:51.024890 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f88c283c-6156-4d47-9387-e8145f26b111 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083079 Aug 24 12:59:51.025441 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1836/3677] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:50 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:52.046019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-326adda8-8e10-4dc0-a0ee-4e0e631124ee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:52.046626 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-326adda8-8e10-4dc0-a0ee-4e0e631124ee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:52.048930 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=28 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:52.053524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-326adda8-8e10-4dc0-a0ee-4e0e631124ee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:52.054005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-326adda8-8e10-4dc0-a0ee-4e0e631124ee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:52.054499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-326adda8-8e10-4dc0-a0ee-4e0e631124ee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:52.055261 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-326adda8-8e10-4dc0-a0ee-4e0e631124ee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:52.055732 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-326adda8-8e10-4dc0-a0ee-4e0e631124ee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:52.056149 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-326adda8-8e10-4dc0-a0ee-4e0e631124ee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:52.121811 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-326adda8-8e10-4dc0-a0ee-4e0e631124ee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:52.130117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-326adda8-8e10-4dc0-a0ee-4e0e631124ee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.088514 Aug 24 12:59:52.130757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1842/3678] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:52 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:53.150485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-be4db140-8649-4881-9072-b33da1f79d31 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:53.151117 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-be4db140-8649-4881-9072-b33da1f79d31 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:53.157586 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be4db140-8649-4881-9072-b33da1f79d31 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:53.158070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be4db140-8649-4881-9072-b33da1f79d31 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:53.158510 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be4db140-8649-4881-9072-b33da1f79d31 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:53.159227 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be4db140-8649-4881-9072-b33da1f79d31 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:53.159685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be4db140-8649-4881-9072-b33da1f79d31 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:53.160114 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be4db140-8649-4881-9072-b33da1f79d31 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:53.219897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-be4db140-8649-4881-9072-b33da1f79d31 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:53.227865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-be4db140-8649-4881-9072-b33da1f79d31 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081245 Aug 24 12:59:53.228427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1837/3679] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:53 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:54.249179 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c3adbab9-b128-492c-a6aa-eefc7bd0847e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:54.249814 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c3adbab9-b128-492c-a6aa-eefc7bd0847e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:54.256255 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3adbab9-b128-492c-a6aa-eefc7bd0847e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:54.256740 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3adbab9-b128-492c-a6aa-eefc7bd0847e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:54.257182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3adbab9-b128-492c-a6aa-eefc7bd0847e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:54.257871 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3adbab9-b128-492c-a6aa-eefc7bd0847e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:54.258328 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3adbab9-b128-492c-a6aa-eefc7bd0847e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:54.258782 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c3adbab9-b128-492c-a6aa-eefc7bd0847e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:54.261282 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=84 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:54.319810 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c3adbab9-b128-492c-a6aa-eefc7bd0847e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:54.328025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c3adbab9-b128-492c-a6aa-eefc7bd0847e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082764 Aug 24 12:59:54.328620 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1843/3680] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:54 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:55.348425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6ae821f8-d597-429e-bd90-ebff72dc2718 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:55.349032 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6ae821f8-d597-429e-bd90-ebff72dc2718 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:55.355533 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6ae821f8-d597-429e-bd90-ebff72dc2718 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:55.356036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6ae821f8-d597-429e-bd90-ebff72dc2718 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:55.356470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6ae821f8-d597-429e-bd90-ebff72dc2718 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:55.357175 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6ae821f8-d597-429e-bd90-ebff72dc2718 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:55.357631 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6ae821f8-d597-429e-bd90-ebff72dc2718 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:55.358055 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6ae821f8-d597-429e-bd90-ebff72dc2718 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:55.422498 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6ae821f8-d597-429e-bd90-ebff72dc2718 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:55.430790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6ae821f8-d597-429e-bd90-ebff72dc2718 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.086242 Aug 24 12:59:55.431356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1838/3681] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:55 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:56.452211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bb16d06c-9211-450f-b95a-9ba2a6fa218b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:56.452831 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bb16d06c-9211-450f-b95a-9ba2a6fa218b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:56.460011 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb16d06c-9211-450f-b95a-9ba2a6fa218b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:56.460491 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb16d06c-9211-450f-b95a-9ba2a6fa218b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:56.460925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb16d06c-9211-450f-b95a-9ba2a6fa218b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:56.461603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb16d06c-9211-450f-b95a-9ba2a6fa218b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:56.462060 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb16d06c-9211-450f-b95a-9ba2a6fa218b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:56.462485 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bb16d06c-9211-450f-b95a-9ba2a6fa218b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:56.522322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bb16d06c-9211-450f-b95a-9ba2a6fa218b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:56.530297 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bb16d06c-9211-450f-b95a-9ba2a6fa218b tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082032 Aug 24 12:59:56.530913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1844/3682] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:56 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:57.550843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e3d7fd52-aea9-4bff-a1c2-a36c23b2231d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:57.552035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e3d7fd52-aea9-4bff-a1c2-a36c23b2231d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:57.558340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e3d7fd52-aea9-4bff-a1c2-a36c23b2231d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:57.558863 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e3d7fd52-aea9-4bff-a1c2-a36c23b2231d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:57.559299 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e3d7fd52-aea9-4bff-a1c2-a36c23b2231d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:57.559976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e3d7fd52-aea9-4bff-a1c2-a36c23b2231d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:57.560428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e3d7fd52-aea9-4bff-a1c2-a36c23b2231d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:57.560855 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e3d7fd52-aea9-4bff-a1c2-a36c23b2231d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:57.623891 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e3d7fd52-aea9-4bff-a1c2-a36c23b2231d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:57.631935 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e3d7fd52-aea9-4bff-a1c2-a36c23b2231d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084982 Aug 24 12:59:57.632499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1839/3683] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:57 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:58.652230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-05c6f49d-f1f2-4fab-a7b7-da2348a16baa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:58.652950 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-05c6f49d-f1f2-4fab-a7b7-da2348a16baa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:58.659901 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-05c6f49d-f1f2-4fab-a7b7-da2348a16baa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:58.660381 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-05c6f49d-f1f2-4fab-a7b7-da2348a16baa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:58.660818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-05c6f49d-f1f2-4fab-a7b7-da2348a16baa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:58.661498 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-05c6f49d-f1f2-4fab-a7b7-da2348a16baa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:58.661955 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-05c6f49d-f1f2-4fab-a7b7-da2348a16baa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:58.662382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-05c6f49d-f1f2-4fab-a7b7-da2348a16baa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:58.726732 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-05c6f49d-f1f2-4fab-a7b7-da2348a16baa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:58.735730 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-05c6f49d-f1f2-4fab-a7b7-da2348a16baa tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.087146 Aug 24 12:59:58.736289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1845/3684] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:58 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:59:59.756481 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ef347142-d22e-4fc7-8f60-a6207789cdee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:59:59.757090 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ef347142-d22e-4fc7-8f60-a6207789cdee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:59:59.763552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef347142-d22e-4fc7-8f60-a6207789cdee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:59.764032 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef347142-d22e-4fc7-8f60-a6207789cdee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:59.764469 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef347142-d22e-4fc7-8f60-a6207789cdee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:59.765143 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef347142-d22e-4fc7-8f60-a6207789cdee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:59:59.765687 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef347142-d22e-4fc7-8f60-a6207789cdee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:59:59.766110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef347142-d22e-4fc7-8f60-a6207789cdee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:59:59.826337 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ef347142-d22e-4fc7-8f60-a6207789cdee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:59:59.834410 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ef347142-d22e-4fc7-8f60-a6207789cdee tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081869 Aug 24 12:59:59.835002 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1840/3685] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 12:59:59 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:00.855084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2b3c5fa2-c770-418d-a92e-b2a922886ab8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:00.855697 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2b3c5fa2-c770-418d-a92e-b2a922886ab8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:00.862312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2b3c5fa2-c770-418d-a92e-b2a922886ab8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:00.862825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2b3c5fa2-c770-418d-a92e-b2a922886ab8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:00.863265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2b3c5fa2-c770-418d-a92e-b2a922886ab8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:00.863944 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2b3c5fa2-c770-418d-a92e-b2a922886ab8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:00.864401 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2b3c5fa2-c770-418d-a92e-b2a922886ab8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:00.864826 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2b3c5fa2-c770-418d-a92e-b2a922886ab8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:00.923850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2b3c5fa2-c770-418d-a92e-b2a922886ab8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:00.931829 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2b3c5fa2-c770-418d-a92e-b2a922886ab8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.080633 Aug 24 13:00:00.932377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1846/3686] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:00 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:01.952794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fd0d370d-03d2-4523-9b03-84f47d43f233 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:01.954036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fd0d370d-03d2-4523-9b03-84f47d43f233 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:01.960562 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd0d370d-03d2-4523-9b03-84f47d43f233 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:01.961043 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd0d370d-03d2-4523-9b03-84f47d43f233 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:01.961480 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd0d370d-03d2-4523-9b03-84f47d43f233 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:01.962161 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd0d370d-03d2-4523-9b03-84f47d43f233 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:01.962631 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd0d370d-03d2-4523-9b03-84f47d43f233 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:01.963067 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd0d370d-03d2-4523-9b03-84f47d43f233 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:02.023489 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fd0d370d-03d2-4523-9b03-84f47d43f233 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:02.031599 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fd0d370d-03d2-4523-9b03-84f47d43f233 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082631 Aug 24 13:00:02.032155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1841/3687] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:01 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:03.044407 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:00:03.045078 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 13:00:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:00:03.051484 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d75bddb0-d542-430f-a871-330dd58c8df8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:03.052092 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d75bddb0-d542-430f-a871-330dd58c8df8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:03.058373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d75bddb0-d542-430f-a871-330dd58c8df8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:03.058890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d75bddb0-d542-430f-a871-330dd58c8df8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:03.059324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d75bddb0-d542-430f-a871-330dd58c8df8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:03.060003 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d75bddb0-d542-430f-a871-330dd58c8df8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:03.060453 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d75bddb0-d542-430f-a871-330dd58c8df8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:03.060875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d75bddb0-d542-430f-a871-330dd58c8df8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:03.121727 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d75bddb0-d542-430f-a871-330dd58c8df8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:03.130242 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d75bddb0-d542-430f-a871-330dd58c8df8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082721 Aug 24 13:00:03.130829 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1847/3688] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:03 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:00:04.151932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f0738720-45a7-4b7c-adfc-3b90facdff8d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:04.152539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f0738720-45a7-4b7c-adfc-3b90facdff8d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:04.158979 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0738720-45a7-4b7c-adfc-3b90facdff8d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:04.159460 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0738720-45a7-4b7c-adfc-3b90facdff8d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:04.159897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0738720-45a7-4b7c-adfc-3b90facdff8d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:04.160596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0738720-45a7-4b7c-adfc-3b90facdff8d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:04.161048 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0738720-45a7-4b7c-adfc-3b90facdff8d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:04.161496 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0738720-45a7-4b7c-adfc-3b90facdff8d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:04.165361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=84 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:04.223238 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f0738720-45a7-4b7c-adfc-3b90facdff8d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:04.231415 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f0738720-45a7-4b7c-adfc-3b90facdff8d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083356 Aug 24 13:00:04.231966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1842/3689] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:04 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:05.252949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-81519a19-63a4-45a8-baa2-41d97c1295f7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:05.253562 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-81519a19-63a4-45a8-baa2-41d97c1295f7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:05.260056 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81519a19-63a4-45a8-baa2-41d97c1295f7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:05.260543 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81519a19-63a4-45a8-baa2-41d97c1295f7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:05.260985 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81519a19-63a4-45a8-baa2-41d97c1295f7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:05.261670 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81519a19-63a4-45a8-baa2-41d97c1295f7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:05.262130 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81519a19-63a4-45a8-baa2-41d97c1295f7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:05.262556 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-81519a19-63a4-45a8-baa2-41d97c1295f7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:05.325618 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-81519a19-63a4-45a8-baa2-41d97c1295f7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:05.332094 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-81519a19-63a4-45a8-baa2-41d97c1295f7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083107 Aug 24 13:00:05.332698 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1848/3690] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:05 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:06.352958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a2de1b67-a4ce-42ad-a907-9c2a8c4d6bf5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:06.353481 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a2de1b67-a4ce-42ad-a907-9c2a8c4d6bf5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:06.360859 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2de1b67-a4ce-42ad-a907-9c2a8c4d6bf5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:06.361335 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2de1b67-a4ce-42ad-a907-9c2a8c4d6bf5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:06.361767 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2de1b67-a4ce-42ad-a907-9c2a8c4d6bf5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:06.362443 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2de1b67-a4ce-42ad-a907-9c2a8c4d6bf5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:06.362919 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2de1b67-a4ce-42ad-a907-9c2a8c4d6bf5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:06.363343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a2de1b67-a4ce-42ad-a907-9c2a8c4d6bf5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:06.426989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a2de1b67-a4ce-42ad-a907-9c2a8c4d6bf5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:06.435172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a2de1b67-a4ce-42ad-a907-9c2a8c4d6bf5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.086179 Aug 24 13:00:06.435726 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1843/3691] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:06 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:07.455759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-96cc4fc6-c5d1-4beb-ac1a-d8ba3bacc1c9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:07.456376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-96cc4fc6-c5d1-4beb-ac1a-d8ba3bacc1c9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:07.462291 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96cc4fc6-c5d1-4beb-ac1a-d8ba3bacc1c9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:07.462822 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96cc4fc6-c5d1-4beb-ac1a-d8ba3bacc1c9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:07.463292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96cc4fc6-c5d1-4beb-ac1a-d8ba3bacc1c9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:07.463984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96cc4fc6-c5d1-4beb-ac1a-d8ba3bacc1c9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:07.464455 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96cc4fc6-c5d1-4beb-ac1a-d8ba3bacc1c9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:07.465060 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96cc4fc6-c5d1-4beb-ac1a-d8ba3bacc1c9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:07.527470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-96cc4fc6-c5d1-4beb-ac1a-d8ba3bacc1c9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:07.535712 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-96cc4fc6-c5d1-4beb-ac1a-d8ba3bacc1c9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.083961 Aug 24 13:00:07.536276 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1849/3692] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:07 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:08.556061 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c8e9dd22-ab1f-41c6-ba4e-144da191a0b9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:08.556670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c8e9dd22-ab1f-41c6-ba4e-144da191a0b9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:08.563661 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c8e9dd22-ab1f-41c6-ba4e-144da191a0b9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:08.564152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c8e9dd22-ab1f-41c6-ba4e-144da191a0b9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:08.564594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c8e9dd22-ab1f-41c6-ba4e-144da191a0b9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:08.565273 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c8e9dd22-ab1f-41c6-ba4e-144da191a0b9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:08.565727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c8e9dd22-ab1f-41c6-ba4e-144da191a0b9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:08.566150 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c8e9dd22-ab1f-41c6-ba4e-144da191a0b9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:08.626019 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c8e9dd22-ab1f-41c6-ba4e-144da191a0b9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:08.634039 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c8e9dd22-ab1f-41c6-ba4e-144da191a0b9 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081888 Aug 24 13:00:08.634591 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1844/3693] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:08 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:09.655175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-855efa35-e9d8-45cc-9c96-81a886ce992d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:09.655785 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-855efa35-e9d8-45cc-9c96-81a886ce992d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:09.662628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-855efa35-e9d8-45cc-9c96-81a886ce992d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:09.663143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-855efa35-e9d8-45cc-9c96-81a886ce992d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:09.663579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-855efa35-e9d8-45cc-9c96-81a886ce992d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:09.664262 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-855efa35-e9d8-45cc-9c96-81a886ce992d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:09.664718 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-855efa35-e9d8-45cc-9c96-81a886ce992d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:09.665198 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-855efa35-e9d8-45cc-9c96-81a886ce992d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:09.724776 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-855efa35-e9d8-45cc-9c96-81a886ce992d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:09.732857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-855efa35-e9d8-45cc-9c96-81a886ce992d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081529 Aug 24 13:00:09.733413 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1850/3694] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:09 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:10.754211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-29e6d243-c8ba-4194-babe-61aac8f9fd47 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:10.754854 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-29e6d243-c8ba-4194-babe-61aac8f9fd47 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:10.761341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-29e6d243-c8ba-4194-babe-61aac8f9fd47 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:10.761820 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-29e6d243-c8ba-4194-babe-61aac8f9fd47 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:10.762256 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-29e6d243-c8ba-4194-babe-61aac8f9fd47 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:10.762972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-29e6d243-c8ba-4194-babe-61aac8f9fd47 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:10.763426 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-29e6d243-c8ba-4194-babe-61aac8f9fd47 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:10.763850 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-29e6d243-c8ba-4194-babe-61aac8f9fd47 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:10.825467 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-29e6d243-c8ba-4194-babe-61aac8f9fd47 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:10.834178 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-29e6d243-c8ba-4194-babe-61aac8f9fd47 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084387 Aug 24 13:00:10.834759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1845/3695] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:10 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:11.854737 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-01cb606d-fd88-4066-a0dd-a911bf0baa0f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:11.855342 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-01cb606d-fd88-4066-a0dd-a911bf0baa0f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:11.861962 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01cb606d-fd88-4066-a0dd-a911bf0baa0f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:11.862441 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01cb606d-fd88-4066-a0dd-a911bf0baa0f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:11.862900 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01cb606d-fd88-4066-a0dd-a911bf0baa0f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:11.863579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01cb606d-fd88-4066-a0dd-a911bf0baa0f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:11.864031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01cb606d-fd88-4066-a0dd-a911bf0baa0f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:11.864455 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-01cb606d-fd88-4066-a0dd-a911bf0baa0f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:11.923952 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-01cb606d-fd88-4066-a0dd-a911bf0baa0f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:11.931883 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-01cb606d-fd88-4066-a0dd-a911bf0baa0f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081044 Aug 24 13:00:11.932427 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1851/3696] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:11 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:12.093531 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:00:12.093743 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 13:00:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:00:12.613364 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:00:12.613770 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 13:00:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:00:12.952224 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-48f6a2b3-d451-421e-8b02-1f5fe6f195f4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:12.952823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-48f6a2b3-d451-421e-8b02-1f5fe6f195f4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:12.959219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-48f6a2b3-d451-421e-8b02-1f5fe6f195f4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:12.959697 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-48f6a2b3-d451-421e-8b02-1f5fe6f195f4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:12.960123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-48f6a2b3-d451-421e-8b02-1f5fe6f195f4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:12.960820 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-48f6a2b3-d451-421e-8b02-1f5fe6f195f4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:12.961266 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-48f6a2b3-d451-421e-8b02-1f5fe6f195f4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:12.961685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-48f6a2b3-d451-421e-8b02-1f5fe6f195f4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:13.021819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-48f6a2b3-d451-421e-8b02-1f5fe6f195f4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:13.029801 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-48f6a2b3-d451-421e-8b02-1f5fe6f195f4 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.081469 Aug 24 13:00:13.030348 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1846/3697] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:12 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:14.051213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8598f2ee-5a79-494b-9859-37827973d4ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:14.051826 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8598f2ee-5a79-494b-9859-37827973d4ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:14.058183 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8598f2ee-5a79-494b-9859-37827973d4ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:14.058692 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8598f2ee-5a79-494b-9859-37827973d4ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:14.059134 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8598f2ee-5a79-494b-9859-37827973d4ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:14.059817 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8598f2ee-5a79-494b-9859-37827973d4ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:14.060274 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8598f2ee-5a79-494b-9859-37827973d4ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:14.060701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8598f2ee-5a79-494b-9859-37827973d4ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:14.123630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8598f2ee-5a79-494b-9859-37827973d4ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:14.132341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8598f2ee-5a79-494b-9859-37827973d4ab tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084997 Aug 24 13:00:14.134456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1852/3698] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:14 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:15.153279 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f37b956c-02ed-4108-91e3-5d8630344bfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:15.153800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f37b956c-02ed-4108-91e3-5d8630344bfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:15.160613 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f37b956c-02ed-4108-91e3-5d8630344bfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:15.161101 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f37b956c-02ed-4108-91e3-5d8630344bfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:15.161537 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f37b956c-02ed-4108-91e3-5d8630344bfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:15.162224 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f37b956c-02ed-4108-91e3-5d8630344bfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:15.162732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f37b956c-02ed-4108-91e3-5d8630344bfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:15.163157 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f37b956c-02ed-4108-91e3-5d8630344bfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:15.240721 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f37b956c-02ed-4108-91e3-5d8630344bfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:15.251525 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f37b956c-02ed-4108-91e3-5d8630344bfb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.102138 Aug 24 13:00:15.252085 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1847/3699] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:15 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:16.272517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2aa409f4-148b-4adb-a0ef-de9370e4fd1f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:16.273129 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2aa409f4-148b-4adb-a0ef-de9370e4fd1f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:16.279739 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2aa409f4-148b-4adb-a0ef-de9370e4fd1f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:16.280221 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2aa409f4-148b-4adb-a0ef-de9370e4fd1f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:16.280660 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2aa409f4-148b-4adb-a0ef-de9370e4fd1f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:16.281916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2aa409f4-148b-4adb-a0ef-de9370e4fd1f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:16.282376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2aa409f4-148b-4adb-a0ef-de9370e4fd1f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:16.282835 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2aa409f4-148b-4adb-a0ef-de9370e4fd1f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:16.345135 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2aa409f4-148b-4adb-a0ef-de9370e4fd1f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:16.353209 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2aa409f4-148b-4adb-a0ef-de9370e4fd1f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.084568 Aug 24 13:00:16.353763 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1853/3700] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:16 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:00:17.374175 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-afed6697-51ad-45e1-97fe-dab374d467e1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:17.375321 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-afed6697-51ad-45e1-97fe-dab374d467e1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:17.377270 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=28 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:17.381865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-afed6697-51ad-45e1-97fe-dab374d467e1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:17.382341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-afed6697-51ad-45e1-97fe-dab374d467e1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:17.382798 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-afed6697-51ad-45e1-97fe-dab374d467e1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:17.383472 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-afed6697-51ad-45e1-97fe-dab374d467e1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:17.383918 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-afed6697-51ad-45e1-97fe-dab374d467e1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:17.384340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-afed6697-51ad-45e1-97fe-dab374d467e1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:17.444724 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-afed6697-51ad-45e1-97fe-dab374d467e1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:17.453404 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-afed6697-51ad-45e1-97fe-dab374d467e1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 200 len: 1368 microversion: 2.1 time: 0.082582 Aug 24 13:00:17.453955 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1848/3701] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:17 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:17.473735 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-99f43425-0793-4d35-81b3-db322abb6377 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '.version_select at 0x7f76f60f9310>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:17.555601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-99f43425-0793-4d35-81b3-db322abb6377 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-879830423" status: 202 len: 0 microversion: 2.1 time: 0.085505 Aug 24 13:00:17.556176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1854/3702] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Aug 24 13:00:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-879830423 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:00:18.529394 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-57ddc188-ec02-4c17-8386-27996db04798 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Action: 'create', calling method: .version_select at 0x7f76f9c483a0>, body: {"keypair": {"name": "tempest-keypair-258856333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObXLiX48Awa/mDboqK32Ptj7YTElL4SZH5WLZWdpcJP+bLlEdy46py+/fkls6M0xaLltmEv5Xnxa9zYflSTnFNdWi5wkFEnF1T0jWhkqhCchQKnl3nDUf/mBtwp3yM55g=="}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:00:18.546699 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-57ddc188-ec02-4c17-8386-27996db04798 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Getting quotas for project e7a3075a9e3a47a4bcb9136ce8303173. Resources: {'key_pairs'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:00:18.550420 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-57ddc188-ec02-4c17-8386-27996db04798 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Getting quotas for user 751f05f1ff6c4593870073d8f47e0db9 and project e7a3075a9e3a47a4bcb9136ce8303173. Resources: {'key_pairs'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:00:18.675971 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-57ddc188-ec02-4c17-8386-27996db04798 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.150293 Aug 24 13:00:18.676562 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1849/3703] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 24 13:00:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:00:20.882785 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d0424fa1-4b63-481b-82ae-35be6225ff5f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-426632368", "imageRef": "62fcb2c8-bff4-46cf-9892-c43d7626629e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f137b54-3584-4b32-aaf7-f4f4fb0dd5d8"}], "security_groups": [{"name": "tempest-securitygroup--1307674812"}], "key_name": "tempest-keypair-258856333", "user_data": "}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:00:20.984280 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.network.neutron [None req-d0424fa1-4b63-481b-82ae-35be6225ff5f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] validate_networks() for [('6f137b54-3584-4b32-aaf7-f4f4fb0dd5d8', None, None, None, None, None)] {{(pid=121170) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:00:21.418997 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-d0424fa1-4b63-481b-82ae-35be6225ff5f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Flavor limits 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:00:21.419418 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-d0424fa1-4b63-481b-82ae-35be6225ff5f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Image limits 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:00:21.420047 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-d0424fa1-4b63-481b-82ae-35be6225ff5f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Flavor pref 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:00:21.420465 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-d0424fa1-4b63-481b-82ae-35be6225ff5f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Image pref 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:00:21.420874 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-d0424fa1-4b63-481b-82ae-35be6225ff5f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:00:21.430416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d0424fa1-4b63-481b-82ae-35be6225ff5f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:21.430928 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d0424fa1-4b63-481b-82ae-35be6225ff5f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:21.431366 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d0424fa1-4b63-481b-82ae-35be6225ff5f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:21.432082 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d0424fa1-4b63-481b-82ae-35be6225ff5f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:21.432533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d0424fa1-4b63-481b-82ae-35be6225ff5f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:21.432957 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d0424fa1-4b63-481b-82ae-35be6225ff5f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:21.449750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-d0424fa1-4b63-481b-82ae-35be6225ff5f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Getting quotas for project e7a3075a9e3a47a4bcb9136ce8303173. Resources: {'instances', 'cores', 'ram'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:00:21.453660 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-d0424fa1-4b63-481b-82ae-35be6225ff5f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Getting quotas for user 751f05f1ff6c4593870073d8f47e0db9 and project e7a3075a9e3a47a4bcb9136ce8303173. Resources: {'instances', 'cores', 'ram'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:00:21.464410 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d0424fa1-4b63-481b-82ae-35be6225ff5f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Going to run 1 instances... {{(pid=121170) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 13:00:21.466937 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d0424fa1-4b63-481b-82ae-35be6225ff5f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: accf42ec-09df-4104-8b66-2f821b26eb69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='62fcb2c8-bff4-46cf-9892-c43d7626629e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 13:00:21.604208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d0424fa1-4b63-481b-82ae-35be6225ff5f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.726245 Aug 24 13:00:21.604960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1855/3704] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 13:00:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 13:00:21.617123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-99bd1723-d315-47fa-8207-5a070343f3cb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:21.617732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-99bd1723-d315-47fa-8207-5a070343f3cb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: accf42ec-09df-4104-8b66-2f821b26eb69] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:21.675787 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-99bd1723-d315-47fa-8207-5a070343f3cb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:21.683433 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-99bd1723-d315-47fa-8207-5a070343f3cb tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69" status: 200 len: 1236 microversion: 2.1 time: 0.069942 Aug 24 13:00:21.683433 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1850/3705] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:21 2022] GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69 => generated 1236 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:22.704454 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dd3022f8-645c-4add-ac50-b2159c371541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:22.705091 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dd3022f8-645c-4add-ac50-b2159c371541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: accf42ec-09df-4104-8b66-2f821b26eb69] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:22.707430 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:22.712899 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dd3022f8-645c-4add-ac50-b2159c371541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:22.713636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dd3022f8-645c-4add-ac50-b2159c371541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:22.713883 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dd3022f8-645c-4add-ac50-b2159c371541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:22.714567 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dd3022f8-645c-4add-ac50-b2159c371541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:22.715048 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dd3022f8-645c-4add-ac50-b2159c371541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:22.715471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dd3022f8-645c-4add-ac50-b2159c371541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:22.777501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-dd3022f8-645c-4add-ac50-b2159c371541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:22.785085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dd3022f8-645c-4add-ac50-b2159c371541 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69" status: 200 len: 1240 microversion: 2.1 time: 0.085128 Aug 24 13:00:22.785647 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1856/3706] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:22 2022] GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:23.805399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d16f49cb-1017-4620-989f-09c5a1667cb2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:23.806025 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d16f49cb-1017-4620-989f-09c5a1667cb2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: accf42ec-09df-4104-8b66-2f821b26eb69] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:23.812169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d16f49cb-1017-4620-989f-09c5a1667cb2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:23.812645 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d16f49cb-1017-4620-989f-09c5a1667cb2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:23.813285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d16f49cb-1017-4620-989f-09c5a1667cb2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:23.814492 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d16f49cb-1017-4620-989f-09c5a1667cb2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:23.814965 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d16f49cb-1017-4620-989f-09c5a1667cb2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:23.815556 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d16f49cb-1017-4620-989f-09c5a1667cb2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:23.888096 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d16f49cb-1017-4620-989f-09c5a1667cb2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:23.895704 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d16f49cb-1017-4620-989f-09c5a1667cb2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69" status: 200 len: 1296 microversion: 2.1 time: 0.094182 Aug 24 13:00:23.896376 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1851/3707] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:23 2022] GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69 => generated 1296 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:24.916614 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c7ba12c2-d4c0-418e-b2b6-f0c0dc306306 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:24.917226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c7ba12c2-d4c0-418e-b2b6-f0c0dc306306 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: accf42ec-09df-4104-8b66-2f821b26eb69] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:24.924200 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7ba12c2-d4c0-418e-b2b6-f0c0dc306306 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:24.924688 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7ba12c2-d4c0-418e-b2b6-f0c0dc306306 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:24.925127 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7ba12c2-d4c0-418e-b2b6-f0c0dc306306 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:24.925815 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7ba12c2-d4c0-418e-b2b6-f0c0dc306306 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:24.926274 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7ba12c2-d4c0-418e-b2b6-f0c0dc306306 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:24.926729 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c7ba12c2-d4c0-418e-b2b6-f0c0dc306306 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:24.929288 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=74 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:25.054883 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-c7ba12c2-d4c0-418e-b2b6-f0c0dc306306 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:25.062581 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c7ba12c2-d4c0-418e-b2b6-f0c0dc306306 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69" status: 200 len: 1362 microversion: 2.1 time: 0.149798 Aug 24 13:00:25.063261 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1857/3708] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:24 2022] GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:25.663807 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-3604f361-7a56-4a72-885e-86946c67b6d7 req-8e605e10-b73b-45a0-8751-5621ad89f217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "accf42ec-09df-4104-8b66-2f821b26eb69", "tag": "c46e3475-3122-4273-81d8-68db896b5af4"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:00:25.672878 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-3604f361-7a56-4a72-885e-86946c67b6d7 req-8e605e10-b73b-45a0-8751-5621ad89f217 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:25.673385 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-3604f361-7a56-4a72-885e-86946c67b6d7 req-8e605e10-b73b-45a0-8751-5621ad89f217 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:25.673823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-3604f361-7a56-4a72-885e-86946c67b6d7 req-8e605e10-b73b-45a0-8751-5621ad89f217 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:25.684258 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-3604f361-7a56-4a72-885e-86946c67b6d7 req-8e605e10-b73b-45a0-8751-5621ad89f217 service nova] Creating event network-changed:c46e3475-3122-4273-81d8-68db896b5af4 for instance accf42ec-09df-4104-8b66-2f821b26eb69 on hv-cinder-84889 Aug 24 13:00:25.687642 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR oslo.messaging._drivers.impl_rabbit [req-3604f361-7a56-4a72-885e-86946c67b6d7 req-8e605e10-b73b-45a0-8751-5621ad89f217 service nova] [0fda3551-bb5d-4bb2-ba26-d3a1679f86f2] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 13:00:26.091335 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b073a648-c43d-410d-96f0-4f10b65c5728 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:26.092023 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b073a648-c43d-410d-96f0-4f10b65c5728 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: accf42ec-09df-4104-8b66-2f821b26eb69] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:26.099487 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b073a648-c43d-410d-96f0-4f10b65c5728 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:26.099984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b073a648-c43d-410d-96f0-4f10b65c5728 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:26.100485 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b073a648-c43d-410d-96f0-4f10b65c5728 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:26.101199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b073a648-c43d-410d-96f0-4f10b65c5728 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:26.101665 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b073a648-c43d-410d-96f0-4f10b65c5728 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:26.102097 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b073a648-c43d-410d-96f0-4f10b65c5728 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:26.250618 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b073a648-c43d-410d-96f0-4f10b65c5728 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:26.258639 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b073a648-c43d-410d-96f0-4f10b65c5728 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69" status: 200 len: 1362 microversion: 2.1 time: 0.171178 Aug 24 13:00:26.259239 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1858/3709] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:26 2022] GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:00:26.694819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [req-3604f361-7a56-4a72-885e-86946c67b6d7 req-8e605e10-b73b-45a0-8751-5621ad89f217 service nova] [0fda3551-bb5d-4bb2-ba26-d3a1679f86f2] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 45846. Aug 24 13:00:26.698221 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-3604f361-7a56-4a72-885e-86946c67b6d7 req-8e605e10-b73b-45a0-8751-5621ad89f217 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.095451 Aug 24 13:00:26.698845 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1852/3710] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:00:27.279594 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-11ae1292-fc97-406f-b408-b29c494c36ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:27.280203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-11ae1292-fc97-406f-b408-b29c494c36ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: accf42ec-09df-4104-8b66-2f821b26eb69] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:27.286532 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11ae1292-fc97-406f-b408-b29c494c36ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:27.287047 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11ae1292-fc97-406f-b408-b29c494c36ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:27.287485 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11ae1292-fc97-406f-b408-b29c494c36ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:27.288167 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11ae1292-fc97-406f-b408-b29c494c36ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:27.288624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11ae1292-fc97-406f-b408-b29c494c36ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:27.289051 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-11ae1292-fc97-406f-b408-b29c494c36ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:27.414416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-11ae1292-fc97-406f-b408-b29c494c36ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:27.422187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-11ae1292-fc97-406f-b408-b29c494c36ef tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69" status: 200 len: 1362 microversion: 2.1 time: 0.146438 Aug 24 13:00:27.422766 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1859/3711] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:27 2022] GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:27.897461 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:00:27.897763 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 13:00:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:00:28.444232 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-488a1e63-27ee-4be2-bccb-1d392c57e421 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:28.444927 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-488a1e63-27ee-4be2-bccb-1d392c57e421 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: accf42ec-09df-4104-8b66-2f821b26eb69] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:28.451149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-488a1e63-27ee-4be2-bccb-1d392c57e421 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:28.451624 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-488a1e63-27ee-4be2-bccb-1d392c57e421 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:28.452060 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-488a1e63-27ee-4be2-bccb-1d392c57e421 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:28.452735 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-488a1e63-27ee-4be2-bccb-1d392c57e421 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:28.453185 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-488a1e63-27ee-4be2-bccb-1d392c57e421 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:28.453607 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-488a1e63-27ee-4be2-bccb-1d392c57e421 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:28.583018 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-488a1e63-27ee-4be2-bccb-1d392c57e421 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:28.590569 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-488a1e63-27ee-4be2-bccb-1d392c57e421 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69" status: 200 len: 1362 microversion: 2.1 time: 0.151092 Aug 24 13:00:28.591145 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1853/3712] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:28 2022] GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:29.611570 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1fa6e7f7-db35-4572-876c-79d969e83fb2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:29.612830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1fa6e7f7-db35-4572-876c-79d969e83fb2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: accf42ec-09df-4104-8b66-2f821b26eb69] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:29.619226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1fa6e7f7-db35-4572-876c-79d969e83fb2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:29.619806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1fa6e7f7-db35-4572-876c-79d969e83fb2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:29.620244 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1fa6e7f7-db35-4572-876c-79d969e83fb2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:29.620919 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1fa6e7f7-db35-4572-876c-79d969e83fb2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:29.621372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1fa6e7f7-db35-4572-876c-79d969e83fb2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:29.621790 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1fa6e7f7-db35-4572-876c-79d969e83fb2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:29.751390 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1fa6e7f7-db35-4572-876c-79d969e83fb2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:29.758870 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1fa6e7f7-db35-4572-876c-79d969e83fb2 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69" status: 200 len: 1362 microversion: 2.1 time: 0.151356 Aug 24 13:00:29.759420 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1860/3713] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:29 2022] GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:30.780039 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f242229a-a8d8-4b37-a534-b35397bfec4f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:30.780652 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f242229a-a8d8-4b37-a534-b35397bfec4f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: accf42ec-09df-4104-8b66-2f821b26eb69] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:30.787072 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f242229a-a8d8-4b37-a534-b35397bfec4f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:30.787501 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f242229a-a8d8-4b37-a534-b35397bfec4f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:30.787942 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f242229a-a8d8-4b37-a534-b35397bfec4f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:30.788629 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f242229a-a8d8-4b37-a534-b35397bfec4f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:30.789085 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f242229a-a8d8-4b37-a534-b35397bfec4f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:30.789511 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f242229a-a8d8-4b37-a534-b35397bfec4f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:30.917141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f242229a-a8d8-4b37-a534-b35397bfec4f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:30.924633 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f242229a-a8d8-4b37-a534-b35397bfec4f tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69" status: 200 len: 1362 microversion: 2.1 time: 0.148453 Aug 24 13:00:30.925178 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1854/3714] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:30 2022] GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:31.945029 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2fbe3fd2-6a1a-428a-b1f9-6acdd03e8372 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:31.945553 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2fbe3fd2-6a1a-428a-b1f9-6acdd03e8372 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: accf42ec-09df-4104-8b66-2f821b26eb69] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:31.947830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell0:SELECT=2 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:31.948484 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell0:SELECT=6 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:31.953144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2fbe3fd2-6a1a-428a-b1f9-6acdd03e8372 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:31.953668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2fbe3fd2-6a1a-428a-b1f9-6acdd03e8372 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:31.958169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2fbe3fd2-6a1a-428a-b1f9-6acdd03e8372 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:31.958169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2fbe3fd2-6a1a-428a-b1f9-6acdd03e8372 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:31.958169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2fbe3fd2-6a1a-428a-b1f9-6acdd03e8372 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:31.958169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2fbe3fd2-6a1a-428a-b1f9-6acdd03e8372 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:32.089860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2fbe3fd2-6a1a-428a-b1f9-6acdd03e8372 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:32.097702 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2fbe3fd2-6a1a-428a-b1f9-6acdd03e8372 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69" status: 200 len: 1362 microversion: 2.1 time: 0.156629 Aug 24 13:00:32.098285 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1861/3715] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:31 2022] GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:32.279409 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=6 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:32.327720 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-def4311f-b049-429a-8748-9252c1dba78b req-99346e1b-f76c-4bb4-af01-ea7acd060c0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "accf42ec-09df-4104-8b66-2f821b26eb69", "name": "network-vif-plugged", "status": "completed", "tag": "c46e3475-3122-4273-81d8-68db896b5af4"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:00:32.337417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-def4311f-b049-429a-8748-9252c1dba78b req-99346e1b-f76c-4bb4-af01-ea7acd060c0d service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:32.342865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-def4311f-b049-429a-8748-9252c1dba78b req-99346e1b-f76c-4bb4-af01-ea7acd060c0d service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:32.342865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-def4311f-b049-429a-8748-9252c1dba78b req-99346e1b-f76c-4bb4-af01-ea7acd060c0d service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:32.348856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-def4311f-b049-429a-8748-9252c1dba78b req-99346e1b-f76c-4bb4-af01-ea7acd060c0d service nova] Creating event network-vif-plugged:c46e3475-3122-4273-81d8-68db896b5af4 for instance accf42ec-09df-4104-8b66-2f821b26eb69 on hv-cinder-84889 Aug 24 13:00:32.353679 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-def4311f-b049-429a-8748-9252c1dba78b req-99346e1b-f76c-4bb4-af01-ea7acd060c0d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078791 Aug 24 13:00:32.354249 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1855/3716] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:00:33.118848 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8ac12a7d-e337-4ba2-88d2-eea6d1066e4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:33.119395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8ac12a7d-e337-4ba2-88d2-eea6d1066e4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: accf42ec-09df-4104-8b66-2f821b26eb69] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:33.125747 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8ac12a7d-e337-4ba2-88d2-eea6d1066e4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:33.126230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8ac12a7d-e337-4ba2-88d2-eea6d1066e4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:33.126689 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8ac12a7d-e337-4ba2-88d2-eea6d1066e4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:33.127378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8ac12a7d-e337-4ba2-88d2-eea6d1066e4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:33.127835 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8ac12a7d-e337-4ba2-88d2-eea6d1066e4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:33.128261 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8ac12a7d-e337-4ba2-88d2-eea6d1066e4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:33.252820 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8ac12a7d-e337-4ba2-88d2-eea6d1066e4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:33.260287 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8ac12a7d-e337-4ba2-88d2-eea6d1066e4d tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69" status: 200 len: 1362 microversion: 2.1 time: 0.145423 Aug 24 13:00:33.260846 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1862/3717] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:33 2022] GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:34.281732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0eae2a3a-019b-42f7-989e-470a65f2a9b6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:34.282417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0eae2a3a-019b-42f7-989e-470a65f2a9b6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: accf42ec-09df-4104-8b66-2f821b26eb69] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:34.289485 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0eae2a3a-019b-42f7-989e-470a65f2a9b6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:34.289964 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0eae2a3a-019b-42f7-989e-470a65f2a9b6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:34.290396 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0eae2a3a-019b-42f7-989e-470a65f2a9b6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:34.291116 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0eae2a3a-019b-42f7-989e-470a65f2a9b6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:34.291558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0eae2a3a-019b-42f7-989e-470a65f2a9b6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:34.296452 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0eae2a3a-019b-42f7-989e-470a65f2a9b6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:34.296452 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=64 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:34.422387 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0eae2a3a-019b-42f7-989e-470a65f2a9b6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:34.430007 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0eae2a3a-019b-42f7-989e-470a65f2a9b6 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69" status: 200 len: 1362 microversion: 2.1 time: 0.152934 Aug 24 13:00:34.430582 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1856/3718] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:34 2022] GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:35.450816 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fa3dfb79-5a83-4726-8e21-c54599173f5e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:35.451422 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fa3dfb79-5a83-4726-8e21-c54599173f5e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: accf42ec-09df-4104-8b66-2f821b26eb69] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:35.458716 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa3dfb79-5a83-4726-8e21-c54599173f5e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:35.459202 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa3dfb79-5a83-4726-8e21-c54599173f5e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:35.459642 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa3dfb79-5a83-4726-8e21-c54599173f5e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:35.460332 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa3dfb79-5a83-4726-8e21-c54599173f5e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:35.460793 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa3dfb79-5a83-4726-8e21-c54599173f5e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:35.461218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa3dfb79-5a83-4726-8e21-c54599173f5e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:35.589336 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fa3dfb79-5a83-4726-8e21-c54599173f5e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:00:35.596914 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fa3dfb79-5a83-4726-8e21-c54599173f5e tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69" status: 200 len: 1548 microversion: 2.1 time: 0.149973 Aug 24 13:00:35.597473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1863/3719] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:00:35 2022] GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:35.617411 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-46a742f6-824f-48f9-8ea1-96fa34704e05 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:00:35.617886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-46a742f6-824f-48f9-8ea1-96fa34704e05 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: accf42ec-09df-4104-8b66-2f821b26eb69] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:00:35.624141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46a742f6-824f-48f9-8ea1-96fa34704e05 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:35.624619 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46a742f6-824f-48f9-8ea1-96fa34704e05 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:35.625051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46a742f6-824f-48f9-8ea1-96fa34704e05 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:35.625727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46a742f6-824f-48f9-8ea1-96fa34704e05 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:35.626181 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46a742f6-824f-48f9-8ea1-96fa34704e05 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:35.626601 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-46a742f6-824f-48f9-8ea1-96fa34704e05 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:35.705379 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-46a742f6-824f-48f9-8ea1-96fa34704e05 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091690 Aug 24 13:00:35.705964 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1857/3720] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 24 13:00:35 2022] GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:00:36.718733 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-32f778ff-185f-4f12-9ada-b1d3058a17d9 req-689fbfc7-0f06-48cc-91b6-06f53b37f9fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "accf42ec-09df-4104-8b66-2f821b26eb69", "tag": "c46e3475-3122-4273-81d8-68db896b5af4"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:00:36.728734 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-32f778ff-185f-4f12-9ada-b1d3058a17d9 req-689fbfc7-0f06-48cc-91b6-06f53b37f9fa service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:00:36.729205 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-32f778ff-185f-4f12-9ada-b1d3058a17d9 req-689fbfc7-0f06-48cc-91b6-06f53b37f9fa service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:00:36.729630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-32f778ff-185f-4f12-9ada-b1d3058a17d9 req-689fbfc7-0f06-48cc-91b6-06f53b37f9fa service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:00:36.740859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-32f778ff-185f-4f12-9ada-b1d3058a17d9 req-689fbfc7-0f06-48cc-91b6-06f53b37f9fa service nova] Creating event network-changed:c46e3475-3122-4273-81d8-68db896b5af4 for instance accf42ec-09df-4104-8b66-2f821b26eb69 on hv-cinder-84889 Aug 24 13:00:36.746801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-32f778ff-185f-4f12-9ada-b1d3058a17d9 req-689fbfc7-0f06-48cc-91b6-06f53b37f9fa service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031838 Aug 24 13:00:36.747382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1864/3721] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:01:41.395571 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:41.396309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=9 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:41.450667 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2067e8bd-23b3-48d3-8041-83588406c9b7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:01:41.451174 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2067e8bd-23b3-48d3-8041-83588406c9b7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: accf42ec-09df-4104-8b66-2f821b26eb69] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:01:41.456999 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2067e8bd-23b3-48d3-8041-83588406c9b7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:01:41.457481 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2067e8bd-23b3-48d3-8041-83588406c9b7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:01:41.457920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2067e8bd-23b3-48d3-8041-83588406c9b7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:01:41.458599 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2067e8bd-23b3-48d3-8041-83588406c9b7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:01:41.459074 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2067e8bd-23b3-48d3-8041-83588406c9b7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:01:41.459502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2067e8bd-23b3-48d3-8041-83588406c9b7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:01:41.482804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2067e8bd-23b3-48d3-8041-83588406c9b7 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69/ips" status: 200 len: 146 microversion: 2.1 time: 0.089183 Aug 24 13:01:41.483340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1858/3722] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 24 13:01:41 2022] GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69/ips => generated 146 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:02:41.557593 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e9b880af-0db7-46d0-80b6-f6e6eac4ce9b] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 13:02:41.558199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=17 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:41.558969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=43 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:41.563261 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bf9f5010-6c26-4f32-8512-c966488aee5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:02:41.563872 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bf9f5010-6c26-4f32-8512-c966488aee5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: accf42ec-09df-4104-8b66-2f821b26eb69] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:02:41.569728 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf9f5010-6c26-4f32-8512-c966488aee5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:02:41.570209 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf9f5010-6c26-4f32-8512-c966488aee5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:02:41.570703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf9f5010-6c26-4f32-8512-c966488aee5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:02:41.571373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf9f5010-6c26-4f32-8512-c966488aee5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:02:41.571834 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf9f5010-6c26-4f32-8512-c966488aee5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:02:41.572260 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bf9f5010-6c26-4f32-8512-c966488aee5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:02:41.597657 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bf9f5010-6c26-4f32-8512-c966488aee5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: accf42ec-09df-4104-8b66-2f821b26eb69] Going to try to terminate instance {{(pid=121170) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 13:02:41.873951 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bf9f5010-6c26-4f32-8512-c966488aee5c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "DELETE /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69" status: 204 len: 0 microversion: 2.1 time: 0.318010 Aug 24 13:02:41.874675 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1865/3723] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 13:02:41 2022] DELETE /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:02:41.881405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=4 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:41.885368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e90d0780-08bd-46cc-836f-650fa6f4ea2c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:02:41.885958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e90d0780-08bd-46cc-836f-650fa6f4ea2c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: accf42ec-09df-4104-8b66-2f821b26eb69] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:02:41.891844 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e90d0780-08bd-46cc-836f-650fa6f4ea2c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:02:41.902831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e90d0780-08bd-46cc-836f-650fa6f4ea2c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:02:41.902831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e90d0780-08bd-46cc-836f-650fa6f4ea2c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:02:41.902831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e90d0780-08bd-46cc-836f-650fa6f4ea2c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:02:41.902831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e90d0780-08bd-46cc-836f-650fa6f4ea2c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:02:41.903189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e90d0780-08bd-46cc-836f-650fa6f4ea2c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:02:42.025299 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e90d0780-08bd-46cc-836f-650fa6f4ea2c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:02:42.033346 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e90d0780-08bd-46cc-836f-650fa6f4ea2c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69" status: 200 len: 1673 microversion: 2.1 time: 0.153454 Aug 24 13:02:42.033891 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1859/3724] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:02:41 2022] GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:02:43.055165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ab8313c0-3a47-43a1-b7b9-0489dc03b7ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:02:43.055856 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ab8313c0-3a47-43a1-b7b9-0489dc03b7ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: accf42ec-09df-4104-8b66-2f821b26eb69] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:02:43.064816 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab8313c0-3a47-43a1-b7b9-0489dc03b7ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:02:43.065305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab8313c0-3a47-43a1-b7b9-0489dc03b7ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:02:43.065746 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab8313c0-3a47-43a1-b7b9-0489dc03b7ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:02:43.066432 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab8313c0-3a47-43a1-b7b9-0489dc03b7ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:02:43.066947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab8313c0-3a47-43a1-b7b9-0489dc03b7ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:02:43.067377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ab8313c0-3a47-43a1-b7b9-0489dc03b7ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:02:43.085507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] [e9b880af-0db7-46d0-80b6-f6e6eac4ce9b] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 45942. Aug 24 13:02:43.200726 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ab8313c0-3a47-43a1-b7b9-0489dc03b7ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:02:43.208274 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ab8313c0-3a47-43a1-b7b9-0489dc03b7ad tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69" status: 200 len: 1673 microversion: 2.1 time: 0.157382 Aug 24 13:02:43.208841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1866/3725] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:02:43 2022] GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:02:44.229912 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c40d9399-a9bd-4104-a7d9-882de3b6a3af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:02:44.230536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c40d9399-a9bd-4104-a7d9-882de3b6a3af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: accf42ec-09df-4104-8b66-2f821b26eb69] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:02:44.237387 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c40d9399-a9bd-4104-a7d9-882de3b6a3af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:02:44.242835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c40d9399-a9bd-4104-a7d9-882de3b6a3af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:02:44.242835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c40d9399-a9bd-4104-a7d9-882de3b6a3af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:02:44.242835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c40d9399-a9bd-4104-a7d9-882de3b6a3af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:02:44.242835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c40d9399-a9bd-4104-a7d9-882de3b6a3af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:02:44.243171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c40d9399-a9bd-4104-a7d9-882de3b6a3af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:02:44.361904 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c40d9399-a9bd-4104-a7d9-882de3b6a3af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:02:44.369583 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c40d9399-a9bd-4104-a7d9-882de3b6a3af tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69" status: 200 len: 1605 microversion: 2.1 time: 0.144332 Aug 24 13:02:44.370143 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1860/3726] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:02:44 2022] GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69 => generated 1605 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:02:44.568933 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-cea49316-5684-409d-b8ae-10c481059911 req-3a8d00fa-1f63-4013-8c78-e3fe6fe79a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "accf42ec-09df-4104-8b66-2f821b26eb69", "name": "network-vif-deleted", "tag": "c46e3475-3122-4273-81d8-68db896b5af4"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:02:44.579777 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-cea49316-5684-409d-b8ae-10c481059911 req-3a8d00fa-1f63-4013-8c78-e3fe6fe79a82 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:02:44.580327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-cea49316-5684-409d-b8ae-10c481059911 req-3a8d00fa-1f63-4013-8c78-e3fe6fe79a82 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:02:44.580767 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-cea49316-5684-409d-b8ae-10c481059911 req-3a8d00fa-1f63-4013-8c78-e3fe6fe79a82 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:02:44.592351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-cea49316-5684-409d-b8ae-10c481059911 req-3a8d00fa-1f63-4013-8c78-e3fe6fe79a82 service nova] Creating event network-vif-deleted:c46e3475-3122-4273-81d8-68db896b5af4 for instance accf42ec-09df-4104-8b66-2f821b26eb69 on hv-cinder-84889 Aug 24 13:02:44.599318 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-cea49316-5684-409d-b8ae-10c481059911 req-3a8d00fa-1f63-4013-8c78-e3fe6fe79a82 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034028 Aug 24 13:02:44.600073 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1867/3727] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:02:45.392912 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1290f015-2fb6-4230-8ccd-68ea9619d085 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:02:45.393615 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1290f015-2fb6-4230-8ccd-68ea9619d085 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: accf42ec-09df-4104-8b66-2f821b26eb69] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:02:45.401613 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1290f015-2fb6-4230-8ccd-68ea9619d085 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:02:45.402103 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1290f015-2fb6-4230-8ccd-68ea9619d085 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:02:45.402541 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1290f015-2fb6-4230-8ccd-68ea9619d085 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:02:45.403303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1290f015-2fb6-4230-8ccd-68ea9619d085 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:02:45.403760 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1290f015-2fb6-4230-8ccd-68ea9619d085 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:02:45.404184 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1290f015-2fb6-4230-8ccd-68ea9619d085 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:02:45.445597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1290f015-2fb6-4230-8ccd-68ea9619d085 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:02:45.446075 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1290f015-2fb6-4230-8ccd-68ea9619d085 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:02:45.446504 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1290f015-2fb6-4230-8ccd-68ea9619d085 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:02:45.446974 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.objects.instance [None req-1290f015-2fb6-4230-8ccd-68ea9619d085 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lazy-loading 'fault' on Instance uuid accf42ec-09df-4104-8b66-2f821b26eb69 {{(pid=121171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:02:45.494980 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1290f015-2fb6-4230-8ccd-68ea9619d085 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '751f05f1ff6c4593870073d8f47e0db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a3075a9e3a47a4bcb9136ce8303173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:02:45.503198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1290f015-2fb6-4230-8ccd-68ea9619d085 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69" status: 200 len: 1326 microversion: 2.1 time: 0.115658 Aug 24 13:02:45.503756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1861/3728] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:02:45 2022] GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69 => generated 1326 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:02:46.525106 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d1c5d258-8bcc-4409-ae96-e0b86693b378 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:02:46.525826 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d1c5d258-8bcc-4409-ae96-e0b86693b378 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: accf42ec-09df-4104-8b66-2f821b26eb69] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:02:46.531943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1c5d258-8bcc-4409-ae96-e0b86693b378 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:02:46.532920 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1c5d258-8bcc-4409-ae96-e0b86693b378 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:02:46.533354 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1c5d258-8bcc-4409-ae96-e0b86693b378 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:02:46.534029 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1c5d258-8bcc-4409-ae96-e0b86693b378 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:02:46.534478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1c5d258-8bcc-4409-ae96-e0b86693b378 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:02:46.534924 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d1c5d258-8bcc-4409-ae96-e0b86693b378 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:02:46.547740 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.wsgi [None req-d1c5d258-8bcc-4409-ae96-e0b86693b378 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] HTTP exception thrown: Instance accf42ec-09df-4104-8b66-2f821b26eb69 could not be found. Aug 24 13:02:46.550067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d1c5d258-8bcc-4409-ae96-e0b86693b378 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Request method failure captured: Aug 24 13:02:46.550067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: request: GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69 HTTP/1.1 Aug 24 13:02:46.550067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept: application/json Aug 24 13:02:46.550067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept-Encoding: identity Aug 24 13:02:46.550067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Connection: close Aug 24 13:02:46.550067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Length: 0 Aug 24 13:02:46.550067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Type: application/json Aug 24 13:02:46.550067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Host: 10.222.0.45 Aug 24 13:02:46.550067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Openstack-System-Scope: None Aug 24 13:02:46.550067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: User-Agent: python-urllib3/1.26.11 Aug 24 13:02:46.550067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Auth-Token: gAAAAABjBhnLLzeMmwotoPORQqZ-kJj6WDHpTiEJRZuSqOw9ujr59eVrzSASRDx18Q_B5e2xfVvkCNCrSpakl_0p-U1mQKN3-uhpC3yZazhE1uqKE6hJZk6xk6Cx-245wc-29RliD7k4jpM14Wwc-D4b5Hh2fNONTrC-SwH1cyszPZ7vnFbRO0A Aug 24 13:02:46.550067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Id: None Aug 24 13:02:46.550067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Name: None Aug 24 13:02:46.550067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Identity-Status: Confirmed Aug 24 13:02:46.550067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Is-Admin-Project: True Aug 24 13:02:46.550067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Id: default Aug 24 13:02:46.550067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Name: Default Aug 24 13:02:46.550067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Id: e7a3075a9e3a47a4bcb9136ce8303173 Aug 24 13:02:46.550067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Name: tempest-AttachVolumeTestJSON-1614074694 Aug 24 13:02:46.550067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Role: member,reader Aug 24 13:02:46.550067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Roles: member,reader Aug 24 13:02:46.551661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e7a3075a9e3a47a4bcb9136ce8303173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e7a3075a9e3a47a4bcb9136ce8303173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e7a3075a9e3a47a4bcb9136ce8303173"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e7a3075a9e3a47a4bcb9136ce8303173"}]}] Aug 24 13:02:46.551661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant: tempest-AttachVolumeTestJSON-1614074694 Aug 24 13:02:46.551661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Id: e7a3075a9e3a47a4bcb9136ce8303173 Aug 24 13:02:46.551661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1614074694 Aug 24 13:02:46.551661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User: tempest-AttachVolumeTestJSON-1614074694-project Aug 24 13:02:46.551661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Id: default Aug 24 13:02:46.551661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Name: Default Aug 24 13:02:46.551661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Id: 751f05f1ff6c4593870073d8f47e0db9 Aug 24 13:02:46.551661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Name: tempest-AttachVolumeTestJSON-1614074694-project Aug 24 13:02:46.551661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: method: > Aug 24 13:02:46.551661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: exception: Instance accf42ec-09df-4104-8b66-2f821b26eb69 could not be found. Aug 24 13:02:46.551661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: action_args: {'id': 'accf42ec-09df-4104-8b66-2f821b26eb69'} Aug 24 13:02:46.552603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:02:46.552603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:02:46.552603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:02:46.552603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:02:46.552603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:02:46.552603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:02:46.552603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:02:46.552603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:02:46.552603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:02:46.552603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:02:46.552603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance accf42ec-09df-4104-8b66-2f821b26eb69 could not be found. Aug 24 13:02:46.552603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:02:46.552603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:02:46.552603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:02:46.552603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:02:46.552603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:02:46.552603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:02:46.552603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:02:46.552603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:02:46.552603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:02:46.553984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:02:46.553984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:02:46.553984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:02:46.553984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:02:46.553984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:02:46.553984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:02:46.553984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:02:46.553984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance accf42ec-09df-4104-8b66-2f821b26eb69 could not be found. Aug 24 13:02:46.553984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:02:46.553984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:02:46.553984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:02:46.553984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:02:46.553984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:02:46.553984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:02:46.553984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:02:46.553984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:02:46.553984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance accf42ec-09df-4104-8b66-2f821b26eb69 could not be found. Aug 24 13:02:46.553984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:02:46.555349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d1c5d258-8bcc-4409-ae96-e0b86693b378 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Returning 404 to user: Instance accf42ec-09df-4104-8b66-2f821b26eb69 could not be found. {{(pid=121170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:02:46.555349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d1c5d258-8bcc-4409-ae96-e0b86693b378 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69" status: 404 len: 111 microversion: 2.1 time: 0.031039 Aug 24 13:02:46.555349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1868/3729] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:02:46 2022] GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:02:46.560226 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-be734160-ea89-435a-b408-f2221b3bc447 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '.version_select at 0x7f76f9d629d0>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:02:46.654277 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-be734160-ea89-435a-b408-f2221b3bc447 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-258856333" status: 202 len: 0 microversion: 2.1 time: 0.097939 Aug 24 13:02:46.654866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1862/3730] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Aug 24 13:02:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-258856333 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:02:47.403474 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-97f21c2f-5784-4c86-978e-569746fd8de5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:02:47.403996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-97f21c2f-5784-4c86-978e-569746fd8de5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: accf42ec-09df-4104-8b66-2f821b26eb69] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:02:47.411975 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97f21c2f-5784-4c86-978e-569746fd8de5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:02:47.413917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97f21c2f-5784-4c86-978e-569746fd8de5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:02:47.413917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97f21c2f-5784-4c86-978e-569746fd8de5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:02:47.413917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97f21c2f-5784-4c86-978e-569746fd8de5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:02:47.414179 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97f21c2f-5784-4c86-978e-569746fd8de5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:02:47.414412 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-97f21c2f-5784-4c86-978e-569746fd8de5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:02:47.428278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.wsgi [None req-97f21c2f-5784-4c86-978e-569746fd8de5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] HTTP exception thrown: Instance accf42ec-09df-4104-8b66-2f821b26eb69 could not be found. Aug 24 13:02:47.429869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-97f21c2f-5784-4c86-978e-569746fd8de5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Request method failure captured: Aug 24 13:02:47.429869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: request: DELETE /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69 HTTP/1.1 Aug 24 13:02:47.429869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept: application/json Aug 24 13:02:47.429869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept-Encoding: identity Aug 24 13:02:47.429869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Connection: close Aug 24 13:02:47.429869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Length: 0 Aug 24 13:02:47.429869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Type: application/json Aug 24 13:02:47.429869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Host: 10.222.0.45 Aug 24 13:02:47.429869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Openstack-System-Scope: None Aug 24 13:02:47.429869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: User-Agent: python-urllib3/1.26.11 Aug 24 13:02:47.429869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Auth-Token: gAAAAABjBhnLLzeMmwotoPORQqZ-kJj6WDHpTiEJRZuSqOw9ujr59eVrzSASRDx18Q_B5e2xfVvkCNCrSpakl_0p-U1mQKN3-uhpC3yZazhE1uqKE6hJZk6xk6Cx-245wc-29RliD7k4jpM14Wwc-D4b5Hh2fNONTrC-SwH1cyszPZ7vnFbRO0A Aug 24 13:02:47.429869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Id: None Aug 24 13:02:47.429869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Name: None Aug 24 13:02:47.429869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Identity-Status: Confirmed Aug 24 13:02:47.429869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Is-Admin-Project: True Aug 24 13:02:47.429869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Id: default Aug 24 13:02:47.429869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Name: Default Aug 24 13:02:47.429869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Id: e7a3075a9e3a47a4bcb9136ce8303173 Aug 24 13:02:47.429869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Name: tempest-AttachVolumeTestJSON-1614074694 Aug 24 13:02:47.429869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Role: member,reader Aug 24 13:02:47.429869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Roles: member,reader Aug 24 13:02:47.431218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e7a3075a9e3a47a4bcb9136ce8303173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e7a3075a9e3a47a4bcb9136ce8303173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e7a3075a9e3a47a4bcb9136ce8303173"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e7a3075a9e3a47a4bcb9136ce8303173"}]}] Aug 24 13:02:47.431218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant: tempest-AttachVolumeTestJSON-1614074694 Aug 24 13:02:47.431218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Id: e7a3075a9e3a47a4bcb9136ce8303173 Aug 24 13:02:47.431218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1614074694 Aug 24 13:02:47.431218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User: tempest-AttachVolumeTestJSON-1614074694-project Aug 24 13:02:47.431218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Id: default Aug 24 13:02:47.431218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Name: Default Aug 24 13:02:47.431218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Id: 751f05f1ff6c4593870073d8f47e0db9 Aug 24 13:02:47.431218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Name: tempest-AttachVolumeTestJSON-1614074694-project Aug 24 13:02:47.431218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: method: > Aug 24 13:02:47.431218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: exception: Instance accf42ec-09df-4104-8b66-2f821b26eb69 could not be found. Aug 24 13:02:47.431218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: action_args: {'id': 'accf42ec-09df-4104-8b66-2f821b26eb69'} Aug 24 13:02:47.432031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:02:47.432031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:02:47.432031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:02:47.432031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:02:47.432031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:02:47.432031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:02:47.432031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:02:47.432031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:02:47.432031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:02:47.432031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:02:47.432031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance accf42ec-09df-4104-8b66-2f821b26eb69 could not be found. Aug 24 13:02:47.432031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:02:47.432031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:02:47.432031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:02:47.432031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:02:47.432031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:02:47.432031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:02:47.432031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:02:47.432031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:02:47.432031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:02:47.433044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:02:47.433044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 13:02:47.433044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 13:02:47.433044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 13:02:47.433044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 13:02:47.433044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:02:47.433044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:02:47.433044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:02:47.433044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:02:47.433044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance accf42ec-09df-4104-8b66-2f821b26eb69 could not be found. Aug 24 13:02:47.433044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:02:47.433044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:02:47.433044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:02:47.433044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:02:47.433044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:02:47.433044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:02:47.433044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:02:47.433044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:02:47.433044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance accf42ec-09df-4104-8b66-2f821b26eb69 could not be found. Aug 24 13:02:47.433044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:02:47.434110 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-97f21c2f-5784-4c86-978e-569746fd8de5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Returning 404 to user: Instance accf42ec-09df-4104-8b66-2f821b26eb69 could not be found. {{(pid=121170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:02:47.434110 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-97f21c2f-5784-4c86-978e-569746fd8de5 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "DELETE /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69" status: 404 len: 111 microversion: 2.1 time: 0.031713 Aug 24 13:02:47.434110 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1869/3731] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 13:02:47 2022] DELETE /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:02:47.440298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-94851754-0427-419e-b319-f230b9c9a75c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:02:47.440913 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-94851754-0427-419e-b319-f230b9c9a75c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: accf42ec-09df-4104-8b66-2f821b26eb69] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:02:47.447877 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94851754-0427-419e-b319-f230b9c9a75c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:02:47.448366 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94851754-0427-419e-b319-f230b9c9a75c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:02:47.448838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94851754-0427-419e-b319-f230b9c9a75c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:02:47.449527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94851754-0427-419e-b319-f230b9c9a75c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:02:47.449983 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94851754-0427-419e-b319-f230b9c9a75c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:02:47.450414 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-94851754-0427-419e-b319-f230b9c9a75c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:02:47.463832 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.wsgi [None req-94851754-0427-419e-b319-f230b9c9a75c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] HTTP exception thrown: Instance accf42ec-09df-4104-8b66-2f821b26eb69 could not be found. Aug 24 13:02:47.465473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-94851754-0427-419e-b319-f230b9c9a75c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Request method failure captured: Aug 24 13:02:47.465473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: request: GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69 HTTP/1.1 Aug 24 13:02:47.465473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept: application/json Aug 24 13:02:47.465473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept-Encoding: identity Aug 24 13:02:47.465473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Connection: close Aug 24 13:02:47.465473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Length: 0 Aug 24 13:02:47.465473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Type: application/json Aug 24 13:02:47.465473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Host: 10.222.0.45 Aug 24 13:02:47.465473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Openstack-System-Scope: None Aug 24 13:02:47.465473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: User-Agent: python-urllib3/1.26.11 Aug 24 13:02:47.465473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Auth-Token: gAAAAABjBhnLLzeMmwotoPORQqZ-kJj6WDHpTiEJRZuSqOw9ujr59eVrzSASRDx18Q_B5e2xfVvkCNCrSpakl_0p-U1mQKN3-uhpC3yZazhE1uqKE6hJZk6xk6Cx-245wc-29RliD7k4jpM14Wwc-D4b5Hh2fNONTrC-SwH1cyszPZ7vnFbRO0A Aug 24 13:02:47.465473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Id: None Aug 24 13:02:47.465473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Name: None Aug 24 13:02:47.465473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Identity-Status: Confirmed Aug 24 13:02:47.465473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Is-Admin-Project: True Aug 24 13:02:47.465473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Id: default Aug 24 13:02:47.465473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Name: Default Aug 24 13:02:47.465473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Id: e7a3075a9e3a47a4bcb9136ce8303173 Aug 24 13:02:47.465473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Name: tempest-AttachVolumeTestJSON-1614074694 Aug 24 13:02:47.465473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Role: member,reader Aug 24 13:02:47.465473 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Roles: member,reader Aug 24 13:02:47.466827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e7a3075a9e3a47a4bcb9136ce8303173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e7a3075a9e3a47a4bcb9136ce8303173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e7a3075a9e3a47a4bcb9136ce8303173"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e7a3075a9e3a47a4bcb9136ce8303173"}]}] Aug 24 13:02:47.466827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant: tempest-AttachVolumeTestJSON-1614074694 Aug 24 13:02:47.466827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Id: e7a3075a9e3a47a4bcb9136ce8303173 Aug 24 13:02:47.466827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1614074694 Aug 24 13:02:47.466827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User: tempest-AttachVolumeTestJSON-1614074694-project Aug 24 13:02:47.466827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Id: default Aug 24 13:02:47.466827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Name: Default Aug 24 13:02:47.466827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Id: 751f05f1ff6c4593870073d8f47e0db9 Aug 24 13:02:47.466827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Name: tempest-AttachVolumeTestJSON-1614074694-project Aug 24 13:02:47.466827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: method: > Aug 24 13:02:47.466827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: exception: Instance accf42ec-09df-4104-8b66-2f821b26eb69 could not be found. Aug 24 13:02:47.466827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: action_args: {'id': 'accf42ec-09df-4104-8b66-2f821b26eb69'} Aug 24 13:02:47.467560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:02:47.467560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:02:47.467560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:02:47.467560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:02:47.467560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:02:47.467560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:02:47.467560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:02:47.467560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:02:47.467560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:02:47.467560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:02:47.467560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance accf42ec-09df-4104-8b66-2f821b26eb69 could not be found. Aug 24 13:02:47.467560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:02:47.467560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:02:47.467560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:02:47.467560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:02:47.467560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:02:47.467560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:02:47.467560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:02:47.467560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:02:47.467560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:02:47.468514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:02:47.468514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:02:47.468514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:02:47.468514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:02:47.468514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:02:47.468514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:02:47.468514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:02:47.468514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance accf42ec-09df-4104-8b66-2f821b26eb69 could not be found. Aug 24 13:02:47.468514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:02:47.468514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:02:47.468514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:02:47.468514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:02:47.468514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:02:47.468514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:02:47.468514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:02:47.468514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:02:47.468514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance accf42ec-09df-4104-8b66-2f821b26eb69 could not be found. Aug 24 13:02:47.468514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:02:47.469372 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-94851754-0427-419e-b319-f230b9c9a75c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Returning 404 to user: Instance accf42ec-09df-4104-8b66-2f821b26eb69 could not be found. {{(pid=121171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:02:47.469372 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-94851754-0427-419e-b319-f230b9c9a75c tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69" status: 404 len: 111 microversion: 2.1 time: 0.030932 Aug 24 13:02:47.469372 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1863/3732] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:02:47 2022] GET /compute/v2.1/servers/accf42ec-09df-4104-8b66-2f821b26eb69 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:03:19.262189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:03:19.262811 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 13:03:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:03:32.101863 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:03:32.102609 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 13:03:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:03:32.621499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:03:32.621987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 13:03:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:03:47.774165 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:03:47.774823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 13:03:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:05:03.054409 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:05:03.055077 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 13:05:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:05:27.907296 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:05:27.907878 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 13:05:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:06:39.270659 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:06:39.271318 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 13:06:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:06:52.110279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:06:52.110953 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 13:06:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:06:52.629805 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:06:52.630346 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 13:06:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:07:07.782719 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:07:07.783370 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 13:07:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:07:19.033554 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8d5022bb-3a72-4acd-9da0-4cca6dfbb2d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:19.035543 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8d5022bb-3a72-4acd-9da0-4cca6dfbb2d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:07:19.038879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e9b880af-0db7-46d0-80b6-f6e6eac4ce9b] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 13:07:19.039530 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:19.040053 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:19.045192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d5022bb-3a72-4acd-9da0-4cca6dfbb2d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:19.050528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d5022bb-3a72-4acd-9da0-4cca6dfbb2d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:19.050528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d5022bb-3a72-4acd-9da0-4cca6dfbb2d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:19.050528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d5022bb-3a72-4acd-9da0-4cca6dfbb2d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:19.050528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d5022bb-3a72-4acd-9da0-4cca6dfbb2d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:19.051028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d5022bb-3a72-4acd-9da0-4cca6dfbb2d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:19.075324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8d5022bb-3a72-4acd-9da0-4cca6dfbb2d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124] Going to try to terminate instance {{(pid=121170) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 13:07:19.341894 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8d5022bb-3a72-4acd-9da0-4cca6dfbb2d9 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124" status: 204 len: 0 microversion: 2.20 time: 0.315065 Aug 24 13:07:19.342410 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1870/3733] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Aug 24 13:07:19 2022] DELETE /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 13:07:19.348745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b6b80c23-6823-4ba7-8f9f-446190311493] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 13:07:19.349244 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:19.354709 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=22 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:19.355039 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-92531405-efec-4c96-b865-611fb9abb21f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:19.355700 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-92531405-efec-4c96-b865-611fb9abb21f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:07:19.361686 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92531405-efec-4c96-b865-611fb9abb21f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:19.362156 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92531405-efec-4c96-b865-611fb9abb21f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:19.362585 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92531405-efec-4c96-b865-611fb9abb21f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:19.363298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92531405-efec-4c96-b865-611fb9abb21f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:19.363742 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92531405-efec-4c96-b865-611fb9abb21f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:19.364163 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-92531405-efec-4c96-b865-611fb9abb21f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:19.579134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-92531405-efec-4c96-b865-611fb9abb21f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:07:19.587855 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-92531405-efec-4c96-b865-611fb9abb21f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:07:19.589463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-92531405-efec-4c96-b865-611fb9abb21f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:07:19.590618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-92531405-efec-4c96-b865-611fb9abb21f tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124" status: 200 len: 1724 microversion: 2.20 time: 0.243949 Aug 24 13:07:19.591200 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1864/3734] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 13:07:19 2022] GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:07:20.298885 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2c229390-b746-4da3-85a1-ba1b4e572943 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:20.299633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2c229390-b746-4da3-85a1-ba1b4e572943 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:07:20.308190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c229390-b746-4da3-85a1-ba1b4e572943 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:20.309014 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c229390-b746-4da3-85a1-ba1b4e572943 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:20.309125 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c229390-b746-4da3-85a1-ba1b4e572943 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:20.309844 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c229390-b746-4da3-85a1-ba1b4e572943 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:20.310306 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c229390-b746-4da3-85a1-ba1b4e572943 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:20.310770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2c229390-b746-4da3-85a1-ba1b4e572943 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:20.328131 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] [e9b880af-0db7-46d0-80b6-f6e6eac4ce9b] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 46146. Aug 24 13:07:20.343438 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2c229390-b746-4da3-85a1-ba1b4e572943 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Going to try to terminate instance {{(pid=121170) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 13:07:20.614298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-973bf4f8-d0f4-4919-ac9d-e2f16e381332 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:20.614889 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-973bf4f8-d0f4-4919-ac9d-e2f16e381332 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:07:20.623493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-973bf4f8-d0f4-4919-ac9d-e2f16e381332 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:20.623976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-973bf4f8-d0f4-4919-ac9d-e2f16e381332 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:20.624106 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2c229390-b746-4da3-85a1-ba1b4e572943 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 204 len: 0 microversion: 2.1 time: 0.329040 Aug 24 13:07:20.624414 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-973bf4f8-d0f4-4919-ac9d-e2f16e381332 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:20.624649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1871/3735] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 13:07:20 2022] DELETE /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:07:20.625168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-973bf4f8-d0f4-4919-ac9d-e2f16e381332 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:20.625689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-973bf4f8-d0f4-4919-ac9d-e2f16e381332 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:20.626115 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-973bf4f8-d0f4-4919-ac9d-e2f16e381332 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:20.632974 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7cd04ca4-2aa3-47b5-b50d-a4af09eb1af0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:20.633711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7cd04ca4-2aa3-47b5-b50d-a4af09eb1af0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:07:20.639504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7cd04ca4-2aa3-47b5-b50d-a4af09eb1af0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:20.639993 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7cd04ca4-2aa3-47b5-b50d-a4af09eb1af0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:20.640434 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7cd04ca4-2aa3-47b5-b50d-a4af09eb1af0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:20.641121 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7cd04ca4-2aa3-47b5-b50d-a4af09eb1af0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:20.641576 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7cd04ca4-2aa3-47b5-b50d-a4af09eb1af0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:20.642006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7cd04ca4-2aa3-47b5-b50d-a4af09eb1af0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:20.642901 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] [b6b80c23-6823-4ba7-8f9f-446190311493] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 46152. Aug 24 13:07:20.760700 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-973bf4f8-d0f4-4919-ac9d-e2f16e381332 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:07:20.772761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-973bf4f8-d0f4-4919-ac9d-e2f16e381332 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:07:20.772761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-973bf4f8-d0f4-4919-ac9d-e2f16e381332 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:07:20.772761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-973bf4f8-d0f4-4919-ac9d-e2f16e381332 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124" status: 200 len: 1724 microversion: 2.20 time: 0.161345 Aug 24 13:07:20.773056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1865/3736] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 13:07:20 2022] GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:07:20.825492 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7cd04ca4-2aa3-47b5-b50d-a4af09eb1af0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:07:20.833213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7cd04ca4-2aa3-47b5-b50d-a4af09eb1af0 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1507 microversion: 2.1 time: 0.204319 Aug 24 13:07:20.833840 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1872/3737] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:07:20 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1507 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:07:21.794984 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6c6c2680-ca39-4a52-aeb4-1a37ad7dd3a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:21.795788 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6c6c2680-ca39-4a52-aeb4-1a37ad7dd3a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:07:21.802824 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c6c2680-ca39-4a52-aeb4-1a37ad7dd3a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:21.803479 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c6c2680-ca39-4a52-aeb4-1a37ad7dd3a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:21.804045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c6c2680-ca39-4a52-aeb4-1a37ad7dd3a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:21.804955 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c6c2680-ca39-4a52-aeb4-1a37ad7dd3a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:21.805589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c6c2680-ca39-4a52-aeb4-1a37ad7dd3a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:21.806119 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6c6c2680-ca39-4a52-aeb4-1a37ad7dd3a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:21.856098 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dcb2c9d8-1c8b-4a43-aebb-533842285177 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:21.857412 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dcb2c9d8-1c8b-4a43-aebb-533842285177 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:07:21.865207 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dcb2c9d8-1c8b-4a43-aebb-533842285177 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:21.866035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dcb2c9d8-1c8b-4a43-aebb-533842285177 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:21.866751 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dcb2c9d8-1c8b-4a43-aebb-533842285177 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:21.867688 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dcb2c9d8-1c8b-4a43-aebb-533842285177 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:21.868463 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dcb2c9d8-1c8b-4a43-aebb-533842285177 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:21.869089 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dcb2c9d8-1c8b-4a43-aebb-533842285177 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:22.001621 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6c6c2680-ca39-4a52-aeb4-1a37ad7dd3a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:07:22.009881 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6c6c2680-ca39-4a52-aeb4-1a37ad7dd3a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:07:22.010819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-dcb2c9d8-1c8b-4a43-aebb-533842285177 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:07:22.011428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6c6c2680-ca39-4a52-aeb4-1a37ad7dd3a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:07:22.012589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6c6c2680-ca39-4a52-aeb4-1a37ad7dd3a0 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124" status: 200 len: 1724 microversion: 2.20 time: 0.221786 Aug 24 13:07:22.013138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1866/3738] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 13:07:21 2022] GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:07:22.018768 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dcb2c9d8-1c8b-4a43-aebb-533842285177 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1507 microversion: 2.1 time: 0.166841 Aug 24 13:07:22.020696 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1873/3739] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:07:21 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:07:23.042219 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-310f067e-67ae-47ce-a7af-2e285354ec37 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:23.042921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-310f067e-67ae-47ce-a7af-2e285354ec37 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:07:23.050090 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ba652e9f-921b-40a5-88a4-5031d535b34e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:23.050630 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ba652e9f-921b-40a5-88a4-5031d535b34e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:07:23.059044 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ba652e9f-921b-40a5-88a4-5031d535b34e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:23.059531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ba652e9f-921b-40a5-88a4-5031d535b34e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:23.059972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ba652e9f-921b-40a5-88a4-5031d535b34e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:23.060668 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ba652e9f-921b-40a5-88a4-5031d535b34e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:23.064499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-310f067e-67ae-47ce-a7af-2e285354ec37 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:23.064997 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-310f067e-67ae-47ce-a7af-2e285354ec37 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:23.065437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-310f067e-67ae-47ce-a7af-2e285354ec37 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:23.066133 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-310f067e-67ae-47ce-a7af-2e285354ec37 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:23.066595 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-310f067e-67ae-47ce-a7af-2e285354ec37 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:23.067060 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-310f067e-67ae-47ce-a7af-2e285354ec37 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:23.071301 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ba652e9f-921b-40a5-88a4-5031d535b34e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:23.071742 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ba652e9f-921b-40a5-88a4-5031d535b34e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:23.195023 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ba652e9f-921b-40a5-88a4-5031d535b34e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:07:23.207924 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ba652e9f-921b-40a5-88a4-5031d535b34e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:07:23.219513 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ba652e9f-921b-40a5-88a4-5031d535b34e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:07:23.221093 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ba652e9f-921b-40a5-88a4-5031d535b34e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124" status: 200 len: 1656 microversion: 2.20 time: 0.185909 Aug 24 13:07:23.235294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1867/3740] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 13:07:23 2022] GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 => generated 1656 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:07:23.374732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-c5c38e48-b9f9-4225-a7b7-8e95866e6d33 req-95a3c945-1bb9-4254-9aee-017caa026c88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ac9d8b8-cbcb-4861-9139-e5d6f7c97124", "name": "network-vif-deleted", "tag": "4f158522-8fdb-41d0-82a1-ac1110e72623"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:07:23.410023 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-c5c38e48-b9f9-4225-a7b7-8e95866e6d33 req-95a3c945-1bb9-4254-9aee-017caa026c88 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:23.416644 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-c5c38e48-b9f9-4225-a7b7-8e95866e6d33 req-95a3c945-1bb9-4254-9aee-017caa026c88 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:23.417476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-c5c38e48-b9f9-4225-a7b7-8e95866e6d33 req-95a3c945-1bb9-4254-9aee-017caa026c88 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:23.442984 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-c5c38e48-b9f9-4225-a7b7-8e95866e6d33 req-95a3c945-1bb9-4254-9aee-017caa026c88 service nova] Creating event network-vif-deleted:4f158522-8fdb-41d0-82a1-ac1110e72623 for instance 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 on hv-cinder-84889 Aug 24 13:07:23.458566 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-c5c38e48-b9f9-4225-a7b7-8e95866e6d33 req-95a3c945-1bb9-4254-9aee-017caa026c88 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188423 Aug 24 13:07:23.459540 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1868/3741] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:07:23.549237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-310f067e-67ae-47ce-a7af-2e285354ec37 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:07:23.559942 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-310f067e-67ae-47ce-a7af-2e285354ec37 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1507 microversion: 2.1 time: 0.520593 Aug 24 13:07:23.560556 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1874/3742] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:07:23 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1507 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:07:24.056708 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-08f74ec5-53ca-44e0-b598-30ba9e1b00de req-5727ed1c-2796-4593-bc43-88d715fe611b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ddbf1cc-0de1-41f8-978c-26dd51882ff6", "name": "network-vif-deleted", "tag": "8204f260-00d2-4dec-9d81-53db68f227e8"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:07:24.066676 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-08f74ec5-53ca-44e0-b598-30ba9e1b00de req-5727ed1c-2796-4593-bc43-88d715fe611b service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:24.068227 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-08f74ec5-53ca-44e0-b598-30ba9e1b00de req-5727ed1c-2796-4593-bc43-88d715fe611b service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:24.068227 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-08f74ec5-53ca-44e0-b598-30ba9e1b00de req-5727ed1c-2796-4593-bc43-88d715fe611b service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:24.080514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-08f74ec5-53ca-44e0-b598-30ba9e1b00de req-5727ed1c-2796-4593-bc43-88d715fe611b service nova] Creating event network-vif-deleted:8204f260-00d2-4dec-9d81-53db68f227e8 for instance 1ddbf1cc-0de1-41f8-978c-26dd51882ff6 on hv-cinder-84889 Aug 24 13:07:24.085985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-08f74ec5-53ca-44e0-b598-30ba9e1b00de req-5727ed1c-2796-4593-bc43-88d715fe611b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095218 Aug 24 13:07:24.086572 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1869/3743] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:07:24.246088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-28e38d08-9755-4aab-9525-7554fbc5d5bb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:24.247225 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-28e38d08-9755-4aab-9525-7554fbc5d5bb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:07:24.254055 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-28e38d08-9755-4aab-9525-7554fbc5d5bb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:24.254871 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-28e38d08-9755-4aab-9525-7554fbc5d5bb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:24.255511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-28e38d08-9755-4aab-9525-7554fbc5d5bb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:24.256460 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-28e38d08-9755-4aab-9525-7554fbc5d5bb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:24.257331 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-28e38d08-9755-4aab-9525-7554fbc5d5bb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:24.257759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-28e38d08-9755-4aab-9525-7554fbc5d5bb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:24.297695 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-28e38d08-9755-4aab-9525-7554fbc5d5bb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:24.298282 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-28e38d08-9755-4aab-9525-7554fbc5d5bb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:24.298814 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-28e38d08-9755-4aab-9525-7554fbc5d5bb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:24.299332 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.objects.instance [None req-28e38d08-9755-4aab-9525-7554fbc5d5bb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lazy-loading 'fault' on Instance uuid 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 {{(pid=121170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:07:24.357669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-28e38d08-9755-4aab-9525-7554fbc5d5bb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:07:24.367287 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-28e38d08-9755-4aab-9525-7554fbc5d5bb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:07:24.368777 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-28e38d08-9755-4aab-9525-7554fbc5d5bb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b94f244190e4af089d070ad83806c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504b03560cf34426a08958b471c91646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:07:24.370511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-28e38d08-9755-4aab-9525-7554fbc5d5bb tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124" status: 200 len: 1371 microversion: 2.20 time: 0.128960 Aug 24 13:07:24.385322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1875/3744] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 13:07:24 2022] GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 => generated 1371 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:07:24.580924 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4ce6fb9e-32b5-4dff-a5b5-c1671ddc8d38 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:24.581686 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4ce6fb9e-32b5-4dff-a5b5-c1671ddc8d38 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:07:24.593039 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ce6fb9e-32b5-4dff-a5b5-c1671ddc8d38 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:24.593546 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ce6fb9e-32b5-4dff-a5b5-c1671ddc8d38 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:24.593992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ce6fb9e-32b5-4dff-a5b5-c1671ddc8d38 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:24.594729 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ce6fb9e-32b5-4dff-a5b5-c1671ddc8d38 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:24.595189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ce6fb9e-32b5-4dff-a5b5-c1671ddc8d38 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:24.599364 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ce6fb9e-32b5-4dff-a5b5-c1671ddc8d38 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:24.664225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4ce6fb9e-32b5-4dff-a5b5-c1671ddc8d38 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:07:24.672468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4ce6fb9e-32b5-4dff-a5b5-c1671ddc8d38 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1292 microversion: 2.1 time: 0.095715 Aug 24 13:07:24.673071 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1870/3745] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:07:24 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1292 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:07:25.395528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b35fac74-64a7-4225-8a08-477d9818992e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:25.396176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b35fac74-64a7-4225-8a08-477d9818992e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:07:25.403501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b35fac74-64a7-4225-8a08-477d9818992e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:25.404002 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b35fac74-64a7-4225-8a08-477d9818992e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:25.404454 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b35fac74-64a7-4225-8a08-477d9818992e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:25.405163 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b35fac74-64a7-4225-8a08-477d9818992e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:25.405631 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b35fac74-64a7-4225-8a08-477d9818992e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:25.406063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b35fac74-64a7-4225-8a08-477d9818992e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:25.422708 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.wsgi [None req-b35fac74-64a7-4225-8a08-477d9818992e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] HTTP exception thrown: Instance 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 could not be found. Aug 24 13:07:25.424355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b35fac74-64a7-4225-8a08-477d9818992e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Request method failure captured: Aug 24 13:07:25.424355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: request: GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 HTTP/1.1 Aug 24 13:07:25.424355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept: application/json Aug 24 13:07:25.424355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept-Encoding: identity Aug 24 13:07:25.424355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Connection: close Aug 24 13:07:25.424355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Length: 0 Aug 24 13:07:25.424355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Type: application/json Aug 24 13:07:25.424355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Host: 10.222.0.45 Aug 24 13:07:25.424355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Openstack-System-Scope: None Aug 24 13:07:25.424355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: User-Agent: python-urllib3/1.26.11 Aug 24 13:07:25.424355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Auth-Token: gAAAAABjBhnJKaqTNbHSzvEO1CYW0pj5zxPyWm1xqaULREZKzA9zs25qKPB6ZydW4KEOBX2uQS8mDSBCyuIoGAwcx_G1gDM9L5KmfP_AsFkmaS5bNE_8FNRobu2__r-ZTwBDyBR87hgDAuc4e-Jg-81UVMMN6tGto4zP74Vxch33cBe6BYGVD3o Aug 24 13:07:25.424355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Id: None Aug 24 13:07:25.424355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Name: None Aug 24 13:07:25.424355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Identity-Status: Confirmed Aug 24 13:07:25.424355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Is-Admin-Project: True Aug 24 13:07:25.424355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 13:07:25.424355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Id: default Aug 24 13:07:25.424355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Name: Default Aug 24 13:07:25.424355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Id: 504b03560cf34426a08958b471c91646 Aug 24 13:07:25.424355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-114073641 Aug 24 13:07:25.424355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Role: member,reader Aug 24 13:07:25.424355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Roles: member,reader Aug 24 13:07:25.425564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_504b03560cf34426a08958b471c91646"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/504b03560cf34426a08958b471c91646"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/504b03560cf34426a08958b471c91646"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/504b03560cf34426a08958b471c91646"}]}] Aug 24 13:07:25.425564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant: tempest-AttachVolumeShelveTestJSON-114073641 Aug 24 13:07:25.425564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Id: 504b03560cf34426a08958b471c91646 Aug 24 13:07:25.425564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-114073641 Aug 24 13:07:25.425564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User: tempest-AttachVolumeShelveTestJSON-114073641-project Aug 24 13:07:25.425564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Id: default Aug 24 13:07:25.425564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Name: Default Aug 24 13:07:25.425564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Id: 6b94f244190e4af089d070ad83806c38 Aug 24 13:07:25.425564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Name: tempest-AttachVolumeShelveTestJSON-114073641-project Aug 24 13:07:25.425564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: method: > Aug 24 13:07:25.425564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: exception: Instance 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 could not be found. Aug 24 13:07:25.425564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: action_args: {'id': '2ac9d8b8-cbcb-4861-9139-e5d6f7c97124'} Aug 24 13:07:25.426279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:07:25.426279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:25.426279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:07:25.426279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:07:25.426279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:07:25.426279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:07:25.426279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:07:25.426279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:07:25.426279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:07:25.426279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:07:25.426279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 could not be found. Aug 24 13:07:25.426279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:25.426279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:07:25.426279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:25.426279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:25.426279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:07:25.426279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:07:25.426279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:07:25.426279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:07:25.426279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:07:25.427755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:07:25.427755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:07:25.427755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:07:25.427755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:07:25.427755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:07:25.427755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:07:25.427755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:07:25.427755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 could not be found. Aug 24 13:07:25.427755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:25.427755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:07:25.427755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:25.427755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:25.427755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:07:25.427755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:07:25.427755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:07:25.427755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:07:25.427755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 could not be found. Aug 24 13:07:25.427755 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:25.428717 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b35fac74-64a7-4225-8a08-477d9818992e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Returning 404 to user: Instance 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 could not be found. {{(pid=121170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:07:25.428717 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b35fac74-64a7-4225-8a08-477d9818992e tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124" status: 404 len: 111 microversion: 2.20 time: 0.034339 Aug 24 13:07:25.428717 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1876/3746] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 13:07:25 2022] GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 13:07:25.434743 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9aa61d8a-343a-4eae-901a-7bf525e5b3ef tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '.version_select at 0x7f76f9cd4160>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:25.526199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-b0a07745-ab13-4970-ad51-999edc299d1b req-20c54e80-2291-4b3b-a0cc-b8a16ddf5e5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50cb23a1-9864-46ef-ae19-411f522e9f10", "name": "network-vif-deleted", "tag": "4fe23f91-93ad-4bd1-9b29-2d302a44a9c9"}, {"server_uuid": "b9fbb4c1-a035-462e-b287-be4131984b09", "name": "network-vif-deleted", "tag": "b27a0942-207a-439e-b81b-5254e8176d43"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:07:25.537049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-b0a07745-ab13-4970-ad51-999edc299d1b req-20c54e80-2291-4b3b-a0cc-b8a16ddf5e5f service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:25.537481 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9aa61d8a-343a-4eae-901a-7bf525e5b3ef tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-744678341" status: 204 len: 0 microversion: 2.20 time: 0.106616 Aug 24 13:07:25.542902 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-b0a07745-ab13-4970-ad51-999edc299d1b req-20c54e80-2291-4b3b-a0cc-b8a16ddf5e5f service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:25.542902 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-b0a07745-ab13-4970-ad51-999edc299d1b req-20c54e80-2291-4b3b-a0cc-b8a16ddf5e5f service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:25.543618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1871/3747] 10.222.0.45 () {60 vars in 1259 bytes} [Wed Aug 24 13:07:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-744678341 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 13:07:25.551388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-b0a07745-ab13-4970-ad51-999edc299d1b req-20c54e80-2291-4b3b-a0cc-b8a16ddf5e5f service nova] Creating event network-vif-deleted:4fe23f91-93ad-4bd1-9b29-2d302a44a9c9 for instance 50cb23a1-9864-46ef-ae19-411f522e9f10 on hv-cinder-84889 Aug 24 13:07:25.551890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-b0a07745-ab13-4970-ad51-999edc299d1b req-20c54e80-2291-4b3b-a0cc-b8a16ddf5e5f service nova] Creating event network-vif-deleted:b27a0942-207a-439e-b81b-5254e8176d43 for instance b9fbb4c1-a035-462e-b287-be4131984b09 on hv-cinder-84889 Aug 24 13:07:25.559641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-b0a07745-ab13-4970-ad51-999edc299d1b req-20c54e80-2291-4b3b-a0cc-b8a16ddf5e5f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037035 Aug 24 13:07:25.560227 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1877/3748] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:07:25.693573 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-34acb902-c2a4-4264-b7fc-1228877d70bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:25.694108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-34acb902-c2a4-4264-b7fc-1228877d70bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:07:25.700920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-34acb902-c2a4-4264-b7fc-1228877d70bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:25.701409 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-34acb902-c2a4-4264-b7fc-1228877d70bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:25.701851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-34acb902-c2a4-4264-b7fc-1228877d70bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:25.702542 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-34acb902-c2a4-4264-b7fc-1228877d70bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:25.703030 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-34acb902-c2a4-4264-b7fc-1228877d70bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:25.703460 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-34acb902-c2a4-4264-b7fc-1228877d70bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:25.734046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-34acb902-c2a4-4264-b7fc-1228877d70bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:25.734524 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-34acb902-c2a4-4264-b7fc-1228877d70bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:25.734986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-34acb902-c2a4-4264-b7fc-1228877d70bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:25.735435 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.objects.instance [None req-34acb902-c2a4-4264-b7fc-1228877d70bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lazy-loading 'fault' on Instance uuid 1ddbf1cc-0de1-41f8-978c-26dd51882ff6 {{(pid=121171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:07:25.791238 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-34acb902-c2a4-4264-b7fc-1228877d70bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:07:25.797691 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-34acb902-c2a4-4264-b7fc-1228877d70bb tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 200 len: 1311 microversion: 2.1 time: 0.108172 Aug 24 13:07:25.798697 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1872/3749] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:07:25 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 1311 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:07:26.106197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-ba4cab5b-00d3-4765-91be-47e2aa2c27b2 req-8bdb80ed-8bd2-430e-8d02-f52c17f305a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ce2c0c-40e5-45d1-b2a6-ad30617badb4", "name": "network-vif-deleted", "tag": "4f48e5e7-3a0c-4f05-abe0-02ba501d8cfd"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:07:26.153429 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-ba4cab5b-00d3-4765-91be-47e2aa2c27b2 req-8bdb80ed-8bd2-430e-8d02-f52c17f305a6 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:26.154298 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-ba4cab5b-00d3-4765-91be-47e2aa2c27b2 req-8bdb80ed-8bd2-430e-8d02-f52c17f305a6 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:26.154955 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-ba4cab5b-00d3-4765-91be-47e2aa2c27b2 req-8bdb80ed-8bd2-430e-8d02-f52c17f305a6 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:26.185696 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-ba4cab5b-00d3-4765-91be-47e2aa2c27b2 req-8bdb80ed-8bd2-430e-8d02-f52c17f305a6 service nova] Creating event network-vif-deleted:4f48e5e7-3a0c-4f05-abe0-02ba501d8cfd for instance 29ce2c0c-40e5-45d1-b2a6-ad30617badb4 on hv-cinder-84889 Aug 24 13:07:26.192301 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-ba4cab5b-00d3-4765-91be-47e2aa2c27b2 req-8bdb80ed-8bd2-430e-8d02-f52c17f305a6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093391 Aug 24 13:07:26.192946 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1878/3750] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:07:26.818241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b0549780-dcfc-4fb6-96f1-462e5b4025a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:26.818903 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b0549780-dcfc-4fb6-96f1-462e5b4025a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: 1ddbf1cc-0de1-41f8-978c-26dd51882ff6] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:07:26.826702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b0549780-dcfc-4fb6-96f1-462e5b4025a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:26.827198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b0549780-dcfc-4fb6-96f1-462e5b4025a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:26.827642 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b0549780-dcfc-4fb6-96f1-462e5b4025a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:26.828348 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b0549780-dcfc-4fb6-96f1-462e5b4025a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:26.828803 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b0549780-dcfc-4fb6-96f1-462e5b4025a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:26.829304 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b0549780-dcfc-4fb6-96f1-462e5b4025a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:26.843007 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.wsgi [None req-b0549780-dcfc-4fb6-96f1-462e5b4025a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] HTTP exception thrown: Instance 1ddbf1cc-0de1-41f8-978c-26dd51882ff6 could not be found. Aug 24 13:07:26.844662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b0549780-dcfc-4fb6-96f1-462e5b4025a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Request method failure captured: Aug 24 13:07:26.844662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: request: GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 HTTP/1.1 Aug 24 13:07:26.844662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept: application/json Aug 24 13:07:26.844662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept-Encoding: identity Aug 24 13:07:26.844662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Connection: close Aug 24 13:07:26.844662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Length: 0 Aug 24 13:07:26.844662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Type: application/json Aug 24 13:07:26.844662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Host: 10.222.0.45 Aug 24 13:07:26.844662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Openstack-System-Scope: None Aug 24 13:07:26.844662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: User-Agent: python-urllib3/1.26.11 Aug 24 13:07:26.844662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Auth-Token: gAAAAABjBhnPiCoZSEe7wmjTe8U9xlUJz4a5Mp48qYy-cXBN9SdubzuznlpWDZlq64yvw-1br5IS5M11o055Otgjl3rpsAMlh8QWB47vk-vMvC9oSLyFSNPSBKLMaQ10tN_kbVVupvSgWrx6NZcM-VEx1q4Wa9x9_sEvmqQpKFDCK4_ukrJvtn4 Aug 24 13:07:26.844662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Id: None Aug 24 13:07:26.844662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Name: None Aug 24 13:07:26.844662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Identity-Status: Confirmed Aug 24 13:07:26.844662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Is-Admin-Project: True Aug 24 13:07:26.844662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Id: default Aug 24 13:07:26.844662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Name: Default Aug 24 13:07:26.844662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Id: 99f0beb902e4472eae20f0e6c8dc3340 Aug 24 13:07:26.844662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1902039323 Aug 24 13:07:26.844662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Role: member,reader Aug 24 13:07:26.844662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Roles: member,reader Aug 24 13:07:26.845929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_99f0beb902e4472eae20f0e6c8dc3340"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99f0beb902e4472eae20f0e6c8dc3340"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/99f0beb902e4472eae20f0e6c8dc3340"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99f0beb902e4472eae20f0e6c8dc3340"}]}] Aug 24 13:07:26.845929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1902039323 Aug 24 13:07:26.845929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Id: 99f0beb902e4472eae20f0e6c8dc3340 Aug 24 13:07:26.845929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1902039323 Aug 24 13:07:26.845929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User: tempest-ServerRescueNegativeTestJSON-1902039323-project Aug 24 13:07:26.845929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Id: default Aug 24 13:07:26.845929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Name: Default Aug 24 13:07:26.845929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Id: b9252893998a490689497697663ca4d2 Aug 24 13:07:26.845929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1902039323-project Aug 24 13:07:26.845929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: method: > Aug 24 13:07:26.845929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: exception: Instance 1ddbf1cc-0de1-41f8-978c-26dd51882ff6 could not be found. Aug 24 13:07:26.845929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: action_args: {'id': '1ddbf1cc-0de1-41f8-978c-26dd51882ff6'} Aug 24 13:07:26.846839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:07:26.846839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:26.846839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:07:26.846839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:07:26.846839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:07:26.846839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:07:26.846839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:07:26.846839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:07:26.846839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:07:26.846839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:07:26.846839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ddbf1cc-0de1-41f8-978c-26dd51882ff6 could not be found. Aug 24 13:07:26.846839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:26.846839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:07:26.846839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:26.846839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:26.846839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:07:26.846839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:07:26.846839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:07:26.846839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:07:26.846839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:07:26.848149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:07:26.848149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:07:26.848149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:07:26.848149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:07:26.848149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:07:26.848149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:07:26.848149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:07:26.848149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ddbf1cc-0de1-41f8-978c-26dd51882ff6 could not be found. Aug 24 13:07:26.848149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:26.848149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:07:26.848149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:26.848149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:26.848149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:07:26.848149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:07:26.848149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:07:26.848149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:07:26.848149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ddbf1cc-0de1-41f8-978c-26dd51882ff6 could not be found. Aug 24 13:07:26.848149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:26.849363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b0549780-dcfc-4fb6-96f1-462e5b4025a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Returning 404 to user: Instance 1ddbf1cc-0de1-41f8-978c-26dd51882ff6 could not be found. {{(pid=121171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:07:26.849363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b0549780-dcfc-4fb6-96f1-462e5b4025a4 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6" status: 404 len: 111 microversion: 2.1 time: 0.031862 Aug 24 13:07:26.849363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1873/3751] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:07:26 2022] GET /compute/v2.1/servers/1ddbf1cc-0de1-41f8-978c-26dd51882ff6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:07:26.857934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6d512e6b-cd4d-4c1f-bd25-861f939f2bd8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:26.857934 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6d512e6b-cd4d-4c1f-bd25-861f939f2bd8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:07:26.864266 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d512e6b-cd4d-4c1f-bd25-861f939f2bd8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:26.864894 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d512e6b-cd4d-4c1f-bd25-861f939f2bd8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:26.865336 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d512e6b-cd4d-4c1f-bd25-861f939f2bd8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:26.866021 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d512e6b-cd4d-4c1f-bd25-861f939f2bd8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:26.867105 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d512e6b-cd4d-4c1f-bd25-861f939f2bd8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:26.867546 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6d512e6b-cd4d-4c1f-bd25-861f939f2bd8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:26.892087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6d512e6b-cd4d-4c1f-bd25-861f939f2bd8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Going to try to terminate instance {{(pid=121170) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 13:07:27.187887 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6d512e6b-cd4d-4c1f-bd25-861f939f2bd8 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 204 len: 0 microversion: 2.1 time: 0.335596 Aug 24 13:07:27.188571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1879/3752] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 13:07:26 2022] DELETE /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 13:07:27.196780 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2dcb93f0-6fe1-40da-80fb-d28dfaf020c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:27.197391 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2dcb93f0-6fe1-40da-80fb-d28dfaf020c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:07:27.203334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2dcb93f0-6fe1-40da-80fb-d28dfaf020c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:27.203815 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2dcb93f0-6fe1-40da-80fb-d28dfaf020c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:27.204254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2dcb93f0-6fe1-40da-80fb-d28dfaf020c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:27.204928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2dcb93f0-6fe1-40da-80fb-d28dfaf020c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:27.205385 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2dcb93f0-6fe1-40da-80fb-d28dfaf020c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:27.205812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2dcb93f0-6fe1-40da-80fb-d28dfaf020c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:27.335587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2dcb93f0-6fe1-40da-80fb-d28dfaf020c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:07:27.343375 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2dcb93f0-6fe1-40da-80fb-d28dfaf020c2 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1520 microversion: 2.1 time: 0.150532 Aug 24 13:07:27.343930 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1874/3753] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:07:27 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:07:27.713991 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-67811b37-e068-4c78-8d62-6bab49d54c69 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:27.714571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-67811b37-e068-4c78-8d62-6bab49d54c69 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:07:27.720336 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67811b37-e068-4c78-8d62-6bab49d54c69 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:27.720821 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67811b37-e068-4c78-8d62-6bab49d54c69 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:27.721253 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67811b37-e068-4c78-8d62-6bab49d54c69 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:27.721923 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67811b37-e068-4c78-8d62-6bab49d54c69 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:27.722372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67811b37-e068-4c78-8d62-6bab49d54c69 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:27.722822 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-67811b37-e068-4c78-8d62-6bab49d54c69 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:27.736766 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.wsgi [None req-67811b37-e068-4c78-8d62-6bab49d54c69 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] HTTP exception thrown: Instance 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 could not be found. Aug 24 13:07:27.738363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-67811b37-e068-4c78-8d62-6bab49d54c69 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Request method failure captured: Aug 24 13:07:27.738363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: request: DELETE /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 HTTP/1.1 Aug 24 13:07:27.738363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept: application/json Aug 24 13:07:27.738363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept-Encoding: identity Aug 24 13:07:27.738363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Connection: close Aug 24 13:07:27.738363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Length: 0 Aug 24 13:07:27.738363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Type: application/json Aug 24 13:07:27.738363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Host: 10.222.0.45 Aug 24 13:07:27.738363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Openstack-System-Scope: None Aug 24 13:07:27.738363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: User-Agent: python-urllib3/1.26.11 Aug 24 13:07:27.738363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Auth-Token: gAAAAABjBhnJKaqTNbHSzvEO1CYW0pj5zxPyWm1xqaULREZKzA9zs25qKPB6ZydW4KEOBX2uQS8mDSBCyuIoGAwcx_G1gDM9L5KmfP_AsFkmaS5bNE_8FNRobu2__r-ZTwBDyBR87hgDAuc4e-Jg-81UVMMN6tGto4zP74Vxch33cBe6BYGVD3o Aug 24 13:07:27.738363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Id: None Aug 24 13:07:27.738363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Name: None Aug 24 13:07:27.738363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Identity-Status: Confirmed Aug 24 13:07:27.738363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Is-Admin-Project: True Aug 24 13:07:27.738363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 13:07:27.738363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Id: default Aug 24 13:07:27.738363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Name: Default Aug 24 13:07:27.738363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Id: 504b03560cf34426a08958b471c91646 Aug 24 13:07:27.738363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-114073641 Aug 24 13:07:27.738363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Role: member,reader Aug 24 13:07:27.738363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Roles: member,reader Aug 24 13:07:27.739864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_504b03560cf34426a08958b471c91646"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/504b03560cf34426a08958b471c91646"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/504b03560cf34426a08958b471c91646"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/504b03560cf34426a08958b471c91646"}]}] Aug 24 13:07:27.739864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant: tempest-AttachVolumeShelveTestJSON-114073641 Aug 24 13:07:27.739864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Id: 504b03560cf34426a08958b471c91646 Aug 24 13:07:27.739864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-114073641 Aug 24 13:07:27.739864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User: tempest-AttachVolumeShelveTestJSON-114073641-project Aug 24 13:07:27.739864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Id: default Aug 24 13:07:27.739864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Name: Default Aug 24 13:07:27.739864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Id: 6b94f244190e4af089d070ad83806c38 Aug 24 13:07:27.739864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Name: tempest-AttachVolumeShelveTestJSON-114073641-project Aug 24 13:07:27.739864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: method: > Aug 24 13:07:27.739864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: exception: Instance 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 could not be found. Aug 24 13:07:27.739864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: action_args: {'id': '2ac9d8b8-cbcb-4861-9139-e5d6f7c97124'} Aug 24 13:07:27.740551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:07:27.740551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:27.740551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:07:27.740551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:07:27.740551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:07:27.740551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:07:27.740551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:07:27.740551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:07:27.740551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:07:27.740551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:07:27.740551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 could not be found. Aug 24 13:07:27.740551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:27.740551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:07:27.740551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:27.740551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:27.740551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:07:27.740551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:07:27.740551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:07:27.740551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:07:27.740551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:07:27.741613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:07:27.741613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 13:07:27.741613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 13:07:27.741613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 13:07:27.741613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 13:07:27.741613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:07:27.741613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:07:27.741613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:07:27.741613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:07:27.741613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 could not be found. Aug 24 13:07:27.741613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:27.741613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:07:27.741613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:27.741613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:27.741613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:07:27.741613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:07:27.741613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:07:27.741613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:07:27.741613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 could not be found. Aug 24 13:07:27.741613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:27.742625 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-67811b37-e068-4c78-8d62-6bab49d54c69 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Returning 404 to user: Instance 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 could not be found. {{(pid=121170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:07:27.742625 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-67811b37-e068-4c78-8d62-6bab49d54c69 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124" status: 404 len: 111 microversion: 2.20 time: 0.030418 Aug 24 13:07:27.742625 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1880/3754] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Aug 24 13:07:27 2022] DELETE /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 13:07:27.748113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-feaa5ff1-4782-44ba-bc00-fdd91fcb9b18 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:27.748750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-feaa5ff1-4782-44ba-bc00-fdd91fcb9b18 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:07:27.754801 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-feaa5ff1-4782-44ba-bc00-fdd91fcb9b18 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:27.755280 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-feaa5ff1-4782-44ba-bc00-fdd91fcb9b18 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:27.755711 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-feaa5ff1-4782-44ba-bc00-fdd91fcb9b18 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:27.756384 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-feaa5ff1-4782-44ba-bc00-fdd91fcb9b18 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:27.756856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-feaa5ff1-4782-44ba-bc00-fdd91fcb9b18 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:27.757343 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-feaa5ff1-4782-44ba-bc00-fdd91fcb9b18 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:27.770480 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.wsgi [None req-feaa5ff1-4782-44ba-bc00-fdd91fcb9b18 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] HTTP exception thrown: Instance 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 could not be found. Aug 24 13:07:27.772014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-feaa5ff1-4782-44ba-bc00-fdd91fcb9b18 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Request method failure captured: Aug 24 13:07:27.772014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: request: GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 HTTP/1.1 Aug 24 13:07:27.772014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept: application/json Aug 24 13:07:27.772014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept-Encoding: identity Aug 24 13:07:27.772014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Connection: close Aug 24 13:07:27.772014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Length: 0 Aug 24 13:07:27.772014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Type: application/json Aug 24 13:07:27.772014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Host: 10.222.0.45 Aug 24 13:07:27.772014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Openstack-System-Scope: None Aug 24 13:07:27.772014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: User-Agent: python-urllib3/1.26.11 Aug 24 13:07:27.772014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Auth-Token: gAAAAABjBhnJKaqTNbHSzvEO1CYW0pj5zxPyWm1xqaULREZKzA9zs25qKPB6ZydW4KEOBX2uQS8mDSBCyuIoGAwcx_G1gDM9L5KmfP_AsFkmaS5bNE_8FNRobu2__r-ZTwBDyBR87hgDAuc4e-Jg-81UVMMN6tGto4zP74Vxch33cBe6BYGVD3o Aug 24 13:07:27.772014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Id: None Aug 24 13:07:27.772014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Name: None Aug 24 13:07:27.772014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Identity-Status: Confirmed Aug 24 13:07:27.772014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Is-Admin-Project: True Aug 24 13:07:27.772014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 13:07:27.772014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Id: default Aug 24 13:07:27.772014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Name: Default Aug 24 13:07:27.772014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Id: 504b03560cf34426a08958b471c91646 Aug 24 13:07:27.772014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-114073641 Aug 24 13:07:27.772014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Role: member,reader Aug 24 13:07:27.772014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Roles: member,reader Aug 24 13:07:27.774029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_504b03560cf34426a08958b471c91646"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/504b03560cf34426a08958b471c91646"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/504b03560cf34426a08958b471c91646"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/504b03560cf34426a08958b471c91646"}]}] Aug 24 13:07:27.774029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant: tempest-AttachVolumeShelveTestJSON-114073641 Aug 24 13:07:27.774029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Id: 504b03560cf34426a08958b471c91646 Aug 24 13:07:27.774029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-114073641 Aug 24 13:07:27.774029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User: tempest-AttachVolumeShelveTestJSON-114073641-project Aug 24 13:07:27.774029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Id: default Aug 24 13:07:27.774029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Name: Default Aug 24 13:07:27.774029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Id: 6b94f244190e4af089d070ad83806c38 Aug 24 13:07:27.774029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Name: tempest-AttachVolumeShelveTestJSON-114073641-project Aug 24 13:07:27.774029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: method: > Aug 24 13:07:27.774029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: exception: Instance 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 could not be found. Aug 24 13:07:27.774029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: action_args: {'id': '2ac9d8b8-cbcb-4861-9139-e5d6f7c97124'} Aug 24 13:07:27.774831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:07:27.774831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:27.774831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:07:27.774831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:07:27.774831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:07:27.774831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:07:27.774831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:07:27.774831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:07:27.774831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:07:27.774831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:07:27.774831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 could not be found. Aug 24 13:07:27.774831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:27.774831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:07:27.774831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:27.774831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:27.774831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:07:27.774831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:07:27.774831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:07:27.774831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:07:27.774831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:07:27.776201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:07:27.776201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:07:27.776201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:07:27.776201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:07:27.776201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:07:27.776201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:07:27.776201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:07:27.776201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 could not be found. Aug 24 13:07:27.776201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:27.776201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:07:27.776201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:27.776201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:27.776201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:07:27.776201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:07:27.776201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:07:27.776201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:07:27.776201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 could not be found. Aug 24 13:07:27.776201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:27.777518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-feaa5ff1-4782-44ba-bc00-fdd91fcb9b18 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Returning 404 to user: Instance 2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 could not be found. {{(pid=121171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:07:27.777518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-feaa5ff1-4782-44ba-bc00-fdd91fcb9b18 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124" status: 404 len: 111 microversion: 2.20 time: 0.029849 Aug 24 13:07:27.777518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1875/3755] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 13:07:27 2022] GET /compute/v2.1/servers/2ac9d8b8-cbcb-4861-9139-e5d6f7c97124 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 13:07:28.364472 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fa6aa028-ed43-41fd-8c99-65402cb1b288 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:28.365202 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fa6aa028-ed43-41fd-8c99-65402cb1b288 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:07:28.372170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa6aa028-ed43-41fd-8c99-65402cb1b288 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:28.372663 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa6aa028-ed43-41fd-8c99-65402cb1b288 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:28.373108 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa6aa028-ed43-41fd-8c99-65402cb1b288 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:28.373805 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa6aa028-ed43-41fd-8c99-65402cb1b288 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:28.374272 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa6aa028-ed43-41fd-8c99-65402cb1b288 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:28.374783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fa6aa028-ed43-41fd-8c99-65402cb1b288 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:28.507626 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fa6aa028-ed43-41fd-8c99-65402cb1b288 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:07:28.515381 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fa6aa028-ed43-41fd-8c99-65402cb1b288 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1520 microversion: 2.1 time: 0.154750 Aug 24 13:07:28.515947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1881/3756] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:07:28 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:07:28.613126 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-cc871925-c07d-4fe9-a999-c334c33f4633 req-a0173920-1ede-42b5-b99c-4e46751d403b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7228012-d37e-4a5c-bc05-791ad60259e3", "name": "network-vif-deleted", "tag": "e9ca9e07-b749-44a3-bfea-cce9e380dd63"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:07:28.622574 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-cc871925-c07d-4fe9-a999-c334c33f4633 req-a0173920-1ede-42b5-b99c-4e46751d403b service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:28.623070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-cc871925-c07d-4fe9-a999-c334c33f4633 req-a0173920-1ede-42b5-b99c-4e46751d403b service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:28.623493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-cc871925-c07d-4fe9-a999-c334c33f4633 req-a0173920-1ede-42b5-b99c-4e46751d403b service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:28.636462 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-cc871925-c07d-4fe9-a999-c334c33f4633 req-a0173920-1ede-42b5-b99c-4e46751d403b service nova] Creating event network-vif-deleted:e9ca9e07-b749-44a3-bfea-cce9e380dd63 for instance e7228012-d37e-4a5c-bc05-791ad60259e3 on hv-cinder-84889 Aug 24 13:07:28.641598 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-cc871925-c07d-4fe9-a999-c334c33f4633 req-a0173920-1ede-42b5-b99c-4e46751d403b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032873 Aug 24 13:07:28.642192 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1876/3757] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:07:29.028046 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f3755b8f-7803-432b-ae87-7e9190884711 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:29.028546 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f3755b8f-7803-432b-ae87-7e9190884711 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:07:29.034502 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3755b8f-7803-432b-ae87-7e9190884711 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:29.035088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3755b8f-7803-432b-ae87-7e9190884711 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:29.042661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3755b8f-7803-432b-ae87-7e9190884711 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:29.042661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3755b8f-7803-432b-ae87-7e9190884711 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:29.042661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3755b8f-7803-432b-ae87-7e9190884711 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:29.042661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3755b8f-7803-432b-ae87-7e9190884711 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:29.050574 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.wsgi [None req-f3755b8f-7803-432b-ae87-7e9190884711 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] HTTP exception thrown: Instance 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 could not be found. Aug 24 13:07:29.052175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f3755b8f-7803-432b-ae87-7e9190884711 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Request method failure captured: Aug 24 13:07:29.052175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: request: DELETE /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 HTTP/1.1 Aug 24 13:07:29.052175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept: application/json Aug 24 13:07:29.052175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept-Encoding: identity Aug 24 13:07:29.052175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Connection: close Aug 24 13:07:29.052175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Length: 0 Aug 24 13:07:29.052175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Type: application/json Aug 24 13:07:29.052175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Host: 10.222.0.45 Aug 24 13:07:29.052175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Openstack-System-Scope: None Aug 24 13:07:29.052175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: User-Agent: python-urllib3/1.26.11 Aug 24 13:07:29.052175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Auth-Token: gAAAAABjBhnJKaqTNbHSzvEO1CYW0pj5zxPyWm1xqaULREZKzA9zs25qKPB6ZydW4KEOBX2uQS8mDSBCyuIoGAwcx_G1gDM9L5KmfP_AsFkmaS5bNE_8FNRobu2__r-ZTwBDyBR87hgDAuc4e-Jg-81UVMMN6tGto4zP74Vxch33cBe6BYGVD3o Aug 24 13:07:29.052175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Id: None Aug 24 13:07:29.052175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Name: None Aug 24 13:07:29.052175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Identity-Status: Confirmed Aug 24 13:07:29.052175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Is-Admin-Project: True Aug 24 13:07:29.052175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 13:07:29.052175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Id: default Aug 24 13:07:29.052175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Name: Default Aug 24 13:07:29.052175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Id: 504b03560cf34426a08958b471c91646 Aug 24 13:07:29.052175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-114073641 Aug 24 13:07:29.052175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Role: member,reader Aug 24 13:07:29.052175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Roles: member,reader Aug 24 13:07:29.053582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_504b03560cf34426a08958b471c91646"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/504b03560cf34426a08958b471c91646"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/504b03560cf34426a08958b471c91646"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/504b03560cf34426a08958b471c91646"}]}] Aug 24 13:07:29.053582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant: tempest-AttachVolumeShelveTestJSON-114073641 Aug 24 13:07:29.053582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Id: 504b03560cf34426a08958b471c91646 Aug 24 13:07:29.053582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-114073641 Aug 24 13:07:29.053582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User: tempest-AttachVolumeShelveTestJSON-114073641-project Aug 24 13:07:29.053582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Id: default Aug 24 13:07:29.053582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Name: Default Aug 24 13:07:29.053582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Id: 6b94f244190e4af089d070ad83806c38 Aug 24 13:07:29.053582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Name: tempest-AttachVolumeShelveTestJSON-114073641-project Aug 24 13:07:29.053582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: method: > Aug 24 13:07:29.053582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: exception: Instance 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 could not be found. Aug 24 13:07:29.053582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: action_args: {'id': '8e5a10ee-202a-453e-b3ff-6c5c05ec72f3'} Aug 24 13:07:29.054633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:07:29.054633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:29.054633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:07:29.054633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:07:29.054633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:07:29.054633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:07:29.054633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:07:29.054633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:07:29.054633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:07:29.054633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:07:29.054633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 could not be found. Aug 24 13:07:29.054633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:29.054633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:07:29.054633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:29.054633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:29.054633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:07:29.054633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:07:29.054633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:07:29.054633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:07:29.054633 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:07:29.056388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:07:29.056388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 13:07:29.056388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 13:07:29.056388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 13:07:29.056388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 13:07:29.056388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:07:29.056388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:07:29.056388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:07:29.056388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:07:29.056388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 could not be found. Aug 24 13:07:29.056388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:29.056388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:07:29.056388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:29.056388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:29.056388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:07:29.056388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:07:29.056388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:07:29.056388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:07:29.056388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 could not be found. Aug 24 13:07:29.056388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:29.057789 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f3755b8f-7803-432b-ae87-7e9190884711 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Returning 404 to user: Instance 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 could not be found. {{(pid=121170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:07:29.057789 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f3755b8f-7803-432b-ae87-7e9190884711 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 404 len: 111 microversion: 2.20 time: 0.029334 Aug 24 13:07:29.057789 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1882/3758] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Aug 24 13:07:29 2022] DELETE /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 13:07:29.062406 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4bf5bd02-4a34-4048-888b-4325505551a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:29.063140 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4bf5bd02-4a34-4048-888b-4325505551a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] [instance: 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:07:29.071942 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4bf5bd02-4a34-4048-888b-4325505551a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:29.072437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4bf5bd02-4a34-4048-888b-4325505551a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:29.072876 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4bf5bd02-4a34-4048-888b-4325505551a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:29.073568 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4bf5bd02-4a34-4048-888b-4325505551a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:29.074023 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4bf5bd02-4a34-4048-888b-4325505551a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:29.074447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4bf5bd02-4a34-4048-888b-4325505551a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:29.088413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.wsgi [None req-4bf5bd02-4a34-4048-888b-4325505551a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] HTTP exception thrown: Instance 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 could not be found. Aug 24 13:07:29.090036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4bf5bd02-4a34-4048-888b-4325505551a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Request method failure captured: Aug 24 13:07:29.090036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: request: GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 HTTP/1.1 Aug 24 13:07:29.090036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept: application/json Aug 24 13:07:29.090036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept-Encoding: identity Aug 24 13:07:29.090036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Connection: close Aug 24 13:07:29.090036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Length: 0 Aug 24 13:07:29.090036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Type: application/json Aug 24 13:07:29.090036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Host: 10.222.0.45 Aug 24 13:07:29.090036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Openstack-System-Scope: None Aug 24 13:07:29.090036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: User-Agent: python-urllib3/1.26.11 Aug 24 13:07:29.090036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Auth-Token: gAAAAABjBhnJKaqTNbHSzvEO1CYW0pj5zxPyWm1xqaULREZKzA9zs25qKPB6ZydW4KEOBX2uQS8mDSBCyuIoGAwcx_G1gDM9L5KmfP_AsFkmaS5bNE_8FNRobu2__r-ZTwBDyBR87hgDAuc4e-Jg-81UVMMN6tGto4zP74Vxch33cBe6BYGVD3o Aug 24 13:07:29.090036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Id: None Aug 24 13:07:29.090036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Name: None Aug 24 13:07:29.090036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Identity-Status: Confirmed Aug 24 13:07:29.090036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Is-Admin-Project: True Aug 24 13:07:29.090036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 13:07:29.090036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Id: default Aug 24 13:07:29.090036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Name: Default Aug 24 13:07:29.090036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Id: 504b03560cf34426a08958b471c91646 Aug 24 13:07:29.090036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-114073641 Aug 24 13:07:29.090036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Role: member,reader Aug 24 13:07:29.090036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Roles: member,reader Aug 24 13:07:29.091522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_504b03560cf34426a08958b471c91646"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/504b03560cf34426a08958b471c91646"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/504b03560cf34426a08958b471c91646"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/504b03560cf34426a08958b471c91646"}]}] Aug 24 13:07:29.091522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant: tempest-AttachVolumeShelveTestJSON-114073641 Aug 24 13:07:29.091522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Id: 504b03560cf34426a08958b471c91646 Aug 24 13:07:29.091522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-114073641 Aug 24 13:07:29.091522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User: tempest-AttachVolumeShelveTestJSON-114073641-project Aug 24 13:07:29.091522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Id: default Aug 24 13:07:29.091522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Name: Default Aug 24 13:07:29.091522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Id: 6b94f244190e4af089d070ad83806c38 Aug 24 13:07:29.091522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Name: tempest-AttachVolumeShelveTestJSON-114073641-project Aug 24 13:07:29.091522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: method: > Aug 24 13:07:29.091522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: exception: Instance 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 could not be found. Aug 24 13:07:29.091522 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: action_args: {'id': '8e5a10ee-202a-453e-b3ff-6c5c05ec72f3'} Aug 24 13:07:29.092305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:07:29.092305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:29.092305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:07:29.092305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:07:29.092305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:07:29.092305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:07:29.092305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:07:29.092305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:07:29.092305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:07:29.092305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:07:29.092305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 could not be found. Aug 24 13:07:29.092305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:29.092305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:07:29.092305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:29.092305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:29.092305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:07:29.092305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:07:29.092305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:07:29.092305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:07:29.092305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:07:29.093578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:07:29.093578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:07:29.093578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:07:29.093578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:07:29.093578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:07:29.093578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:07:29.093578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:07:29.093578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 could not be found. Aug 24 13:07:29.093578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:29.093578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:07:29.093578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:29.093578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:29.093578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:07:29.093578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:07:29.093578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:07:29.093578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:07:29.093578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 could not be found. Aug 24 13:07:29.093578 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:29.094765 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4bf5bd02-4a34-4048-888b-4325505551a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] Returning 404 to user: Instance 8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 could not be found. {{(pid=121171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:07:29.094765 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4bf5bd02-4a34-4048-888b-4325505551a3 tempest-AttachVolumeShelveTestJSON-114073641 tempest-AttachVolumeShelveTestJSON-114073641-project] 10.222.0.45 "GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3" status: 404 len: 111 microversion: 2.20 time: 0.033212 Aug 24 13:07:29.094765 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1877/3759] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 24 13:07:29 2022] GET /compute/v2.1/servers/8e5a10ee-202a-453e-b3ff-6c5c05ec72f3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 13:07:29.536228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f17821db-fda9-46de-9bc4-92409d034657 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:29.537112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f17821db-fda9-46de-9bc4-92409d034657 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:07:29.544025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f17821db-fda9-46de-9bc4-92409d034657 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:29.544517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f17821db-fda9-46de-9bc4-92409d034657 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:29.544957 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f17821db-fda9-46de-9bc4-92409d034657 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:29.545662 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f17821db-fda9-46de-9bc4-92409d034657 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:29.546125 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f17821db-fda9-46de-9bc4-92409d034657 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:29.546612 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f17821db-fda9-46de-9bc4-92409d034657 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:29.581970 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f17821db-fda9-46de-9bc4-92409d034657 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:29.582377 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f17821db-fda9-46de-9bc4-92409d034657 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:29.582854 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f17821db-fda9-46de-9bc4-92409d034657 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:29.583311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.objects.instance [None req-f17821db-fda9-46de-9bc4-92409d034657 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lazy-loading 'fault' on Instance uuid e7228012-d37e-4a5c-bc05-791ad60259e3 {{(pid=121170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:07:29.626240 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f17821db-fda9-46de-9bc4-92409d034657 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9252893998a490689497697663ca4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f0beb902e4472eae20f0e6c8dc3340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:07:29.634506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f17821db-fda9-46de-9bc4-92409d034657 tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 200 len: 1311 microversion: 2.1 time: 0.102098 Aug 24 13:07:29.635107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1883/3760] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:07:29 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:07:30.655168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9b5250fa-b494-4b76-b26b-041a5d8fba3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:30.655881 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9b5250fa-b494-4b76-b26b-041a5d8fba3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] [instance: e7228012-d37e-4a5c-bc05-791ad60259e3] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:07:30.662356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b5250fa-b494-4b76-b26b-041a5d8fba3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:30.662866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b5250fa-b494-4b76-b26b-041a5d8fba3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:30.663814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b5250fa-b494-4b76-b26b-041a5d8fba3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:30.664491 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b5250fa-b494-4b76-b26b-041a5d8fba3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:07:30.664933 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b5250fa-b494-4b76-b26b-041a5d8fba3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:07:30.665349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b5250fa-b494-4b76-b26b-041a5d8fba3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:07:30.678506 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.wsgi [None req-9b5250fa-b494-4b76-b26b-041a5d8fba3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] HTTP exception thrown: Instance e7228012-d37e-4a5c-bc05-791ad60259e3 could not be found. Aug 24 13:07:30.680563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9b5250fa-b494-4b76-b26b-041a5d8fba3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Request method failure captured: Aug 24 13:07:30.680563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: request: GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 HTTP/1.1 Aug 24 13:07:30.680563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept: application/json Aug 24 13:07:30.680563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept-Encoding: identity Aug 24 13:07:30.680563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Connection: close Aug 24 13:07:30.680563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Length: 0 Aug 24 13:07:30.680563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Type: application/json Aug 24 13:07:30.680563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Host: 10.222.0.45 Aug 24 13:07:30.680563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Openstack-System-Scope: None Aug 24 13:07:30.680563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: User-Agent: python-urllib3/1.26.11 Aug 24 13:07:30.680563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Auth-Token: gAAAAABjBhnPiCoZSEe7wmjTe8U9xlUJz4a5Mp48qYy-cXBN9SdubzuznlpWDZlq64yvw-1br5IS5M11o055Otgjl3rpsAMlh8QWB47vk-vMvC9oSLyFSNPSBKLMaQ10tN_kbVVupvSgWrx6NZcM-VEx1q4Wa9x9_sEvmqQpKFDCK4_ukrJvtn4 Aug 24 13:07:30.680563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Id: None Aug 24 13:07:30.680563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Name: None Aug 24 13:07:30.680563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Identity-Status: Confirmed Aug 24 13:07:30.680563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Is-Admin-Project: True Aug 24 13:07:30.680563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Id: default Aug 24 13:07:30.680563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Name: Default Aug 24 13:07:30.680563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Id: 99f0beb902e4472eae20f0e6c8dc3340 Aug 24 13:07:30.680563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1902039323 Aug 24 13:07:30.680563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Role: member,reader Aug 24 13:07:30.680563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Roles: member,reader Aug 24 13:07:30.681789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_99f0beb902e4472eae20f0e6c8dc3340"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99f0beb902e4472eae20f0e6c8dc3340"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/99f0beb902e4472eae20f0e6c8dc3340"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99f0beb902e4472eae20f0e6c8dc3340"}]}] Aug 24 13:07:30.681789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1902039323 Aug 24 13:07:30.681789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Id: 99f0beb902e4472eae20f0e6c8dc3340 Aug 24 13:07:30.681789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1902039323 Aug 24 13:07:30.681789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User: tempest-ServerRescueNegativeTestJSON-1902039323-project Aug 24 13:07:30.681789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Id: default Aug 24 13:07:30.681789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Name: Default Aug 24 13:07:30.681789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Id: b9252893998a490689497697663ca4d2 Aug 24 13:07:30.681789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1902039323-project Aug 24 13:07:30.681789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: method: > Aug 24 13:07:30.681789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: exception: Instance e7228012-d37e-4a5c-bc05-791ad60259e3 could not be found. Aug 24 13:07:30.681789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: action_args: {'id': 'e7228012-d37e-4a5c-bc05-791ad60259e3'} Aug 24 13:07:30.682429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:07:30.682429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:30.682429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:07:30.682429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:07:30.682429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:07:30.682429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:07:30.682429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:07:30.682429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:07:30.682429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:07:30.682429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:07:30.682429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7228012-d37e-4a5c-bc05-791ad60259e3 could not be found. Aug 24 13:07:30.682429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:30.682429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:07:30.682429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:30.682429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:30.682429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:07:30.682429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:07:30.682429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:07:30.682429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:07:30.682429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:07:30.683905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:07:30.683905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:07:30.683905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:07:30.683905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:07:30.683905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:07:30.683905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:07:30.683905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:07:30.683905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7228012-d37e-4a5c-bc05-791ad60259e3 could not be found. Aug 24 13:07:30.683905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:30.683905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:07:30.683905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:30.683905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:30.683905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:07:30.683905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:07:30.683905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:07:30.683905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:07:30.683905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7228012-d37e-4a5c-bc05-791ad60259e3 could not be found. Aug 24 13:07:30.683905 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:30.685046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9b5250fa-b494-4b76-b26b-041a5d8fba3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] Returning 404 to user: Instance e7228012-d37e-4a5c-bc05-791ad60259e3 could not be found. {{(pid=121171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:07:30.685046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9b5250fa-b494-4b76-b26b-041a5d8fba3e tempest-ServerRescueNegativeTestJSON-1902039323 tempest-ServerRescueNegativeTestJSON-1902039323-project] 10.222.0.45 "GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3" status: 404 len: 111 microversion: 2.1 time: 0.030632 Aug 24 13:07:30.685046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1878/3761] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:07:30 2022] GET /compute/v2.1/servers/e7228012-d37e-4a5c-bc05-791ad60259e3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:07:35.758732 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bb0f681f-e796-468c-a22b-7262263eddaf tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Action: 'create', calling method: .version_select at 0x7f76f9cd75e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-240911329"}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:07:36.376409 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bb0f681f-e796-468c-a22b-7262263eddaf tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.732660 Aug 24 13:07:36.377402 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1884/3762] 10.222.0.45 () {60 vars in 1155 bytes} [Wed Aug 24 13:07:35 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 734 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 13:07:36.392021 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b4e91360-94f6-447c-802f-00cd78687736 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Calling method '.version_select at 0x7f76f9d56f70>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:36.449209 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b4e91360-94f6-447c-802f-00cd78687736 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/2faf7b21-872e-410c-bac4-5c34ae850c39" status: 200 len: 344 microversion: 2.1 time: 0.062720 Aug 24 13:07:36.449851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1879/3763] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 13:07:36 2022] GET /compute/v2.1/os-volumes/2faf7b21-872e-410c-bac4-5c34ae850c39 => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:07:37.464635 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-94b0e57e-d79b-4de3-8f4e-4d709e9457ad tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Calling method '.version_select at 0x7f76f5478310>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:37.512980 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-94b0e57e-d79b-4de3-8f4e-4d709e9457ad tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/2faf7b21-872e-410c-bac4-5c34ae850c39" status: 200 len: 345 microversion: 2.1 time: 0.052424 Aug 24 13:07:37.513481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1885/3764] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 13:07:37 2022] GET /compute/v2.1/os-volumes/2faf7b21-872e-410c-bac4-5c34ae850c39 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:07:37.527218 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-67658275-fea2-4539-a50d-4a8b8361a6db tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Action: 'create', calling method: .version_select at 0x7f76f9c8cb80>, body: {"snapshot": {"volume_id": "2faf7b21-872e-410c-bac4-5c34ae850c39", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-752740030"}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:07:37.929557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-67658275-fea2-4539-a50d-4a8b8361a6db tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] 10.222.0.45 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.406650 Aug 24 13:07:37.930168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1880/3765] 10.222.0.45 () {60 vars in 1162 bytes} [Wed Aug 24 13:07:37 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:07:37.940898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-149b446e-395a-4c65-81ea-f94fc7047a96 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Calling method '.version_select at 0x7f76f9cd2550>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:37.973414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-149b446e-395a-4c65-81ea-f94fc7047a96 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3" status: 200 len: 286 microversion: 2.1 time: 0.036222 Aug 24 13:07:37.974287 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1886/3766] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 24 13:07:37 2022] GET /compute/v2.1/os-snapshots/380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:07:37.985643 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0382d4d8-1dd5-495b-aab0-c195e5a2fd1c tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Calling method '.version_select at 0x7f76f9c8cd30>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:38.018440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0382d4d8-1dd5-495b-aab0-c195e5a2fd1c tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.036781 Aug 24 13:07:38.019623 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1881/3767] 10.222.0.45 () {58 vars in 1140 bytes} [Wed Aug 24 13:07:37 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:07:38.033570 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-769381ca-a994-483c-9a59-e050f89c98b4 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Calling method '.version_select at 0x7f76f9d34af0>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:38.065871 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-769381ca-a994-483c-9a59-e050f89c98b4 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3" status: 200 len: 286 microversion: 2.1 time: 0.039124 Aug 24 13:07:38.066463 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1887/3768] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 24 13:07:38 2022] GET /compute/v2.1/os-snapshots/380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:07:39.081870 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-93951bd1-9e26-4c63-9238-c04b9a7c8173 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Calling method '.version_select at 0x7f76f9cb7dc0>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:39.112919 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-93951bd1-9e26-4c63-9238-c04b9a7c8173 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3" status: 200 len: 286 microversion: 2.1 time: 0.035427 Aug 24 13:07:39.113502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1882/3769] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 24 13:07:39 2022] GET /compute/v2.1/os-snapshots/380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:07:40.123143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=3 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:40.123905 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:40.127646 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4ebe7d56-855f-4eda-88e4-495610a70b43 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Calling method '.version_select at 0x7f76f9cd75e0>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:40.157143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4ebe7d56-855f-4eda-88e4-495610a70b43 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3" status: 200 len: 286 microversion: 2.1 time: 0.035326 Aug 24 13:07:40.157702 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1888/3770] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 24 13:07:40 2022] GET /compute/v2.1/os-snapshots/380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:07:41.166842 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:41.167518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=58 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:41.171317 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a59a1711-bb4e-4209-b0e2-a1f1efa4735d tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Calling method '.version_select at 0x7f76f9c48940>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:41.200634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a59a1711-bb4e-4209-b0e2-a1f1efa4735d tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3" status: 200 len: 286 microversion: 2.1 time: 0.035229 Aug 24 13:07:41.201218 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1883/3771] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 24 13:07:41 2022] GET /compute/v2.1/os-snapshots/380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:07:42.214408 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-79e670b9-0e35-41b4-adf9-5de3ca84d635 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Calling method '.version_select at 0x7f76f9d52c10>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:42.250683 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-79e670b9-0e35-41b4-adf9-5de3ca84d635 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3" status: 200 len: 286 microversion: 2.1 time: 0.034905 Aug 24 13:07:42.250683 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1889/3772] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 24 13:07:42 2022] GET /compute/v2.1/os-snapshots/380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:07:43.257400 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d805c777-5123-498a-bbb9-96dd20c85b0b tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Calling method '.version_select at 0x7f76f9cb7940>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:43.288653 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d805c777-5123-498a-bbb9-96dd20c85b0b tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3" status: 200 len: 286 microversion: 2.1 time: 0.033150 Aug 24 13:07:43.288653 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1884/3773] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 24 13:07:43 2022] GET /compute/v2.1/os-snapshots/380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:07:44.299252 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ae05f17e-a599-4288-ab13-0454a01bb760 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Calling method '.version_select at 0x7f76f9cd75e0>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:44.328810 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ae05f17e-a599-4288-ab13-0454a01bb760 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3" status: 200 len: 287 microversion: 2.1 time: 0.034203 Aug 24 13:07:44.329372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1890/3774] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 24 13:07:44 2022] GET /compute/v2.1/os-snapshots/380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:07:44.340490 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6e3945e1-dcb9-406e-ad9c-4e5605d7e50a tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Calling method '.version_select at 0x7f76f9c8c310>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:44.442007 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6e3945e1-dcb9-406e-ad9c-4e5605d7e50a tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] 10.222.0.45 "DELETE /compute/v2.1/os-snapshots/380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3" status: 202 len: 0 microversion: 2.1 time: 0.105607 Aug 24 13:07:44.442589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1885/3775] 10.222.0.45 () {58 vars in 1254 bytes} [Wed Aug 24 13:07:44 2022] DELETE /compute/v2.1/os-snapshots/380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 13:07:44.451538 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a6f46d2a-c84b-41a5-accf-255ed9506f73 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Calling method '.version_select at 0x7f76f9d47160>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:44.480757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a6f46d2a-c84b-41a5-accf-255ed9506f73 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3" status: 200 len: 286 microversion: 2.1 time: 0.033113 Aug 24 13:07:44.481314 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1891/3776] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 24 13:07:44 2022] GET /compute/v2.1/os-snapshots/380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:07:45.494325 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-816c7205-80eb-4751-9d10-96c729faadd1 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Calling method '.version_select at 0x7f76f9c48700>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:45.519439 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.wsgi [None req-816c7205-80eb-4751-9d10-96c729faadd1 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] HTTP exception thrown: Snapshot 380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3 could not be found. Aug 24 13:07:45.521761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-816c7205-80eb-4751-9d10-96c729faadd1 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Request method failure captured: Aug 24 13:07:45.521761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: request: GET /compute/v2.1/os-snapshots/380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3 HTTP/1.1 Aug 24 13:07:45.521761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept: application/json Aug 24 13:07:45.521761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept-Encoding: identity Aug 24 13:07:45.521761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Connection: close Aug 24 13:07:45.521761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Length: 0 Aug 24 13:07:45.521761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Type: application/json Aug 24 13:07:45.521761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Host: 10.222.0.45 Aug 24 13:07:45.521761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Openstack-System-Scope: None Aug 24 13:07:45.521761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: User-Agent: python-urllib3/1.26.11 Aug 24 13:07:45.521761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Auth-Token: gAAAAABjBiKX03PjnhylzE0__HAPIu2iKTvcQemIA3W64MkVS0h4MZI0F7ExiiZIbs-ESzLMtwr7eiAsQe3bwa6qJshTSrIfFAkgMQEHl4Z30t3Ntou9ifTZoc7KOk26HKNAxZpqU5olHVJzX1MLuIzrZ3vHAQTRhOdN33iU8ku8upRtOj7PF8k Aug 24 13:07:45.521761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Id: None Aug 24 13:07:45.521761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Name: None Aug 24 13:07:45.521761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Identity-Status: Confirmed Aug 24 13:07:45.521761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Is-Admin-Project: True Aug 24 13:07:45.521761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Id: default Aug 24 13:07:45.521761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Name: Default Aug 24 13:07:45.521761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Id: bcfccce80ab74e6591df6ef220a26a95 Aug 24 13:07:45.521761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-170119878 Aug 24 13:07:45.521761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Role: member,reader Aug 24 13:07:45.521761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Roles: member,reader Aug 24 13:07:45.524132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bcfccce80ab74e6591df6ef220a26a95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bcfccce80ab74e6591df6ef220a26a95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bcfccce80ab74e6591df6ef220a26a95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bcfccce80ab74e6591df6ef220a26a95"}]}] Aug 24 13:07:45.524132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant: tempest-VolumesSnapshotsTestJSON-170119878 Aug 24 13:07:45.524132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Id: bcfccce80ab74e6591df6ef220a26a95 Aug 24 13:07:45.524132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-170119878 Aug 24 13:07:45.524132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User: tempest-VolumesSnapshotsTestJSON-170119878-project Aug 24 13:07:45.524132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Id: default Aug 24 13:07:45.524132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Name: Default Aug 24 13:07:45.524132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Id: 256b4ce317664b5493e81ab3a5a0f3bf Aug 24 13:07:45.524132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Name: tempest-VolumesSnapshotsTestJSON-170119878-project Aug 24 13:07:45.524132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: method: Aug 24 13:07:45.524132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: exception: Snapshot 380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3 could not be found. Aug 24 13:07:45.524132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: action_args: {'id': '380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3'} Aug 24 13:07:45.524132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:07:45.525750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:45.525750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 13:07:45.525750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 13:07:45.525750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 13:07:45.525750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 13:07:45.525750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 13:07:45.525750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 13:07:45.525750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 13:07:45.525750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 13:07:45.525750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 13:07:45.525750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 13:07:45.525750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 13:07:45.525750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 13:07:45.525750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 13:07:45.525750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 13:07:45.525750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3 could not be found. (HTTP 404) (Request-ID: req-f73b8af5-1308-46be-a1af-d678a094f505) Aug 24 13:07:45.525750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:45.525750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:07:45.528076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:45.528076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:45.528076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 13:07:45.528076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 13:07:45.528076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 13:07:45.528076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 13:07:45.528076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 13:07:45.528076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 13:07:45.528076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 13:07:45.528076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 13:07:45.528076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 13:07:45.528076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 13:07:45.528076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 13:07:45.528076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 13:07:45.528076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 13:07:45.528076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 13:07:45.528076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 13:07:45.528076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 13:07:45.528076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 13:07:45.530442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 13:07:45.530442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 13:07:45.530442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 13:07:45.530442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 13:07:45.530442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 13:07:45.530442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3 could not be found. Aug 24 13:07:45.530442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:45.530442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:07:45.530442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:45.530442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:45.530442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:07:45.530442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:07:45.530442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:07:45.530442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:07:45.530442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 13:07:45.530442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 13:07:45.530442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:07:45.530442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:07:45.530442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 13:07:45.530442 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:07:45.532608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3 could not be found. Aug 24 13:07:45.532608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:45.532608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:07:45.532608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:45.532608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:45.532608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:07:45.532608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:07:45.532608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:07:45.532608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:07:45.532608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3 could not be found. Aug 24 13:07:45.532608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:45.532608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-816c7205-80eb-4751-9d10-96c729faadd1 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Returning 404 to user: Snapshot 380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3 could not be found. {{(pid=121171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:07:45.532608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-816c7205-80eb-4751-9d10-96c729faadd1 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3" status: 404 len: 111 microversion: 2.1 time: 0.033789 Aug 24 13:07:45.533708 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1886/3777] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 24 13:07:45 2022] GET /compute/v2.1/os-snapshots/380fed1a-729a-4d6b-9d43-ca7f9b5ec8a3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:07:45.533803 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9f84e6d1-ed95-4d72-94c5-94cedd59bbe7 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Calling method '.version_select at 0x7f76f9d34b80>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:45.737766 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9f84e6d1-ed95-4d72-94c5-94cedd59bbe7 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/2faf7b21-872e-410c-bac4-5c34ae850c39" status: 202 len: 0 microversion: 2.1 time: 0.207861 Aug 24 13:07:45.738330 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1892/3778] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 24 13:07:45 2022] DELETE /compute/v2.1/os-volumes/2faf7b21-872e-410c-bac4-5c34ae850c39 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:07:45.746741 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bf89fd0b-2e80-48df-91a6-2daaafba2888 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Calling method '.version_select at 0x7f76f9c8c3a0>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:45.792720 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bf89fd0b-2e80-48df-91a6-2daaafba2888 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/2faf7b21-872e-410c-bac4-5c34ae850c39" status: 200 len: 344 microversion: 2.1 time: 0.049932 Aug 24 13:07:45.793361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1887/3779] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 13:07:45 2022] GET /compute/v2.1/os-volumes/2faf7b21-872e-410c-bac4-5c34ae850c39 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:07:46.807348 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0bfb7bb3-8fc4-48d9-b3d5-5a2511bccb9d tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Calling method '.version_select at 0x7f76f9d47280>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:46.833847 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.wsgi [None req-0bfb7bb3-8fc4-48d9-b3d5-5a2511bccb9d tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] HTTP exception thrown: Volume 2faf7b21-872e-410c-bac4-5c34ae850c39 could not be found. Aug 24 13:07:46.836389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0bfb7bb3-8fc4-48d9-b3d5-5a2511bccb9d tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Request method failure captured: Aug 24 13:07:46.836389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: request: GET /compute/v2.1/os-volumes/2faf7b21-872e-410c-bac4-5c34ae850c39 HTTP/1.1 Aug 24 13:07:46.836389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept: application/json Aug 24 13:07:46.836389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept-Encoding: identity Aug 24 13:07:46.836389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Connection: close Aug 24 13:07:46.836389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Length: 0 Aug 24 13:07:46.836389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Type: application/json Aug 24 13:07:46.836389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Host: 10.222.0.45 Aug 24 13:07:46.836389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Openstack-System-Scope: None Aug 24 13:07:46.836389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: User-Agent: python-urllib3/1.26.11 Aug 24 13:07:46.836389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Auth-Token: gAAAAABjBiKX03PjnhylzE0__HAPIu2iKTvcQemIA3W64MkVS0h4MZI0F7ExiiZIbs-ESzLMtwr7eiAsQe3bwa6qJshTSrIfFAkgMQEHl4Z30t3Ntou9ifTZoc7KOk26HKNAxZpqU5olHVJzX1MLuIzrZ3vHAQTRhOdN33iU8ku8upRtOj7PF8k Aug 24 13:07:46.836389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Id: None Aug 24 13:07:46.836389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Name: None Aug 24 13:07:46.836389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Identity-Status: Confirmed Aug 24 13:07:46.836389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Is-Admin-Project: True Aug 24 13:07:46.836389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Id: default Aug 24 13:07:46.836389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Name: Default Aug 24 13:07:46.836389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Id: bcfccce80ab74e6591df6ef220a26a95 Aug 24 13:07:46.836389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-170119878 Aug 24 13:07:46.836389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Role: member,reader Aug 24 13:07:46.836389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Roles: member,reader Aug 24 13:07:46.837769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bcfccce80ab74e6591df6ef220a26a95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bcfccce80ab74e6591df6ef220a26a95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bcfccce80ab74e6591df6ef220a26a95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bcfccce80ab74e6591df6ef220a26a95"}]}] Aug 24 13:07:46.837769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant: tempest-VolumesSnapshotsTestJSON-170119878 Aug 24 13:07:46.837769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Id: bcfccce80ab74e6591df6ef220a26a95 Aug 24 13:07:46.837769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-170119878 Aug 24 13:07:46.837769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User: tempest-VolumesSnapshotsTestJSON-170119878-project Aug 24 13:07:46.837769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Id: default Aug 24 13:07:46.837769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Name: Default Aug 24 13:07:46.837769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Id: 256b4ce317664b5493e81ab3a5a0f3bf Aug 24 13:07:46.837769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Name: tempest-VolumesSnapshotsTestJSON-170119878-project Aug 24 13:07:46.837769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: method: Aug 24 13:07:46.837769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: exception: Volume 2faf7b21-872e-410c-bac4-5c34ae850c39 could not be found. Aug 24 13:07:46.837769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: action_args: {'id': '2faf7b21-872e-410c-bac4-5c34ae850c39'} Aug 24 13:07:46.837769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:07:46.838669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:46.838669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 13:07:46.838669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 13:07:46.838669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 13:07:46.838669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 13:07:46.838669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 13:07:46.838669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 13:07:46.838669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 13:07:46.838669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 13:07:46.838669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 13:07:46.838669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 13:07:46.838669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 13:07:46.838669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 13:07:46.838669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 13:07:46.838669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 13:07:46.838669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2faf7b21-872e-410c-bac4-5c34ae850c39 could not be found. (HTTP 404) (Request-ID: req-a639df86-c404-42af-8ab8-a7bdc783acba) Aug 24 13:07:46.838669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:46.838669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:07:46.838669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:46.839806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:46.839806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 13:07:46.839806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 13:07:46.839806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 13:07:46.839806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 13:07:46.839806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 13:07:46.839806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 13:07:46.839806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 13:07:46.839806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 13:07:46.839806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 13:07:46.839806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 13:07:46.839806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 13:07:46.839806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 13:07:46.839806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 13:07:46.839806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 13:07:46.839806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 13:07:46.839806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 13:07:46.839806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 13:07:46.839806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 13:07:46.840833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 13:07:46.840833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 13:07:46.840833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 13:07:46.840833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 13:07:46.840833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2faf7b21-872e-410c-bac4-5c34ae850c39 could not be found. Aug 24 13:07:46.840833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:46.840833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:07:46.840833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:46.840833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:46.840833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:07:46.840833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:07:46.840833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:07:46.840833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:07:46.840833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 13:07:46.840833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 13:07:46.840833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:07:46.840833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:07:46.840833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 13:07:46.840833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:07:46.842087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2faf7b21-872e-410c-bac4-5c34ae850c39 could not be found. Aug 24 13:07:46.842087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:46.842087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:07:46.842087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:46.842087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:46.842087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:07:46.842087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:07:46.842087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:07:46.842087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:07:46.842087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2faf7b21-872e-410c-bac4-5c34ae850c39 could not be found. Aug 24 13:07:46.842087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:46.842087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0bfb7bb3-8fc4-48d9-b3d5-5a2511bccb9d tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Returning 404 to user: Volume 2faf7b21-872e-410c-bac4-5c34ae850c39 could not be found. {{(pid=121170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:07:46.842087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0bfb7bb3-8fc4-48d9-b3d5-5a2511bccb9d tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/2faf7b21-872e-410c-bac4-5c34ae850c39" status: 404 len: 109 microversion: 2.1 time: 0.034805 Aug 24 13:07:46.842087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1893/3780] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 13:07:46 2022] GET /compute/v2.1/os-volumes/2faf7b21-872e-410c-bac4-5c34ae850c39 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:07:46.853661 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e1d2d49a-e485-46db-af06-1c2985d97a90 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Calling method '.version_select at 0x7f76f9cb7040>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:46.883204 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.wsgi [None req-e1d2d49a-e485-46db-af06-1c2985d97a90 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] HTTP exception thrown: Volume 2faf7b21-872e-410c-bac4-5c34ae850c39 could not be found. Aug 24 13:07:46.885319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e1d2d49a-e485-46db-af06-1c2985d97a90 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Request method failure captured: Aug 24 13:07:46.885319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: request: DELETE /compute/v2.1/os-volumes/2faf7b21-872e-410c-bac4-5c34ae850c39 HTTP/1.1 Aug 24 13:07:46.885319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept: application/json Aug 24 13:07:46.885319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept-Encoding: identity Aug 24 13:07:46.885319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Connection: close Aug 24 13:07:46.885319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Length: 0 Aug 24 13:07:46.885319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Type: application/json Aug 24 13:07:46.885319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Host: 10.222.0.45 Aug 24 13:07:46.885319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Openstack-System-Scope: None Aug 24 13:07:46.885319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: User-Agent: python-urllib3/1.26.11 Aug 24 13:07:46.885319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Auth-Token: gAAAAABjBiKX03PjnhylzE0__HAPIu2iKTvcQemIA3W64MkVS0h4MZI0F7ExiiZIbs-ESzLMtwr7eiAsQe3bwa6qJshTSrIfFAkgMQEHl4Z30t3Ntou9ifTZoc7KOk26HKNAxZpqU5olHVJzX1MLuIzrZ3vHAQTRhOdN33iU8ku8upRtOj7PF8k Aug 24 13:07:46.885319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Id: None Aug 24 13:07:46.885319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Name: None Aug 24 13:07:46.885319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Identity-Status: Confirmed Aug 24 13:07:46.885319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Is-Admin-Project: True Aug 24 13:07:46.885319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Id: default Aug 24 13:07:46.885319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Name: Default Aug 24 13:07:46.885319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Id: bcfccce80ab74e6591df6ef220a26a95 Aug 24 13:07:46.885319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-170119878 Aug 24 13:07:46.885319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Role: member,reader Aug 24 13:07:46.885319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Roles: member,reader Aug 24 13:07:46.886790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bcfccce80ab74e6591df6ef220a26a95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bcfccce80ab74e6591df6ef220a26a95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bcfccce80ab74e6591df6ef220a26a95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bcfccce80ab74e6591df6ef220a26a95"}]}] Aug 24 13:07:46.886790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant: tempest-VolumesSnapshotsTestJSON-170119878 Aug 24 13:07:46.886790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Id: bcfccce80ab74e6591df6ef220a26a95 Aug 24 13:07:46.886790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-170119878 Aug 24 13:07:46.886790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User: tempest-VolumesSnapshotsTestJSON-170119878-project Aug 24 13:07:46.886790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Id: default Aug 24 13:07:46.886790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Name: Default Aug 24 13:07:46.886790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Id: 256b4ce317664b5493e81ab3a5a0f3bf Aug 24 13:07:46.886790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Name: tempest-VolumesSnapshotsTestJSON-170119878-project Aug 24 13:07:46.886790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: method: Aug 24 13:07:46.886790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: exception: Volume 2faf7b21-872e-410c-bac4-5c34ae850c39 could not be found. Aug 24 13:07:46.886790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: action_args: {'id': '2faf7b21-872e-410c-bac4-5c34ae850c39'} Aug 24 13:07:46.886790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:07:46.887654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:46.887654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 13:07:46.887654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 13:07:46.887654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 13:07:46.887654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 13:07:46.887654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 13:07:46.887654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 13:07:46.887654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 13:07:46.887654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 13:07:46.887654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 13:07:46.887654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 13:07:46.887654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 13:07:46.887654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 13:07:46.887654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 13:07:46.887654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 13:07:46.887654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2faf7b21-872e-410c-bac4-5c34ae850c39 could not be found. (HTTP 404) (Request-ID: req-12dc1d46-693c-4430-a472-0c6c2d778ab3) Aug 24 13:07:46.887654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:46.887654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:07:46.887654 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:46.888950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:46.888950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 13:07:46.888950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 13:07:46.888950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 13:07:46.888950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 13:07:46.888950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 13:07:46.888950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 13:07:46.888950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 13:07:46.888950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 13:07:46.888950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 13:07:46.888950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 13:07:46.888950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 13:07:46.888950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 13:07:46.888950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 13:07:46.888950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 13:07:46.888950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 13:07:46.888950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 13:07:46.888950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 13:07:46.888950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 13:07:46.890131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 13:07:46.890131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 13:07:46.890131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 13:07:46.890131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 13:07:46.890131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2faf7b21-872e-410c-bac4-5c34ae850c39 could not be found. Aug 24 13:07:46.890131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:46.890131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:07:46.890131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:46.890131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:46.890131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:07:46.890131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:07:46.890131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:07:46.890131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:07:46.890131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 13:07:46.890131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 13:07:46.890131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:07:46.890131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:07:46.890131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 13:07:46.890131 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:07:46.891405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2faf7b21-872e-410c-bac4-5c34ae850c39 could not be found. Aug 24 13:07:46.891405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:46.891405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:07:46.891405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:46.891405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:46.891405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:07:46.891405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:07:46.891405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:07:46.891405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:07:46.891405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2faf7b21-872e-410c-bac4-5c34ae850c39 could not be found. Aug 24 13:07:46.891405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:07:46.891405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e1d2d49a-e485-46db-af06-1c2985d97a90 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Returning 404 to user: Volume 2faf7b21-872e-410c-bac4-5c34ae850c39 could not be found. {{(pid=121171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:07:46.891405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e1d2d49a-e485-46db-af06-1c2985d97a90 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/2faf7b21-872e-410c-bac4-5c34ae850c39" status: 404 len: 109 microversion: 2.1 time: 0.038292 Aug 24 13:07:46.891405 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1888/3781] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 24 13:07:46 2022] DELETE /compute/v2.1/os-volumes/2faf7b21-872e-410c-bac4-5c34ae850c39 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:07:46.895628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a4595ccd-78bd-4ead-9c8c-2687e44b0598 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Calling method '.version_select at 0x7f76f9cd2e50>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:07:46.923572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.wsgi [None req-a4595ccd-78bd-4ead-9c8c-2687e44b0598 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] HTTP exception thrown: Volume 2faf7b21-872e-410c-bac4-5c34ae850c39 could not be found. Aug 24 13:07:46.925482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a4595ccd-78bd-4ead-9c8c-2687e44b0598 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Request method failure captured: Aug 24 13:07:46.925482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: request: GET /compute/v2.1/os-volumes/2faf7b21-872e-410c-bac4-5c34ae850c39 HTTP/1.1 Aug 24 13:07:46.925482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept: application/json Aug 24 13:07:46.925482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept-Encoding: identity Aug 24 13:07:46.925482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Connection: close Aug 24 13:07:46.925482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Length: 0 Aug 24 13:07:46.925482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Type: application/json Aug 24 13:07:46.925482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Host: 10.222.0.45 Aug 24 13:07:46.925482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Openstack-System-Scope: None Aug 24 13:07:46.925482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: User-Agent: python-urllib3/1.26.11 Aug 24 13:07:46.925482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Auth-Token: gAAAAABjBiKX03PjnhylzE0__HAPIu2iKTvcQemIA3W64MkVS0h4MZI0F7ExiiZIbs-ESzLMtwr7eiAsQe3bwa6qJshTSrIfFAkgMQEHl4Z30t3Ntou9ifTZoc7KOk26HKNAxZpqU5olHVJzX1MLuIzrZ3vHAQTRhOdN33iU8ku8upRtOj7PF8k Aug 24 13:07:46.925482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Id: None Aug 24 13:07:46.925482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Name: None Aug 24 13:07:46.925482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Identity-Status: Confirmed Aug 24 13:07:46.925482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Is-Admin-Project: True Aug 24 13:07:46.925482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Id: default Aug 24 13:07:46.925482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Name: Default Aug 24 13:07:46.925482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Id: bcfccce80ab74e6591df6ef220a26a95 Aug 24 13:07:46.925482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-170119878 Aug 24 13:07:46.925482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Role: member,reader Aug 24 13:07:46.925482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Roles: member,reader Aug 24 13:07:46.926917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bcfccce80ab74e6591df6ef220a26a95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bcfccce80ab74e6591df6ef220a26a95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bcfccce80ab74e6591df6ef220a26a95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bcfccce80ab74e6591df6ef220a26a95"}]}] Aug 24 13:07:46.926917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant: tempest-VolumesSnapshotsTestJSON-170119878 Aug 24 13:07:46.926917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Id: bcfccce80ab74e6591df6ef220a26a95 Aug 24 13:07:46.926917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-170119878 Aug 24 13:07:46.926917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User: tempest-VolumesSnapshotsTestJSON-170119878-project Aug 24 13:07:46.926917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Id: default Aug 24 13:07:46.926917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Name: Default Aug 24 13:07:46.926917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Id: 256b4ce317664b5493e81ab3a5a0f3bf Aug 24 13:07:46.926917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Name: tempest-VolumesSnapshotsTestJSON-170119878-project Aug 24 13:07:46.926917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: method: Aug 24 13:07:46.926917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: exception: Volume 2faf7b21-872e-410c-bac4-5c34ae850c39 could not be found. Aug 24 13:07:46.926917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: action_args: {'id': '2faf7b21-872e-410c-bac4-5c34ae850c39'} Aug 24 13:07:46.926917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:07:46.927796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:46.927796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 13:07:46.927796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 13:07:46.927796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 13:07:46.927796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 13:07:46.927796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 13:07:46.927796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 13:07:46.927796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 13:07:46.927796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 13:07:46.927796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 13:07:46.927796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 13:07:46.927796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 13:07:46.927796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 13:07:46.927796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 13:07:46.927796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 13:07:46.927796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2faf7b21-872e-410c-bac4-5c34ae850c39 could not be found. (HTTP 404) (Request-ID: req-888685dd-b1d8-4400-afc5-86423f51840d) Aug 24 13:07:46.927796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:46.927796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:07:46.927796 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:46.929141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:46.929141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 13:07:46.929141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 13:07:46.929141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 13:07:46.929141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 13:07:46.929141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 13:07:46.929141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 13:07:46.929141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 13:07:46.929141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 13:07:46.929141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 13:07:46.929141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 13:07:46.929141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 13:07:46.929141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 13:07:46.929141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 13:07:46.929141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 13:07:46.929141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 13:07:46.929141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 13:07:46.929141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 13:07:46.929141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 13:07:46.930319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 13:07:46.930319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 13:07:46.930319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 13:07:46.930319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 13:07:46.930319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2faf7b21-872e-410c-bac4-5c34ae850c39 could not be found. Aug 24 13:07:46.930319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:46.930319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:07:46.930319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:46.930319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:46.930319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:07:46.930319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:07:46.930319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:07:46.930319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:07:46.930319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 13:07:46.930319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 13:07:46.930319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:07:46.930319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:07:46.930319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 13:07:46.930319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:07:46.934960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2faf7b21-872e-410c-bac4-5c34ae850c39 could not be found. Aug 24 13:07:46.934960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:46.934960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:07:46.934960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:46.934960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:07:46.934960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:07:46.934960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:07:46.934960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:07:46.934960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:07:46.934960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2faf7b21-872e-410c-bac4-5c34ae850c39 could not be found. Aug 24 13:07:46.934960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:07:46.934960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a4595ccd-78bd-4ead-9c8c-2687e44b0598 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] Returning 404 to user: Volume 2faf7b21-872e-410c-bac4-5c34ae850c39 could not be found. {{(pid=121170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:07:46.934960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a4595ccd-78bd-4ead-9c8c-2687e44b0598 tempest-VolumesSnapshotsTestJSON-170119878 tempest-VolumesSnapshotsTestJSON-170119878-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/2faf7b21-872e-410c-bac4-5c34ae850c39" status: 404 len: 109 microversion: 2.1 time: 0.034993 Aug 24 13:07:46.934960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1894/3782] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 24 13:07:46 2022] GET /compute/v2.1/os-volumes/2faf7b21-872e-410c-bac4-5c34ae850c39 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 13:08:05.539006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5c3d5211-7c0c-43cd-af56-464985e1af97 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2072698926", "imageRef": "62fcb2c8-bff4-46cf-9892-c43d7626629e", "flavorRef": "452", "networks": [{"uuid": "d435e8c2-e189-4ed7-a04a-4272c0830113"}]}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:08:05.594235 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.network.neutron [None req-5c3d5211-7c0c-43cd-af56-464985e1af97 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] validate_networks() for [('d435e8c2-e189-4ed7-a04a-4272c0830113', None, None, None, None, None)] {{(pid=121171) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:08:06.106539 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-5c3d5211-7c0c-43cd-af56-464985e1af97 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Flavor limits 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:08:06.106990 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-5c3d5211-7c0c-43cd-af56-464985e1af97 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Image limits 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:08:06.107456 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-5c3d5211-7c0c-43cd-af56-464985e1af97 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Flavor pref 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:08:06.107858 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-5c3d5211-7c0c-43cd-af56-464985e1af97 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Image pref 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:08:06.108298 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-5c3d5211-7c0c-43cd-af56-464985e1af97 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:08:06.117449 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c3d5211-7c0c-43cd-af56-464985e1af97 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:06.118031 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c3d5211-7c0c-43cd-af56-464985e1af97 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:06.118459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c3d5211-7c0c-43cd-af56-464985e1af97 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:06.119269 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c3d5211-7c0c-43cd-af56-464985e1af97 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:06.119716 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c3d5211-7c0c-43cd-af56-464985e1af97 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:06.120135 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c3d5211-7c0c-43cd-af56-464985e1af97 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:06.136629 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-5c3d5211-7c0c-43cd-af56-464985e1af97 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Getting quotas for project 262256e7068b41fa96dde68614cfc126. Resources: {'instances', 'cores', 'ram'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:08:06.140676 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-5c3d5211-7c0c-43cd-af56-464985e1af97 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Getting quotas for user 7eb2f527351f49f4aef0be7535f60baa and project 262256e7068b41fa96dde68614cfc126. Resources: {'instances', 'cores', 'ram'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:08:06.152329 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5c3d5211-7c0c-43cd-af56-464985e1af97 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Going to run 1 instances... {{(pid=121171) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 13:08:06.154581 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5c3d5211-7c0c-43cd-af56-464985e1af97 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='62fcb2c8-bff4-46cf-9892-c43d7626629e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 13:08:06.261278 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5c3d5211-7c0c-43cd-af56-464985e1af97 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.726719 Aug 24 13:08:06.261914 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1889/3783] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 13:08:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 13:08:06.273821 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dbdcf83b-164e-4e63-927d-f7cef80716b3 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:06.274423 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dbdcf83b-164e-4e63-927d-f7cef80716b3 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:06.330639 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-dbdcf83b-164e-4e63-927d-f7cef80716b3 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:06.339692 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dbdcf83b-164e-4e63-927d-f7cef80716b3 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45" status: 200 len: 1214 microversion: 2.1 time: 0.070826 Aug 24 13:08:06.340253 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1895/3784] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:06 2022] GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:07.360550 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-519b2605-4b8b-460b-b0a3-269e7d02920e tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:07.361169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-519b2605-4b8b-460b-b0a3-269e7d02920e tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:07.419829 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-519b2605-4b8b-460b-b0a3-269e7d02920e tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:07.426595 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-519b2605-4b8b-460b-b0a3-269e7d02920e tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45" status: 200 len: 1214 microversion: 2.1 time: 0.070694 Aug 24 13:08:07.427554 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1890/3785] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:07 2022] GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:08.448222 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3b16436c-2f88-4ca6-a31f-0c311f5a9750 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:08.448828 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3b16436c-2f88-4ca6-a31f-0c311f5a9750 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:08.455118 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b16436c-2f88-4ca6-a31f-0c311f5a9750 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:08.455592 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b16436c-2f88-4ca6-a31f-0c311f5a9750 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:08.456022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b16436c-2f88-4ca6-a31f-0c311f5a9750 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:08.456699 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b16436c-2f88-4ca6-a31f-0c311f5a9750 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:08.457150 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b16436c-2f88-4ca6-a31f-0c311f5a9750 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:08.457570 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b16436c-2f88-4ca6-a31f-0c311f5a9750 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:08.519843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3b16436c-2f88-4ca6-a31f-0c311f5a9750 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:08.527533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3b16436c-2f88-4ca6-a31f-0c311f5a9750 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45" status: 200 len: 1266 microversion: 2.1 time: 0.083681 Aug 24 13:08:08.528394 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1896/3786] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:08 2022] GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:08:09.548683 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2f20bf68-99db-4620-bfae-ab8765f0d605 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:09.549432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2f20bf68-99db-4620-bfae-ab8765f0d605 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:09.556594 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f20bf68-99db-4620-bfae-ab8765f0d605 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:09.557196 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f20bf68-99db-4620-bfae-ab8765f0d605 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:09.557701 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f20bf68-99db-4620-bfae-ab8765f0d605 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:09.558394 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f20bf68-99db-4620-bfae-ab8765f0d605 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:09.559228 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f20bf68-99db-4620-bfae-ab8765f0d605 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:09.559381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2f20bf68-99db-4620-bfae-ab8765f0d605 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:09.728462 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2f20bf68-99db-4620-bfae-ab8765f0d605 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:09.736627 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2f20bf68-99db-4620-bfae-ab8765f0d605 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45" status: 200 len: 1314 microversion: 2.1 time: 0.191786 Aug 24 13:08:09.737192 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1891/3787] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:09 2022] GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:10.682122 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-ed8f1839-0fe9-4935-ab30-43ef0a9b2ffb req-997badea-79ce-44ca-8431-e57ac7e12ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fbc6720-9fd1-4189-be43-6696d4404a45", "tag": "a265a80a-d599-4b57-ae64-b2a819bcd8a0"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:08:10.692704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-ed8f1839-0fe9-4935-ab30-43ef0a9b2ffb req-997badea-79ce-44ca-8431-e57ac7e12ef0 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:10.693524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-ed8f1839-0fe9-4935-ab30-43ef0a9b2ffb req-997badea-79ce-44ca-8431-e57ac7e12ef0 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:10.694312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-ed8f1839-0fe9-4935-ab30-43ef0a9b2ffb req-997badea-79ce-44ca-8431-e57ac7e12ef0 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:10.713565 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-ed8f1839-0fe9-4935-ab30-43ef0a9b2ffb req-997badea-79ce-44ca-8431-e57ac7e12ef0 service nova] Creating event network-changed:a265a80a-d599-4b57-ae64-b2a819bcd8a0 for instance 7fbc6720-9fd1-4189-be43-6696d4404a45 on hv-cinder-84889 Aug 24 13:08:10.718969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-ed8f1839-0fe9-4935-ab30-43ef0a9b2ffb req-997badea-79ce-44ca-8431-e57ac7e12ef0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041310 Aug 24 13:08:10.719570 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1897/3788] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:08:10.757813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ea5ab2aa-b895-43fb-9625-7a6866567ab4 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:10.760576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ea5ab2aa-b895-43fb-9625-7a6866567ab4 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:10.764954 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea5ab2aa-b895-43fb-9625-7a6866567ab4 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:10.765438 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea5ab2aa-b895-43fb-9625-7a6866567ab4 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:10.765882 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea5ab2aa-b895-43fb-9625-7a6866567ab4 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:10.766564 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea5ab2aa-b895-43fb-9625-7a6866567ab4 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:10.767059 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea5ab2aa-b895-43fb-9625-7a6866567ab4 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:10.767482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ea5ab2aa-b895-43fb-9625-7a6866567ab4 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:10.972596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ea5ab2aa-b895-43fb-9625-7a6866567ab4 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:10.980119 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ea5ab2aa-b895-43fb-9625-7a6866567ab4 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45" status: 200 len: 1314 microversion: 2.1 time: 0.226348 Aug 24 13:08:10.980681 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1892/3789] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:10 2022] GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:12.001636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b7c92a2f-e5cb-44c2-906b-6cded8e32404 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:12.002357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b7c92a2f-e5cb-44c2-906b-6cded8e32404 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:12.009754 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7c92a2f-e5cb-44c2-906b-6cded8e32404 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:12.010228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7c92a2f-e5cb-44c2-906b-6cded8e32404 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:12.010674 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7c92a2f-e5cb-44c2-906b-6cded8e32404 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:12.011362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7c92a2f-e5cb-44c2-906b-6cded8e32404 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:12.011814 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7c92a2f-e5cb-44c2-906b-6cded8e32404 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:12.012238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b7c92a2f-e5cb-44c2-906b-6cded8e32404 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:12.146178 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b7c92a2f-e5cb-44c2-906b-6cded8e32404 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:12.153825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b7c92a2f-e5cb-44c2-906b-6cded8e32404 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45" status: 200 len: 1314 microversion: 2.1 time: 0.156381 Aug 24 13:08:12.154382 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1898/3790] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:11 2022] GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:13.173569 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-631ccdbf-9700-48c3-9003-41c2e0cb7149 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:13.175865 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-631ccdbf-9700-48c3-9003-41c2e0cb7149 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:13.181074 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-631ccdbf-9700-48c3-9003-41c2e0cb7149 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:13.181561 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-631ccdbf-9700-48c3-9003-41c2e0cb7149 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:13.182067 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-631ccdbf-9700-48c3-9003-41c2e0cb7149 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:13.183088 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-631ccdbf-9700-48c3-9003-41c2e0cb7149 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:13.183549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-631ccdbf-9700-48c3-9003-41c2e0cb7149 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:13.183976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-631ccdbf-9700-48c3-9003-41c2e0cb7149 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:13.320001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-631ccdbf-9700-48c3-9003-41c2e0cb7149 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:13.327747 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-631ccdbf-9700-48c3-9003-41c2e0cb7149 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45" status: 200 len: 1314 microversion: 2.1 time: 0.158171 Aug 24 13:08:13.328326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1893/3791] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:13 2022] GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:14.347460 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-06a4b19c-a4f6-4d82-aa59-6c5acede0e33 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:14.348063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-06a4b19c-a4f6-4d82-aa59-6c5acede0e33 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:14.354374 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06a4b19c-a4f6-4d82-aa59-6c5acede0e33 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:14.354890 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06a4b19c-a4f6-4d82-aa59-6c5acede0e33 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:14.355324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06a4b19c-a4f6-4d82-aa59-6c5acede0e33 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:14.356000 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06a4b19c-a4f6-4d82-aa59-6c5acede0e33 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:14.356449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06a4b19c-a4f6-4d82-aa59-6c5acede0e33 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:14.356871 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-06a4b19c-a4f6-4d82-aa59-6c5acede0e33 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:14.483335 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-06a4b19c-a4f6-4d82-aa59-6c5acede0e33 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:14.491094 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-06a4b19c-a4f6-4d82-aa59-6c5acede0e33 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45" status: 200 len: 1314 microversion: 2.1 time: 0.147406 Aug 24 13:08:14.491648 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1899/3792] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:14 2022] GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:15.512437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ac0f198d-2c66-4504-9821-e83e1e9bbe04 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:15.513034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ac0f198d-2c66-4504-9821-e83e1e9bbe04 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:15.519416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ac0f198d-2c66-4504-9821-e83e1e9bbe04 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:15.519894 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ac0f198d-2c66-4504-9821-e83e1e9bbe04 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:15.520319 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ac0f198d-2c66-4504-9821-e83e1e9bbe04 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:15.520991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ac0f198d-2c66-4504-9821-e83e1e9bbe04 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:15.521437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ac0f198d-2c66-4504-9821-e83e1e9bbe04 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:15.521851 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ac0f198d-2c66-4504-9821-e83e1e9bbe04 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:15.650627 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ac0f198d-2c66-4504-9821-e83e1e9bbe04 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:15.658732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ac0f198d-2c66-4504-9821-e83e1e9bbe04 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45" status: 200 len: 1314 microversion: 2.1 time: 0.150548 Aug 24 13:08:15.659295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1894/3793] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:15 2022] GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:16.679901 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f66c2597-4fbb-4045-817b-da8c300ed814 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:16.680467 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f66c2597-4fbb-4045-817b-da8c300ed814 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:16.682942 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell0:SELECT=2 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:08:16.687668 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f66c2597-4fbb-4045-817b-da8c300ed814 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:16.688147 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f66c2597-4fbb-4045-817b-da8c300ed814 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:16.688575 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f66c2597-4fbb-4045-817b-da8c300ed814 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:16.689251 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f66c2597-4fbb-4045-817b-da8c300ed814 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:16.689702 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f66c2597-4fbb-4045-817b-da8c300ed814 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:16.690121 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f66c2597-4fbb-4045-817b-da8c300ed814 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:16.820986 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f66c2597-4fbb-4045-817b-da8c300ed814 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:16.829536 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f66c2597-4fbb-4045-817b-da8c300ed814 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45" status: 200 len: 1314 microversion: 2.1 time: 0.153451 Aug 24 13:08:16.830098 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1900/3794] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:16 2022] GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:17.850050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a7b7ed61-8658-4e7d-9050-35bc23e40da2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:17.850676 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a7b7ed61-8658-4e7d-9050-35bc23e40da2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:17.852451 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=2 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:08:17.854310 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=8 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:08:17.858952 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a7b7ed61-8658-4e7d-9050-35bc23e40da2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:17.859426 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a7b7ed61-8658-4e7d-9050-35bc23e40da2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:17.859849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a7b7ed61-8658-4e7d-9050-35bc23e40da2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:17.860780 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a7b7ed61-8658-4e7d-9050-35bc23e40da2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:17.861219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a7b7ed61-8658-4e7d-9050-35bc23e40da2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:17.861632 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a7b7ed61-8658-4e7d-9050-35bc23e40da2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:17.992677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a7b7ed61-8658-4e7d-9050-35bc23e40da2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:18.000153 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a7b7ed61-8658-4e7d-9050-35bc23e40da2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45" status: 200 len: 1314 microversion: 2.1 time: 0.153959 Aug 24 13:08:18.000710 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1895/3795] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:17 2022] GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:19.020558 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f7700ba5-55ea-454e-83a8-35fc617dcc6c tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:19.021168 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f7700ba5-55ea-454e-83a8-35fc617dcc6c tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:19.027517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7700ba5-55ea-454e-83a8-35fc617dcc6c tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:19.028000 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7700ba5-55ea-454e-83a8-35fc617dcc6c tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:19.028434 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7700ba5-55ea-454e-83a8-35fc617dcc6c tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:19.029114 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7700ba5-55ea-454e-83a8-35fc617dcc6c tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:19.029569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7700ba5-55ea-454e-83a8-35fc617dcc6c tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:19.029996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7700ba5-55ea-454e-83a8-35fc617dcc6c tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:19.154267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f7700ba5-55ea-454e-83a8-35fc617dcc6c tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:19.162528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f7700ba5-55ea-454e-83a8-35fc617dcc6c tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45" status: 200 len: 1314 microversion: 2.1 time: 0.145788 Aug 24 13:08:19.163132 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1901/3796] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:19 2022] GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:20.183894 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-01934b83-07ce-4f41-9534-7ee4ab858f05 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:20.184511 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-01934b83-07ce-4f41-9534-7ee4ab858f05 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:20.190936 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01934b83-07ce-4f41-9534-7ee4ab858f05 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:20.191413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01934b83-07ce-4f41-9534-7ee4ab858f05 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:20.191847 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01934b83-07ce-4f41-9534-7ee4ab858f05 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:20.192544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01934b83-07ce-4f41-9534-7ee4ab858f05 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:20.192983 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01934b83-07ce-4f41-9534-7ee4ab858f05 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:20.193400 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-01934b83-07ce-4f41-9534-7ee4ab858f05 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:20.319640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-01934b83-07ce-4f41-9534-7ee4ab858f05 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:20.327943 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-01934b83-07ce-4f41-9534-7ee4ab858f05 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45" status: 200 len: 1314 microversion: 2.1 time: 0.148516 Aug 24 13:08:20.332652 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1896/3797] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:20 2022] GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:21.351180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3dc12f2a-08d6-4f4d-8202-0ead9d7860b2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:21.351831 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3dc12f2a-08d6-4f4d-8202-0ead9d7860b2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:21.358338 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3dc12f2a-08d6-4f4d-8202-0ead9d7860b2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:21.358869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3dc12f2a-08d6-4f4d-8202-0ead9d7860b2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:21.359311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3dc12f2a-08d6-4f4d-8202-0ead9d7860b2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:21.360033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3dc12f2a-08d6-4f4d-8202-0ead9d7860b2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:21.360740 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3dc12f2a-08d6-4f4d-8202-0ead9d7860b2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:21.361181 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3dc12f2a-08d6-4f4d-8202-0ead9d7860b2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:21.489651 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3dc12f2a-08d6-4f4d-8202-0ead9d7860b2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:21.497845 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3dc12f2a-08d6-4f4d-8202-0ead9d7860b2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45" status: 200 len: 1314 microversion: 2.1 time: 0.150741 Aug 24 13:08:21.498403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1902/3798] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:21 2022] GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:22.518047 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d1c53361-1d2c-45ad-bd15-98454b11035b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:22.518562 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d1c53361-1d2c-45ad-bd15-98454b11035b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:22.524560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d1c53361-1d2c-45ad-bd15-98454b11035b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:22.525848 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d1c53361-1d2c-45ad-bd15-98454b11035b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:22.525848 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d1c53361-1d2c-45ad-bd15-98454b11035b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:22.526159 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d1c53361-1d2c-45ad-bd15-98454b11035b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:22.526609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d1c53361-1d2c-45ad-bd15-98454b11035b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:22.527061 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d1c53361-1d2c-45ad-bd15-98454b11035b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:22.660892 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d1c53361-1d2c-45ad-bd15-98454b11035b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:22.669633 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d1c53361-1d2c-45ad-bd15-98454b11035b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45" status: 200 len: 1314 microversion: 2.1 time: 0.155265 Aug 24 13:08:22.682715 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1897/3799] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:22 2022] GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:23.690252 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-04d2d74b-0127-4d5d-899e-4d9a16b457b8 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:23.691007 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-04d2d74b-0127-4d5d-899e-4d9a16b457b8 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:23.698734 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-04d2d74b-0127-4d5d-899e-4d9a16b457b8 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:23.699233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-04d2d74b-0127-4d5d-899e-4d9a16b457b8 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:23.699676 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-04d2d74b-0127-4d5d-899e-4d9a16b457b8 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:23.700397 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-04d2d74b-0127-4d5d-899e-4d9a16b457b8 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:23.700856 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-04d2d74b-0127-4d5d-899e-4d9a16b457b8 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:23.701284 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-04d2d74b-0127-4d5d-899e-4d9a16b457b8 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:23.836431 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-04d2d74b-0127-4d5d-899e-4d9a16b457b8 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:23.844728 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-04d2d74b-0127-4d5d-899e-4d9a16b457b8 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45" status: 200 len: 1314 microversion: 2.1 time: 0.158426 Aug 24 13:08:23.846920 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1903/3800] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:23 2022] GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:24.172533 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-732f2bc3-b497-4bd9-8aa0-48fc47e1a7f5 req-078a13ce-ba56-46a3-b9c3-bf2bd91ab77d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fbc6720-9fd1-4189-be43-6696d4404a45", "name": "network-vif-plugged", "status": "completed", "tag": "a265a80a-d599-4b57-ae64-b2a819bcd8a0"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:08:24.182599 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-732f2bc3-b497-4bd9-8aa0-48fc47e1a7f5 req-078a13ce-ba56-46a3-b9c3-bf2bd91ab77d service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:24.186361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-732f2bc3-b497-4bd9-8aa0-48fc47e1a7f5 req-078a13ce-ba56-46a3-b9c3-bf2bd91ab77d service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:24.186361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-732f2bc3-b497-4bd9-8aa0-48fc47e1a7f5 req-078a13ce-ba56-46a3-b9c3-bf2bd91ab77d service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:24.194945 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-732f2bc3-b497-4bd9-8aa0-48fc47e1a7f5 req-078a13ce-ba56-46a3-b9c3-bf2bd91ab77d service nova] Creating event network-vif-plugged:a265a80a-d599-4b57-ae64-b2a819bcd8a0 for instance 7fbc6720-9fd1-4189-be43-6696d4404a45 on hv-cinder-84889 Aug 24 13:08:24.200674 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-732f2bc3-b497-4bd9-8aa0-48fc47e1a7f5 req-078a13ce-ba56-46a3-b9c3-bf2bd91ab77d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166143 Aug 24 13:08:24.201269 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1898/3801] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:08:24.866815 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-38a56f84-8b14-40ba-b899-d7932feac985 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:24.867422 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-38a56f84-8b14-40ba-b899-d7932feac985 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:24.879226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-38a56f84-8b14-40ba-b899-d7932feac985 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:24.879226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-38a56f84-8b14-40ba-b899-d7932feac985 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:24.879226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-38a56f84-8b14-40ba-b899-d7932feac985 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:24.879226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-38a56f84-8b14-40ba-b899-d7932feac985 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:24.879540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-38a56f84-8b14-40ba-b899-d7932feac985 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:24.879540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-38a56f84-8b14-40ba-b899-d7932feac985 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:25.162040 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-38a56f84-8b14-40ba-b899-d7932feac985 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:25.169683 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-38a56f84-8b14-40ba-b899-d7932feac985 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45" status: 200 len: 1314 microversion: 2.1 time: 0.306577 Aug 24 13:08:25.170189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1904/3802] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:24 2022] GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:26.190584 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e13b3318-2dbd-4288-a3b9-d2d4045bdeb8 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:26.191226 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e13b3318-2dbd-4288-a3b9-d2d4045bdeb8 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:26.197417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e13b3318-2dbd-4288-a3b9-d2d4045bdeb8 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:26.197900 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e13b3318-2dbd-4288-a3b9-d2d4045bdeb8 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:26.198971 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e13b3318-2dbd-4288-a3b9-d2d4045bdeb8 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:26.201576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e13b3318-2dbd-4288-a3b9-d2d4045bdeb8 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:26.201576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e13b3318-2dbd-4288-a3b9-d2d4045bdeb8 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:26.201576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e13b3318-2dbd-4288-a3b9-d2d4045bdeb8 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:26.327147 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e13b3318-2dbd-4288-a3b9-d2d4045bdeb8 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:26.334745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e13b3318-2dbd-4288-a3b9-d2d4045bdeb8 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45" status: 200 len: 1499 microversion: 2.1 time: 0.148864 Aug 24 13:08:26.335304 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1899/3803] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:26 2022] GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 => generated 1499 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:27.306380 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fb81d2c6-b622-4738-9741-3e510092c929 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:27.306945 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fb81d2c6-b622-4738-9741-3e510092c929 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:27.313255 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fb81d2c6-b622-4738-9741-3e510092c929 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:27.313737 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fb81d2c6-b622-4738-9741-3e510092c929 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:27.314169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fb81d2c6-b622-4738-9741-3e510092c929 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:27.314867 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fb81d2c6-b622-4738-9741-3e510092c929 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:27.315319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fb81d2c6-b622-4738-9741-3e510092c929 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:27.315740 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fb81d2c6-b622-4738-9741-3e510092c929 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:27.341117 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fb81d2c6-b622-4738-9741-3e510092c929 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Going to try to terminate instance {{(pid=121170) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 13:08:27.594313 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fb81d2c6-b622-4738-9741-3e510092c929 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45" status: 204 len: 0 microversion: 2.1 time: 0.291339 Aug 24 13:08:27.594871 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1905/3804] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 13:08:27 2022] DELETE /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:08:27.603085 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ec2191f8-ea2e-449f-a923-ef1f148852ef tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:27.603694 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ec2191f8-ea2e-449f-a923-ef1f148852ef tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:27.609962 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ec2191f8-ea2e-449f-a923-ef1f148852ef tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:27.610436 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ec2191f8-ea2e-449f-a923-ef1f148852ef tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:27.611213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ec2191f8-ea2e-449f-a923-ef1f148852ef tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:27.611883 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ec2191f8-ea2e-449f-a923-ef1f148852ef tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:27.612336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ec2191f8-ea2e-449f-a923-ef1f148852ef tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:27.612751 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ec2191f8-ea2e-449f-a923-ef1f148852ef tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:27.747720 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ec2191f8-ea2e-449f-a923-ef1f148852ef tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:27.755369 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ec2191f8-ea2e-449f-a923-ef1f148852ef tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45" status: 200 len: 1505 microversion: 2.1 time: 0.156169 Aug 24 13:08:27.755936 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1900/3805] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:27 2022] GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:28.784182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5eb1733e-3222-4f63-9a98-423c7cfb06b0 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:28.784898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5eb1733e-3222-4f63-9a98-423c7cfb06b0 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:28.791229 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5eb1733e-3222-4f63-9a98-423c7cfb06b0 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:28.791714 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5eb1733e-3222-4f63-9a98-423c7cfb06b0 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:28.792158 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5eb1733e-3222-4f63-9a98-423c7cfb06b0 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:28.792849 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5eb1733e-3222-4f63-9a98-423c7cfb06b0 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:28.793310 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5eb1733e-3222-4f63-9a98-423c7cfb06b0 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:28.793739 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5eb1733e-3222-4f63-9a98-423c7cfb06b0 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:28.920002 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5eb1733e-3222-4f63-9a98-423c7cfb06b0 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:28.927859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5eb1733e-3222-4f63-9a98-423c7cfb06b0 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45" status: 200 len: 1505 microversion: 2.1 time: 0.147948 Aug 24 13:08:28.928404 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1906/3806] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:28 2022] GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:29.947994 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-375873e8-64ca-4ac9-8b20-69cced4ab7c7 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:29.949184 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-375873e8-64ca-4ac9-8b20-69cced4ab7c7 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:29.955606 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-375873e8-64ca-4ac9-8b20-69cced4ab7c7 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:29.956076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-375873e8-64ca-4ac9-8b20-69cced4ab7c7 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:29.956502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-375873e8-64ca-4ac9-8b20-69cced4ab7c7 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:29.957172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-375873e8-64ca-4ac9-8b20-69cced4ab7c7 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:29.957613 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-375873e8-64ca-4ac9-8b20-69cced4ab7c7 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:29.958027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-375873e8-64ca-4ac9-8b20-69cced4ab7c7 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:30.087460 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-375873e8-64ca-4ac9-8b20-69cced4ab7c7 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:30.094950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-375873e8-64ca-4ac9-8b20-69cced4ab7c7 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45" status: 200 len: 1505 microversion: 2.1 time: 0.150812 Aug 24 13:08:30.095630 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1901/3807] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:29 2022] GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:31.115495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7fd387a3-755d-47a4-8a2a-b40691da82dc tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:31.116052 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7fd387a3-755d-47a4-8a2a-b40691da82dc tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:31.123034 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7fd387a3-755d-47a4-8a2a-b40691da82dc tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:31.123520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7fd387a3-755d-47a4-8a2a-b40691da82dc tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:31.123960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7fd387a3-755d-47a4-8a2a-b40691da82dc tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:31.124646 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7fd387a3-755d-47a4-8a2a-b40691da82dc tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:31.125104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7fd387a3-755d-47a4-8a2a-b40691da82dc tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:31.125537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7fd387a3-755d-47a4-8a2a-b40691da82dc tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:31.255667 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7fd387a3-755d-47a4-8a2a-b40691da82dc tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:31.263194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7fd387a3-755d-47a4-8a2a-b40691da82dc tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45" status: 200 len: 1505 microversion: 2.1 time: 0.151537 Aug 24 13:08:31.263749 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1907/3808] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:31 2022] GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:32.283704 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ecc315d5-7e2b-46a8-a81d-c0951e5638a6 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:32.284232 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ecc315d5-7e2b-46a8-a81d-c0951e5638a6 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:32.290732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ecc315d5-7e2b-46a8-a81d-c0951e5638a6 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:32.291211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ecc315d5-7e2b-46a8-a81d-c0951e5638a6 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:32.291645 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ecc315d5-7e2b-46a8-a81d-c0951e5638a6 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:32.292322 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ecc315d5-7e2b-46a8-a81d-c0951e5638a6 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:32.292773 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ecc315d5-7e2b-46a8-a81d-c0951e5638a6 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:32.293226 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ecc315d5-7e2b-46a8-a81d-c0951e5638a6 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:32.423316 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ecc315d5-7e2b-46a8-a81d-c0951e5638a6 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:32.430890 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ecc315d5-7e2b-46a8-a81d-c0951e5638a6 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45" status: 200 len: 1505 microversion: 2.1 time: 0.151076 Aug 24 13:08:32.431455 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1902/3809] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:32 2022] GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:33.465529 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-934a79c3-67ff-4095-b84f-e63ca1e66820 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:33.466254 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-934a79c3-67ff-4095-b84f-e63ca1e66820 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:33.472969 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-934a79c3-67ff-4095-b84f-e63ca1e66820 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:33.473465 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-934a79c3-67ff-4095-b84f-e63ca1e66820 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:33.473911 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-934a79c3-67ff-4095-b84f-e63ca1e66820 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:33.474614 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-934a79c3-67ff-4095-b84f-e63ca1e66820 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:33.475249 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-934a79c3-67ff-4095-b84f-e63ca1e66820 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:33.475683 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-934a79c3-67ff-4095-b84f-e63ca1e66820 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:33.607906 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-934a79c3-67ff-4095-b84f-e63ca1e66820 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:33.616211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-934a79c3-67ff-4095-b84f-e63ca1e66820 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45" status: 200 len: 1505 microversion: 2.1 time: 0.154559 Aug 24 13:08:33.619045 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1908/3810] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:33 2022] GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:33.981139 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-1f1721bc-6e83-4025-913c-90c450dc57b8 req-f2ad6dcc-346a-44ee-a1da-082bb95e5d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fbc6720-9fd1-4189-be43-6696d4404a45", "name": "network-vif-deleted", "tag": "a265a80a-d599-4b57-ae64-b2a819bcd8a0"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:08:33.991562 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-1f1721bc-6e83-4025-913c-90c450dc57b8 req-f2ad6dcc-346a-44ee-a1da-082bb95e5d9d service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:33.992089 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-1f1721bc-6e83-4025-913c-90c450dc57b8 req-f2ad6dcc-346a-44ee-a1da-082bb95e5d9d service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:33.992520 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-1f1721bc-6e83-4025-913c-90c450dc57b8 req-f2ad6dcc-346a-44ee-a1da-082bb95e5d9d service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:34.003944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-1f1721bc-6e83-4025-913c-90c450dc57b8 req-f2ad6dcc-346a-44ee-a1da-082bb95e5d9d service nova] Creating event network-vif-deleted:a265a80a-d599-4b57-ae64-b2a819bcd8a0 for instance 7fbc6720-9fd1-4189-be43-6696d4404a45 on hv-cinder-84889 Aug 24 13:08:34.008836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-1f1721bc-6e83-4025-913c-90c450dc57b8 req-f2ad6dcc-346a-44ee-a1da-082bb95e5d9d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032103 Aug 24 13:08:34.009402 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1903/3811] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:08:34.642160 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0b512b6e-87cd-4f58-9501-20b235aa0e7d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:34.642800 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0b512b6e-87cd-4f58-9501-20b235aa0e7d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:34.649177 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b512b6e-87cd-4f58-9501-20b235aa0e7d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:34.649661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b512b6e-87cd-4f58-9501-20b235aa0e7d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:34.650099 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b512b6e-87cd-4f58-9501-20b235aa0e7d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:34.650853 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b512b6e-87cd-4f58-9501-20b235aa0e7d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:34.651277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b512b6e-87cd-4f58-9501-20b235aa0e7d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:34.655701 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b512b6e-87cd-4f58-9501-20b235aa0e7d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:34.685191 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b512b6e-87cd-4f58-9501-20b235aa0e7d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:34.685600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b512b6e-87cd-4f58-9501-20b235aa0e7d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:34.686037 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b512b6e-87cd-4f58-9501-20b235aa0e7d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:34.686484 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.objects.instance [None req-0b512b6e-87cd-4f58-9501-20b235aa0e7d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lazy-loading 'fault' on Instance uuid 7fbc6720-9fd1-4189-be43-6696d4404a45 {{(pid=121170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:08:34.727857 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0b512b6e-87cd-4f58-9501-20b235aa0e7d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:34.736292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0b512b6e-87cd-4f58-9501-20b235aa0e7d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45" status: 200 len: 1304 microversion: 2.1 time: 0.097733 Aug 24 13:08:34.736845 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1909/3812] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:34 2022] GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:35.757395 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d9eabff3-9bec-48a1-a074-5a2341a71e6d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:35.758144 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d9eabff3-9bec-48a1-a074-5a2341a71e6d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: 7fbc6720-9fd1-4189-be43-6696d4404a45] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:35.760084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:08:35.765399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d9eabff3-9bec-48a1-a074-5a2341a71e6d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:35.765903 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d9eabff3-9bec-48a1-a074-5a2341a71e6d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:35.766330 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d9eabff3-9bec-48a1-a074-5a2341a71e6d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:35.767028 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d9eabff3-9bec-48a1-a074-5a2341a71e6d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:35.767472 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d9eabff3-9bec-48a1-a074-5a2341a71e6d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:35.767887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d9eabff3-9bec-48a1-a074-5a2341a71e6d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:35.770558 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=73 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:08:35.782293 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.wsgi [None req-d9eabff3-9bec-48a1-a074-5a2341a71e6d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] HTTP exception thrown: Instance 7fbc6720-9fd1-4189-be43-6696d4404a45 could not be found. Aug 24 13:08:35.783917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d9eabff3-9bec-48a1-a074-5a2341a71e6d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Request method failure captured: Aug 24 13:08:35.783917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: request: GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 HTTP/1.1 Aug 24 13:08:35.783917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept: application/json Aug 24 13:08:35.783917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept-Encoding: identity Aug 24 13:08:35.783917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Connection: close Aug 24 13:08:35.783917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Length: 0 Aug 24 13:08:35.783917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Type: application/json Aug 24 13:08:35.783917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Host: 10.222.0.45 Aug 24 13:08:35.783917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Openstack-System-Scope: None Aug 24 13:08:35.783917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: User-Agent: python-urllib3/1.26.11 Aug 24 13:08:35.783917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Auth-Token: gAAAAABjBiKy0wKg9xoFk0E4N0E6BcZuPO16p50WZ-Ckxs_-2YwmwJ57Vpog0tbElmmdJSY7Q2qSMTfKfJz6zfwlnEkR31gN0aX5zuYmS6WXh7Lpi4WDr8XWW0z7tkIXo9-anGDAeqZ9OdzsklottNDMPz_PXvJUIE2T1pUx92fIM1XHEPXwOGI Aug 24 13:08:35.783917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Id: None Aug 24 13:08:35.783917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Name: None Aug 24 13:08:35.783917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Identity-Status: Confirmed Aug 24 13:08:35.783917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Is-Admin-Project: True Aug 24 13:08:35.783917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Id: default Aug 24 13:08:35.783917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Name: Default Aug 24 13:08:35.783917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Id: 262256e7068b41fa96dde68614cfc126 Aug 24 13:08:35.783917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Name: tempest-VolumesActionsTest-1385601733 Aug 24 13:08:35.783917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Role: member,reader Aug 24 13:08:35.783917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Roles: member,reader Aug 24 13:08:35.785417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_262256e7068b41fa96dde68614cfc126"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/262256e7068b41fa96dde68614cfc126"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/262256e7068b41fa96dde68614cfc126"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/262256e7068b41fa96dde68614cfc126"}]}] Aug 24 13:08:35.785417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant: tempest-VolumesActionsTest-1385601733 Aug 24 13:08:35.785417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Id: 262256e7068b41fa96dde68614cfc126 Aug 24 13:08:35.785417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Name: tempest-VolumesActionsTest-1385601733 Aug 24 13:08:35.785417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User: tempest-VolumesActionsTest-1385601733-project Aug 24 13:08:35.785417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Id: default Aug 24 13:08:35.785417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Name: Default Aug 24 13:08:35.785417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Id: 7eb2f527351f49f4aef0be7535f60baa Aug 24 13:08:35.785417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Name: tempest-VolumesActionsTest-1385601733-project Aug 24 13:08:35.785417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: method: > Aug 24 13:08:35.785417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: exception: Instance 7fbc6720-9fd1-4189-be43-6696d4404a45 could not be found. Aug 24 13:08:35.785417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: action_args: {'id': '7fbc6720-9fd1-4189-be43-6696d4404a45'} Aug 24 13:08:35.786363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:08:35.786363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:08:35.786363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:08:35.786363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:08:35.786363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:08:35.786363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:08:35.786363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:08:35.786363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:08:35.786363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:08:35.786363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:08:35.786363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fbc6720-9fd1-4189-be43-6696d4404a45 could not be found. Aug 24 13:08:35.786363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:08:35.786363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:08:35.786363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:08:35.786363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:08:35.786363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:08:35.786363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:08:35.786363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:08:35.786363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:08:35.786363 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:08:35.787828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:08:35.787828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:08:35.787828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:08:35.787828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:08:35.787828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:08:35.787828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:08:35.787828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:08:35.787828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fbc6720-9fd1-4189-be43-6696d4404a45 could not be found. Aug 24 13:08:35.787828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:08:35.787828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:08:35.787828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:08:35.787828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:08:35.787828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:08:35.787828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:08:35.787828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:08:35.787828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:08:35.787828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fbc6720-9fd1-4189-be43-6696d4404a45 could not be found. Aug 24 13:08:35.787828 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:08:35.789034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d9eabff3-9bec-48a1-a074-5a2341a71e6d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Returning 404 to user: Instance 7fbc6720-9fd1-4189-be43-6696d4404a45 could not be found. {{(pid=121171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:08:35.789034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d9eabff3-9bec-48a1-a074-5a2341a71e6d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45" status: 404 len: 111 microversion: 2.1 time: 0.032680 Aug 24 13:08:35.789034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1904/3813] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:35 2022] GET /compute/v2.1/servers/7fbc6720-9fd1-4189-be43-6696d4404a45 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:08:35.889638 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-98b08931-4839-4893-85c4-9ced1749d035 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1032996943", "imageRef": "62fcb2c8-bff4-46cf-9892-c43d7626629e", "flavorRef": "452", "networks": [{"uuid": "d435e8c2-e189-4ed7-a04a-4272c0830113"}]}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:08:35.941070 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.network.neutron [None req-98b08931-4839-4893-85c4-9ced1749d035 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] validate_networks() for [('d435e8c2-e189-4ed7-a04a-4272c0830113', None, None, None, None, None)] {{(pid=121170) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:08:36.375620 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-98b08931-4839-4893-85c4-9ced1749d035 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Flavor limits 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:08:36.376042 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-98b08931-4839-4893-85c4-9ced1749d035 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Image limits 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:08:36.376515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-98b08931-4839-4893-85c4-9ced1749d035 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Flavor pref 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:08:36.376921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-98b08931-4839-4893-85c4-9ced1749d035 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Image pref 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:08:36.377331 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-98b08931-4839-4893-85c4-9ced1749d035 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:08:36.379396 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:08:36.386843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-98b08931-4839-4893-85c4-9ced1749d035 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:36.387330 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-98b08931-4839-4893-85c4-9ced1749d035 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:36.387766 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-98b08931-4839-4893-85c4-9ced1749d035 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:36.388487 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-98b08931-4839-4893-85c4-9ced1749d035 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:36.388944 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-98b08931-4839-4893-85c4-9ced1749d035 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:36.389373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-98b08931-4839-4893-85c4-9ced1749d035 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:36.396048 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:08:36.406125 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-98b08931-4839-4893-85c4-9ced1749d035 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Getting quotas for project 262256e7068b41fa96dde68614cfc126. Resources: {'instances', 'cores', 'ram'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:08:36.410053 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-98b08931-4839-4893-85c4-9ced1749d035 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Getting quotas for user 7eb2f527351f49f4aef0be7535f60baa and project 262256e7068b41fa96dde68614cfc126. Resources: {'instances', 'cores', 'ram'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:08:36.422420 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-98b08931-4839-4893-85c4-9ced1749d035 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Going to run 1 instances... {{(pid=121170) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 13:08:36.424925 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-98b08931-4839-4893-85c4-9ced1749d035 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: e49cdac5-e4d6-41bd-8755-4cc4894e7870] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='62fcb2c8-bff4-46cf-9892-c43d7626629e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 13:08:36.557064 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-98b08931-4839-4893-85c4-9ced1749d035 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671896 Aug 24 13:08:36.557836 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1910/3814] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 13:08:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 13:08:36.568902 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-26c37f24-6b27-4719-b76e-b115556c5ce4 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:36.569511 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-26c37f24-6b27-4719-b76e-b115556c5ce4 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: e49cdac5-e4d6-41bd-8755-4cc4894e7870] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:36.629805 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-26c37f24-6b27-4719-b76e-b115556c5ce4 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:36.636858 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-26c37f24-6b27-4719-b76e-b115556c5ce4 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870" status: 200 len: 1214 microversion: 2.1 time: 0.071664 Aug 24 13:08:36.637453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1905/3815] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:36 2022] GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:37.666447 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-14aeeefb-3dc3-4e86-81af-c27a955d6d17 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:37.667713 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-14aeeefb-3dc3-4e86-81af-c27a955d6d17 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: e49cdac5-e4d6-41bd-8755-4cc4894e7870] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:37.675428 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14aeeefb-3dc3-4e86-81af-c27a955d6d17 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:37.682039 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14aeeefb-3dc3-4e86-81af-c27a955d6d17 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:37.682039 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14aeeefb-3dc3-4e86-81af-c27a955d6d17 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:37.682039 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14aeeefb-3dc3-4e86-81af-c27a955d6d17 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:37.682039 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14aeeefb-3dc3-4e86-81af-c27a955d6d17 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:37.682353 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-14aeeefb-3dc3-4e86-81af-c27a955d6d17 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:37.738161 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-14aeeefb-3dc3-4e86-81af-c27a955d6d17 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:37.745681 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-14aeeefb-3dc3-4e86-81af-c27a955d6d17 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870" status: 200 len: 1218 microversion: 2.1 time: 0.084465 Aug 24 13:08:37.746281 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1911/3816] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:37 2022] GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:38.766696 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5c71c666-930b-4db9-9867-fb2d8988ac5b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:38.767384 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5c71c666-930b-4db9-9867-fb2d8988ac5b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: e49cdac5-e4d6-41bd-8755-4cc4894e7870] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:38.775962 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c71c666-930b-4db9-9867-fb2d8988ac5b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:38.777076 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c71c666-930b-4db9-9867-fb2d8988ac5b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:38.782476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c71c666-930b-4db9-9867-fb2d8988ac5b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:38.782476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c71c666-930b-4db9-9867-fb2d8988ac5b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:38.782476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c71c666-930b-4db9-9867-fb2d8988ac5b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:38.782476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5c71c666-930b-4db9-9867-fb2d8988ac5b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:38.874469 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5c71c666-930b-4db9-9867-fb2d8988ac5b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:38.883210 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5c71c666-930b-4db9-9867-fb2d8988ac5b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870" status: 200 len: 1274 microversion: 2.1 time: 0.120884 Aug 24 13:08:38.883760 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1906/3817] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:38 2022] GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870 => generated 1274 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:39.905726 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-29154d13-bb23-4293-b3ed-db3ddc8beff0 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:39.906954 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-29154d13-bb23-4293-b3ed-db3ddc8beff0 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: e49cdac5-e4d6-41bd-8755-4cc4894e7870] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:39.914334 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29154d13-bb23-4293-b3ed-db3ddc8beff0 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:39.914855 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29154d13-bb23-4293-b3ed-db3ddc8beff0 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:39.915597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29154d13-bb23-4293-b3ed-db3ddc8beff0 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:39.916311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29154d13-bb23-4293-b3ed-db3ddc8beff0 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:39.916818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29154d13-bb23-4293-b3ed-db3ddc8beff0 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:39.917531 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-29154d13-bb23-4293-b3ed-db3ddc8beff0 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:40.053056 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-29154d13-bb23-4293-b3ed-db3ddc8beff0 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:40.061563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-29154d13-bb23-4293-b3ed-db3ddc8beff0 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870" status: 200 len: 1314 microversion: 2.1 time: 0.160623 Aug 24 13:08:40.062194 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1912/3818] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:39 2022] GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:40.108226 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-96dd2201-b1a2-4eb7-96e4-e780dbe09431 req-b11d82e3-db4b-44f5-8355-c7ac0aca7d52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e49cdac5-e4d6-41bd-8755-4cc4894e7870", "tag": "5a7c4123-7312-49b7-bd25-6cd6bbedf7f9"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:08:40.120949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-96dd2201-b1a2-4eb7-96e4-e780dbe09431 req-b11d82e3-db4b-44f5-8355-c7ac0aca7d52 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:40.122003 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-96dd2201-b1a2-4eb7-96e4-e780dbe09431 req-b11d82e3-db4b-44f5-8355-c7ac0aca7d52 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:40.122497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-96dd2201-b1a2-4eb7-96e4-e780dbe09431 req-b11d82e3-db4b-44f5-8355-c7ac0aca7d52 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:40.136108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-96dd2201-b1a2-4eb7-96e4-e780dbe09431 req-b11d82e3-db4b-44f5-8355-c7ac0aca7d52 service nova] Creating event network-changed:5a7c4123-7312-49b7-bd25-6cd6bbedf7f9 for instance e49cdac5-e4d6-41bd-8755-4cc4894e7870 on hv-cinder-84889 Aug 24 13:08:40.143571 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-96dd2201-b1a2-4eb7-96e4-e780dbe09431 req-b11d82e3-db4b-44f5-8355-c7ac0aca7d52 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041551 Aug 24 13:08:40.144655 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1907/3819] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:08:41.081704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-bcc4785e-0f01-4a43-86ec-35d87e80be40 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:41.082243 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-bcc4785e-0f01-4a43-86ec-35d87e80be40 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: e49cdac5-e4d6-41bd-8755-4cc4894e7870] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:41.088542 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bcc4785e-0f01-4a43-86ec-35d87e80be40 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:41.089626 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bcc4785e-0f01-4a43-86ec-35d87e80be40 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:41.090058 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bcc4785e-0f01-4a43-86ec-35d87e80be40 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:41.090767 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bcc4785e-0f01-4a43-86ec-35d87e80be40 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:41.091220 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bcc4785e-0f01-4a43-86ec-35d87e80be40 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:41.091638 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-bcc4785e-0f01-4a43-86ec-35d87e80be40 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:41.219087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-bcc4785e-0f01-4a43-86ec-35d87e80be40 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:41.226760 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-bcc4785e-0f01-4a43-86ec-35d87e80be40 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870" status: 200 len: 1314 microversion: 2.1 time: 0.148907 Aug 24 13:08:41.227306 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1913/3820] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:41 2022] GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:42.247986 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-baa2de40-31dc-4224-9259-006aa027cfec tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:42.248672 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-baa2de40-31dc-4224-9259-006aa027cfec tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: e49cdac5-e4d6-41bd-8755-4cc4894e7870] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:42.255145 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-baa2de40-31dc-4224-9259-006aa027cfec tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:42.255622 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-baa2de40-31dc-4224-9259-006aa027cfec tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:42.256052 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-baa2de40-31dc-4224-9259-006aa027cfec tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:42.256723 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-baa2de40-31dc-4224-9259-006aa027cfec tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:42.257199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-baa2de40-31dc-4224-9259-006aa027cfec tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:42.257617 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-baa2de40-31dc-4224-9259-006aa027cfec tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:42.383633 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-baa2de40-31dc-4224-9259-006aa027cfec tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:42.391720 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-baa2de40-31dc-4224-9259-006aa027cfec tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870" status: 200 len: 1314 microversion: 2.1 time: 0.147970 Aug 24 13:08:42.392278 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1908/3821] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:42 2022] GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:43.412943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ccb1f802-d5e5-4fc5-8785-12ddd575d386 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:43.413681 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ccb1f802-d5e5-4fc5-8785-12ddd575d386 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: e49cdac5-e4d6-41bd-8755-4cc4894e7870] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:43.420153 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ccb1f802-d5e5-4fc5-8785-12ddd575d386 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:43.420662 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ccb1f802-d5e5-4fc5-8785-12ddd575d386 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:43.421087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ccb1f802-d5e5-4fc5-8785-12ddd575d386 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:43.421779 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ccb1f802-d5e5-4fc5-8785-12ddd575d386 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:43.422359 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ccb1f802-d5e5-4fc5-8785-12ddd575d386 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:43.422681 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ccb1f802-d5e5-4fc5-8785-12ddd575d386 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:43.566243 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ccb1f802-d5e5-4fc5-8785-12ddd575d386 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:43.574699 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ccb1f802-d5e5-4fc5-8785-12ddd575d386 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870" status: 200 len: 1314 microversion: 2.1 time: 0.165576 Aug 24 13:08:43.575525 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1914/3822] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:43 2022] GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:44.603657 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4ea5536c-b669-46ca-956a-28c72439bcee tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:44.604425 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4ea5536c-b669-46ca-956a-28c72439bcee tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: e49cdac5-e4d6-41bd-8755-4cc4894e7870] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:44.611520 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ea5536c-b669-46ca-956a-28c72439bcee tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:44.612464 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ea5536c-b669-46ca-956a-28c72439bcee tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:44.612464 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ea5536c-b669-46ca-956a-28c72439bcee tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:44.613150 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ea5536c-b669-46ca-956a-28c72439bcee tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:44.613598 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ea5536c-b669-46ca-956a-28c72439bcee tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:44.614017 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4ea5536c-b669-46ca-956a-28c72439bcee tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:44.746465 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4ea5536c-b669-46ca-956a-28c72439bcee tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:44.753902 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4ea5536c-b669-46ca-956a-28c72439bcee tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870" status: 200 len: 1314 microversion: 2.1 time: 0.154403 Aug 24 13:08:44.754466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1909/3823] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:44 2022] GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:45.773473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6dc6b890-fa11-43bb-8110-b50136858575 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:45.774120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6dc6b890-fa11-43bb-8110-b50136858575 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: e49cdac5-e4d6-41bd-8755-4cc4894e7870] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:45.780790 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6dc6b890-fa11-43bb-8110-b50136858575 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:45.781180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6dc6b890-fa11-43bb-8110-b50136858575 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:45.781614 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6dc6b890-fa11-43bb-8110-b50136858575 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:45.782296 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6dc6b890-fa11-43bb-8110-b50136858575 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:45.782777 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6dc6b890-fa11-43bb-8110-b50136858575 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:45.783199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6dc6b890-fa11-43bb-8110-b50136858575 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:45.914133 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6dc6b890-fa11-43bb-8110-b50136858575 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:45.921795 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6dc6b890-fa11-43bb-8110-b50136858575 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870" status: 200 len: 1314 microversion: 2.1 time: 0.152243 Aug 24 13:08:45.922342 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1915/3824] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:45 2022] GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:46.150471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-a63a6088-e3cf-4d76-bc49-8f10828d6873 req-91c4a944-01a9-4647-8c3d-e28277fadc26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e49cdac5-e4d6-41bd-8755-4cc4894e7870", "name": "network-vif-plugged", "status": "completed", "tag": "5a7c4123-7312-49b7-bd25-6cd6bbedf7f9"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:08:46.161614 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-a63a6088-e3cf-4d76-bc49-8f10828d6873 req-91c4a944-01a9-4647-8c3d-e28277fadc26 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:46.162144 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-a63a6088-e3cf-4d76-bc49-8f10828d6873 req-91c4a944-01a9-4647-8c3d-e28277fadc26 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:46.164609 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-a63a6088-e3cf-4d76-bc49-8f10828d6873 req-91c4a944-01a9-4647-8c3d-e28277fadc26 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:46.175837 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-a63a6088-e3cf-4d76-bc49-8f10828d6873 req-91c4a944-01a9-4647-8c3d-e28277fadc26 service nova] Creating event network-vif-plugged:5a7c4123-7312-49b7-bd25-6cd6bbedf7f9 for instance e49cdac5-e4d6-41bd-8755-4cc4894e7870 on hv-cinder-84889 Aug 24 13:08:46.181099 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-a63a6088-e3cf-4d76-bc49-8f10828d6873 req-91c4a944-01a9-4647-8c3d-e28277fadc26 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034384 Aug 24 13:08:46.182130 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1910/3825] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:08:46.943514 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ece6db0d-a1de-4961-8673-8ebcd1684465 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:46.944119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ece6db0d-a1de-4961-8673-8ebcd1684465 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: e49cdac5-e4d6-41bd-8755-4cc4894e7870] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:46.945945 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell0:SELECT=2 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:08:46.946622 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell0:SELECT=6 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:08:46.951697 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ece6db0d-a1de-4961-8673-8ebcd1684465 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:46.952196 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ece6db0d-a1de-4961-8673-8ebcd1684465 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:46.952795 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ece6db0d-a1de-4961-8673-8ebcd1684465 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:46.953696 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ece6db0d-a1de-4961-8673-8ebcd1684465 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:46.954116 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ece6db0d-a1de-4961-8673-8ebcd1684465 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:46.954536 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ece6db0d-a1de-4961-8673-8ebcd1684465 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:47.091538 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ece6db0d-a1de-4961-8673-8ebcd1684465 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:47.099326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ece6db0d-a1de-4961-8673-8ebcd1684465 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870" status: 200 len: 1314 microversion: 2.1 time: 0.159613 Aug 24 13:08:47.099821 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1916/3826] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:46 2022] GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:48.125481 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-625ec5d1-9dec-4979-ae91-db4834470512 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:48.126175 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-625ec5d1-9dec-4979-ae91-db4834470512 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: e49cdac5-e4d6-41bd-8755-4cc4894e7870] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:48.128201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=2 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:08:48.133649 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-625ec5d1-9dec-4979-ae91-db4834470512 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:48.134132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-625ec5d1-9dec-4979-ae91-db4834470512 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:48.134562 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-625ec5d1-9dec-4979-ae91-db4834470512 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:48.135292 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-625ec5d1-9dec-4979-ae91-db4834470512 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:48.135745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-625ec5d1-9dec-4979-ae91-db4834470512 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:48.136173 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-625ec5d1-9dec-4979-ae91-db4834470512 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:48.268636 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-625ec5d1-9dec-4979-ae91-db4834470512 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:48.276307 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-625ec5d1-9dec-4979-ae91-db4834470512 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870" status: 200 len: 1314 microversion: 2.1 time: 0.155489 Aug 24 13:08:48.276864 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1911/3827] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:48 2022] GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:49.296964 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-52e91554-89ad-4f5a-a3c0-7b47bc9cf53b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:49.297574 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-52e91554-89ad-4f5a-a3c0-7b47bc9cf53b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: e49cdac5-e4d6-41bd-8755-4cc4894e7870] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:49.304044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52e91554-89ad-4f5a-a3c0-7b47bc9cf53b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:49.304531 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52e91554-89ad-4f5a-a3c0-7b47bc9cf53b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:49.304980 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52e91554-89ad-4f5a-a3c0-7b47bc9cf53b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:49.305677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52e91554-89ad-4f5a-a3c0-7b47bc9cf53b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:49.306198 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52e91554-89ad-4f5a-a3c0-7b47bc9cf53b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:49.306616 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-52e91554-89ad-4f5a-a3c0-7b47bc9cf53b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:49.435089 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-52e91554-89ad-4f5a-a3c0-7b47bc9cf53b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:49.442739 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-52e91554-89ad-4f5a-a3c0-7b47bc9cf53b tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870" status: 200 len: 1499 microversion: 2.1 time: 0.149669 Aug 24 13:08:49.443224 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1917/3828] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:49 2022] GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870 => generated 1499 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:50.516124 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b71a6a45-8bb9-4929-9ed5-f4bef7f4998d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:50.516635 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b71a6a45-8bb9-4929-9ed5-f4bef7f4998d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: e49cdac5-e4d6-41bd-8755-4cc4894e7870] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:50.523161 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b71a6a45-8bb9-4929-9ed5-f4bef7f4998d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:50.523651 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b71a6a45-8bb9-4929-9ed5-f4bef7f4998d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:50.524090 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b71a6a45-8bb9-4929-9ed5-f4bef7f4998d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:50.524779 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b71a6a45-8bb9-4929-9ed5-f4bef7f4998d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:50.525234 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b71a6a45-8bb9-4929-9ed5-f4bef7f4998d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:50.525668 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b71a6a45-8bb9-4929-9ed5-f4bef7f4998d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:50.552018 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b71a6a45-8bb9-4929-9ed5-f4bef7f4998d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: e49cdac5-e4d6-41bd-8755-4cc4894e7870] Going to try to terminate instance {{(pid=121171) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 13:08:50.881569 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b71a6a45-8bb9-4929-9ed5-f4bef7f4998d tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870" status: 204 len: 0 microversion: 2.1 time: 0.369726 Aug 24 13:08:50.882148 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1912/3829] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 13:08:50 2022] DELETE /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:08:50.892095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9e76eb0b-0a09-402b-b1b2-963f3324784c tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:50.892767 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9e76eb0b-0a09-402b-b1b2-963f3324784c tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: e49cdac5-e4d6-41bd-8755-4cc4894e7870] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:50.898885 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e76eb0b-0a09-402b-b1b2-963f3324784c tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:50.904355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e76eb0b-0a09-402b-b1b2-963f3324784c tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:50.904355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e76eb0b-0a09-402b-b1b2-963f3324784c tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:50.904355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e76eb0b-0a09-402b-b1b2-963f3324784c tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:50.904355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e76eb0b-0a09-402b-b1b2-963f3324784c tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:50.904680 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9e76eb0b-0a09-402b-b1b2-963f3324784c tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:51.032370 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9e76eb0b-0a09-402b-b1b2-963f3324784c tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:51.040007 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9e76eb0b-0a09-402b-b1b2-963f3324784c tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870" status: 200 len: 1505 microversion: 2.1 time: 0.152621 Aug 24 13:08:51.040557 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1918/3830] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:50 2022] GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:52.061622 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-14fc6889-6454-4cc6-905d-de3a23da3642 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:52.062309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-14fc6889-6454-4cc6-905d-de3a23da3642 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: e49cdac5-e4d6-41bd-8755-4cc4894e7870] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:52.068514 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14fc6889-6454-4cc6-905d-de3a23da3642 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:52.068989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14fc6889-6454-4cc6-905d-de3a23da3642 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:52.069419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14fc6889-6454-4cc6-905d-de3a23da3642 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:52.070091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14fc6889-6454-4cc6-905d-de3a23da3642 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:52.070535 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14fc6889-6454-4cc6-905d-de3a23da3642 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:52.070985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-14fc6889-6454-4cc6-905d-de3a23da3642 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:52.205566 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-14fc6889-6454-4cc6-905d-de3a23da3642 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:52.213655 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-14fc6889-6454-4cc6-905d-de3a23da3642 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870" status: 200 len: 1505 microversion: 2.1 time: 0.156160 Aug 24 13:08:52.214222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1913/3831] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:52 2022] GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:53.024053 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-85000ecd-be26-4b15-9708-47d085cf4e32 req-bd8416d0-aff8-4456-ad30-cb96a14f02ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e49cdac5-e4d6-41bd-8755-4cc4894e7870", "name": "network-vif-deleted", "tag": "5a7c4123-7312-49b7-bd25-6cd6bbedf7f9"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:08:53.033913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-85000ecd-be26-4b15-9708-47d085cf4e32 req-bd8416d0-aff8-4456-ad30-cb96a14f02ab service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:53.034394 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-85000ecd-be26-4b15-9708-47d085cf4e32 req-bd8416d0-aff8-4456-ad30-cb96a14f02ab service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:53.034861 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-85000ecd-be26-4b15-9708-47d085cf4e32 req-bd8416d0-aff8-4456-ad30-cb96a14f02ab service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:53.046167 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-85000ecd-be26-4b15-9708-47d085cf4e32 req-bd8416d0-aff8-4456-ad30-cb96a14f02ab service nova] Creating event network-vif-deleted:5a7c4123-7312-49b7-bd25-6cd6bbedf7f9 for instance e49cdac5-e4d6-41bd-8755-4cc4894e7870 on hv-cinder-84889 Aug 24 13:08:53.051123 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-85000ecd-be26-4b15-9708-47d085cf4e32 req-bd8416d0-aff8-4456-ad30-cb96a14f02ab service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030736 Aug 24 13:08:53.051735 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1919/3832] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:08:53.237611 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-795fa9b9-d583-48f7-87fe-95a40f1ad0d2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:53.238216 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-795fa9b9-d583-48f7-87fe-95a40f1ad0d2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: e49cdac5-e4d6-41bd-8755-4cc4894e7870] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:53.244753 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-795fa9b9-d583-48f7-87fe-95a40f1ad0d2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:53.245360 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-795fa9b9-d583-48f7-87fe-95a40f1ad0d2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:53.245826 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-795fa9b9-d583-48f7-87fe-95a40f1ad0d2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:53.246504 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-795fa9b9-d583-48f7-87fe-95a40f1ad0d2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:53.246987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-795fa9b9-d583-48f7-87fe-95a40f1ad0d2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:53.247403 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-795fa9b9-d583-48f7-87fe-95a40f1ad0d2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:53.311288 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-795fa9b9-d583-48f7-87fe-95a40f1ad0d2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb2f527351f49f4aef0be7535f60baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262256e7068b41fa96dde68614cfc126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:08:53.319740 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-795fa9b9-d583-48f7-87fe-95a40f1ad0d2 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870" status: 200 len: 1299 microversion: 2.1 time: 0.086525 Aug 24 13:08:53.321257 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1914/3833] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:53 2022] GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870 => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:08:54.342048 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f3595de9-702d-4b47-a72c-b0c9d08c8c79 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:08:54.351141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f3595de9-702d-4b47-a72c-b0c9d08c8c79 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] [instance: e49cdac5-e4d6-41bd-8755-4cc4894e7870] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:08:54.351141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3595de9-702d-4b47-a72c-b0c9d08c8c79 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:54.351141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3595de9-702d-4b47-a72c-b0c9d08c8c79 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:54.351141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3595de9-702d-4b47-a72c-b0c9d08c8c79 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:54.351510 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3595de9-702d-4b47-a72c-b0c9d08c8c79 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:08:54.351510 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3595de9-702d-4b47-a72c-b0c9d08c8c79 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:08:54.351510 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3595de9-702d-4b47-a72c-b0c9d08c8c79 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:08:54.364358 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.wsgi [None req-f3595de9-702d-4b47-a72c-b0c9d08c8c79 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] HTTP exception thrown: Instance e49cdac5-e4d6-41bd-8755-4cc4894e7870 could not be found. Aug 24 13:08:54.366084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f3595de9-702d-4b47-a72c-b0c9d08c8c79 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Request method failure captured: Aug 24 13:08:54.366084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: request: GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870 HTTP/1.1 Aug 24 13:08:54.366084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept: application/json Aug 24 13:08:54.366084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept-Encoding: identity Aug 24 13:08:54.366084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Connection: close Aug 24 13:08:54.366084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Length: 0 Aug 24 13:08:54.366084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Type: application/json Aug 24 13:08:54.366084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Host: 10.222.0.45 Aug 24 13:08:54.366084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Openstack-System-Scope: None Aug 24 13:08:54.366084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: User-Agent: python-urllib3/1.26.11 Aug 24 13:08:54.366084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Auth-Token: gAAAAABjBiKy0wKg9xoFk0E4N0E6BcZuPO16p50WZ-Ckxs_-2YwmwJ57Vpog0tbElmmdJSY7Q2qSMTfKfJz6zfwlnEkR31gN0aX5zuYmS6WXh7Lpi4WDr8XWW0z7tkIXo9-anGDAeqZ9OdzsklottNDMPz_PXvJUIE2T1pUx92fIM1XHEPXwOGI Aug 24 13:08:54.366084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Id: None Aug 24 13:08:54.366084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Name: None Aug 24 13:08:54.366084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Identity-Status: Confirmed Aug 24 13:08:54.366084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Is-Admin-Project: True Aug 24 13:08:54.366084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Id: default Aug 24 13:08:54.366084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Name: Default Aug 24 13:08:54.366084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Id: 262256e7068b41fa96dde68614cfc126 Aug 24 13:08:54.366084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Name: tempest-VolumesActionsTest-1385601733 Aug 24 13:08:54.366084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Role: member,reader Aug 24 13:08:54.366084 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Roles: member,reader Aug 24 13:08:54.367569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_262256e7068b41fa96dde68614cfc126"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/262256e7068b41fa96dde68614cfc126"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/262256e7068b41fa96dde68614cfc126"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/262256e7068b41fa96dde68614cfc126"}]}] Aug 24 13:08:54.367569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant: tempest-VolumesActionsTest-1385601733 Aug 24 13:08:54.367569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Id: 262256e7068b41fa96dde68614cfc126 Aug 24 13:08:54.367569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Name: tempest-VolumesActionsTest-1385601733 Aug 24 13:08:54.367569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User: tempest-VolumesActionsTest-1385601733-project Aug 24 13:08:54.367569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Id: default Aug 24 13:08:54.367569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Name: Default Aug 24 13:08:54.367569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Id: 7eb2f527351f49f4aef0be7535f60baa Aug 24 13:08:54.367569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Name: tempest-VolumesActionsTest-1385601733-project Aug 24 13:08:54.367569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: method: > Aug 24 13:08:54.367569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: exception: Instance e49cdac5-e4d6-41bd-8755-4cc4894e7870 could not be found. Aug 24 13:08:54.367569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: action_args: {'id': 'e49cdac5-e4d6-41bd-8755-4cc4894e7870'} Aug 24 13:08:54.368415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:08:54.368415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:08:54.368415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:08:54.368415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:08:54.368415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:08:54.368415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:08:54.368415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:08:54.368415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:08:54.368415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:08:54.368415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:08:54.368415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e49cdac5-e4d6-41bd-8755-4cc4894e7870 could not be found. Aug 24 13:08:54.368415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:08:54.368415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:08:54.368415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:08:54.368415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:08:54.368415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:08:54.368415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:08:54.368415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:08:54.368415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:08:54.368415 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:08:54.369601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:08:54.369601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:08:54.369601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:08:54.369601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:08:54.369601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:08:54.369601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:08:54.369601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:08:54.369601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e49cdac5-e4d6-41bd-8755-4cc4894e7870 could not be found. Aug 24 13:08:54.369601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:08:54.369601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:08:54.369601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:08:54.369601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:08:54.369601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:08:54.369601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:08:54.369601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:08:54.369601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:08:54.369601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e49cdac5-e4d6-41bd-8755-4cc4894e7870 could not be found. Aug 24 13:08:54.369601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:08:54.370618 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f3595de9-702d-4b47-a72c-b0c9d08c8c79 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] Returning 404 to user: Instance e49cdac5-e4d6-41bd-8755-4cc4894e7870 could not be found. {{(pid=121170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:08:54.370618 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f3595de9-702d-4b47-a72c-b0c9d08c8c79 tempest-VolumesActionsTest-1385601733 tempest-VolumesActionsTest-1385601733-project] 10.222.0.45 "GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870" status: 404 len: 111 microversion: 2.1 time: 0.030751 Aug 24 13:08:54.370618 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1920/3834] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:08:54 2022] GET /compute/v2.1/servers/e49cdac5-e4d6-41bd-8755-4cc4894e7870 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:09:48.630071 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:09:48.630925 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:09:48.799816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-93c02f20-617c-4b85-b674-83ffacb62b96 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Action: 'create', calling method: .version_select at 0x7f76f9c8c040>, body: {"keypair": {"name": "tempest-TestShelveInstance-318005720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEScXOJ8bPLNJu2/7ULscaOqPhMUtsfVGvboTyYF9hWQHppTPuR1/ii62XtKtD1pdnLj0DPF1dRvh1JAgA+MqnYH+PQpaVkFQpDvonUO+r3CtEfWemMwhWSAGJEw7XkhAw=="}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:09:48.815356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-93c02f20-617c-4b85-b674-83ffacb62b96 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Getting quotas for project 618334fc8ef14486a1fc1411c42bf9b7. Resources: {'key_pairs'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:09:48.819267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-93c02f20-617c-4b85-b674-83ffacb62b96 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Getting quotas for user 5b6dec9001a14679ade64276a7962b5f and project 618334fc8ef14486a1fc1411c42bf9b7. Resources: {'key_pairs'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:09:48.902978 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-93c02f20-617c-4b85-b674-83ffacb62b96 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.277757 Aug 24 13:09:48.913518 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1915/3835] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 24 13:09:48 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:09:59.279383 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:09:59.279953 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 13:09:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:10:12.159621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:10:12.160384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=53 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:10:12.166065 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2ecd7a84-9551-420a-a6fb-c85c9f2da7ab tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1236706732", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-318005720", "security_groups": [{"name": "tempest-secgroup-smoke-2119865640"}], "networks": [{"uuid": "8d5bfd5c-11f8-45ef-a917-87b07f071fc9"}], "block_device_mapping_v2": [{"uuid": "8cc928b5-3b70-4c9f-b2da-968b245987d5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:10:12.290638 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.network.neutron [None req-2ecd7a84-9551-420a-a6fb-c85c9f2da7ab tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] validate_networks() for [('8d5bfd5c-11f8-45ef-a917-87b07f071fc9', None, None, None, None, None)] {{(pid=121170) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:10:12.651504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-2ecd7a84-9551-420a-a6fb-c85c9f2da7ab tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Flavor limits 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:10:12.651926 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-2ecd7a84-9551-420a-a6fb-c85c9f2da7ab tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Image limits 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:10:12.652395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-2ecd7a84-9551-420a-a6fb-c85c9f2da7ab tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Flavor pref 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:10:12.652799 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-2ecd7a84-9551-420a-a6fb-c85c9f2da7ab tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Image pref 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:10:12.653204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-2ecd7a84-9551-420a-a6fb-c85c9f2da7ab tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:10:12.662292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2ecd7a84-9551-420a-a6fb-c85c9f2da7ab tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:12.662799 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2ecd7a84-9551-420a-a6fb-c85c9f2da7ab tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:12.663229 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2ecd7a84-9551-420a-a6fb-c85c9f2da7ab tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:12.663941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2ecd7a84-9551-420a-a6fb-c85c9f2da7ab tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:12.664393 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2ecd7a84-9551-420a-a6fb-c85c9f2da7ab tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:12.664810 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2ecd7a84-9551-420a-a6fb-c85c9f2da7ab tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:12.681332 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-2ecd7a84-9551-420a-a6fb-c85c9f2da7ab tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Getting quotas for project 618334fc8ef14486a1fc1411c42bf9b7. Resources: {'instances', 'cores', 'ram'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:10:12.685176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-2ecd7a84-9551-420a-a6fb-c85c9f2da7ab tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Getting quotas for user 5b6dec9001a14679ade64276a7962b5f and project 618334fc8ef14486a1fc1411c42bf9b7. Resources: {'instances', 'cores', 'ram'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:10:12.740883 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2ecd7a84-9551-420a-a6fb-c85c9f2da7ab tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Going to run 1 instances... {{(pid=121170) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 13:10:12.743025 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2ecd7a84-9551-420a-a6fb-c85c9f2da7ab tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8cc928b5-3b70-4c9f-b2da-968b245987d5',volume_size=None,volume_type=None)] {{(pid=121170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 13:10:13.067053 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2ecd7a84-9551-420a-a6fb-c85c9f2da7ab tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.908976 Aug 24 13:10:13.067685 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1921/3836] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 13:10:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 13:10:13.076347 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=4 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:10:13.077897 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:10:13.081717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-23dac112-87e3-4948-ae05-45b27e10bcfe tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:10:13.082317 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-23dac112-87e3-4948-ae05-45b27e10bcfe tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:10:13.135229 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-23dac112-87e3-4948-ae05-45b27e10bcfe tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:10:13.143564 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-23dac112-87e3-4948-ae05-45b27e10bcfe tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1088 microversion: 2.1 time: 0.068759 Aug 24 13:10:13.146679 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1916/3837] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:10:13 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:10:14.164781 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2a5baf97-2283-45cb-82bf-85c0ae4fb24c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:10:14.165500 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2a5baf97-2283-45cb-82bf-85c0ae4fb24c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:10:14.172827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a5baf97-2283-45cb-82bf-85c0ae4fb24c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:14.173315 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a5baf97-2283-45cb-82bf-85c0ae4fb24c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:14.173748 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a5baf97-2283-45cb-82bf-85c0ae4fb24c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:14.174439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a5baf97-2283-45cb-82bf-85c0ae4fb24c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:14.174926 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a5baf97-2283-45cb-82bf-85c0ae4fb24c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:14.175352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2a5baf97-2283-45cb-82bf-85c0ae4fb24c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:14.236896 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2a5baf97-2283-45cb-82bf-85c0ae4fb24c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:10:14.244714 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2a5baf97-2283-45cb-82bf-85c0ae4fb24c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1138 microversion: 2.1 time: 0.083881 Aug 24 13:10:14.246294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1922/3838] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:10:14 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1138 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:10:15.264958 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-efcc4feb-1893-4e2e-ab73-bca900b08438 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:10:15.265575 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-efcc4feb-1893-4e2e-ab73-bca900b08438 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:10:15.272912 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-efcc4feb-1893-4e2e-ab73-bca900b08438 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:15.273395 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-efcc4feb-1893-4e2e-ab73-bca900b08438 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:15.273852 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-efcc4feb-1893-4e2e-ab73-bca900b08438 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:15.274541 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-efcc4feb-1893-4e2e-ab73-bca900b08438 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:15.275020 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-efcc4feb-1893-4e2e-ab73-bca900b08438 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:15.275448 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-efcc4feb-1893-4e2e-ab73-bca900b08438 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:15.346962 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-efcc4feb-1893-4e2e-ab73-bca900b08438 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:10:15.355569 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-efcc4feb-1893-4e2e-ab73-bca900b08438 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1194 microversion: 2.1 time: 0.094464 Aug 24 13:10:15.356589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1917/3839] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:10:15 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1194 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:10:16.377533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7a9ea90a-f619-4400-96da-75292f24c80d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:10:16.379016 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7a9ea90a-f619-4400-96da-75292f24c80d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:10:16.386244 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a9ea90a-f619-4400-96da-75292f24c80d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:16.386864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a9ea90a-f619-4400-96da-75292f24c80d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:16.387452 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a9ea90a-f619-4400-96da-75292f24c80d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:16.388247 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a9ea90a-f619-4400-96da-75292f24c80d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:16.388916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a9ea90a-f619-4400-96da-75292f24c80d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:16.389437 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7a9ea90a-f619-4400-96da-75292f24c80d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:16.557946 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7a9ea90a-f619-4400-96da-75292f24c80d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:10:16.568414 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7a9ea90a-f619-4400-96da-75292f24c80d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1272 microversion: 2.1 time: 0.195098 Aug 24 13:10:16.569688 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1923/3840] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:10:16 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1272 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:10:17.217462 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-fa73a4a5-f899-4e4f-9b71-9137bf33f40b req-53ec1d4e-1d72-49d3-9dca-664dac92f792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48a36929-b791-4fa2-8537-d27f23d6db2c", "tag": "ffc1d77e-3111-433a-8725-48516fb03bd7"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:10:17.227738 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-fa73a4a5-f899-4e4f-9b71-9137bf33f40b req-53ec1d4e-1d72-49d3-9dca-664dac92f792 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:17.228350 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-fa73a4a5-f899-4e4f-9b71-9137bf33f40b req-53ec1d4e-1d72-49d3-9dca-664dac92f792 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:17.228864 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-fa73a4a5-f899-4e4f-9b71-9137bf33f40b req-53ec1d4e-1d72-49d3-9dca-664dac92f792 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:17.241072 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-fa73a4a5-f899-4e4f-9b71-9137bf33f40b req-53ec1d4e-1d72-49d3-9dca-664dac92f792 service nova] Creating event network-changed:ffc1d77e-3111-433a-8725-48516fb03bd7 for instance 48a36929-b791-4fa2-8537-d27f23d6db2c on hv-cinder-84889 Aug 24 13:10:17.246352 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-fa73a4a5-f899-4e4f-9b71-9137bf33f40b req-53ec1d4e-1d72-49d3-9dca-664dac92f792 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038522 Aug 24 13:10:17.247264 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1918/3841] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:10:17.592451 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-fe36105a-cbbe-4a55-9da9-b7e9e2951c93 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:10:17.593076 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-fe36105a-cbbe-4a55-9da9-b7e9e2951c93 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:10:17.599962 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe36105a-cbbe-4a55-9da9-b7e9e2951c93 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:17.600684 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe36105a-cbbe-4a55-9da9-b7e9e2951c93 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:17.601118 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe36105a-cbbe-4a55-9da9-b7e9e2951c93 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:17.601806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe36105a-cbbe-4a55-9da9-b7e9e2951c93 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:17.602262 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe36105a-cbbe-4a55-9da9-b7e9e2951c93 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:17.602708 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-fe36105a-cbbe-4a55-9da9-b7e9e2951c93 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:17.738296 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-fe36105a-cbbe-4a55-9da9-b7e9e2951c93 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:10:17.746188 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-fe36105a-cbbe-4a55-9da9-b7e9e2951c93 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1260 microversion: 2.1 time: 0.157450 Aug 24 13:10:17.751640 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1924/3842] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:10:17 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:10:18.766976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-033fcdd2-f314-41ff-b19b-9801ba713752 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:10:18.767669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-033fcdd2-f314-41ff-b19b-9801ba713752 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:10:18.774329 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-033fcdd2-f314-41ff-b19b-9801ba713752 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:18.774841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-033fcdd2-f314-41ff-b19b-9801ba713752 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:18.775277 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-033fcdd2-f314-41ff-b19b-9801ba713752 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:18.775956 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-033fcdd2-f314-41ff-b19b-9801ba713752 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:18.776432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-033fcdd2-f314-41ff-b19b-9801ba713752 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:18.776860 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-033fcdd2-f314-41ff-b19b-9801ba713752 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:18.907555 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-033fcdd2-f314-41ff-b19b-9801ba713752 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:10:18.915101 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-033fcdd2-f314-41ff-b19b-9801ba713752 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1260 microversion: 2.1 time: 0.152354 Aug 24 13:10:18.915660 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1919/3843] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:10:18 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:10:19.935484 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1720afef-0d3b-4484-b224-a190a2543375 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:10:19.936071 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1720afef-0d3b-4484-b224-a190a2543375 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:10:19.942528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1720afef-0d3b-4484-b224-a190a2543375 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:19.943046 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1720afef-0d3b-4484-b224-a190a2543375 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:19.943477 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1720afef-0d3b-4484-b224-a190a2543375 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:19.944156 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1720afef-0d3b-4484-b224-a190a2543375 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:19.944608 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1720afef-0d3b-4484-b224-a190a2543375 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:19.945034 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1720afef-0d3b-4484-b224-a190a2543375 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:20.074016 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-1720afef-0d3b-4484-b224-a190a2543375 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:10:20.082401 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1720afef-0d3b-4484-b224-a190a2543375 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1260 microversion: 2.1 time: 0.150916 Aug 24 13:10:20.083010 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1925/3844] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:10:19 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:10:21.102093 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fba0ef8e-2fa9-43c0-a05c-613a305b1feb tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:10:21.102699 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fba0ef8e-2fa9-43c0-a05c-613a305b1feb tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:10:21.108691 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fba0ef8e-2fa9-43c0-a05c-613a305b1feb tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:21.109177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fba0ef8e-2fa9-43c0-a05c-613a305b1feb tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:21.109587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fba0ef8e-2fa9-43c0-a05c-613a305b1feb tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:21.110254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fba0ef8e-2fa9-43c0-a05c-613a305b1feb tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:21.110757 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fba0ef8e-2fa9-43c0-a05c-613a305b1feb tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:21.111177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fba0ef8e-2fa9-43c0-a05c-613a305b1feb tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:21.241366 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fba0ef8e-2fa9-43c0-a05c-613a305b1feb tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:10:21.249006 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fba0ef8e-2fa9-43c0-a05c-613a305b1feb tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1260 microversion: 2.1 time: 0.150743 Aug 24 13:10:21.249585 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1920/3845] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:10:21 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:10:22.271046 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e45e14ba-b2f5-4d7b-b974-1e542942343d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:10:22.271637 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e45e14ba-b2f5-4d7b-b974-1e542942343d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:10:22.278804 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e45e14ba-b2f5-4d7b-b974-1e542942343d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:22.279284 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e45e14ba-b2f5-4d7b-b974-1e542942343d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:22.279718 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e45e14ba-b2f5-4d7b-b974-1e542942343d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:22.280402 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e45e14ba-b2f5-4d7b-b974-1e542942343d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:22.280852 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e45e14ba-b2f5-4d7b-b974-1e542942343d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:22.281273 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e45e14ba-b2f5-4d7b-b974-1e542942343d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:22.417241 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e45e14ba-b2f5-4d7b-b974-1e542942343d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:10:22.427541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e45e14ba-b2f5-4d7b-b974-1e542942343d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1260 microversion: 2.1 time: 0.162137 Aug 24 13:10:22.428304 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1926/3846] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:10:22 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:10:23.447998 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cfae53e8-8ce5-4ef9-b0cc-6ea7f82576bc tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:10:23.448601 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cfae53e8-8ce5-4ef9-b0cc-6ea7f82576bc tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:10:23.451058 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=2 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:10:23.456480 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfae53e8-8ce5-4ef9-b0cc-6ea7f82576bc tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:23.465148 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfae53e8-8ce5-4ef9-b0cc-6ea7f82576bc tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:23.465148 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfae53e8-8ce5-4ef9-b0cc-6ea7f82576bc tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:23.465148 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfae53e8-8ce5-4ef9-b0cc-6ea7f82576bc tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:23.465148 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfae53e8-8ce5-4ef9-b0cc-6ea7f82576bc tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:23.465751 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cfae53e8-8ce5-4ef9-b0cc-6ea7f82576bc tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:23.592933 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cfae53e8-8ce5-4ef9-b0cc-6ea7f82576bc tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:10:23.601212 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cfae53e8-8ce5-4ef9-b0cc-6ea7f82576bc tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1260 microversion: 2.1 time: 0.156990 Aug 24 13:10:23.601777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1921/3847] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:10:23 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:10:24.622027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-58dcf2bc-ad2e-498c-beae-7ab691059b9c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:10:24.622698 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-58dcf2bc-ad2e-498c-beae-7ab691059b9c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:10:24.624462 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell0:SELECT=2 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:10:24.625120 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell0:SELECT=6 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:10:24.630340 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58dcf2bc-ad2e-498c-beae-7ab691059b9c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:24.630865 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58dcf2bc-ad2e-498c-beae-7ab691059b9c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:24.631310 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58dcf2bc-ad2e-498c-beae-7ab691059b9c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:24.631998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58dcf2bc-ad2e-498c-beae-7ab691059b9c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:24.632456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58dcf2bc-ad2e-498c-beae-7ab691059b9c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:24.632885 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-58dcf2bc-ad2e-498c-beae-7ab691059b9c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:24.761240 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-58dcf2bc-ad2e-498c-beae-7ab691059b9c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:10:24.769005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-58dcf2bc-ad2e-498c-beae-7ab691059b9c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1260 microversion: 2.1 time: 0.150865 Aug 24 13:10:24.769561 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1927/3848] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:10:24 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:10:25.789041 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8cc789cc-bdb8-44a8-a9cf-33775c7883ba tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:10:25.789650 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8cc789cc-bdb8-44a8-a9cf-33775c7883ba tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:10:25.796038 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8cc789cc-bdb8-44a8-a9cf-33775c7883ba tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:25.796519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8cc789cc-bdb8-44a8-a9cf-33775c7883ba tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:25.796955 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8cc789cc-bdb8-44a8-a9cf-33775c7883ba tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:25.797637 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8cc789cc-bdb8-44a8-a9cf-33775c7883ba tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:25.798601 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8cc789cc-bdb8-44a8-a9cf-33775c7883ba tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:25.799486 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8cc789cc-bdb8-44a8-a9cf-33775c7883ba tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:25.926228 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8cc789cc-bdb8-44a8-a9cf-33775c7883ba tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:10:25.933683 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8cc789cc-bdb8-44a8-a9cf-33775c7883ba tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1260 microversion: 2.1 time: 0.148490 Aug 24 13:10:25.934236 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1922/3849] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:10:25 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:10:26.954872 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-96c81294-620f-46b4-8137-56f9e8196d33 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:10:26.955473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-96c81294-620f-46b4-8137-56f9e8196d33 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:10:26.961759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96c81294-620f-46b4-8137-56f9e8196d33 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:26.962232 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96c81294-620f-46b4-8137-56f9e8196d33 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:26.962684 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96c81294-620f-46b4-8137-56f9e8196d33 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:26.963363 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96c81294-620f-46b4-8137-56f9e8196d33 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:26.963813 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96c81294-620f-46b4-8137-56f9e8196d33 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:26.964232 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-96c81294-620f-46b4-8137-56f9e8196d33 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:27.094965 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-96c81294-620f-46b4-8137-56f9e8196d33 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:10:27.103089 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-96c81294-620f-46b4-8137-56f9e8196d33 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1260 microversion: 2.1 time: 0.152060 Aug 24 13:10:27.103637 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1928/3850] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:10:26 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:10:28.123571 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d89af760-a4f4-4e97-b632-5c6039f723dd tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:10:28.124188 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d89af760-a4f4-4e97-b632-5c6039f723dd tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:10:28.131180 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d89af760-a4f4-4e97-b632-5c6039f723dd tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:28.131657 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d89af760-a4f4-4e97-b632-5c6039f723dd tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:28.132090 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d89af760-a4f4-4e97-b632-5c6039f723dd tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:28.132766 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d89af760-a4f4-4e97-b632-5c6039f723dd tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:28.133215 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d89af760-a4f4-4e97-b632-5c6039f723dd tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:28.133636 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d89af760-a4f4-4e97-b632-5c6039f723dd tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:28.270487 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d89af760-a4f4-4e97-b632-5c6039f723dd tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:10:28.278089 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d89af760-a4f4-4e97-b632-5c6039f723dd tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1260 microversion: 2.1 time: 0.158330 Aug 24 13:10:28.278668 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1923/3851] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:10:28 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:10:29.302621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dc2166af-dae2-4b2a-b735-e266a609d8a0 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:10:29.303267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dc2166af-dae2-4b2a-b735-e266a609d8a0 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:10:29.309573 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc2166af-dae2-4b2a-b735-e266a609d8a0 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:29.310049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc2166af-dae2-4b2a-b735-e266a609d8a0 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:29.310481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc2166af-dae2-4b2a-b735-e266a609d8a0 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:29.311189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc2166af-dae2-4b2a-b735-e266a609d8a0 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:29.311641 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc2166af-dae2-4b2a-b735-e266a609d8a0 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:29.312060 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dc2166af-dae2-4b2a-b735-e266a609d8a0 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:29.441515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-dc2166af-dae2-4b2a-b735-e266a609d8a0 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:10:29.449172 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dc2166af-dae2-4b2a-b735-e266a609d8a0 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1260 microversion: 2.1 time: 0.150885 Aug 24 13:10:29.449727 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1929/3852] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:10:29 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:10:30.469447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-02828ca5-d1b5-4bac-a76a-9fe5fa6c0e7f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:10:30.470045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-02828ca5-d1b5-4bac-a76a-9fe5fa6c0e7f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:10:30.476674 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02828ca5-d1b5-4bac-a76a-9fe5fa6c0e7f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:30.477150 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02828ca5-d1b5-4bac-a76a-9fe5fa6c0e7f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:30.477583 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02828ca5-d1b5-4bac-a76a-9fe5fa6c0e7f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:30.478265 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02828ca5-d1b5-4bac-a76a-9fe5fa6c0e7f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:30.478864 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02828ca5-d1b5-4bac-a76a-9fe5fa6c0e7f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:30.479211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02828ca5-d1b5-4bac-a76a-9fe5fa6c0e7f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:30.496184 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-87e8745a-5c19-4f2b-910c-6e55a8721021 req-405c77cb-d4d3-4197-9220-e490b456b045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48a36929-b791-4fa2-8537-d27f23d6db2c", "name": "network-vif-plugged", "status": "completed", "tag": "ffc1d77e-3111-433a-8725-48516fb03bd7"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:10:30.506864 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-87e8745a-5c19-4f2b-910c-6e55a8721021 req-405c77cb-d4d3-4197-9220-e490b456b045 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:30.507613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-87e8745a-5c19-4f2b-910c-6e55a8721021 req-405c77cb-d4d3-4197-9220-e490b456b045 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:30.508050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-87e8745a-5c19-4f2b-910c-6e55a8721021 req-405c77cb-d4d3-4197-9220-e490b456b045 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:30.520003 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-87e8745a-5c19-4f2b-910c-6e55a8721021 req-405c77cb-d4d3-4197-9220-e490b456b045 service nova] Creating event network-vif-plugged:ffc1d77e-3111-433a-8725-48516fb03bd7 for instance 48a36929-b791-4fa2-8537-d27f23d6db2c on hv-cinder-84889 Aug 24 13:10:30.525278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-87e8745a-5c19-4f2b-910c-6e55a8721021 req-405c77cb-d4d3-4197-9220-e490b456b045 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033180 Aug 24 13:10:30.526075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1930/3853] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:10:30.615803 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-02828ca5-d1b5-4bac-a76a-9fe5fa6c0e7f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:10:30.623803 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-02828ca5-d1b5-4bac-a76a-9fe5fa6c0e7f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1260 microversion: 2.1 time: 0.158374 Aug 24 13:10:30.624356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1924/3854] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:10:30 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:10:31.645945 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6a39fdd7-0271-4866-9d08-bbfdb98c4484 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:10:31.646678 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6a39fdd7-0271-4866-9d08-bbfdb98c4484 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:10:31.653216 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a39fdd7-0271-4866-9d08-bbfdb98c4484 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:31.653700 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a39fdd7-0271-4866-9d08-bbfdb98c4484 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:31.654142 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a39fdd7-0271-4866-9d08-bbfdb98c4484 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:31.654861 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a39fdd7-0271-4866-9d08-bbfdb98c4484 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:31.655325 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a39fdd7-0271-4866-9d08-bbfdb98c4484 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:31.655754 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6a39fdd7-0271-4866-9d08-bbfdb98c4484 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:31.787831 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-6a39fdd7-0271-4866-9d08-bbfdb98c4484 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:10:31.795592 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6a39fdd7-0271-4866-9d08-bbfdb98c4484 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1260 microversion: 2.1 time: 0.153895 Aug 24 13:10:31.796149 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1931/3855] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:10:31 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:10:32.816271 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c98322d9-001e-4a82-ac29-b3a3ccc3739f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:10:32.816876 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c98322d9-001e-4a82-ac29-b3a3ccc3739f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:10:32.823325 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c98322d9-001e-4a82-ac29-b3a3ccc3739f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:32.823804 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c98322d9-001e-4a82-ac29-b3a3ccc3739f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:32.824240 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c98322d9-001e-4a82-ac29-b3a3ccc3739f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:32.824919 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c98322d9-001e-4a82-ac29-b3a3ccc3739f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:32.825371 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c98322d9-001e-4a82-ac29-b3a3ccc3739f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:32.825797 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c98322d9-001e-4a82-ac29-b3a3ccc3739f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:32.957449 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c98322d9-001e-4a82-ac29-b3a3ccc3739f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:10:32.965482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c98322d9-001e-4a82-ac29-b3a3ccc3739f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1443 microversion: 2.1 time: 0.153167 Aug 24 13:10:32.966040 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1925/3856] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:10:32 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:10:32.985681 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4bd493fb-8025-4ead-b6be-2e2a4c843f57 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:10:32.986292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4bd493fb-8025-4ead-b6be-2e2a4c843f57 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:10:32.993795 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4bd493fb-8025-4ead-b6be-2e2a4c843f57 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:32.994285 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4bd493fb-8025-4ead-b6be-2e2a4c843f57 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:32.995027 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4bd493fb-8025-4ead-b6be-2e2a4c843f57 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:32.996138 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4bd493fb-8025-4ead-b6be-2e2a4c843f57 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:32.996607 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4bd493fb-8025-4ead-b6be-2e2a4c843f57 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:32.997331 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4bd493fb-8025-4ead-b6be-2e2a4c843f57 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:33.134504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-4bd493fb-8025-4ead-b6be-2e2a4c843f57 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:10:33.142233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4bd493fb-8025-4ead-b6be-2e2a4c843f57 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1443 microversion: 2.1 time: 0.160352 Aug 24 13:10:33.142823 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1932/3857] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:10:32 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1443 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:10:35.101835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-6367cceb-5f74-4083-a9b6-35cb68c8ed64 req-de9ee3bc-70eb-4f42-9fa8-dcfdcc78fb9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48a36929-b791-4fa2-8537-d27f23d6db2c", "tag": "ffc1d77e-3111-433a-8725-48516fb03bd7"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:10:35.113603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-6367cceb-5f74-4083-a9b6-35cb68c8ed64 req-de9ee3bc-70eb-4f42-9fa8-dcfdcc78fb9b service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:10:35.114563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-6367cceb-5f74-4083-a9b6-35cb68c8ed64 req-de9ee3bc-70eb-4f42-9fa8-dcfdcc78fb9b service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:10:35.115182 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-6367cceb-5f74-4083-a9b6-35cb68c8ed64 req-de9ee3bc-70eb-4f42-9fa8-dcfdcc78fb9b service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:10:35.127880 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-6367cceb-5f74-4083-a9b6-35cb68c8ed64 req-de9ee3bc-70eb-4f42-9fa8-dcfdcc78fb9b service nova] Creating event network-changed:ffc1d77e-3111-433a-8725-48516fb03bd7 for instance 48a36929-b791-4fa2-8537-d27f23d6db2c on hv-cinder-84889 Aug 24 13:10:35.133122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-6367cceb-5f74-4083-a9b6-35cb68c8ed64 req-de9ee3bc-70eb-4f42-9fa8-dcfdcc78fb9b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035452 Aug 24 13:10:35.133875 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1926/3858] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:12:49.919827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e9b880af-0db7-46d0-80b6-f6e6eac4ce9b] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 13:12:49.920425 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:12:49.921079 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=64 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:12:49.925013 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3ee50f9a-9500-4c7c-b10e-3abe4d42b210 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:12:49.930431 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3ee50f9a-9500-4c7c-b10e-3abe4d42b210 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:12:49.931973 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ee50f9a-9500-4c7c-b10e-3abe4d42b210 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:12:49.932456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ee50f9a-9500-4c7c-b10e-3abe4d42b210 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:12:49.932888 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ee50f9a-9500-4c7c-b10e-3abe4d42b210 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:12:49.933561 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ee50f9a-9500-4c7c-b10e-3abe4d42b210 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:12:49.934014 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ee50f9a-9500-4c7c-b10e-3abe4d42b210 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:12:49.934433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ee50f9a-9500-4c7c-b10e-3abe4d42b210 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:12:49.957531 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.objects.instance [None req-3ee50f9a-9500-4c7c-b10e-3abe4d42b210 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lazy-loading 'flavor' on Instance uuid 48a36929-b791-4fa2-8537-d27f23d6db2c {{(pid=121170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:12:50.213595 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3ee50f9a-9500-4c7c-b10e-3abe4d42b210 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "POST /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c/action" status: 202 len: 0 microversion: 2.1 time: 0.295413 Aug 24 13:12:50.214089 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1933/3859] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 13:12:49 2022] POST /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:12:50.221397 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b6b80c23-6823-4ba7-8f9f-446190311493] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 13:12:50.221956 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=24 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:12:50.223016 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=52 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:12:50.228161 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6214b19a-e981-4558-990b-7c2b5db6f266 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:12:50.229983 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6214b19a-e981-4558-990b-7c2b5db6f266 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:12:50.235858 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6214b19a-e981-4558-990b-7c2b5db6f266 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:12:50.237993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6214b19a-e981-4558-990b-7c2b5db6f266 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:12:50.237993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6214b19a-e981-4558-990b-7c2b5db6f266 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:12:50.237993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6214b19a-e981-4558-990b-7c2b5db6f266 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:12:50.237993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6214b19a-e981-4558-990b-7c2b5db6f266 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:12:50.238353 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6214b19a-e981-4558-990b-7c2b5db6f266 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:12:50.425256 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6214b19a-e981-4558-990b-7c2b5db6f266 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:12:50.433971 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6214b19a-e981-4558-990b-7c2b5db6f266 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1567 microversion: 2.1 time: 0.214887 Aug 24 13:12:50.434589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1927/3860] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:12:50 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:12:51.457775 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-aab6a87f-3d96-464c-99d3-57e5fc4a18fd tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:12:51.458473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-aab6a87f-3d96-464c-99d3-57e5fc4a18fd tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:12:51.469514 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] [e9b880af-0db7-46d0-80b6-f6e6eac4ce9b] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 48710. Aug 24 13:12:51.473588 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aab6a87f-3d96-464c-99d3-57e5fc4a18fd tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:12:51.474085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aab6a87f-3d96-464c-99d3-57e5fc4a18fd tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:12:51.474521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aab6a87f-3d96-464c-99d3-57e5fc4a18fd tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:12:51.475244 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aab6a87f-3d96-464c-99d3-57e5fc4a18fd tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:12:51.475698 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aab6a87f-3d96-464c-99d3-57e5fc4a18fd tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:12:51.476127 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-aab6a87f-3d96-464c-99d3-57e5fc4a18fd tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:12:51.658104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-aab6a87f-3d96-464c-99d3-57e5fc4a18fd tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:12:51.666489 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-aab6a87f-3d96-464c-99d3-57e5fc4a18fd tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1567 microversion: 2.1 time: 0.212375 Aug 24 13:12:51.667064 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1934/3861] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:12:51 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1567 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:12:52.687505 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-adbd992c-54fc-4efd-8e94-eefae274c4ea tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:12:52.688034 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-adbd992c-54fc-4efd-8e94-eefae274c4ea tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:12:52.695745 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-adbd992c-54fc-4efd-8e94-eefae274c4ea tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:12:52.696224 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-adbd992c-54fc-4efd-8e94-eefae274c4ea tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:12:52.696662 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-adbd992c-54fc-4efd-8e94-eefae274c4ea tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:12:52.697336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-adbd992c-54fc-4efd-8e94-eefae274c4ea tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:12:52.697790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-adbd992c-54fc-4efd-8e94-eefae274c4ea tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:12:52.698211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-adbd992c-54fc-4efd-8e94-eefae274c4ea tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:12:52.703973 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] [b6b80c23-6823-4ba7-8f9f-446190311493] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 48720. Aug 24 13:12:52.827834 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-adbd992c-54fc-4efd-8e94-eefae274c4ea tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:12:52.835524 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-adbd992c-54fc-4efd-8e94-eefae274c4ea tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1567 microversion: 2.1 time: 0.152535 Aug 24 13:12:52.836075 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1928/3862] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:12:52 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:12:53.856955 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-07354114-3c19-4fae-9308-919f5d3d611b tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:12:53.857764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-07354114-3c19-4fae-9308-919f5d3d611b tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:12:53.864272 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-07354114-3c19-4fae-9308-919f5d3d611b tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:12:53.864746 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-07354114-3c19-4fae-9308-919f5d3d611b tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:12:53.865180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-07354114-3c19-4fae-9308-919f5d3d611b tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:12:53.865854 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-07354114-3c19-4fae-9308-919f5d3d611b tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:12:53.866305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-07354114-3c19-4fae-9308-919f5d3d611b tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:12:53.866749 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-07354114-3c19-4fae-9308-919f5d3d611b tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:12:53.998156 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-07354114-3c19-4fae-9308-919f5d3d611b tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:12:54.005733 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-07354114-3c19-4fae-9308-919f5d3d611b tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1567 microversion: 2.1 time: 0.153350 Aug 24 13:12:54.006279 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1935/3863] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:12:53 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:12:55.025931 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2a134537-01fe-4b90-bf41-8f649b75d97e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:12:55.027070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2a134537-01fe-4b90-bf41-8f649b75d97e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:12:55.033384 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a134537-01fe-4b90-bf41-8f649b75d97e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:12:55.033866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a134537-01fe-4b90-bf41-8f649b75d97e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:12:55.034299 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a134537-01fe-4b90-bf41-8f649b75d97e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:12:55.035004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a134537-01fe-4b90-bf41-8f649b75d97e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:12:55.035455 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a134537-01fe-4b90-bf41-8f649b75d97e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:12:55.035879 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2a134537-01fe-4b90-bf41-8f649b75d97e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:12:55.177132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2a134537-01fe-4b90-bf41-8f649b75d97e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:12:55.177309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2a134537-01fe-4b90-bf41-8f649b75d97e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1567 microversion: 2.1 time: 0.155175 Aug 24 13:12:55.177864 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1929/3864] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:12:55 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:12:56.197247 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8ccee4d1-15e4-4be8-b431-26abdda3fa77 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:12:56.197855 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8ccee4d1-15e4-4be8-b431-26abdda3fa77 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:12:56.204193 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8ccee4d1-15e4-4be8-b431-26abdda3fa77 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:12:56.204673 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8ccee4d1-15e4-4be8-b431-26abdda3fa77 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:12:56.205107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8ccee4d1-15e4-4be8-b431-26abdda3fa77 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:12:56.205784 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8ccee4d1-15e4-4be8-b431-26abdda3fa77 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:12:56.206239 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8ccee4d1-15e4-4be8-b431-26abdda3fa77 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:12:56.206682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8ccee4d1-15e4-4be8-b431-26abdda3fa77 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:12:56.333357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8ccee4d1-15e4-4be8-b431-26abdda3fa77 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:12:56.340980 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8ccee4d1-15e4-4be8-b431-26abdda3fa77 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1567 microversion: 2.1 time: 0.147576 Aug 24 13:12:56.341539 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1936/3865] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:12:56 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:12:57.361568 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8386caad-f23b-4271-a975-b440158c6618 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:12:57.362175 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8386caad-f23b-4271-a975-b440158c6618 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:12:57.368741 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8386caad-f23b-4271-a975-b440158c6618 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:12:57.369217 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8386caad-f23b-4271-a975-b440158c6618 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:12:57.369648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8386caad-f23b-4271-a975-b440158c6618 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:12:57.370858 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8386caad-f23b-4271-a975-b440158c6618 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:12:57.371311 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8386caad-f23b-4271-a975-b440158c6618 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:12:57.371730 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8386caad-f23b-4271-a975-b440158c6618 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:12:57.498843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8386caad-f23b-4271-a975-b440158c6618 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:12:57.506420 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8386caad-f23b-4271-a975-b440158c6618 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1567 microversion: 2.1 time: 0.148659 Aug 24 13:12:57.507007 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1930/3866] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:12:57 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:12:58.528322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-2e128903-dca9-4ff3-8ed3-9d2469ff8c31 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:12:58.532086 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-2e128903-dca9-4ff3-8ed3-9d2469ff8c31 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:12:58.535253 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2e128903-dca9-4ff3-8ed3-9d2469ff8c31 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:12:58.535728 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2e128903-dca9-4ff3-8ed3-9d2469ff8c31 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:12:58.536158 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2e128903-dca9-4ff3-8ed3-9d2469ff8c31 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:12:58.536837 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2e128903-dca9-4ff3-8ed3-9d2469ff8c31 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:12:58.537289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2e128903-dca9-4ff3-8ed3-9d2469ff8c31 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:12:58.537709 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-2e128903-dca9-4ff3-8ed3-9d2469ff8c31 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:12:58.671514 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-2e128903-dca9-4ff3-8ed3-9d2469ff8c31 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:12:58.679165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-2e128903-dca9-4ff3-8ed3-9d2469ff8c31 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1567 microversion: 2.1 time: 0.155214 Aug 24 13:12:58.679679 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1937/3867] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:12:58 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:12:59.699936 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-20c678dd-499d-4e5b-bb2c-a7873b71ac9e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:12:59.700455 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-20c678dd-499d-4e5b-bb2c-a7873b71ac9e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:12:59.706717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20c678dd-499d-4e5b-bb2c-a7873b71ac9e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:12:59.707188 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20c678dd-499d-4e5b-bb2c-a7873b71ac9e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:12:59.707614 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20c678dd-499d-4e5b-bb2c-a7873b71ac9e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:12:59.708280 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20c678dd-499d-4e5b-bb2c-a7873b71ac9e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:12:59.708726 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20c678dd-499d-4e5b-bb2c-a7873b71ac9e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:12:59.709143 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-20c678dd-499d-4e5b-bb2c-a7873b71ac9e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:12:59.839850 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-20c678dd-499d-4e5b-bb2c-a7873b71ac9e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:12:59.847449 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-20c678dd-499d-4e5b-bb2c-a7873b71ac9e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1567 microversion: 2.1 time: 0.151423 Aug 24 13:12:59.847999 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1931/3868] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:12:59 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:00.867895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5f4cffae-d59b-466d-b8c4-9807a18c6ab1 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:00.868508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5f4cffae-d59b-466d-b8c4-9807a18c6ab1 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:00.874906 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f4cffae-d59b-466d-b8c4-9807a18c6ab1 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:00.875395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f4cffae-d59b-466d-b8c4-9807a18c6ab1 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:00.875865 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f4cffae-d59b-466d-b8c4-9807a18c6ab1 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:00.876550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f4cffae-d59b-466d-b8c4-9807a18c6ab1 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:00.877006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f4cffae-d59b-466d-b8c4-9807a18c6ab1 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:00.877431 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f4cffae-d59b-466d-b8c4-9807a18c6ab1 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:01.010548 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5f4cffae-d59b-466d-b8c4-9807a18c6ab1 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:01.019148 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5f4cffae-d59b-466d-b8c4-9807a18c6ab1 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1567 microversion: 2.1 time: 0.155321 Aug 24 13:13:01.019721 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1938/3869] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:00 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:02.039725 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d17aacff-bea7-4078-9b4a-bf584bfa6aeb tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:02.040424 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d17aacff-bea7-4078-9b4a-bf584bfa6aeb tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:02.047612 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d17aacff-bea7-4078-9b4a-bf584bfa6aeb tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:02.048094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d17aacff-bea7-4078-9b4a-bf584bfa6aeb tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:02.048537 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d17aacff-bea7-4078-9b4a-bf584bfa6aeb tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:02.049224 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d17aacff-bea7-4078-9b4a-bf584bfa6aeb tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:02.049673 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d17aacff-bea7-4078-9b4a-bf584bfa6aeb tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:02.050097 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d17aacff-bea7-4078-9b4a-bf584bfa6aeb tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:02.181531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d17aacff-bea7-4078-9b4a-bf584bfa6aeb tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:02.189151 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d17aacff-bea7-4078-9b4a-bf584bfa6aeb tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1567 microversion: 2.1 time: 0.153199 Aug 24 13:13:02.197120 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1932/3870] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:02 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:03.210441 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8a27e41b-b425-4125-878d-1a80711ff3d0 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:03.211072 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8a27e41b-b425-4125-878d-1a80711ff3d0 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:03.217990 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8a27e41b-b425-4125-878d-1a80711ff3d0 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:03.218464 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8a27e41b-b425-4125-878d-1a80711ff3d0 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:03.218937 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8a27e41b-b425-4125-878d-1a80711ff3d0 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:03.219609 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8a27e41b-b425-4125-878d-1a80711ff3d0 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:03.220054 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8a27e41b-b425-4125-878d-1a80711ff3d0 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:03.220471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8a27e41b-b425-4125-878d-1a80711ff3d0 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:03.353657 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8a27e41b-b425-4125-878d-1a80711ff3d0 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:03.362338 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8a27e41b-b425-4125-878d-1a80711ff3d0 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1567 microversion: 2.1 time: 0.155708 Aug 24 13:13:03.362927 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1939/3871] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:03 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:04.383362 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d779bf21-a733-42b5-99ab-b1d1fa41145e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:04.383912 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d779bf21-a733-42b5-99ab-b1d1fa41145e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:04.390206 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d779bf21-a733-42b5-99ab-b1d1fa41145e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:04.390709 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d779bf21-a733-42b5-99ab-b1d1fa41145e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:04.391154 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d779bf21-a733-42b5-99ab-b1d1fa41145e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:04.391833 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d779bf21-a733-42b5-99ab-b1d1fa41145e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:04.392281 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d779bf21-a733-42b5-99ab-b1d1fa41145e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:04.392703 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d779bf21-a733-42b5-99ab-b1d1fa41145e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:04.520254 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d779bf21-a733-42b5-99ab-b1d1fa41145e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:04.527834 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d779bf21-a733-42b5-99ab-b1d1fa41145e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1508 microversion: 2.1 time: 0.148404 Aug 24 13:13:04.528388 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1933/3872] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:04 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:04.547907 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b9d04dd0-6053-43bc-8a61-7a671e90d8a2 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:13:04.548499 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b9d04dd0-6053-43bc-8a61-7a671e90d8a2 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:04.554872 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b9d04dd0-6053-43bc-8a61-7a671e90d8a2 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:04.555349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b9d04dd0-6053-43bc-8a61-7a671e90d8a2 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:04.555780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b9d04dd0-6053-43bc-8a61-7a671e90d8a2 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:04.556456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b9d04dd0-6053-43bc-8a61-7a671e90d8a2 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:04.556906 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b9d04dd0-6053-43bc-8a61-7a671e90d8a2 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:04.557325 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b9d04dd0-6053-43bc-8a61-7a671e90d8a2 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:04.595905 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b9d04dd0-6053-43bc-8a61-7a671e90d8a2 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121170) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 13:13:04.864936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b9d04dd0-6053-43bc-8a61-7a671e90d8a2 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [d9b54b6e-3edf-432c-84f6-c5eee932d3b4] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 13:13:05.873262 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [None req-b9d04dd0-6053-43bc-8a61-7a671e90d8a2 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [d9b54b6e-3edf-432c-84f6-c5eee932d3b4] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 48770. Aug 24 13:13:05.876338 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b9d04dd0-6053-43bc-8a61-7a671e90d8a2 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "POST /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c/action" status: 202 len: 0 microversion: 2.1 time: 1.332326 Aug 24 13:13:05.876941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1940/3873] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 24 13:13:04 2022] POST /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c/action => generated 0 bytes in 1334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:13:05.885013 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-be1b1736-4e23-4e6c-80a1-8456efe81aea tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:05.885616 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-be1b1736-4e23-4e6c-80a1-8456efe81aea tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:05.891673 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be1b1736-4e23-4e6c-80a1-8456efe81aea tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:05.892199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be1b1736-4e23-4e6c-80a1-8456efe81aea tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:05.892659 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be1b1736-4e23-4e6c-80a1-8456efe81aea tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:05.893346 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be1b1736-4e23-4e6c-80a1-8456efe81aea tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:05.893795 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be1b1736-4e23-4e6c-80a1-8456efe81aea tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:05.894214 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be1b1736-4e23-4e6c-80a1-8456efe81aea tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:06.037864 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-be1b1736-4e23-4e6c-80a1-8456efe81aea tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:06.046111 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-be1b1736-4e23-4e6c-80a1-8456efe81aea tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1516 microversion: 2.1 time: 0.164890 Aug 24 13:13:06.046677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1934/3874] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:05 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:07.067378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d4c338dd-753f-4ebd-b213-3c99a0051aad tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:07.068067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d4c338dd-753f-4ebd-b213-3c99a0051aad tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:07.075949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4c338dd-753f-4ebd-b213-3c99a0051aad tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:07.076445 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4c338dd-753f-4ebd-b213-3c99a0051aad tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:07.076887 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4c338dd-753f-4ebd-b213-3c99a0051aad tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:07.077581 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4c338dd-753f-4ebd-b213-3c99a0051aad tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:07.078048 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4c338dd-753f-4ebd-b213-3c99a0051aad tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:07.078475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d4c338dd-753f-4ebd-b213-3c99a0051aad tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:07.133549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-535be338-858d-49d0-b11e-ee5c122c7602 req-b9b388ef-cc7b-43ec-9519-df96a2afd02d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48a36929-b791-4fa2-8537-d27f23d6db2c", "name": "network-vif-unplugged", "status": "completed", "tag": "ffc1d77e-3111-433a-8725-48516fb03bd7"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:13:07.144671 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-535be338-858d-49d0-b11e-ee5c122c7602 req-b9b388ef-cc7b-43ec-9519-df96a2afd02d service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:07.145305 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-535be338-858d-49d0-b11e-ee5c122c7602 req-b9b388ef-cc7b-43ec-9519-df96a2afd02d service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:07.145928 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-535be338-858d-49d0-b11e-ee5c122c7602 req-b9b388ef-cc7b-43ec-9519-df96a2afd02d service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:07.158129 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.compute.server_external_events [req-535be338-858d-49d0-b11e-ee5c122c7602 req-b9b388ef-cc7b-43ec-9519-df96a2afd02d service nova] Unable to find a host for instance 48a36929-b791-4fa2-8537-d27f23d6db2c. Dropping event network-vif-unplugged {{(pid=121171) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 13:13:07.159025 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-535be338-858d-49d0-b11e-ee5c122c7602 req-b9b388ef-cc7b-43ec-9519-df96a2afd02d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032224 Aug 24 13:13:07.159596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1935/3875] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 24 13:13:07.225765 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d4c338dd-753f-4ebd-b213-3c99a0051aad tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:07.233933 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d4c338dd-753f-4ebd-b213-3c99a0051aad tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1518 microversion: 2.1 time: 0.170291 Aug 24 13:13:07.242591 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1941/3876] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:07 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:08.255612 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-336241a2-f5fe-4846-a5af-165cfa26b167 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:08.256231 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-336241a2-f5fe-4846-a5af-165cfa26b167 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:08.263187 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-336241a2-f5fe-4846-a5af-165cfa26b167 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:08.263670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-336241a2-f5fe-4846-a5af-165cfa26b167 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:08.264108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-336241a2-f5fe-4846-a5af-165cfa26b167 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:08.264812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-336241a2-f5fe-4846-a5af-165cfa26b167 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:08.265275 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-336241a2-f5fe-4846-a5af-165cfa26b167 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:08.265674 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-336241a2-f5fe-4846-a5af-165cfa26b167 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:08.397671 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-336241a2-f5fe-4846-a5af-165cfa26b167 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:08.405908 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-336241a2-f5fe-4846-a5af-165cfa26b167 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1518 microversion: 2.1 time: 0.154078 Aug 24 13:13:08.406464 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1936/3877] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:08 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:09.431352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e3af5146-be9b-4732-ad82-46bed64cf0ad tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:09.431961 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e3af5146-be9b-4732-ad82-46bed64cf0ad tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:09.439007 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3af5146-be9b-4732-ad82-46bed64cf0ad tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:09.439804 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3af5146-be9b-4732-ad82-46bed64cf0ad tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:09.440309 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3af5146-be9b-4732-ad82-46bed64cf0ad tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:09.441116 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3af5146-be9b-4732-ad82-46bed64cf0ad tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:09.441639 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3af5146-be9b-4732-ad82-46bed64cf0ad tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:09.442149 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e3af5146-be9b-4732-ad82-46bed64cf0ad tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:09.572742 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e3af5146-be9b-4732-ad82-46bed64cf0ad tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:09.581208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e3af5146-be9b-4732-ad82-46bed64cf0ad tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1574 microversion: 2.1 time: 0.155635 Aug 24 13:13:09.581790 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1942/3878] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:09 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:10.602153 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d30644f4-d0df-4004-8bb3-2fd1469b829f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:10.602786 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d30644f4-d0df-4004-8bb3-2fd1469b829f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:10.609078 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d30644f4-d0df-4004-8bb3-2fd1469b829f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:10.609556 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d30644f4-d0df-4004-8bb3-2fd1469b829f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:10.609990 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d30644f4-d0df-4004-8bb3-2fd1469b829f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:10.610687 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d30644f4-d0df-4004-8bb3-2fd1469b829f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:10.611138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d30644f4-d0df-4004-8bb3-2fd1469b829f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:10.611557 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d30644f4-d0df-4004-8bb3-2fd1469b829f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:10.739668 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d30644f4-d0df-4004-8bb3-2fd1469b829f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:10.748073 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d30644f4-d0df-4004-8bb3-2fd1469b829f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1574 microversion: 2.1 time: 0.149690 Aug 24 13:13:10.748634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1937/3879] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:10 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:11.769753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-887f2375-ff13-42ff-85f4-4e9ccc4d0ae1 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:11.770367 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-887f2375-ff13-42ff-85f4-4e9ccc4d0ae1 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:11.777349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-887f2375-ff13-42ff-85f4-4e9ccc4d0ae1 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:11.777833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-887f2375-ff13-42ff-85f4-4e9ccc4d0ae1 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:11.778294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-887f2375-ff13-42ff-85f4-4e9ccc4d0ae1 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:11.779012 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-887f2375-ff13-42ff-85f4-4e9ccc4d0ae1 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:11.779467 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-887f2375-ff13-42ff-85f4-4e9ccc4d0ae1 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:11.779893 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-887f2375-ff13-42ff-85f4-4e9ccc4d0ae1 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:11.913799 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-887f2375-ff13-42ff-85f4-4e9ccc4d0ae1 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:11.921487 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-887f2375-ff13-42ff-85f4-4e9ccc4d0ae1 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1574 microversion: 2.1 time: 0.155715 Aug 24 13:13:11.922047 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1943/3880] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:11 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:12.941612 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e433c476-58e8-4a95-a0b5-8a771e81123e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:12.942219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e433c476-58e8-4a95-a0b5-8a771e81123e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:12.948655 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e433c476-58e8-4a95-a0b5-8a771e81123e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:12.949134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e433c476-58e8-4a95-a0b5-8a771e81123e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:12.949569 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e433c476-58e8-4a95-a0b5-8a771e81123e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:12.950240 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e433c476-58e8-4a95-a0b5-8a771e81123e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:12.950709 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e433c476-58e8-4a95-a0b5-8a771e81123e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:12.951133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e433c476-58e8-4a95-a0b5-8a771e81123e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:13.084827 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e433c476-58e8-4a95-a0b5-8a771e81123e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:13.092961 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e433c476-58e8-4a95-a0b5-8a771e81123e tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1574 microversion: 2.1 time: 0.155180 Aug 24 13:13:13.093516 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1938/3881] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:12 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:14.114256 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3b4ab1f3-1de4-48d4-ab87-951d5d0df23c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:14.114896 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3b4ab1f3-1de4-48d4-ab87-951d5d0df23c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:14.122077 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b4ab1f3-1de4-48d4-ab87-951d5d0df23c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:14.122554 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b4ab1f3-1de4-48d4-ab87-951d5d0df23c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:14.123016 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b4ab1f3-1de4-48d4-ab87-951d5d0df23c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:14.123693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b4ab1f3-1de4-48d4-ab87-951d5d0df23c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:14.124154 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b4ab1f3-1de4-48d4-ab87-951d5d0df23c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:14.124575 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3b4ab1f3-1de4-48d4-ab87-951d5d0df23c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:14.250470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3b4ab1f3-1de4-48d4-ab87-951d5d0df23c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:14.258098 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3b4ab1f3-1de4-48d4-ab87-951d5d0df23c tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1574 microversion: 2.1 time: 0.147744 Aug 24 13:13:14.258670 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1944/3882] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:14 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:15.279590 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-909216b9-ef9f-48ea-9003-94805016a2ce tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:15.280194 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-909216b9-ef9f-48ea-9003-94805016a2ce tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:15.286732 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-909216b9-ef9f-48ea-9003-94805016a2ce tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:15.287212 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-909216b9-ef9f-48ea-9003-94805016a2ce tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:15.287642 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-909216b9-ef9f-48ea-9003-94805016a2ce tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:15.288324 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-909216b9-ef9f-48ea-9003-94805016a2ce tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:15.288776 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-909216b9-ef9f-48ea-9003-94805016a2ce tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:15.289200 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-909216b9-ef9f-48ea-9003-94805016a2ce tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:15.583933 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-909216b9-ef9f-48ea-9003-94805016a2ce tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:15.592923 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-909216b9-ef9f-48ea-9003-94805016a2ce tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1574 microversion: 2.1 time: 0.317673 Aug 24 13:13:15.593480 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1939/3883] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:15 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1574 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:16.614337 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d60639fd-af68-4d96-8b85-611a69243ee3 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:16.614997 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d60639fd-af68-4d96-8b85-611a69243ee3 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:16.622150 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d60639fd-af68-4d96-8b85-611a69243ee3 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:16.623071 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d60639fd-af68-4d96-8b85-611a69243ee3 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:16.623071 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d60639fd-af68-4d96-8b85-611a69243ee3 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:16.623729 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d60639fd-af68-4d96-8b85-611a69243ee3 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:16.624182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d60639fd-af68-4d96-8b85-611a69243ee3 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:16.624599 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d60639fd-af68-4d96-8b85-611a69243ee3 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:16.758998 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d60639fd-af68-4d96-8b85-611a69243ee3 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:16.766698 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d60639fd-af68-4d96-8b85-611a69243ee3 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1574 microversion: 2.1 time: 0.156213 Aug 24 13:13:16.767259 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1945/3884] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:16 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:17.786944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2ab0d03f-8922-404d-b1f9-2d5ad9794c09 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:17.787579 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2ab0d03f-8922-404d-b1f9-2d5ad9794c09 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:17.794499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ab0d03f-8922-404d-b1f9-2d5ad9794c09 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:17.795011 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ab0d03f-8922-404d-b1f9-2d5ad9794c09 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:17.795447 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ab0d03f-8922-404d-b1f9-2d5ad9794c09 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:17.796127 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ab0d03f-8922-404d-b1f9-2d5ad9794c09 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:17.796577 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ab0d03f-8922-404d-b1f9-2d5ad9794c09 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:17.797002 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ab0d03f-8922-404d-b1f9-2d5ad9794c09 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:17.928481 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2ab0d03f-8922-404d-b1f9-2d5ad9794c09 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:17.936268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2ab0d03f-8922-404d-b1f9-2d5ad9794c09 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1574 microversion: 2.1 time: 0.153161 Aug 24 13:13:17.936829 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1940/3885] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:17 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:18.957256 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a4a65ec0-a484-4ffc-96da-e8359878264f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:18.957943 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a4a65ec0-a484-4ffc-96da-e8359878264f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:18.964532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d6f6a536-b21d-46df-aaa3-f0e7090051a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:18.965056 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d6f6a536-b21d-46df-aaa3-f0e7090051a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:18.966245 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a4a65ec0-a484-4ffc-96da-e8359878264f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:18.966765 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a4a65ec0-a484-4ffc-96da-e8359878264f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:18.967202 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a4a65ec0-a484-4ffc-96da-e8359878264f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:18.967981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a4a65ec0-a484-4ffc-96da-e8359878264f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:18.968436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a4a65ec0-a484-4ffc-96da-e8359878264f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:18.968851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a4a65ec0-a484-4ffc-96da-e8359878264f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:18.972119 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d6f6a536-b21d-46df-aaa3-f0e7090051a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:18.972605 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d6f6a536-b21d-46df-aaa3-f0e7090051a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:18.973047 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d6f6a536-b21d-46df-aaa3-f0e7090051a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:18.973762 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d6f6a536-b21d-46df-aaa3-f0e7090051a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:18.974199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d6f6a536-b21d-46df-aaa3-f0e7090051a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:18.974620 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d6f6a536-b21d-46df-aaa3-f0e7090051a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:18.988353 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:18.989294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.wsgi [None req-d6f6a536-b21d-46df-aaa3-f0e7090051a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] HTTP exception thrown: Instance 720992f6-0031-4c2a-801d-07a71dd87158 could not be found. Aug 24 13:13:18.991050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d6f6a536-b21d-46df-aaa3-f0e7090051a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Request method failure captured: Aug 24 13:13:18.991050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: request: DELETE /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 HTTP/1.1 Aug 24 13:13:18.991050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept: application/json Aug 24 13:13:18.991050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept-Encoding: identity Aug 24 13:13:18.991050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Connection: close Aug 24 13:13:18.991050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Length: 0 Aug 24 13:13:18.991050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Type: application/json Aug 24 13:13:18.991050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Host: 10.222.0.45 Aug 24 13:13:18.991050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Openstack-System-Scope: None Aug 24 13:13:18.991050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: User-Agent: python-urllib3/1.26.11 Aug 24 13:13:18.991050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Auth-Token: gAAAAABjBhnLLzeMmwotoPORQqZ-kJj6WDHpTiEJRZuSqOw9ujr59eVrzSASRDx18Q_B5e2xfVvkCNCrSpakl_0p-U1mQKN3-uhpC3yZazhE1uqKE6hJZk6xk6Cx-245wc-29RliD7k4jpM14Wwc-D4b5Hh2fNONTrC-SwH1cyszPZ7vnFbRO0A Aug 24 13:13:18.991050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Id: None Aug 24 13:13:18.991050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Name: None Aug 24 13:13:18.991050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Identity-Status: Confirmed Aug 24 13:13:18.991050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Is-Admin-Project: True Aug 24 13:13:18.991050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Id: default Aug 24 13:13:18.991050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Name: Default Aug 24 13:13:18.991050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Id: e7a3075a9e3a47a4bcb9136ce8303173 Aug 24 13:13:18.991050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Name: tempest-AttachVolumeTestJSON-1614074694 Aug 24 13:13:18.991050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Role: member,reader Aug 24 13:13:18.991050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Roles: member,reader Aug 24 13:13:18.992326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e7a3075a9e3a47a4bcb9136ce8303173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e7a3075a9e3a47a4bcb9136ce8303173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e7a3075a9e3a47a4bcb9136ce8303173"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e7a3075a9e3a47a4bcb9136ce8303173"}]}] Aug 24 13:13:18.992326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant: tempest-AttachVolumeTestJSON-1614074694 Aug 24 13:13:18.992326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Id: e7a3075a9e3a47a4bcb9136ce8303173 Aug 24 13:13:18.992326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1614074694 Aug 24 13:13:18.992326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User: tempest-AttachVolumeTestJSON-1614074694-project Aug 24 13:13:18.992326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Id: default Aug 24 13:13:18.992326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Name: Default Aug 24 13:13:18.992326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Id: 751f05f1ff6c4593870073d8f47e0db9 Aug 24 13:13:18.992326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Name: tempest-AttachVolumeTestJSON-1614074694-project Aug 24 13:13:18.992326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: method: > Aug 24 13:13:18.992326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: exception: Instance 720992f6-0031-4c2a-801d-07a71dd87158 could not be found. Aug 24 13:13:18.992326 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: action_args: {'id': '720992f6-0031-4c2a-801d-07a71dd87158'} Aug 24 13:13:18.993312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:13:18.993312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:13:18.993312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:13:18.993312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:13:18.993312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:13:18.993312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:13:18.993312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:13:18.993312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:13:18.993312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:13:18.993312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:13:18.993312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 720992f6-0031-4c2a-801d-07a71dd87158 could not be found. Aug 24 13:13:18.993312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:13:18.993312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:13:18.993312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:13:18.993312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:13:18.993312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:13:18.993312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:13:18.993312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:13:18.993312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:13:18.993312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:13:18.994517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:13:18.994517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 13:13:18.994517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 13:13:18.994517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 13:13:18.994517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 13:13:18.994517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:13:18.994517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:13:18.994517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:13:18.994517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:13:18.994517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 720992f6-0031-4c2a-801d-07a71dd87158 could not be found. Aug 24 13:13:18.994517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:13:18.994517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:13:18.994517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:13:18.994517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:13:18.994517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:13:18.994517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:13:18.994517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:13:18.994517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:13:18.994517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 720992f6-0031-4c2a-801d-07a71dd87158 could not be found. Aug 24 13:13:18.994517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:13:18.995846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d6f6a536-b21d-46df-aaa3-f0e7090051a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Returning 404 to user: Instance 720992f6-0031-4c2a-801d-07a71dd87158 could not be found. {{(pid=121171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:13:18.995846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d6f6a536-b21d-46df-aaa3-f0e7090051a8 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "DELETE /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 404 len: 111 microversion: 2.1 time: 0.032826 Aug 24 13:13:18.995846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1941/3886] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 13:13:18 2022] DELETE /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 13:13:19.001094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1262cde1-662c-4c64-aebe-07ad003e8ea1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:19.001701 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1262cde1-662c-4c64-aebe-07ad003e8ea1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] [instance: 720992f6-0031-4c2a-801d-07a71dd87158] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:19.008115 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1262cde1-662c-4c64-aebe-07ad003e8ea1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:19.012721 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1262cde1-662c-4c64-aebe-07ad003e8ea1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:19.012721 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1262cde1-662c-4c64-aebe-07ad003e8ea1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:19.012721 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1262cde1-662c-4c64-aebe-07ad003e8ea1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:19.012721 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1262cde1-662c-4c64-aebe-07ad003e8ea1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:19.013120 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1262cde1-662c-4c64-aebe-07ad003e8ea1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:19.023973 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.wsgi [None req-1262cde1-662c-4c64-aebe-07ad003e8ea1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] HTTP exception thrown: Instance 720992f6-0031-4c2a-801d-07a71dd87158 could not be found. Aug 24 13:13:19.025508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1262cde1-662c-4c64-aebe-07ad003e8ea1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Request method failure captured: Aug 24 13:13:19.025508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: request: GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 HTTP/1.1 Aug 24 13:13:19.025508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept: application/json Aug 24 13:13:19.025508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept-Encoding: identity Aug 24 13:13:19.025508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Connection: close Aug 24 13:13:19.025508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Length: 0 Aug 24 13:13:19.025508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Type: application/json Aug 24 13:13:19.025508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Host: 10.222.0.45 Aug 24 13:13:19.025508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Openstack-System-Scope: None Aug 24 13:13:19.025508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: User-Agent: python-urllib3/1.26.11 Aug 24 13:13:19.025508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Auth-Token: gAAAAABjBhnLLzeMmwotoPORQqZ-kJj6WDHpTiEJRZuSqOw9ujr59eVrzSASRDx18Q_B5e2xfVvkCNCrSpakl_0p-U1mQKN3-uhpC3yZazhE1uqKE6hJZk6xk6Cx-245wc-29RliD7k4jpM14Wwc-D4b5Hh2fNONTrC-SwH1cyszPZ7vnFbRO0A Aug 24 13:13:19.025508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Id: None Aug 24 13:13:19.025508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Name: None Aug 24 13:13:19.025508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Identity-Status: Confirmed Aug 24 13:13:19.025508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Is-Admin-Project: True Aug 24 13:13:19.025508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Id: default Aug 24 13:13:19.025508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Name: Default Aug 24 13:13:19.025508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Id: e7a3075a9e3a47a4bcb9136ce8303173 Aug 24 13:13:19.025508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Name: tempest-AttachVolumeTestJSON-1614074694 Aug 24 13:13:19.025508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Role: member,reader Aug 24 13:13:19.025508 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Roles: member,reader Aug 24 13:13:19.027553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e7a3075a9e3a47a4bcb9136ce8303173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e7a3075a9e3a47a4bcb9136ce8303173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e7a3075a9e3a47a4bcb9136ce8303173"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e7a3075a9e3a47a4bcb9136ce8303173"}]}] Aug 24 13:13:19.027553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant: tempest-AttachVolumeTestJSON-1614074694 Aug 24 13:13:19.027553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Id: e7a3075a9e3a47a4bcb9136ce8303173 Aug 24 13:13:19.027553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1614074694 Aug 24 13:13:19.027553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User: tempest-AttachVolumeTestJSON-1614074694-project Aug 24 13:13:19.027553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Id: default Aug 24 13:13:19.027553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Name: Default Aug 24 13:13:19.027553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Id: 751f05f1ff6c4593870073d8f47e0db9 Aug 24 13:13:19.027553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Name: tempest-AttachVolumeTestJSON-1614074694-project Aug 24 13:13:19.027553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: method: > Aug 24 13:13:19.027553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: exception: Instance 720992f6-0031-4c2a-801d-07a71dd87158 could not be found. Aug 24 13:13:19.027553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: action_args: {'id': '720992f6-0031-4c2a-801d-07a71dd87158'} Aug 24 13:13:19.028368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:13:19.028368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:13:19.028368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:13:19.028368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:13:19.028368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:13:19.028368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:13:19.028368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:13:19.028368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:13:19.028368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:13:19.028368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:13:19.028368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 720992f6-0031-4c2a-801d-07a71dd87158 could not be found. Aug 24 13:13:19.028368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:13:19.028368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:13:19.028368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:13:19.028368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:13:19.028368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:13:19.028368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:13:19.028368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:13:19.028368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:13:19.028368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:13:19.029690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:13:19.029690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:13:19.029690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:13:19.029690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:13:19.029690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:13:19.029690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:13:19.029690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:13:19.029690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 720992f6-0031-4c2a-801d-07a71dd87158 could not be found. Aug 24 13:13:19.029690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:13:19.029690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:13:19.029690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:13:19.029690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:13:19.029690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:13:19.029690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:13:19.029690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:13:19.029690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:13:19.029690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 720992f6-0031-4c2a-801d-07a71dd87158 could not be found. Aug 24 13:13:19.029690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:13:19.030964 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1262cde1-662c-4c64-aebe-07ad003e8ea1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] Returning 404 to user: Instance 720992f6-0031-4c2a-801d-07a71dd87158 could not be found. {{(pid=121171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:13:19.030964 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1262cde1-662c-4c64-aebe-07ad003e8ea1 tempest-AttachVolumeTestJSON-1614074694 tempest-AttachVolumeTestJSON-1614074694-project] 10.222.0.45 "GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158" status: 404 len: 111 microversion: 2.1 time: 0.030096 Aug 24 13:13:19.030964 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1942/3887] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:18 2022] GET /compute/v2.1/servers/720992f6-0031-4c2a-801d-07a71dd87158 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:13:19.108190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a4a65ec0-a484-4ffc-96da-e8359878264f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:19.117052 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a4a65ec0-a484-4ffc-96da-e8359878264f tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1574 microversion: 2.1 time: 0.163641 Aug 24 13:13:19.117885 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1946/3888] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:18 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:19.275486 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-9050a007-7b8f-4360-a672-82ee5ce7b119 req-bf2a95ef-f5d1-487c-be95-0472f0f1b80c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48a36929-b791-4fa2-8537-d27f23d6db2c", "name": "network-vif-plugged", "status": "completed", "tag": "ffc1d77e-3111-433a-8725-48516fb03bd7"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:13:19.286894 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-9050a007-7b8f-4360-a672-82ee5ce7b119 req-bf2a95ef-f5d1-487c-be95-0472f0f1b80c service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:19.298418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-9050a007-7b8f-4360-a672-82ee5ce7b119 req-bf2a95ef-f5d1-487c-be95-0472f0f1b80c service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:19.298582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:13:19.298718 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-9050a007-7b8f-4360-a672-82ee5ce7b119 req-bf2a95ef-f5d1-487c-be95-0472f0f1b80c service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:19.298820 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 13:13:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:13:19.300913 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-9050a007-7b8f-4360-a672-82ee5ce7b119 req-bf2a95ef-f5d1-487c-be95-0472f0f1b80c service nova] Creating event network-vif-plugged:ffc1d77e-3111-433a-8725-48516fb03bd7 for instance 48a36929-b791-4fa2-8537-d27f23d6db2c on hv-cinder-84889 Aug 24 13:13:19.304780 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR oslo.messaging._drivers.impl_rabbit [req-9050a007-7b8f-4360-a672-82ee5ce7b119 req-bf2a95ef-f5d1-487c-be95-0472f0f1b80c service nova] [0fda3551-bb5d-4bb2-ba26-d3a1679f86f2] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 13:13:20.139589 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-593f3fc2-0837-49e4-a1c2-17d37dbc8974 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:20.140322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-593f3fc2-0837-49e4-a1c2-17d37dbc8974 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:20.142721 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:20.147410 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-593f3fc2-0837-49e4-a1c2-17d37dbc8974 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:20.147966 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-593f3fc2-0837-49e4-a1c2-17d37dbc8974 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:20.148476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-593f3fc2-0837-49e4-a1c2-17d37dbc8974 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:20.149172 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-593f3fc2-0837-49e4-a1c2-17d37dbc8974 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:20.149626 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-593f3fc2-0837-49e4-a1c2-17d37dbc8974 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:20.150168 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-593f3fc2-0837-49e4-a1c2-17d37dbc8974 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:20.288470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-593f3fc2-0837-49e4-a1c2-17d37dbc8974 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:20.300125 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-593f3fc2-0837-49e4-a1c2-17d37dbc8974 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1574 microversion: 2.1 time: 0.164313 Aug 24 13:13:20.300802 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1947/3889] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:20 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:13:20.320901 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [req-9050a007-7b8f-4360-a672-82ee5ce7b119 req-bf2a95ef-f5d1-487c-be95-0472f0f1b80c service nova] [0fda3551-bb5d-4bb2-ba26-d3a1679f86f2] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 48854. Aug 24 13:13:20.325143 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-9050a007-7b8f-4360-a672-82ee5ce7b119 req-bf2a95ef-f5d1-487c-be95-0472f0f1b80c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.054362 Aug 24 13:13:20.325838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1943/3890] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:13:21.321526 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b4c128fd-df45-41d4-937c-385d501e4196 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:21.322316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b4c128fd-df45-41d4-937c-385d501e4196 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:21.328893 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4c128fd-df45-41d4-937c-385d501e4196 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:21.329565 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4c128fd-df45-41d4-937c-385d501e4196 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:21.330298 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4c128fd-df45-41d4-937c-385d501e4196 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:21.331161 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4c128fd-df45-41d4-937c-385d501e4196 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:21.331727 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4c128fd-df45-41d4-937c-385d501e4196 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:21.332262 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b4c128fd-df45-41d4-937c-385d501e4196 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:21.524688 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b4c128fd-df45-41d4-937c-385d501e4196 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:21.532348 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b4c128fd-df45-41d4-937c-385d501e4196 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1574 microversion: 2.1 time: 0.214757 Aug 24 13:13:21.532898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1948/3891] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:21 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1574 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:22.554882 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2ce04987-dda7-4e42-8703-426559f7bbd9 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:22.556378 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2ce04987-dda7-4e42-8703-426559f7bbd9 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:22.559892 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=35 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:22.563638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ce04987-dda7-4e42-8703-426559f7bbd9 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:22.564337 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ce04987-dda7-4e42-8703-426559f7bbd9 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:22.564777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ce04987-dda7-4e42-8703-426559f7bbd9 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:22.565602 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ce04987-dda7-4e42-8703-426559f7bbd9 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:22.566062 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ce04987-dda7-4e42-8703-426559f7bbd9 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:22.566533 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ce04987-dda7-4e42-8703-426559f7bbd9 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:22.570143 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=87 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:22.712663 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2ce04987-dda7-4e42-8703-426559f7bbd9 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:22.720574 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2ce04987-dda7-4e42-8703-426559f7bbd9 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1561 microversion: 2.1 time: 0.170753 Aug 24 13:13:22.723599 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1944/3892] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:22 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:29.836534 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a1439f32-814d-4367-8aca-7a62f4ffe034 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Action: 'create', calling method: .version_select at 0x7f76f9d52b80>, body: {"keypair": {"name": "tempest-keypair-1441855236", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEERD7V8wPBO8k91ZLIeAnvvsVfX4+I5GFFq3uRZR4yM9FqrRWQNY+TwIjr3stlCWOZCiNUjOSaz+k933PF7NOD8aZwLeY+qZxcBy2agd3marEA+AbFss0uMlHaCRB2MxQ=="}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:13:29.852488 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-a1439f32-814d-4367-8aca-7a62f4ffe034 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Getting quotas for project 5e9455e7426b490680c92f1bb3cecca0. Resources: {'key_pairs'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:13:29.856425 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-a1439f32-814d-4367-8aca-7a62f4ffe034 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Getting quotas for user fa9364936c614a68b22f66c32b76cba9 and project 5e9455e7426b490680c92f1bb3cecca0. Resources: {'key_pairs'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:13:29.946509 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a1439f32-814d-4367-8aca-7a62f4ffe034 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.228445 Aug 24 13:13:29.947153 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1949/3893] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 24 13:13:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:13:31.979528 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-094defcd-8349-4ce4-aa4b-697c367826e7 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-131209597", "imageRef": "62fcb2c8-bff4-46cf-9892-c43d7626629e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3a6b6253-0057-4d36-bf42-268f73b09473"}], "security_groups": [{"name": "tempest-securitygroup--1635308417"}], "key_name": "tempest-keypair-1441855236", "user_data": "}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:13:32.087241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.network.neutron [None req-094defcd-8349-4ce4-aa4b-697c367826e7 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] validate_networks() for [('3a6b6253-0057-4d36-bf42-268f73b09473', None, None, None, None, None)] {{(pid=121171) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:13:32.543645 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-094defcd-8349-4ce4-aa4b-697c367826e7 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Flavor limits 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:13:32.544119 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-094defcd-8349-4ce4-aa4b-697c367826e7 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Image limits 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:13:32.544528 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-094defcd-8349-4ce4-aa4b-697c367826e7 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Flavor pref 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:13:32.544935 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-094defcd-8349-4ce4-aa4b-697c367826e7 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Image pref 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:13:32.545345 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-094defcd-8349-4ce4-aa4b-697c367826e7 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:13:32.554926 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-094defcd-8349-4ce4-aa4b-697c367826e7 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:32.555499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-094defcd-8349-4ce4-aa4b-697c367826e7 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:32.555938 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-094defcd-8349-4ce4-aa4b-697c367826e7 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:32.556655 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-094defcd-8349-4ce4-aa4b-697c367826e7 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:32.557111 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-094defcd-8349-4ce4-aa4b-697c367826e7 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:32.557532 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-094defcd-8349-4ce4-aa4b-697c367826e7 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:32.574524 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-094defcd-8349-4ce4-aa4b-697c367826e7 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Getting quotas for project 5e9455e7426b490680c92f1bb3cecca0. Resources: {'instances', 'cores', 'ram'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:13:32.578838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-094defcd-8349-4ce4-aa4b-697c367826e7 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Getting quotas for user fa9364936c614a68b22f66c32b76cba9 and project 5e9455e7426b490680c92f1bb3cecca0. Resources: {'instances', 'cores', 'ram'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:13:32.590595 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-094defcd-8349-4ce4-aa4b-697c367826e7 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Going to run 1 instances... {{(pid=121171) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 13:13:32.592669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-094defcd-8349-4ce4-aa4b-697c367826e7 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='62fcb2c8-bff4-46cf-9892-c43d7626629e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 13:13:32.643488 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:13:32.643488 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 13:13:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.45) !!! Aug 24 13:13:32.702463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-094defcd-8349-4ce4-aa4b-697c367826e7 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.727149 Aug 24 13:13:32.703159 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1945/3894] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 13:13:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 13:13:32.711348 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=14 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:32.716270 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d969bcf2-5c4e-4bfc-93e8-86fd9ee99166 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:32.716896 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d969bcf2-5c4e-4bfc-93e8-86fd9ee99166 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:32.787556 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-d969bcf2-5c4e-4bfc-93e8-86fd9ee99166 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:32.795417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d969bcf2-5c4e-4bfc-93e8-86fd9ee99166 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc" status: 200 len: 1241 microversion: 2.1 time: 0.085231 Aug 24 13:13:32.796498 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1950/3895] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:32 2022] GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:13:33.816590 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-412b822d-5606-4491-998c-f55229c543fb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:33.817186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-412b822d-5606-4491-998c-f55229c543fb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:33.823981 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-412b822d-5606-4491-998c-f55229c543fb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:33.824451 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-412b822d-5606-4491-998c-f55229c543fb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:33.824878 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-412b822d-5606-4491-998c-f55229c543fb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:33.825548 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-412b822d-5606-4491-998c-f55229c543fb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:33.825995 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-412b822d-5606-4491-998c-f55229c543fb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:33.826411 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-412b822d-5606-4491-998c-f55229c543fb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:33.887611 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-412b822d-5606-4491-998c-f55229c543fb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:33.895187 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-412b822d-5606-4491-998c-f55229c543fb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc" status: 200 len: 1245 microversion: 2.1 time: 0.083196 Aug 24 13:13:33.895716 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1946/3896] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:33 2022] GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:34.916411 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0b0eb971-2dfc-45b3-b3af-ca4ff9230391 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:34.917026 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0b0eb971-2dfc-45b3-b3af-ca4ff9230391 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:34.923571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b0eb971-2dfc-45b3-b3af-ca4ff9230391 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:34.924065 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b0eb971-2dfc-45b3-b3af-ca4ff9230391 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:34.924524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b0eb971-2dfc-45b3-b3af-ca4ff9230391 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:34.925207 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b0eb971-2dfc-45b3-b3af-ca4ff9230391 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:34.925873 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b0eb971-2dfc-45b3-b3af-ca4ff9230391 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:34.926289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0b0eb971-2dfc-45b3-b3af-ca4ff9230391 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:34.990884 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0b0eb971-2dfc-45b3-b3af-ca4ff9230391 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:35.001388 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0b0eb971-2dfc-45b3-b3af-ca4ff9230391 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc" status: 200 len: 1301 microversion: 2.1 time: 0.088685 Aug 24 13:13:35.017405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1951/3897] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:34 2022] GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc => generated 1301 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:36.025407 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-12ec2e26-586b-43d5-9d1a-35303c316aab tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:36.027414 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-12ec2e26-586b-43d5-9d1a-35303c316aab tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:36.034351 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12ec2e26-586b-43d5-9d1a-35303c316aab tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:36.034881 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12ec2e26-586b-43d5-9d1a-35303c316aab tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:36.035317 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12ec2e26-586b-43d5-9d1a-35303c316aab tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:36.036013 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12ec2e26-586b-43d5-9d1a-35303c316aab tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:36.036616 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12ec2e26-586b-43d5-9d1a-35303c316aab tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:36.037046 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-12ec2e26-586b-43d5-9d1a-35303c316aab tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:36.214451 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-12ec2e26-586b-43d5-9d1a-35303c316aab tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:36.222241 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-12ec2e26-586b-43d5-9d1a-35303c316aab tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc" status: 200 len: 1367 microversion: 2.1 time: 0.200780 Aug 24 13:13:36.222838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1947/3898] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:36 2022] GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:36.923207 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-a395a58f-0d75-4467-918b-e7051fd4bc3d req-3160f2a5-e7b3-477a-af62-5dbca11f57a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55f47f59-c5c5-4831-b535-881f53f6a2bc", "tag": "7f1feffe-2920-490a-9420-84204ca3d3fe"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:13:36.932403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-a395a58f-0d75-4467-918b-e7051fd4bc3d req-3160f2a5-e7b3-477a-af62-5dbca11f57a4 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:36.932873 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-a395a58f-0d75-4467-918b-e7051fd4bc3d req-3160f2a5-e7b3-477a-af62-5dbca11f57a4 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:36.933300 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-a395a58f-0d75-4467-918b-e7051fd4bc3d req-3160f2a5-e7b3-477a-af62-5dbca11f57a4 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:36.945819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-a395a58f-0d75-4467-918b-e7051fd4bc3d req-3160f2a5-e7b3-477a-af62-5dbca11f57a4 service nova] Creating event network-changed:7f1feffe-2920-490a-9420-84204ca3d3fe for instance 55f47f59-c5c5-4831-b535-881f53f6a2bc on hv-cinder-84889 Aug 24 13:13:36.950536 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-a395a58f-0d75-4467-918b-e7051fd4bc3d req-3160f2a5-e7b3-477a-af62-5dbca11f57a4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090526 Aug 24 13:13:36.956602 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1952/3899] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:13:37.251339 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-560e6602-2960-4a37-a870-f08c067a5793 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:37.251977 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-560e6602-2960-4a37-a870-f08c067a5793 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:37.258205 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-560e6602-2960-4a37-a870-f08c067a5793 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:37.258720 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-560e6602-2960-4a37-a870-f08c067a5793 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:37.259160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-560e6602-2960-4a37-a870-f08c067a5793 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:37.259844 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-560e6602-2960-4a37-a870-f08c067a5793 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:37.260293 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-560e6602-2960-4a37-a870-f08c067a5793 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:37.260785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-560e6602-2960-4a37-a870-f08c067a5793 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:37.448848 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-560e6602-2960-4a37-a870-f08c067a5793 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:37.457603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-560e6602-2960-4a37-a870-f08c067a5793 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc" status: 200 len: 1367 microversion: 2.1 time: 0.208878 Aug 24 13:13:37.457603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1948/3900] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:37 2022] GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:38.478542 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-35f60e1e-7d41-46a6-a551-92ccce13dd26 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:38.479256 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-35f60e1e-7d41-46a6-a551-92ccce13dd26 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:38.485919 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35f60e1e-7d41-46a6-a551-92ccce13dd26 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:38.486394 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35f60e1e-7d41-46a6-a551-92ccce13dd26 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:38.486855 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35f60e1e-7d41-46a6-a551-92ccce13dd26 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:38.487560 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35f60e1e-7d41-46a6-a551-92ccce13dd26 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:38.488010 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35f60e1e-7d41-46a6-a551-92ccce13dd26 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:38.488430 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-35f60e1e-7d41-46a6-a551-92ccce13dd26 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:38.842322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-35f60e1e-7d41-46a6-a551-92ccce13dd26 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:38.849849 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-35f60e1e-7d41-46a6-a551-92ccce13dd26 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc" status: 200 len: 1367 microversion: 2.1 time: 0.375958 Aug 24 13:13:38.850399 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1953/3901] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:38 2022] GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc => generated 1367 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:39.870835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f0946c18-30bd-4fc5-a608-3c17755d9c1c tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:39.871431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f0946c18-30bd-4fc5-a608-3c17755d9c1c tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:39.877648 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0946c18-30bd-4fc5-a608-3c17755d9c1c tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:39.878138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0946c18-30bd-4fc5-a608-3c17755d9c1c tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:39.878554 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0946c18-30bd-4fc5-a608-3c17755d9c1c tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:39.879255 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0946c18-30bd-4fc5-a608-3c17755d9c1c tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:39.879811 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0946c18-30bd-4fc5-a608-3c17755d9c1c tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:39.880228 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f0946c18-30bd-4fc5-a608-3c17755d9c1c tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:40.081477 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f0946c18-30bd-4fc5-a608-3c17755d9c1c tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:40.089132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f0946c18-30bd-4fc5-a608-3c17755d9c1c tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc" status: 200 len: 1367 microversion: 2.1 time: 0.222484 Aug 24 13:13:40.089681 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1949/3902] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:39 2022] GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:41.110021 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a7184f1e-7978-4fd4-b62f-081d3ce79357 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:41.110833 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a7184f1e-7978-4fd4-b62f-081d3ce79357 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:41.117509 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7184f1e-7978-4fd4-b62f-081d3ce79357 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:41.118263 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7184f1e-7978-4fd4-b62f-081d3ce79357 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:41.118736 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7184f1e-7978-4fd4-b62f-081d3ce79357 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:41.119424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7184f1e-7978-4fd4-b62f-081d3ce79357 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:41.119881 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7184f1e-7978-4fd4-b62f-081d3ce79357 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:41.120307 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7184f1e-7978-4fd4-b62f-081d3ce79357 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:41.246974 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a7184f1e-7978-4fd4-b62f-081d3ce79357 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:41.254458 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a7184f1e-7978-4fd4-b62f-081d3ce79357 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc" status: 200 len: 1367 microversion: 2.1 time: 0.148423 Aug 24 13:13:41.255063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1954/3903] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:41 2022] GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:42.276414 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3a6f0a19-6bee-4478-8627-54591638b68e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:42.277182 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3a6f0a19-6bee-4478-8627-54591638b68e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:42.283526 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a6f0a19-6bee-4478-8627-54591638b68e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:42.284004 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a6f0a19-6bee-4478-8627-54591638b68e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:42.284436 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a6f0a19-6bee-4478-8627-54591638b68e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:42.285107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a6f0a19-6bee-4478-8627-54591638b68e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:42.285553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a6f0a19-6bee-4478-8627-54591638b68e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:42.285970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3a6f0a19-6bee-4478-8627-54591638b68e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:42.412307 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3a6f0a19-6bee-4478-8627-54591638b68e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:42.419893 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3a6f0a19-6bee-4478-8627-54591638b68e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc" status: 200 len: 1367 microversion: 2.1 time: 0.148140 Aug 24 13:13:42.420446 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1950/3904] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:42 2022] GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:43.441186 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-beb0a18a-886f-4ef0-b8c5-c1469349dec9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:43.441904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-beb0a18a-886f-4ef0-b8c5-c1469349dec9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:43.444355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell0:SELECT=6 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:43.450028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-beb0a18a-886f-4ef0-b8c5-c1469349dec9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:43.450525 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-beb0a18a-886f-4ef0-b8c5-c1469349dec9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:43.451019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-beb0a18a-886f-4ef0-b8c5-c1469349dec9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:43.451717 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-beb0a18a-886f-4ef0-b8c5-c1469349dec9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:43.452310 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=2 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:43.452855 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-beb0a18a-886f-4ef0-b8c5-c1469349dec9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:43.453447 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-beb0a18a-886f-4ef0-b8c5-c1469349dec9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:43.453583 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=6 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:43.515830 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-bf95761f-84a0-48c4-b0ef-f6be3ef63d89 req-cd4997d6-7284-470e-a642-707e086baa5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55f47f59-c5c5-4831-b535-881f53f6a2bc", "name": "network-vif-plugged", "status": "completed", "tag": "7f1feffe-2920-490a-9420-84204ca3d3fe"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:13:43.529633 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-bf95761f-84a0-48c4-b0ef-f6be3ef63d89 req-cd4997d6-7284-470e-a642-707e086baa5d service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:43.530340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-bf95761f-84a0-48c4-b0ef-f6be3ef63d89 req-cd4997d6-7284-470e-a642-707e086baa5d service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:43.530970 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-bf95761f-84a0-48c4-b0ef-f6be3ef63d89 req-cd4997d6-7284-470e-a642-707e086baa5d service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:43.542293 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-bf95761f-84a0-48c4-b0ef-f6be3ef63d89 req-cd4997d6-7284-470e-a642-707e086baa5d service nova] Creating event network-vif-plugged:7f1feffe-2920-490a-9420-84204ca3d3fe for instance 55f47f59-c5c5-4831-b535-881f53f6a2bc on hv-cinder-84889 Aug 24 13:13:43.547391 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-bf95761f-84a0-48c4-b0ef-f6be3ef63d89 req-cd4997d6-7284-470e-a642-707e086baa5d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101118 Aug 24 13:13:43.548169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1951/3905] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:13:43.595480 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-beb0a18a-886f-4ef0-b8c5-c1469349dec9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:43.603269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-beb0a18a-886f-4ef0-b8c5-c1469349dec9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc" status: 200 len: 1367 microversion: 2.1 time: 0.166227 Aug 24 13:13:43.603805 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1955/3906] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:43 2022] GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:44.629393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1cb06268-fe8f-4db4-8c64-453dcf06bca0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:44.630093 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1cb06268-fe8f-4db4-8c64-453dcf06bca0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:44.637211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1cb06268-fe8f-4db4-8c64-453dcf06bca0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:44.637695 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1cb06268-fe8f-4db4-8c64-453dcf06bca0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:44.638138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1cb06268-fe8f-4db4-8c64-453dcf06bca0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:44.638859 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1cb06268-fe8f-4db4-8c64-453dcf06bca0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:44.639322 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1cb06268-fe8f-4db4-8c64-453dcf06bca0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:44.639749 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1cb06268-fe8f-4db4-8c64-453dcf06bca0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:44.769517 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1cb06268-fe8f-4db4-8c64-453dcf06bca0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:44.777091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1cb06268-fe8f-4db4-8c64-453dcf06bca0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc" status: 200 len: 1367 microversion: 2.1 time: 0.153120 Aug 24 13:13:44.777664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1952/3907] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:44 2022] GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:45.798401 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-54e1434e-2d3e-41f2-b01a-60297dd4e437 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:45.799030 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-54e1434e-2d3e-41f2-b01a-60297dd4e437 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:45.805582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-54e1434e-2d3e-41f2-b01a-60297dd4e437 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:45.808711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-54e1434e-2d3e-41f2-b01a-60297dd4e437 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:45.808711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-54e1434e-2d3e-41f2-b01a-60297dd4e437 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:45.808711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-54e1434e-2d3e-41f2-b01a-60297dd4e437 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:45.808711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-54e1434e-2d3e-41f2-b01a-60297dd4e437 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:45.809040 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-54e1434e-2d3e-41f2-b01a-60297dd4e437 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:45.939483 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-54e1434e-2d3e-41f2-b01a-60297dd4e437 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:13:45.947068 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-54e1434e-2d3e-41f2-b01a-60297dd4e437 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc" status: 200 len: 1557 microversion: 2.1 time: 0.152626 Aug 24 13:13:45.947612 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1956/3908] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:13:45 2022] GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:13:45.967376 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-91025145-b2ab-4c6a-8bc3-160a9afc0a7a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:13:45.967901 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-91025145-b2ab-4c6a-8bc3-160a9afc0a7a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:13:45.974255 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91025145-b2ab-4c6a-8bc3-160a9afc0a7a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:45.974766 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91025145-b2ab-4c6a-8bc3-160a9afc0a7a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:45.975208 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91025145-b2ab-4c6a-8bc3-160a9afc0a7a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:45.975886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91025145-b2ab-4c6a-8bc3-160a9afc0a7a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:45.976339 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91025145-b2ab-4c6a-8bc3-160a9afc0a7a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:45.976764 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-91025145-b2ab-4c6a-8bc3-160a9afc0a7a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:46.051622 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-91025145-b2ab-4c6a-8bc3-160a9afc0a7a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088587 Aug 24 13:13:46.052219 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1953/3909] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 24 13:13:45 2022] GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:13:47.016270 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-b9ed05d1-e1e9-4c2f-b8c7-a7b79aa4dfb3 req-fc385c0a-22e2-430a-baec-f60ed76e4aac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55f47f59-c5c5-4831-b535-881f53f6a2bc", "tag": "7f1feffe-2920-490a-9420-84204ca3d3fe"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:13:47.025999 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-b9ed05d1-e1e9-4c2f-b8c7-a7b79aa4dfb3 req-fc385c0a-22e2-430a-baec-f60ed76e4aac service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:13:47.026478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-b9ed05d1-e1e9-4c2f-b8c7-a7b79aa4dfb3 req-fc385c0a-22e2-430a-baec-f60ed76e4aac service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:13:47.026948 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-b9ed05d1-e1e9-4c2f-b8c7-a7b79aa4dfb3 req-fc385c0a-22e2-430a-baec-f60ed76e4aac service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:13:47.037867 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-b9ed05d1-e1e9-4c2f-b8c7-a7b79aa4dfb3 req-fc385c0a-22e2-430a-baec-f60ed76e4aac service nova] Creating event network-changed:7f1feffe-2920-490a-9420-84204ca3d3fe for instance 55f47f59-c5c5-4831-b535-881f53f6a2bc on hv-cinder-84889 Aug 24 13:13:47.043677 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-b9ed05d1-e1e9-4c2f-b8c7-a7b79aa4dfb3 req-fc385c0a-22e2-430a-baec-f60ed76e4aac service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030992 Aug 24 13:13:47.044518 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1957/3910] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:14:52.884393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:52.885278 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=49 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:52.887405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:52.888479 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=34 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:52.890754 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9b9e53a5-324f-40d4-90c2-3f7c3e584b6d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:14:52.891322 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9b9e53a5-324f-40d4-90c2-3f7c3e584b6d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:14:52.893551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-dc2b382e-1d58-45ad-948c-a370758cdfb8 req-e8a3f8aa-4a9b-4913-ac57-ed08ed0db0fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48a36929-b791-4fa2-8537-d27f23d6db2c", "tag": "ffc1d77e-3111-433a-8725-48516fb03bd7"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:14:52.897713 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b9e53a5-324f-40d4-90c2-3f7c3e584b6d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:14:52.898211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b9e53a5-324f-40d4-90c2-3f7c3e584b6d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:14:52.905949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b9e53a5-324f-40d4-90c2-3f7c3e584b6d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:14:52.905949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b9e53a5-324f-40d4-90c2-3f7c3e584b6d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:14:52.905949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b9e53a5-324f-40d4-90c2-3f7c3e584b6d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:14:52.905949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9b9e53a5-324f-40d4-90c2-3f7c3e584b6d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:14:52.906281 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-dc2b382e-1d58-45ad-948c-a370758cdfb8 req-e8a3f8aa-4a9b-4913-ac57-ed08ed0db0fe service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:14:52.906281 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-dc2b382e-1d58-45ad-948c-a370758cdfb8 req-e8a3f8aa-4a9b-4913-ac57-ed08ed0db0fe service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:14:52.906281 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-dc2b382e-1d58-45ad-948c-a370758cdfb8 req-e8a3f8aa-4a9b-4913-ac57-ed08ed0db0fe service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:14:52.916055 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-dc2b382e-1d58-45ad-948c-a370758cdfb8 req-e8a3f8aa-4a9b-4913-ac57-ed08ed0db0fe service nova] Creating event network-changed:ffc1d77e-3111-433a-8725-48516fb03bd7 for instance 48a36929-b791-4fa2-8537-d27f23d6db2c on hv-cinder-84889 Aug 24 13:14:52.922312 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-dc2b382e-1d58-45ad-948c-a370758cdfb8 req-e8a3f8aa-4a9b-4913-ac57-ed08ed0db0fe service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036736 Aug 24 13:14:52.923640 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1958/3911] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:14:52.930750 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9b9e53a5-324f-40d4-90c2-3f7c3e584b6d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Going to try to terminate instance {{(pid=121171) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 13:14:53.219638 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9b9e53a5-324f-40d4-90c2-3f7c3e584b6d tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "DELETE /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 204 len: 0 microversion: 2.1 time: 0.337239 Aug 24 13:14:53.220225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1954/3912] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 13:14:52 2022] DELETE /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:14:53.229687 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e082e46f-1025-48d3-a575-5acbf5984846 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:14:53.234141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e082e46f-1025-48d3-a575-5acbf5984846 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:14:53.238329 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e082e46f-1025-48d3-a575-5acbf5984846 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:14:53.238845 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e082e46f-1025-48d3-a575-5acbf5984846 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:14:53.239368 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e082e46f-1025-48d3-a575-5acbf5984846 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:14:53.240230 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e082e46f-1025-48d3-a575-5acbf5984846 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:14:53.240494 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e082e46f-1025-48d3-a575-5acbf5984846 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:14:53.240912 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e082e46f-1025-48d3-a575-5acbf5984846 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:14:53.392558 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e082e46f-1025-48d3-a575-5acbf5984846 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:14:53.400535 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e082e46f-1025-48d3-a575-5acbf5984846 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1567 microversion: 2.1 time: 0.175823 Aug 24 13:14:53.401098 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1959/3913] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:14:53 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:14:54.424232 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e8ac94d3-893e-4bd5-924e-4ee9f0b11df9 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:14:54.424846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e8ac94d3-893e-4bd5-924e-4ee9f0b11df9 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:14:54.431896 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e8ac94d3-893e-4bd5-924e-4ee9f0b11df9 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:14:54.432390 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e8ac94d3-893e-4bd5-924e-4ee9f0b11df9 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:14:54.432869 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e8ac94d3-893e-4bd5-924e-4ee9f0b11df9 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:14:54.433640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e8ac94d3-893e-4bd5-924e-4ee9f0b11df9 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:14:54.434092 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e8ac94d3-893e-4bd5-924e-4ee9f0b11df9 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:14:54.434549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e8ac94d3-893e-4bd5-924e-4ee9f0b11df9 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:14:54.608867 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e8ac94d3-893e-4bd5-924e-4ee9f0b11df9 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:14:54.616421 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e8ac94d3-893e-4bd5-924e-4ee9f0b11df9 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1567 microversion: 2.1 time: 0.197125 Aug 24 13:14:54.616971 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1955/3914] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:14:54 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1567 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:14:55.637424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b1ebe725-ba03-4247-8f49-86a3ba510092 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:14:55.638035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b1ebe725-ba03-4247-8f49-86a3ba510092 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:14:55.645151 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1ebe725-ba03-4247-8f49-86a3ba510092 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:14:55.645628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1ebe725-ba03-4247-8f49-86a3ba510092 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:14:55.646062 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1ebe725-ba03-4247-8f49-86a3ba510092 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:14:55.646771 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1ebe725-ba03-4247-8f49-86a3ba510092 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:14:55.647225 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1ebe725-ba03-4247-8f49-86a3ba510092 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:14:55.647656 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b1ebe725-ba03-4247-8f49-86a3ba510092 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:14:55.713647 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b1ebe725-ba03-4247-8f49-86a3ba510092 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:14:55.722407 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-11de11f1-da9b-4aed-beb3-2c60cbc67b93 req-b654e1ef-0457-4601-bc14-29fab0d9012a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48a36929-b791-4fa2-8537-d27f23d6db2c", "name": "network-vif-deleted", "tag": "ffc1d77e-3111-433a-8725-48516fb03bd7"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:14:55.722985 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b1ebe725-ba03-4247-8f49-86a3ba510092 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1381 microversion: 2.1 time: 0.089473 Aug 24 13:14:55.723645 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1960/3915] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:14:55 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1381 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:14:55.733075 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-11de11f1-da9b-4aed-beb3-2c60cbc67b93 req-b654e1ef-0457-4601-bc14-29fab0d9012a service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:14:55.733756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-11de11f1-da9b-4aed-beb3-2c60cbc67b93 req-b654e1ef-0457-4601-bc14-29fab0d9012a service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:14:55.734255 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-11de11f1-da9b-4aed-beb3-2c60cbc67b93 req-b654e1ef-0457-4601-bc14-29fab0d9012a service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:14:55.745505 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-11de11f1-da9b-4aed-beb3-2c60cbc67b93 req-b654e1ef-0457-4601-bc14-29fab0d9012a service nova] Creating event network-vif-deleted:ffc1d77e-3111-433a-8725-48516fb03bd7 for instance 48a36929-b791-4fa2-8537-d27f23d6db2c on hv-cinder-84889 Aug 24 13:14:55.751410 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-11de11f1-da9b-4aed-beb3-2c60cbc67b93 req-b654e1ef-0457-4601-bc14-29fab0d9012a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032659 Aug 24 13:14:55.751984 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1956/3916] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:14:56.743632 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-08b22ba1-753b-4f44-bbe3-7d278be257d4 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:14:56.744517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-08b22ba1-753b-4f44-bbe3-7d278be257d4 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:14:56.750918 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-08b22ba1-753b-4f44-bbe3-7d278be257d4 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:14:56.751407 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-08b22ba1-753b-4f44-bbe3-7d278be257d4 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:14:56.751849 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-08b22ba1-753b-4f44-bbe3-7d278be257d4 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:14:56.752542 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-08b22ba1-753b-4f44-bbe3-7d278be257d4 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:14:56.753000 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-08b22ba1-753b-4f44-bbe3-7d278be257d4 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:14:56.753427 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-08b22ba1-753b-4f44-bbe3-7d278be257d4 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:14:56.784294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-08b22ba1-753b-4f44-bbe3-7d278be257d4 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:14:56.784949 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-08b22ba1-753b-4f44-bbe3-7d278be257d4 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:14:56.785536 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-08b22ba1-753b-4f44-bbe3-7d278be257d4 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:14:56.785990 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.objects.instance [None req-08b22ba1-753b-4f44-bbe3-7d278be257d4 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lazy-loading 'fault' on Instance uuid 48a36929-b791-4fa2-8537-d27f23d6db2c {{(pid=121170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:14:56.825376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-08b22ba1-753b-4f44-bbe3-7d278be257d4 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6dec9001a14679ade64276a7962b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618334fc8ef14486a1fc1411c42bf9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:14:56.833494 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-08b22ba1-753b-4f44-bbe3-7d278be257d4 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 200 len: 1224 microversion: 2.1 time: 0.093797 Aug 24 13:14:56.834046 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1961/3917] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:14:56 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:14:57.855249 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9a32d949-74b5-44d2-b113-a86520a323ce tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:14:57.855953 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-9a32d949-74b5-44d2-b113-a86520a323ce tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] [instance: 48a36929-b791-4fa2-8537-d27f23d6db2c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:14:57.863240 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9a32d949-74b5-44d2-b113-a86520a323ce tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:14:57.863719 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9a32d949-74b5-44d2-b113-a86520a323ce tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:14:57.864155 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9a32d949-74b5-44d2-b113-a86520a323ce tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:14:57.864837 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9a32d949-74b5-44d2-b113-a86520a323ce tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:14:57.865290 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9a32d949-74b5-44d2-b113-a86520a323ce tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:14:57.865716 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-9a32d949-74b5-44d2-b113-a86520a323ce tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:14:57.878863 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.wsgi [None req-9a32d949-74b5-44d2-b113-a86520a323ce tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] HTTP exception thrown: Instance 48a36929-b791-4fa2-8537-d27f23d6db2c could not be found. Aug 24 13:14:57.880470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9a32d949-74b5-44d2-b113-a86520a323ce tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Request method failure captured: Aug 24 13:14:57.880470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: request: GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c HTTP/1.1 Aug 24 13:14:57.880470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept: application/json Aug 24 13:14:57.880470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept-Encoding: identity Aug 24 13:14:57.880470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Connection: close Aug 24 13:14:57.880470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Length: 0 Aug 24 13:14:57.880470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Type: application/json Aug 24 13:14:57.880470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Host: 10.222.0.45 Aug 24 13:14:57.880470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Openstack-System-Scope: None Aug 24 13:14:57.880470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: User-Agent: python-urllib3/1.26.11 Aug 24 13:14:57.880470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Auth-Token: gAAAAABjBiMW13SuQAxZsmhd6AkHqwIa3GnItO3j1veRr7nOOf68WLi_sWfEbu-Q4y5nF3fuxMB9WB2X2y_JgTYFy-fZa5MKxUo63dNiPWapcpHb7hXI5u_Zqhv8D_HCBssFPnRwsK56QTRbdmA3LGFuef3B-WuuLc03Apt9ddWBl4ahermam_s Aug 24 13:14:57.880470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Id: None Aug 24 13:14:57.880470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Name: None Aug 24 13:14:57.880470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Identity-Status: Confirmed Aug 24 13:14:57.880470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Is-Admin-Project: True Aug 24 13:14:57.880470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Id: default Aug 24 13:14:57.880470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Name: Default Aug 24 13:14:57.880470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Id: 618334fc8ef14486a1fc1411c42bf9b7 Aug 24 13:14:57.880470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Name: tempest-TestShelveInstance-440036891 Aug 24 13:14:57.880470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Role: member,reader Aug 24 13:14:57.880470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Roles: member,reader Aug 24 13:14:57.881966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_618334fc8ef14486a1fc1411c42bf9b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/618334fc8ef14486a1fc1411c42bf9b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/618334fc8ef14486a1fc1411c42bf9b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/618334fc8ef14486a1fc1411c42bf9b7"}]}] Aug 24 13:14:57.881966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant: tempest-TestShelveInstance-440036891 Aug 24 13:14:57.881966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Id: 618334fc8ef14486a1fc1411c42bf9b7 Aug 24 13:14:57.881966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Name: tempest-TestShelveInstance-440036891 Aug 24 13:14:57.881966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User: tempest-TestShelveInstance-440036891-project Aug 24 13:14:57.881966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Id: default Aug 24 13:14:57.881966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Name: Default Aug 24 13:14:57.881966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Id: 5b6dec9001a14679ade64276a7962b5f Aug 24 13:14:57.881966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Name: tempest-TestShelveInstance-440036891-project Aug 24 13:14:57.881966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: method: > Aug 24 13:14:57.881966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: exception: Instance 48a36929-b791-4fa2-8537-d27f23d6db2c could not be found. Aug 24 13:14:57.881966 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: action_args: {'id': '48a36929-b791-4fa2-8537-d27f23d6db2c'} Aug 24 13:14:57.882915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:14:57.882915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:14:57.882915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:14:57.882915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:14:57.882915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:14:57.882915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:14:57.882915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:14:57.882915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:14:57.882915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:14:57.882915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:14:57.882915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48a36929-b791-4fa2-8537-d27f23d6db2c could not be found. Aug 24 13:14:57.882915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:14:57.882915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:14:57.882915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:14:57.882915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:14:57.882915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:14:57.882915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:14:57.882915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:14:57.882915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:14:57.882915 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:14:57.884309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:14:57.884309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:14:57.884309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:14:57.884309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:14:57.884309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:14:57.884309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:14:57.884309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:14:57.884309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48a36929-b791-4fa2-8537-d27f23d6db2c could not be found. Aug 24 13:14:57.884309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:14:57.884309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:14:57.884309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:14:57.884309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:14:57.884309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:14:57.884309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:14:57.884309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:14:57.884309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:14:57.884309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48a36929-b791-4fa2-8537-d27f23d6db2c could not be found. Aug 24 13:14:57.884309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:14:57.885699 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-9a32d949-74b5-44d2-b113-a86520a323ce tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Returning 404 to user: Instance 48a36929-b791-4fa2-8537-d27f23d6db2c could not be found. {{(pid=121171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:14:57.885699 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-9a32d949-74b5-44d2-b113-a86520a323ce tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c" status: 404 len: 111 microversion: 2.1 time: 0.030851 Aug 24 13:14:57.885699 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1957/3918] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:14:57 2022] GET /compute/v2.1/servers/48a36929-b791-4fa2-8537-d27f23d6db2c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:14:58.155280 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-178f4472-bb10-4f38-b814-2b5fb4a1c5e9 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] Calling method '.version_select at 0x7f76f9d1d550>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:14:58.248278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-178f4472-bb10-4f38-b814-2b5fb4a1c5e9 tempest-TestShelveInstance-440036891 tempest-TestShelveInstance-440036891-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-318005720" status: 202 len: 0 microversion: 2.1 time: 0.097609 Aug 24 13:14:58.248847 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1962/3919] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 24 13:14:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-318005720 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:15:01.936179 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8dd42560-a842-4dca-8845-e68d63aa5aad tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:15:01.936939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8dd42560-a842-4dca-8845-e68d63aa5aad tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:15:01.942947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8dd42560-a842-4dca-8845-e68d63aa5aad tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:01.943427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8dd42560-a842-4dca-8845-e68d63aa5aad tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:01.943861 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8dd42560-a842-4dca-8845-e68d63aa5aad tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:01.944541 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8dd42560-a842-4dca-8845-e68d63aa5aad tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:01.944992 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8dd42560-a842-4dca-8845-e68d63aa5aad tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:01.945418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8dd42560-a842-4dca-8845-e68d63aa5aad tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:01.968078 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8dd42560-a842-4dca-8845-e68d63aa5aad tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc/ips" status: 200 len: 150 microversion: 2.1 time: 0.036306 Aug 24 13:15:01.968812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1958/3920] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 24 13:15:01 2022] GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:15:03.070041 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:15:03.070720 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 13:15:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:15:03.660074 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-38536891-bc22-4a80-bfc3-f73bb7ab6f0e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "abf5433f-6b09-477f-be29-3926ac896383"}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:15:03.662571 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-38536891-bc22-4a80-bfc3-f73bb7ab6f0e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:15:03.670557 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-38536891-bc22-4a80-bfc3-f73bb7ab6f0e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:03.671036 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-38536891-bc22-4a80-bfc3-f73bb7ab6f0e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:03.671489 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-38536891-bc22-4a80-bfc3-f73bb7ab6f0e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:03.672197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-38536891-bc22-4a80-bfc3-f73bb7ab6f0e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:03.672662 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-38536891-bc22-4a80-bfc3-f73bb7ab6f0e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:03.673075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-38536891-bc22-4a80-bfc3-f73bb7ab6f0e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:04.428121 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-38536891-bc22-4a80-bfc3-f73bb7ab6f0e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "POST /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.772794 Aug 24 13:15:04.433514 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1963/3921] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 24 13:15:03 2022] POST /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc/os-volume_attachments => generated 194 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:15:11.956843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0a8d96ad-1d38-4188-8ca5-6e7657a18f4b tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Action: 'create', calling method: .version_select at 0x7f76f52c4550>, body: {"keypair": {"name": "tempest-keypair-1880208080", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlkEpEJXYJSwp0qbUYpBk2JwC7VN4IzQsFG2stS+LgHr/KyC5xvsXJdC4w1zDEXhK+U4HuRa+7FWIa/71x4krSj4PaLIKhKnYIZU73GvTLdkYmkYEVuuGsjNxKAJf4Ggw=="}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:15:11.962497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:11.963168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:11.973757 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-0a8d96ad-1d38-4188-8ca5-6e7657a18f4b tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Getting quotas for project 5e9455e7426b490680c92f1bb3cecca0. Resources: {'key_pairs'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:15:11.977830 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-0a8d96ad-1d38-4188-8ca5-6e7657a18f4b tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Getting quotas for user fa9364936c614a68b22f66c32b76cba9 and project 5e9455e7426b490680c92f1bb3cecca0. Resources: {'key_pairs'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:15:12.059390 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0a8d96ad-1d38-4188-8ca5-6e7657a18f4b tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.106610 Aug 24 13:15:12.059976 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1959/3922] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 24 13:15:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:15:14.265875 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:14.270482 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a0a96f9d-a3df-43b5-bf04-88c6c2b6425f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2035517844", "imageRef": "62fcb2c8-bff4-46cf-9892-c43d7626629e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3a6b6253-0057-4d36-bf42-268f73b09473"}], "security_groups": [{"name": "tempest-securitygroup--1040339735"}], "key_name": "tempest-keypair-1880208080", "user_data": "}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:15:14.341172 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:14.378781 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.network.neutron [None req-a0a96f9d-a3df-43b5-bf04-88c6c2b6425f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] validate_networks() for [('3a6b6253-0057-4d36-bf42-268f73b09473', None, None, None, None, None)] {{(pid=121170) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:15:14.859592 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-a0a96f9d-a3df-43b5-bf04-88c6c2b6425f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Flavor limits 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:15:14.860044 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-a0a96f9d-a3df-43b5-bf04-88c6c2b6425f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Image limits 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:15:14.860518 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-a0a96f9d-a3df-43b5-bf04-88c6c2b6425f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Flavor pref 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:15:14.860952 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-a0a96f9d-a3df-43b5-bf04-88c6c2b6425f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Image pref 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:15:14.861361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-a0a96f9d-a3df-43b5-bf04-88c6c2b6425f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:15:14.870173 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0a96f9d-a3df-43b5-bf04-88c6c2b6425f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:14.870667 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0a96f9d-a3df-43b5-bf04-88c6c2b6425f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:14.871112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0a96f9d-a3df-43b5-bf04-88c6c2b6425f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:14.871859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0a96f9d-a3df-43b5-bf04-88c6c2b6425f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:14.872322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0a96f9d-a3df-43b5-bf04-88c6c2b6425f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:14.873313 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0a96f9d-a3df-43b5-bf04-88c6c2b6425f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:14.890322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-a0a96f9d-a3df-43b5-bf04-88c6c2b6425f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Getting quotas for project 5e9455e7426b490680c92f1bb3cecca0. Resources: {'instances', 'cores', 'ram'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:15:14.894199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-a0a96f9d-a3df-43b5-bf04-88c6c2b6425f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Getting quotas for user fa9364936c614a68b22f66c32b76cba9 and project 5e9455e7426b490680c92f1bb3cecca0. Resources: {'instances', 'cores', 'ram'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:15:14.905563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a0a96f9d-a3df-43b5-bf04-88c6c2b6425f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Going to run 1 instances... {{(pid=121170) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 13:15:14.907937 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a0a96f9d-a3df-43b5-bf04-88c6c2b6425f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 183254c6-4230-403b-88db-0ed629171a8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='62fcb2c8-bff4-46cf-9892-c43d7626629e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 13:15:15.061041 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a0a96f9d-a3df-43b5-bf04-88c6c2b6425f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.796067 Aug 24 13:15:15.061692 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1964/3923] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 13:15:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 13:15:15.073341 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-751d6d86-0adf-4ff1-9f3b-d5905b9253ca tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:15:15.073959 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-751d6d86-0adf-4ff1-9f3b-d5905b9253ca tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 183254c6-4230-403b-88db-0ed629171a8c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:15:15.132125 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-751d6d86-0adf-4ff1-9f3b-d5905b9253ca tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:15:15.139646 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-751d6d86-0adf-4ff1-9f3b-d5905b9253ca tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c" status: 200 len: 1242 microversion: 2.1 time: 0.070974 Aug 24 13:15:15.140334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1960/3924] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:15:15 2022] GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:15:16.161203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a0b57d4e-9453-4a31-a598-d1fd6c25cb67 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:15:16.161839 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a0b57d4e-9453-4a31-a598-d1fd6c25cb67 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 183254c6-4230-403b-88db-0ed629171a8c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:15:16.168853 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0b57d4e-9453-4a31-a598-d1fd6c25cb67 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:16.169339 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0b57d4e-9453-4a31-a598-d1fd6c25cb67 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:16.171300 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0b57d4e-9453-4a31-a598-d1fd6c25cb67 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:16.171300 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0b57d4e-9453-4a31-a598-d1fd6c25cb67 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:16.171602 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0b57d4e-9453-4a31-a598-d1fd6c25cb67 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:16.172030 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a0b57d4e-9453-4a31-a598-d1fd6c25cb67 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:16.233792 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-a0b57d4e-9453-4a31-a598-d1fd6c25cb67 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:15:16.241563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a0b57d4e-9453-4a31-a598-d1fd6c25cb67 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c" status: 200 len: 1238 microversion: 2.1 time: 0.084666 Aug 24 13:15:16.242133 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1965/3925] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:15:16 2022] GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c => generated 1238 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:15:17.262690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e07fec42-f28d-43ac-bf94-6233dc8c7a9b tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:15:17.263822 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e07fec42-f28d-43ac-bf94-6233dc8c7a9b tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 183254c6-4230-403b-88db-0ed629171a8c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:15:17.270837 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e07fec42-f28d-43ac-bf94-6233dc8c7a9b tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:17.271418 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e07fec42-f28d-43ac-bf94-6233dc8c7a9b tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:17.271835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e07fec42-f28d-43ac-bf94-6233dc8c7a9b tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:17.272527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e07fec42-f28d-43ac-bf94-6233dc8c7a9b tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:17.272983 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e07fec42-f28d-43ac-bf94-6233dc8c7a9b tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:17.273412 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e07fec42-f28d-43ac-bf94-6233dc8c7a9b tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:17.347213 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e07fec42-f28d-43ac-bf94-6233dc8c7a9b tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:15:17.354699 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e07fec42-f28d-43ac-bf94-6233dc8c7a9b tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c" status: 200 len: 1300 microversion: 2.1 time: 0.095842 Aug 24 13:15:17.355455 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1961/3926] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:15:17 2022] GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c => generated 1300 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:15:18.376449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-599b2c1f-9d5e-4fc4-b24a-2d6d1b3ddd9f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:15:18.377416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-599b2c1f-9d5e-4fc4-b24a-2d6d1b3ddd9f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 183254c6-4230-403b-88db-0ed629171a8c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:15:18.383487 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-599b2c1f-9d5e-4fc4-b24a-2d6d1b3ddd9f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:18.383964 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-599b2c1f-9d5e-4fc4-b24a-2d6d1b3ddd9f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:18.384401 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-599b2c1f-9d5e-4fc4-b24a-2d6d1b3ddd9f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:18.385107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-599b2c1f-9d5e-4fc4-b24a-2d6d1b3ddd9f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:18.385557 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-599b2c1f-9d5e-4fc4-b24a-2d6d1b3ddd9f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:18.385979 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-599b2c1f-9d5e-4fc4-b24a-2d6d1b3ddd9f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:18.511636 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-eddbbcde-9bee-4008-bc18-a722d2ad7404 req-2fc9ce3c-e6d5-4e2e-8eba-8a0ed1d77f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "183254c6-4230-403b-88db-0ed629171a8c", "tag": "eaa1148c-fc95-4a23-a462-c4ccc1148a6a"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:15:18.522394 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-599b2c1f-9d5e-4fc4-b24a-2d6d1b3ddd9f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:15:18.522985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-eddbbcde-9bee-4008-bc18-a722d2ad7404 req-2fc9ce3c-e6d5-4e2e-8eba-8a0ed1d77f2d service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:18.523581 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-eddbbcde-9bee-4008-bc18-a722d2ad7404 req-2fc9ce3c-e6d5-4e2e-8eba-8a0ed1d77f2d service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:18.524084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-eddbbcde-9bee-4008-bc18-a722d2ad7404 req-2fc9ce3c-e6d5-4e2e-8eba-8a0ed1d77f2d service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:18.531538 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-599b2c1f-9d5e-4fc4-b24a-2d6d1b3ddd9f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c" status: 200 len: 1368 microversion: 2.1 time: 0.157971 Aug 24 13:15:18.531538 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1966/3927] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:15:18 2022] GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:15:18.536523 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-eddbbcde-9bee-4008-bc18-a722d2ad7404 req-2fc9ce3c-e6d5-4e2e-8eba-8a0ed1d77f2d service nova] Creating event network-changed:eaa1148c-fc95-4a23-a462-c4ccc1148a6a for instance 183254c6-4230-403b-88db-0ed629171a8c on hv-cinder-84889 Aug 24 13:15:18.541440 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-eddbbcde-9bee-4008-bc18-a722d2ad7404 req-2fc9ce3c-e6d5-4e2e-8eba-8a0ed1d77f2d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033909 Aug 24 13:15:18.542291 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1962/3928] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:15:19.550792 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f50ecf5a-efe8-43d5-8b48-40fbfb62572c tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:15:19.551405 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f50ecf5a-efe8-43d5-8b48-40fbfb62572c tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 183254c6-4230-403b-88db-0ed629171a8c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:15:19.557882 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f50ecf5a-efe8-43d5-8b48-40fbfb62572c tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:19.558395 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f50ecf5a-efe8-43d5-8b48-40fbfb62572c tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:19.558865 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f50ecf5a-efe8-43d5-8b48-40fbfb62572c tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:19.559553 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f50ecf5a-efe8-43d5-8b48-40fbfb62572c tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:19.560009 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f50ecf5a-efe8-43d5-8b48-40fbfb62572c tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:19.560944 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f50ecf5a-efe8-43d5-8b48-40fbfb62572c tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:19.695529 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f50ecf5a-efe8-43d5-8b48-40fbfb62572c tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:15:19.703900 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f50ecf5a-efe8-43d5-8b48-40fbfb62572c tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c" status: 200 len: 1368 microversion: 2.1 time: 0.156986 Aug 24 13:15:19.704472 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1967/3929] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:15:19 2022] GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:15:20.729169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2d919e61-7b6e-4d7d-b048-c30edae5f27f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:15:20.729788 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2d919e61-7b6e-4d7d-b048-c30edae5f27f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 183254c6-4230-403b-88db-0ed629171a8c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:15:20.736408 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d919e61-7b6e-4d7d-b048-c30edae5f27f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:20.736886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d919e61-7b6e-4d7d-b048-c30edae5f27f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:20.737322 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d919e61-7b6e-4d7d-b048-c30edae5f27f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:20.738000 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d919e61-7b6e-4d7d-b048-c30edae5f27f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:20.738453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d919e61-7b6e-4d7d-b048-c30edae5f27f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:20.738925 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2d919e61-7b6e-4d7d-b048-c30edae5f27f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:20.869998 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2d919e61-7b6e-4d7d-b048-c30edae5f27f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:15:20.878138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2d919e61-7b6e-4d7d-b048-c30edae5f27f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c" status: 200 len: 1368 microversion: 2.1 time: 0.153740 Aug 24 13:15:20.884083 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1963/3930] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:15:20 2022] GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:15:21.899832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-211d891e-4b2c-4622-85e9-5ad9aa49b17a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:15:21.900553 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-211d891e-4b2c-4622-85e9-5ad9aa49b17a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 183254c6-4230-403b-88db-0ed629171a8c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:15:21.908661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-211d891e-4b2c-4622-85e9-5ad9aa49b17a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:21.909180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-211d891e-4b2c-4622-85e9-5ad9aa49b17a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:21.909614 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-211d891e-4b2c-4622-85e9-5ad9aa49b17a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:21.910300 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-211d891e-4b2c-4622-85e9-5ad9aa49b17a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:21.910781 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-211d891e-4b2c-4622-85e9-5ad9aa49b17a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:21.911235 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-211d891e-4b2c-4622-85e9-5ad9aa49b17a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:22.041508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-211d891e-4b2c-4622-85e9-5ad9aa49b17a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:15:22.049528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-211d891e-4b2c-4622-85e9-5ad9aa49b17a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c" status: 200 len: 1368 microversion: 2.1 time: 0.153940 Aug 24 13:15:22.050079 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1968/3931] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:15:21 2022] GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:15:23.069195 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c5fa9653-0843-4ce3-8e01-d8f6f7dfaf75 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:15:23.069811 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c5fa9653-0843-4ce3-8e01-d8f6f7dfaf75 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 183254c6-4230-403b-88db-0ed629171a8c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:15:23.075984 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5fa9653-0843-4ce3-8e01-d8f6f7dfaf75 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:23.076464 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5fa9653-0843-4ce3-8e01-d8f6f7dfaf75 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:23.077434 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5fa9653-0843-4ce3-8e01-d8f6f7dfaf75 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:23.078112 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5fa9653-0843-4ce3-8e01-d8f6f7dfaf75 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:23.078564 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5fa9653-0843-4ce3-8e01-d8f6f7dfaf75 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:23.079015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c5fa9653-0843-4ce3-8e01-d8f6f7dfaf75 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:23.205105 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c5fa9653-0843-4ce3-8e01-d8f6f7dfaf75 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:15:23.212587 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c5fa9653-0843-4ce3-8e01-d8f6f7dfaf75 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c" status: 200 len: 1368 microversion: 2.1 time: 0.147229 Aug 24 13:15:23.213586 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1964/3932] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:15:23 2022] GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:15:23.879441 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-4243008e-b26d-4d29-a81c-81bf92e6d280 req-818ba60c-90c6-4357-a633-becd74f460e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "183254c6-4230-403b-88db-0ed629171a8c", "name": "network-vif-plugged", "status": "completed", "tag": "eaa1148c-fc95-4a23-a462-c4ccc1148a6a"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:15:23.889162 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-4243008e-b26d-4d29-a81c-81bf92e6d280 req-818ba60c-90c6-4357-a633-becd74f460e1 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:23.889749 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-4243008e-b26d-4d29-a81c-81bf92e6d280 req-818ba60c-90c6-4357-a633-becd74f460e1 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:23.890187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-4243008e-b26d-4d29-a81c-81bf92e6d280 req-818ba60c-90c6-4357-a633-becd74f460e1 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:23.901380 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-4243008e-b26d-4d29-a81c-81bf92e6d280 req-818ba60c-90c6-4357-a633-becd74f460e1 service nova] Creating event network-vif-plugged:eaa1148c-fc95-4a23-a462-c4ccc1148a6a for instance 183254c6-4230-403b-88db-0ed629171a8c on hv-cinder-84889 Aug 24 13:15:23.906521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-4243008e-b26d-4d29-a81c-81bf92e6d280 req-818ba60c-90c6-4357-a633-becd74f460e1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030819 Aug 24 13:15:23.907210 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1969/3933] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:15:24.234527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a894b1b5-bd86-4a98-be71-0bd17c424518 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:15:24.235801 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a894b1b5-bd86-4a98-be71-0bd17c424518 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 183254c6-4230-403b-88db-0ed629171a8c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:15:24.242015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a894b1b5-bd86-4a98-be71-0bd17c424518 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:24.242502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a894b1b5-bd86-4a98-be71-0bd17c424518 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:24.242977 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a894b1b5-bd86-4a98-be71-0bd17c424518 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:24.243667 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a894b1b5-bd86-4a98-be71-0bd17c424518 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:24.244121 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a894b1b5-bd86-4a98-be71-0bd17c424518 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:24.244858 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a894b1b5-bd86-4a98-be71-0bd17c424518 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:24.408972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a894b1b5-bd86-4a98-be71-0bd17c424518 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:15:24.416720 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a894b1b5-bd86-4a98-be71-0bd17c424518 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c" status: 200 len: 1368 microversion: 2.1 time: 0.186674 Aug 24 13:15:24.417290 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1965/3934] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:15:24 2022] GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:15:25.439076 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e70dc9df-0215-46a7-96f0-8d9f88db60f4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:15:25.439764 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e70dc9df-0215-46a7-96f0-8d9f88db60f4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 183254c6-4230-403b-88db-0ed629171a8c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:15:25.441684 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell0:SELECT=2 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:25.442782 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell0:SELECT=6 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:25.447680 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e70dc9df-0215-46a7-96f0-8d9f88db60f4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:25.448158 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e70dc9df-0215-46a7-96f0-8d9f88db60f4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:25.448593 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e70dc9df-0215-46a7-96f0-8d9f88db60f4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:25.449267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e70dc9df-0215-46a7-96f0-8d9f88db60f4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:25.449720 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e70dc9df-0215-46a7-96f0-8d9f88db60f4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:25.450144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e70dc9df-0215-46a7-96f0-8d9f88db60f4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:25.583743 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e70dc9df-0215-46a7-96f0-8d9f88db60f4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:15:25.591362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e70dc9df-0215-46a7-96f0-8d9f88db60f4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c" status: 200 len: 1368 microversion: 2.1 time: 0.157159 Aug 24 13:15:25.591926 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1970/3935] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:15:25 2022] GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:15:26.612105 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-00a3b6a2-8fa5-47cf-926e-bcc86df69bb5 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:15:26.612740 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-00a3b6a2-8fa5-47cf-926e-bcc86df69bb5 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 183254c6-4230-403b-88db-0ed629171a8c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:15:26.614677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=6 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:26.620434 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00a3b6a2-8fa5-47cf-926e-bcc86df69bb5 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:26.624177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00a3b6a2-8fa5-47cf-926e-bcc86df69bb5 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:26.624177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00a3b6a2-8fa5-47cf-926e-bcc86df69bb5 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:26.624177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00a3b6a2-8fa5-47cf-926e-bcc86df69bb5 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:26.624177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00a3b6a2-8fa5-47cf-926e-bcc86df69bb5 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:26.624704 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-00a3b6a2-8fa5-47cf-926e-bcc86df69bb5 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:26.750633 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-00a3b6a2-8fa5-47cf-926e-bcc86df69bb5 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:15:26.759211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-00a3b6a2-8fa5-47cf-926e-bcc86df69bb5 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c" status: 200 len: 1558 microversion: 2.1 time: 0.151182 Aug 24 13:15:26.759765 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1966/3936] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:15:26 2022] GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:15:26.778958 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-4c40a73c-0e24-4ad6-ae65-90734ad0a14d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:15:26.779464 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-4c40a73c-0e24-4ad6-ae65-90734ad0a14d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 183254c6-4230-403b-88db-0ed629171a8c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:15:26.785768 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4c40a73c-0e24-4ad6-ae65-90734ad0a14d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:26.786254 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4c40a73c-0e24-4ad6-ae65-90734ad0a14d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:26.786818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4c40a73c-0e24-4ad6-ae65-90734ad0a14d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:26.787513 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4c40a73c-0e24-4ad6-ae65-90734ad0a14d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:26.787979 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4c40a73c-0e24-4ad6-ae65-90734ad0a14d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:26.788411 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-4c40a73c-0e24-4ad6-ae65-90734ad0a14d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:26.863205 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-4c40a73c-0e24-4ad6-ae65-90734ad0a14d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088059 Aug 24 13:15:26.863797 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1971/3937] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 24 13:15:26 2022] GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:15:28.159009 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-81e8e793-5bac-4223-b7ef-3d1104c7e4bb req-23af0e21-80e9-452b-b3e7-2fa44e8099f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "183254c6-4230-403b-88db-0ed629171a8c", "tag": "eaa1148c-fc95-4a23-a462-c4ccc1148a6a"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:15:28.168186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-81e8e793-5bac-4223-b7ef-3d1104c7e4bb req-23af0e21-80e9-452b-b3e7-2fa44e8099f4 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:15:28.168661 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-81e8e793-5bac-4223-b7ef-3d1104c7e4bb req-23af0e21-80e9-452b-b3e7-2fa44e8099f4 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:15:28.169091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-81e8e793-5bac-4223-b7ef-3d1104c7e4bb req-23af0e21-80e9-452b-b3e7-2fa44e8099f4 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:15:28.180289 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-81e8e793-5bac-4223-b7ef-3d1104c7e4bb req-23af0e21-80e9-452b-b3e7-2fa44e8099f4 service nova] Creating event network-changed:eaa1148c-fc95-4a23-a462-c4ccc1148a6a for instance 183254c6-4230-403b-88db-0ed629171a8c on hv-cinder-84889 Aug 24 13:15:28.185204 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-81e8e793-5bac-4223-b7ef-3d1104c7e4bb req-23af0e21-80e9-452b-b3e7-2fa44e8099f4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148774 Aug 24 13:15:28.185780 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1967/3938] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:16:43.084243 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:16:43.084981 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=38 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:16:43.089189 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d639e1aa-9569-40c6-8670-203a8e986000 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:16:43.100214 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d639e1aa-9569-40c6-8670-203a8e986000 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 183254c6-4230-403b-88db-0ed629171a8c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:16:43.100214 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d639e1aa-9569-40c6-8670-203a8e986000 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:43.100214 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d639e1aa-9569-40c6-8670-203a8e986000 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:43.100214 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d639e1aa-9569-40c6-8670-203a8e986000 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:43.100576 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d639e1aa-9569-40c6-8670-203a8e986000 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:43.100576 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d639e1aa-9569-40c6-8670-203a8e986000 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:43.100576 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d639e1aa-9569-40c6-8670-203a8e986000 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:43.121362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d639e1aa-9569-40c6-8670-203a8e986000 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c/ips" status: 200 len: 150 microversion: 2.1 time: 0.039036 Aug 24 13:16:43.121920 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1972/3939] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 24 13:16:43 2022] GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:16:43.132203 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:16:43.132950 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=34 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:16:43.137424 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-396a97b7-78e2-4f04-b1e1-a8448427c222 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "abf5433f-6b09-477f-be29-3926ac896383"}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:16:43.139801 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-396a97b7-78e2-4f04-b1e1-a8448427c222 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 183254c6-4230-403b-88db-0ed629171a8c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:16:43.145697 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-396a97b7-78e2-4f04-b1e1-a8448427c222 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:43.146177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-396a97b7-78e2-4f04-b1e1-a8448427c222 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:43.146619 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-396a97b7-78e2-4f04-b1e1-a8448427c222 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:43.147328 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-396a97b7-78e2-4f04-b1e1-a8448427c222 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:43.147778 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-396a97b7-78e2-4f04-b1e1-a8448427c222 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:43.148199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-396a97b7-78e2-4f04-b1e1-a8448427c222 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:43.228049 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.wsgi [None req-396a97b7-78e2-4f04-b1e1-a8448427c222 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] HTTP exception thrown: Invalid volume: volume abf5433f-6b09-477f-be29-3926ac896383 is already attached to instances: 55f47f59-c5c5-4831-b535-881f53f6a2bc Aug 24 13:16:43.229761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-396a97b7-78e2-4f04-b1e1-a8448427c222 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Request method failure captured: Aug 24 13:16:43.229761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: request: POST /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c/os-volume_attachments HTTP/1.1 Aug 24 13:16:43.229761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept: application/json Aug 24 13:16:43.229761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept-Encoding: identity Aug 24 13:16:43.229761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Connection: close Aug 24 13:16:43.229761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Length: 74 Aug 24 13:16:43.229761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Type: application/json Aug 24 13:16:43.229761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Host: 10.222.0.45 Aug 24 13:16:43.229761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Openstack-System-Scope: None Aug 24 13:16:43.229761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: User-Agent: python-urllib3/1.26.11 Aug 24 13:16:43.229761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Auth-Token: gAAAAABjBiP5eWEmCH1rTy3m7m9k9tdAn-MnqMzHWGZRmRwtIge3QPfo9RpMXcI_LY98ZmPLiGQnyraOQKKZTpPuQ7xHFVK5Rrn8lL4ilOSLnxJOMDFVHwkD8fW0lAsKO3_bHu1jCBS6E5WwEpSHN863rTspgcEScExi5zF4GV4mWJORGe0jHpc Aug 24 13:16:43.229761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Id: None Aug 24 13:16:43.229761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Name: None Aug 24 13:16:43.229761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Identity-Status: Confirmed Aug 24 13:16:43.229761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Is-Admin-Project: True Aug 24 13:16:43.229761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Id: default Aug 24 13:16:43.229761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Name: Default Aug 24 13:16:43.229761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:16:43.229761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:16:43.229761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Role: member,reader Aug 24 13:16:43.229761 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Roles: member,reader Aug 24 13:16:43.231340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}] Aug 24 13:16:43.231340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:16:43.231340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:16:43.231340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:16:43.231340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:16:43.231340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Id: default Aug 24 13:16:43.231340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Name: Default Aug 24 13:16:43.231340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Id: fa9364936c614a68b22f66c32b76cba9 Aug 24 13:16:43.231340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Name: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:16:43.231340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Aug 24 13:16:43.231340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {"volumeAttachment": {"volumeId": "abf5433f-6b09-477f-be29-3926ac896383"}} Aug 24 13:16:43.231340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: method: > Aug 24 13:16:43.232381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: exception: Invalid volume: volume abf5433f-6b09-477f-be29-3926ac896383 is already attached to instances: 55f47f59-c5c5-4831-b535-881f53f6a2bc Aug 24 13:16:43.232381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: action_args: {'server_id': '183254c6-4230-403b-88db-0ed629171a8c', 'body': {'volumeAttachment': {'volumeId': 'abf5433f-6b09-477f-be29-3926ac896383'}}} Aug 24 13:16:43.232381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:16:43.232381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:16:43.232381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 13:16:43.232381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 13:16:43.232381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 13:16:43.232381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 13:16:43.232381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 13:16:43.232381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 13:16:43.232381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 13:16:43.232381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 13:16:43.232381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 13:16:43.232381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 13:16:43.232381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume abf5433f-6b09-477f-be29-3926ac896383 is already attached to instances: 55f47f59-c5c5-4831-b535-881f53f6a2bc Aug 24 13:16:43.232381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:16:43.232381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:16:43.232381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:16:43.232381 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:16:43.233800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:16:43.233800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:16:43.233800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:16:43.233800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:16:43.233800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:16:43.233800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:16:43.233800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 13:16:43.233800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 13:16:43.233800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 13:16:43.233800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 13:16:43.233800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 13:16:43.233800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 13:16:43.233800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 13:16:43.233800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 13:16:43.233800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume abf5433f-6b09-477f-be29-3926ac896383 is already attached to instances: 55f47f59-c5c5-4831-b535-881f53f6a2bc Aug 24 13:16:43.233800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:16:43.233800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:16:43.233800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:16:43.233800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:16:43.233800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:16:43.235334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:16:43.235334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:16:43.235334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:16:43.235334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume abf5433f-6b09-477f-be29-3926ac896383 is already attached to instances: 55f47f59-c5c5-4831-b535-881f53f6a2bc Aug 24 13:16:43.235334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:16:43.235334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-396a97b7-78e2-4f04-b1e1-a8448427c222 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Returning 400 to user: Invalid volume: volume abf5433f-6b09-477f-be29-3926ac896383 is already attached to instances: 55f47f59-c5c5-4831-b535-881f53f6a2bc {{(pid=121171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:16:43.235334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-396a97b7-78e2-4f04-b1e1-a8448427c222 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "POST /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101173 Aug 24 13:16:43.235334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1968/3940] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 24 13:16:43 2022] POST /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 13:16:43.241032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-c25518c4-0d94-44b6-95f5-3c555e408dc4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:16:43.241528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c25518c4-0d94-44b6-95f5-3c555e408dc4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 183254c6-4230-403b-88db-0ed629171a8c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:16:43.248305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c25518c4-0d94-44b6-95f5-3c555e408dc4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:43.250850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c25518c4-0d94-44b6-95f5-3c555e408dc4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:43.250850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c25518c4-0d94-44b6-95f5-3c555e408dc4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:43.250850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c25518c4-0d94-44b6-95f5-3c555e408dc4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:43.250850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c25518c4-0d94-44b6-95f5-3c555e408dc4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:43.251203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-c25518c4-0d94-44b6-95f5-3c555e408dc4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:43.275738 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-c25518c4-0d94-44b6-95f5-3c555e408dc4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 183254c6-4230-403b-88db-0ed629171a8c] Going to try to terminate instance {{(pid=121170) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 13:16:43.514957 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-c25518c4-0d94-44b6-95f5-3c555e408dc4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "DELETE /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c" status: 204 len: 0 microversion: 2.1 time: 0.278126 Aug 24 13:16:43.515540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1973/3941] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 13:16:43 2022] DELETE /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:16:43.524297 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-51879314-9412-431b-a6a2-251c3f721610 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:16:43.524904 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-51879314-9412-431b-a6a2-251c3f721610 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 183254c6-4230-403b-88db-0ed629171a8c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:16:43.531863 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51879314-9412-431b-a6a2-251c3f721610 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:43.532342 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51879314-9412-431b-a6a2-251c3f721610 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:43.532775 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51879314-9412-431b-a6a2-251c3f721610 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:43.533455 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51879314-9412-431b-a6a2-251c3f721610 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:43.533900 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51879314-9412-431b-a6a2-251c3f721610 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:43.534325 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-51879314-9412-431b-a6a2-251c3f721610 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:43.662224 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-51879314-9412-431b-a6a2-251c3f721610 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:16:43.669939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-51879314-9412-431b-a6a2-251c3f721610 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c" status: 200 len: 1683 microversion: 2.1 time: 0.149552 Aug 24 13:16:43.670490 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1969/3942] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:16:43 2022] GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:16:44.692973 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-861094f1-f35e-4330-b29e-ac34c2b05189 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:16:44.693589 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-861094f1-f35e-4330-b29e-ac34c2b05189 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 183254c6-4230-403b-88db-0ed629171a8c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:16:44.699957 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-861094f1-f35e-4330-b29e-ac34c2b05189 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:44.700441 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-861094f1-f35e-4330-b29e-ac34c2b05189 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:44.700879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-861094f1-f35e-4330-b29e-ac34c2b05189 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:44.701567 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-861094f1-f35e-4330-b29e-ac34c2b05189 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:44.702024 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-861094f1-f35e-4330-b29e-ac34c2b05189 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:44.702452 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-861094f1-f35e-4330-b29e-ac34c2b05189 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:44.842669 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-861094f1-f35e-4330-b29e-ac34c2b05189 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:16:44.850938 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-861094f1-f35e-4330-b29e-ac34c2b05189 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c" status: 200 len: 1683 microversion: 2.1 time: 0.162343 Aug 24 13:16:44.851503 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1974/3943] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:16:44 2022] GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:16:45.872431 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c139aafb-ee60-4e85-b0f2-45f7f473e932 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:16:45.873044 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c139aafb-ee60-4e85-b0f2-45f7f473e932 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 183254c6-4230-403b-88db-0ed629171a8c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:16:45.879534 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c139aafb-ee60-4e85-b0f2-45f7f473e932 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:45.880015 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c139aafb-ee60-4e85-b0f2-45f7f473e932 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:45.880453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c139aafb-ee60-4e85-b0f2-45f7f473e932 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:45.881134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c139aafb-ee60-4e85-b0f2-45f7f473e932 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:45.881590 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c139aafb-ee60-4e85-b0f2-45f7f473e932 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:45.882008 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c139aafb-ee60-4e85-b0f2-45f7f473e932 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:45.956064 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c139aafb-ee60-4e85-b0f2-45f7f473e932 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:16:45.963576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c139aafb-ee60-4e85-b0f2-45f7f473e932 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c" status: 200 len: 1615 microversion: 2.1 time: 0.095327 Aug 24 13:16:45.964136 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1970/3944] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:16:45 2022] GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c => generated 1615 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:16:46.120742 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-597b7aef-14e9-4308-ac78-005e92be06eb req-670d8019-5782-4a3b-9068-b575f0649e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "183254c6-4230-403b-88db-0ed629171a8c", "name": "network-vif-deleted", "tag": "eaa1148c-fc95-4a23-a462-c4ccc1148a6a"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:16:46.131478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-597b7aef-14e9-4308-ac78-005e92be06eb req-670d8019-5782-4a3b-9068-b575f0649e57 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:46.132049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-597b7aef-14e9-4308-ac78-005e92be06eb req-670d8019-5782-4a3b-9068-b575f0649e57 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:46.132387 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-597b7aef-14e9-4308-ac78-005e92be06eb req-670d8019-5782-4a3b-9068-b575f0649e57 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:46.146466 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-597b7aef-14e9-4308-ac78-005e92be06eb req-670d8019-5782-4a3b-9068-b575f0649e57 service nova] Creating event network-vif-deleted:eaa1148c-fc95-4a23-a462-c4ccc1148a6a for instance 183254c6-4230-403b-88db-0ed629171a8c on hv-cinder-84889 Aug 24 13:16:46.152560 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-597b7aef-14e9-4308-ac78-005e92be06eb req-670d8019-5782-4a3b-9068-b575f0649e57 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035834 Aug 24 13:16:46.153693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1975/3945] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:16:46.985130 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-97f2ae51-2c43-4724-95b4-8d5d95010bab tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:16:46.996702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-97f2ae51-2c43-4724-95b4-8d5d95010bab tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 183254c6-4230-403b-88db-0ed629171a8c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:16:46.996702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-97f2ae51-2c43-4724-95b4-8d5d95010bab tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:46.996702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-97f2ae51-2c43-4724-95b4-8d5d95010bab tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:46.996702 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-97f2ae51-2c43-4724-95b4-8d5d95010bab tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:46.997259 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-97f2ae51-2c43-4724-95b4-8d5d95010bab tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:46.997259 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-97f2ae51-2c43-4724-95b4-8d5d95010bab tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:46.997259 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-97f2ae51-2c43-4724-95b4-8d5d95010bab tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:47.032002 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-97f2ae51-2c43-4724-95b4-8d5d95010bab tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:47.032596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-97f2ae51-2c43-4724-95b4-8d5d95010bab tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:47.033104 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-97f2ae51-2c43-4724-95b4-8d5d95010bab tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:47.033655 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.objects.instance [None req-97f2ae51-2c43-4724-95b4-8d5d95010bab tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lazy-loading 'fault' on Instance uuid 183254c6-4230-403b-88db-0ed629171a8c {{(pid=121171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:16:47.076713 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-97f2ae51-2c43-4724-95b4-8d5d95010bab tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:16:47.084698 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-97f2ae51-2c43-4724-95b4-8d5d95010bab tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c" status: 200 len: 1332 microversion: 2.1 time: 0.103436 Aug 24 13:16:47.085265 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1971/3946] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:16:46 2022] GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c => generated 1332 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:16:48.108011 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-879304ab-13ba-443b-b0c0-d1dcf3339137 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:16:48.108709 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-879304ab-13ba-443b-b0c0-d1dcf3339137 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 183254c6-4230-403b-88db-0ed629171a8c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:16:48.114873 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-879304ab-13ba-443b-b0c0-d1dcf3339137 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:48.115375 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-879304ab-13ba-443b-b0c0-d1dcf3339137 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:48.115797 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-879304ab-13ba-443b-b0c0-d1dcf3339137 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:48.116561 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-879304ab-13ba-443b-b0c0-d1dcf3339137 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:48.116931 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-879304ab-13ba-443b-b0c0-d1dcf3339137 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:48.117361 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-879304ab-13ba-443b-b0c0-d1dcf3339137 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:48.131410 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.wsgi [None req-879304ab-13ba-443b-b0c0-d1dcf3339137 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] HTTP exception thrown: Instance 183254c6-4230-403b-88db-0ed629171a8c could not be found. Aug 24 13:16:48.133081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-879304ab-13ba-443b-b0c0-d1dcf3339137 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Request method failure captured: Aug 24 13:16:48.133081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: request: GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c HTTP/1.1 Aug 24 13:16:48.133081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept: application/json Aug 24 13:16:48.133081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept-Encoding: identity Aug 24 13:16:48.133081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Connection: close Aug 24 13:16:48.133081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Length: 0 Aug 24 13:16:48.133081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Type: application/json Aug 24 13:16:48.133081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Host: 10.222.0.45 Aug 24 13:16:48.133081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Openstack-System-Scope: None Aug 24 13:16:48.133081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: User-Agent: python-urllib3/1.26.11 Aug 24 13:16:48.133081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Auth-Token: gAAAAABjBiP5eWEmCH1rTy3m7m9k9tdAn-MnqMzHWGZRmRwtIge3QPfo9RpMXcI_LY98ZmPLiGQnyraOQKKZTpPuQ7xHFVK5Rrn8lL4ilOSLnxJOMDFVHwkD8fW0lAsKO3_bHu1jCBS6E5WwEpSHN863rTspgcEScExi5zF4GV4mWJORGe0jHpc Aug 24 13:16:48.133081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Id: None Aug 24 13:16:48.133081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Name: None Aug 24 13:16:48.133081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Identity-Status: Confirmed Aug 24 13:16:48.133081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Is-Admin-Project: True Aug 24 13:16:48.133081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Id: default Aug 24 13:16:48.133081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Name: Default Aug 24 13:16:48.133081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:16:48.133081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:16:48.133081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Role: member,reader Aug 24 13:16:48.133081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Roles: member,reader Aug 24 13:16:48.134563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}] Aug 24 13:16:48.134563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:16:48.134563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:16:48.134563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:16:48.134563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:16:48.134563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Id: default Aug 24 13:16:48.134563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Name: Default Aug 24 13:16:48.134563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Id: fa9364936c614a68b22f66c32b76cba9 Aug 24 13:16:48.134563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Name: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:16:48.134563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: method: > Aug 24 13:16:48.134563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: exception: Instance 183254c6-4230-403b-88db-0ed629171a8c could not be found. Aug 24 13:16:48.134563 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: action_args: {'id': '183254c6-4230-403b-88db-0ed629171a8c'} Aug 24 13:16:48.135341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:16:48.135341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:16:48.135341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:16:48.135341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:16:48.135341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:16:48.135341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:16:48.135341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:16:48.135341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:16:48.135341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:16:48.135341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:16:48.135341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 183254c6-4230-403b-88db-0ed629171a8c could not be found. Aug 24 13:16:48.135341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:16:48.135341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:16:48.135341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:16:48.135341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:16:48.135341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:16:48.135341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:16:48.135341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:16:48.135341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:16:48.135341 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:16:48.136511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:16:48.136511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:16:48.136511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:16:48.136511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:16:48.136511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:16:48.136511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:16:48.136511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:16:48.136511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 183254c6-4230-403b-88db-0ed629171a8c could not be found. Aug 24 13:16:48.136511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:16:48.136511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:16:48.136511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:16:48.136511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:16:48.136511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:16:48.136511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:16:48.136511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:16:48.136511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:16:48.136511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 183254c6-4230-403b-88db-0ed629171a8c could not be found. Aug 24 13:16:48.136511 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:16:48.137719 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-879304ab-13ba-443b-b0c0-d1dcf3339137 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Returning 404 to user: Instance 183254c6-4230-403b-88db-0ed629171a8c could not be found. {{(pid=121170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:16:48.137719 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-879304ab-13ba-443b-b0c0-d1dcf3339137 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c" status: 404 len: 111 microversion: 2.1 time: 0.031098 Aug 24 13:16:48.137719 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1976/3947] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:16:48 2022] GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:16:48.144057 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-08aee483-a806-4f7c-b508-0b8a75d40899 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '.version_select at 0x7f76f52ffee0>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:16:48.224061 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-08aee483-a806-4f7c-b508-0b8a75d40899 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1880208080" status: 202 len: 0 microversion: 2.1 time: 0.084502 Aug 24 13:16:48.224610 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1972/3948] 10.222.0.45 () {58 vars in 1221 bytes} [Wed Aug 24 13:16:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1880208080 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:16:49.005290 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ee79a5ac-3676-4c48-9c5e-9e0eacb96926 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:16:49.005780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ee79a5ac-3676-4c48-9c5e-9e0eacb96926 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:16:49.011577 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee79a5ac-3676-4c48-9c5e-9e0eacb96926 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:49.012053 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee79a5ac-3676-4c48-9c5e-9e0eacb96926 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:49.012484 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee79a5ac-3676-4c48-9c5e-9e0eacb96926 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:49.013158 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee79a5ac-3676-4c48-9c5e-9e0eacb96926 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:49.013612 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee79a5ac-3676-4c48-9c5e-9e0eacb96926 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:49.014035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ee79a5ac-3676-4c48-9c5e-9e0eacb96926 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:49.092960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.objects.instance [None req-ee79a5ac-3676-4c48-9c5e-9e0eacb96926 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lazy-loading 'services' on Instance uuid 55f47f59-c5c5-4831-b535-881f53f6a2bc {{(pid=121170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:16:49.262630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ee79a5ac-3676-4c48-9c5e-9e0eacb96926 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "DELETE /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc/os-volume_attachments/abf5433f-6b09-477f-be29-3926ac896383" status: 202 len: 0 microversion: 2.1 time: 0.261204 Aug 24 13:16:49.263277 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1977/3949] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 24 13:16:49 2022] DELETE /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc/os-volume_attachments/abf5433f-6b09-477f-be29-3926ac896383 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:16:49.272627 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f610e4b1-6c50-4b6a-93fd-a19eee388202 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:16:49.274813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f610e4b1-6c50-4b6a-93fd-a19eee388202 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:16:49.281596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f610e4b1-6c50-4b6a-93fd-a19eee388202 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:49.282086 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f610e4b1-6c50-4b6a-93fd-a19eee388202 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:49.282839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f610e4b1-6c50-4b6a-93fd-a19eee388202 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:49.283247 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f610e4b1-6c50-4b6a-93fd-a19eee388202 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:49.283729 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f610e4b1-6c50-4b6a-93fd-a19eee388202 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:49.284799 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f610e4b1-6c50-4b6a-93fd-a19eee388202 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:49.312867 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f610e4b1-6c50-4b6a-93fd-a19eee388202 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045153 Aug 24 13:16:49.313420 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1973/3950] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 13:16:49 2022] GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:16:50.325985 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6278359a-92e8-4f4a-b329-09674c5e2c34 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:16:50.328228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6278359a-92e8-4f4a-b329-09674c5e2c34 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:16:50.334916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6278359a-92e8-4f4a-b329-09674c5e2c34 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:50.335403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6278359a-92e8-4f4a-b329-09674c5e2c34 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:50.335843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6278359a-92e8-4f4a-b329-09674c5e2c34 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:50.336528 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6278359a-92e8-4f4a-b329-09674c5e2c34 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:50.336982 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6278359a-92e8-4f4a-b329-09674c5e2c34 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:50.337411 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6278359a-92e8-4f4a-b329-09674c5e2c34 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:50.367060 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6278359a-92e8-4f4a-b329-09674c5e2c34 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045911 Aug 24 13:16:50.367673 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1978/3951] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 13:16:50 2022] GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:16:51.380411 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-72302f48-7d2a-425a-8a8b-3fb633ab63d8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:16:51.382419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-72302f48-7d2a-425a-8a8b-3fb633ab63d8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:16:51.388856 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-72302f48-7d2a-425a-8a8b-3fb633ab63d8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:51.389327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-72302f48-7d2a-425a-8a8b-3fb633ab63d8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:51.389758 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-72302f48-7d2a-425a-8a8b-3fb633ab63d8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:51.390427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-72302f48-7d2a-425a-8a8b-3fb633ab63d8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:51.390996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-72302f48-7d2a-425a-8a8b-3fb633ab63d8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:51.391413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-72302f48-7d2a-425a-8a8b-3fb633ab63d8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:51.418873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-72302f48-7d2a-425a-8a8b-3fb633ab63d8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043045 Aug 24 13:16:51.419416 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1974/3952] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 13:16:51 2022] GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 13:16:51.483151 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-1da9f85e-16ce-4759-9dd0-7d7fadd53f30 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:16:51.483686 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1da9f85e-16ce-4759-9dd0-7d7fadd53f30 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:16:51.490133 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1da9f85e-16ce-4759-9dd0-7d7fadd53f30 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:51.490611 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1da9f85e-16ce-4759-9dd0-7d7fadd53f30 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:51.491064 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1da9f85e-16ce-4759-9dd0-7d7fadd53f30 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:51.491735 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1da9f85e-16ce-4759-9dd0-7d7fadd53f30 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:51.492184 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1da9f85e-16ce-4759-9dd0-7d7fadd53f30 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:51.492605 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-1da9f85e-16ce-4759-9dd0-7d7fadd53f30 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:51.517278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-1da9f85e-16ce-4759-9dd0-7d7fadd53f30 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Going to try to terminate instance {{(pid=121170) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 13:16:51.834927 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-1da9f85e-16ce-4759-9dd0-7d7fadd53f30 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "DELETE /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc" status: 204 len: 0 microversion: 2.1 time: 0.355201 Aug 24 13:16:51.835506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1979/3953] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 13:16:51 2022] DELETE /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:16:51.843607 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f47bf448-94cf-4cda-90d7-d0d8d7d78b40 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:16:51.844210 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f47bf448-94cf-4cda-90d7-d0d8d7d78b40 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:16:51.850156 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f47bf448-94cf-4cda-90d7-d0d8d7d78b40 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:51.850623 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f47bf448-94cf-4cda-90d7-d0d8d7d78b40 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:51.851113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f47bf448-94cf-4cda-90d7-d0d8d7d78b40 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:51.851792 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f47bf448-94cf-4cda-90d7-d0d8d7d78b40 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:51.852240 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f47bf448-94cf-4cda-90d7-d0d8d7d78b40 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:51.852661 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f47bf448-94cf-4cda-90d7-d0d8d7d78b40 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:51.979604 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f47bf448-94cf-4cda-90d7-d0d8d7d78b40 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:16:51.987829 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f47bf448-94cf-4cda-90d7-d0d8d7d78b40 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc" status: 200 len: 1682 microversion: 2.1 time: 0.147544 Aug 24 13:16:51.989768 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1975/3954] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:16:51 2022] GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:16:52.650559 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:16:52.651266 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 13:16:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:16:53.009578 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b09648dc-7830-4315-810d-8f8d48c45fbe tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:16:53.010268 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b09648dc-7830-4315-810d-8f8d48c45fbe tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:16:53.016600 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b09648dc-7830-4315-810d-8f8d48c45fbe tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:53.017078 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b09648dc-7830-4315-810d-8f8d48c45fbe tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:53.017512 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b09648dc-7830-4315-810d-8f8d48c45fbe tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:53.018190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b09648dc-7830-4315-810d-8f8d48c45fbe tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:53.019184 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b09648dc-7830-4315-810d-8f8d48c45fbe tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:53.019599 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b09648dc-7830-4315-810d-8f8d48c45fbe tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:53.150637 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b09648dc-7830-4315-810d-8f8d48c45fbe tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:16:53.158182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b09648dc-7830-4315-810d-8f8d48c45fbe tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc" status: 200 len: 1682 microversion: 2.1 time: 0.152828 Aug 24 13:16:53.158819 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1980/3955] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:16:53 2022] GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:16:54.181085 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d93ffc78-4339-4d44-a341-93a1e06688bf tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:16:54.181720 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d93ffc78-4339-4d44-a341-93a1e06688bf tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:16:54.187890 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d93ffc78-4339-4d44-a341-93a1e06688bf tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:54.188370 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d93ffc78-4339-4d44-a341-93a1e06688bf tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:54.188798 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d93ffc78-4339-4d44-a341-93a1e06688bf tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:54.189489 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d93ffc78-4339-4d44-a341-93a1e06688bf tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:54.189939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d93ffc78-4339-4d44-a341-93a1e06688bf tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:54.190889 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d93ffc78-4339-4d44-a341-93a1e06688bf tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:54.382712 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d93ffc78-4339-4d44-a341-93a1e06688bf tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:16:54.390814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d93ffc78-4339-4d44-a341-93a1e06688bf tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc" status: 200 len: 1682 microversion: 2.1 time: 0.213525 Aug 24 13:16:54.392190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1976/3956] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:16:54 2022] GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc => generated 1682 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:16:54.805330 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-7b464195-962f-4987-80ac-dfe1e0eecced req-13f0cb4f-d75a-491c-95d8-857bd356c53e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55f47f59-c5c5-4831-b535-881f53f6a2bc", "name": "network-vif-deleted", "tag": "7f1feffe-2920-490a-9420-84204ca3d3fe"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:16:54.816472 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-7b464195-962f-4987-80ac-dfe1e0eecced req-13f0cb4f-d75a-491c-95d8-857bd356c53e service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:54.817329 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-7b464195-962f-4987-80ac-dfe1e0eecced req-13f0cb4f-d75a-491c-95d8-857bd356c53e service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:54.817550 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-7b464195-962f-4987-80ac-dfe1e0eecced req-13f0cb4f-d75a-491c-95d8-857bd356c53e service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:54.828932 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-7b464195-962f-4987-80ac-dfe1e0eecced req-13f0cb4f-d75a-491c-95d8-857bd356c53e service nova] Creating event network-vif-deleted:7f1feffe-2920-490a-9420-84204ca3d3fe for instance 55f47f59-c5c5-4831-b535-881f53f6a2bc on hv-cinder-84889 Aug 24 13:16:54.835349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-7b464195-962f-4987-80ac-dfe1e0eecced req-13f0cb4f-d75a-491c-95d8-857bd356c53e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033247 Aug 24 13:16:54.836456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1981/3957] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:16:55.412293 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-918a7034-9f0c-4d10-95bc-0fbc23daf689 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:16:55.413581 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-918a7034-9f0c-4d10-95bc-0fbc23daf689 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:16:55.419833 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-918a7034-9f0c-4d10-95bc-0fbc23daf689 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:55.420310 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-918a7034-9f0c-4d10-95bc-0fbc23daf689 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:55.420741 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-918a7034-9f0c-4d10-95bc-0fbc23daf689 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:55.421428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-918a7034-9f0c-4d10-95bc-0fbc23daf689 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:55.421869 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-918a7034-9f0c-4d10-95bc-0fbc23daf689 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:55.422480 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-918a7034-9f0c-4d10-95bc-0fbc23daf689 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:55.457285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-918a7034-9f0c-4d10-95bc-0fbc23daf689 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:55.457757 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-918a7034-9f0c-4d10-95bc-0fbc23daf689 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:55.458365 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-918a7034-9f0c-4d10-95bc-0fbc23daf689 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:55.458838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.objects.instance [None req-918a7034-9f0c-4d10-95bc-0fbc23daf689 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lazy-loading 'fault' on Instance uuid 55f47f59-c5c5-4831-b535-881f53f6a2bc {{(pid=121171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:16:55.501036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-918a7034-9f0c-4d10-95bc-0fbc23daf689 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:16:55.509092 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-918a7034-9f0c-4d10-95bc-0fbc23daf689 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc" status: 200 len: 1331 microversion: 2.1 time: 0.101179 Aug 24 13:16:55.509660 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1977/3958] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:16:55 2022] GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:16:56.530887 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6b0bf550-1f1a-474e-85dd-1c5320eece2f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:16:56.531583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-6b0bf550-1f1a-474e-85dd-1c5320eece2f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:16:56.538844 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b0bf550-1f1a-474e-85dd-1c5320eece2f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:56.539322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b0bf550-1f1a-474e-85dd-1c5320eece2f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:56.539769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b0bf550-1f1a-474e-85dd-1c5320eece2f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:56.540429 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b0bf550-1f1a-474e-85dd-1c5320eece2f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:56.540908 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b0bf550-1f1a-474e-85dd-1c5320eece2f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:56.541326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-6b0bf550-1f1a-474e-85dd-1c5320eece2f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:56.555115 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.wsgi [None req-6b0bf550-1f1a-474e-85dd-1c5320eece2f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] HTTP exception thrown: Instance 55f47f59-c5c5-4831-b535-881f53f6a2bc could not be found. Aug 24 13:16:56.556916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6b0bf550-1f1a-474e-85dd-1c5320eece2f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Request method failure captured: Aug 24 13:16:56.556916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: request: GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc HTTP/1.1 Aug 24 13:16:56.556916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept: application/json Aug 24 13:16:56.556916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept-Encoding: identity Aug 24 13:16:56.556916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Connection: close Aug 24 13:16:56.556916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Length: 0 Aug 24 13:16:56.556916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Type: application/json Aug 24 13:16:56.556916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Host: 10.222.0.45 Aug 24 13:16:56.556916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Openstack-System-Scope: None Aug 24 13:16:56.556916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: User-Agent: python-urllib3/1.26.11 Aug 24 13:16:56.556916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Auth-Token: gAAAAABjBiP5eWEmCH1rTy3m7m9k9tdAn-MnqMzHWGZRmRwtIge3QPfo9RpMXcI_LY98ZmPLiGQnyraOQKKZTpPuQ7xHFVK5Rrn8lL4ilOSLnxJOMDFVHwkD8fW0lAsKO3_bHu1jCBS6E5WwEpSHN863rTspgcEScExi5zF4GV4mWJORGe0jHpc Aug 24 13:16:56.556916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Id: None Aug 24 13:16:56.556916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Name: None Aug 24 13:16:56.556916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Identity-Status: Confirmed Aug 24 13:16:56.556916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Is-Admin-Project: True Aug 24 13:16:56.556916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Id: default Aug 24 13:16:56.556916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Name: Default Aug 24 13:16:56.556916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:16:56.556916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:16:56.556916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Role: member,reader Aug 24 13:16:56.556916 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Roles: member,reader Aug 24 13:16:56.558541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}] Aug 24 13:16:56.558541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:16:56.558541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:16:56.558541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:16:56.558541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:16:56.558541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Id: default Aug 24 13:16:56.558541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Name: Default Aug 24 13:16:56.558541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Id: fa9364936c614a68b22f66c32b76cba9 Aug 24 13:16:56.558541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Name: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:16:56.558541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: method: > Aug 24 13:16:56.558541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: exception: Instance 55f47f59-c5c5-4831-b535-881f53f6a2bc could not be found. Aug 24 13:16:56.558541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: action_args: {'id': '55f47f59-c5c5-4831-b535-881f53f6a2bc'} Aug 24 13:16:56.559515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:16:56.559515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:16:56.559515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:16:56.559515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:16:56.559515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:16:56.559515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:16:56.559515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:16:56.559515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:16:56.559515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:16:56.559515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:16:56.559515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55f47f59-c5c5-4831-b535-881f53f6a2bc could not be found. Aug 24 13:16:56.559515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:16:56.559515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:16:56.559515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:16:56.559515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:16:56.559515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:16:56.559515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:16:56.559515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:16:56.559515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:16:56.559515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:16:56.561126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:16:56.561126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:16:56.561126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:16:56.561126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:16:56.561126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:16:56.561126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:16:56.561126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:16:56.561126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55f47f59-c5c5-4831-b535-881f53f6a2bc could not be found. Aug 24 13:16:56.561126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:16:56.561126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:16:56.561126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:16:56.561126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:16:56.561126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:16:56.561126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:16:56.561126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:16:56.561126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:16:56.561126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55f47f59-c5c5-4831-b535-881f53f6a2bc could not be found. Aug 24 13:16:56.561126 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:16:56.562536 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-6b0bf550-1f1a-474e-85dd-1c5320eece2f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Returning 404 to user: Instance 55f47f59-c5c5-4831-b535-881f53f6a2bc could not be found. {{(pid=121170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:16:56.562536 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-6b0bf550-1f1a-474e-85dd-1c5320eece2f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc" status: 404 len: 111 microversion: 2.1 time: 0.031970 Aug 24 13:16:56.562536 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1982/3959] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:16:56 2022] GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:16:56.567776 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4d4d2950-9987-4517-ae1d-f78469ff785c tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '.version_select at 0x7f76f52c40d0>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:16:56.624041 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4d4d2950-9987-4517-ae1d-f78469ff785c tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1441855236" status: 202 len: 0 microversion: 2.1 time: 0.060001 Aug 24 13:16:56.624610 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1978/3960] 10.222.0.45 () {58 vars in 1221 bytes} [Wed Aug 24 13:16:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1441855236 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:16:57.354666 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-627961fd-4cbc-4297-8c49-e5c1907ad708 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Action: 'create', calling method: .version_select at 0x7f76f9d52e50>, body: {"keypair": {"name": "tempest-keypair-1299927072", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+8J9xPSs083k0LsppQeh9SfEmcrc9Bv0lmB2zfauOTqviQfPfSm6qlqkxiBH4vn2mFjUfMbHLLWPBHFdO9Xrb0vCvwS8fMHxGrZG/ai+CaplCCWVI+ILLKysf4RSYL9w=="}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:16:57.370151 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-627961fd-4cbc-4297-8c49-e5c1907ad708 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Getting quotas for project 5e9455e7426b490680c92f1bb3cecca0. Resources: {'key_pairs'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:16:57.374123 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-627961fd-4cbc-4297-8c49-e5c1907ad708 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Getting quotas for user fa9364936c614a68b22f66c32b76cba9 and project 5e9455e7426b490680c92f1bb3cecca0. Resources: {'key_pairs'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:16:57.453739 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-627961fd-4cbc-4297-8c49-e5c1907ad708 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.103025 Aug 24 13:16:57.455200 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1983/3961] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 24 13:16:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:16:59.467819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2b9619e0-95e9-49b9-98ee-bd8d52c88d18 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1613182045", "imageRef": "62fcb2c8-bff4-46cf-9892-c43d7626629e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3a6b6253-0057-4d36-bf42-268f73b09473"}], "security_groups": [{"name": "tempest-securitygroup--1191810874"}], "key_name": "tempest-keypair-1299927072", "user_data": "}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:16:59.576713 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.network.neutron [None req-2b9619e0-95e9-49b9-98ee-bd8d52c88d18 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] validate_networks() for [('3a6b6253-0057-4d36-bf42-268f73b09473', None, None, None, None, None)] {{(pid=121171) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:16:59.942625 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-2b9619e0-95e9-49b9-98ee-bd8d52c88d18 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Flavor limits 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:16:59.943070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-2b9619e0-95e9-49b9-98ee-bd8d52c88d18 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Image limits 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:16:59.943536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-2b9619e0-95e9-49b9-98ee-bd8d52c88d18 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Flavor pref 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:16:59.943939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-2b9619e0-95e9-49b9-98ee-bd8d52c88d18 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Image pref 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:16:59.944348 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-2b9619e0-95e9-49b9-98ee-bd8d52c88d18 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:16:59.952946 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b9619e0-95e9-49b9-98ee-bd8d52c88d18 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:59.953414 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b9619e0-95e9-49b9-98ee-bd8d52c88d18 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:59.953839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b9619e0-95e9-49b9-98ee-bd8d52c88d18 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:59.954544 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b9619e0-95e9-49b9-98ee-bd8d52c88d18 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:16:59.955045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b9619e0-95e9-49b9-98ee-bd8d52c88d18 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:16:59.955464 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2b9619e0-95e9-49b9-98ee-bd8d52c88d18 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:16:59.972349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-2b9619e0-95e9-49b9-98ee-bd8d52c88d18 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Getting quotas for project 5e9455e7426b490680c92f1bb3cecca0. Resources: {'instances', 'cores', 'ram'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:16:59.976179 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-2b9619e0-95e9-49b9-98ee-bd8d52c88d18 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Getting quotas for user fa9364936c614a68b22f66c32b76cba9 and project 5e9455e7426b490680c92f1bb3cecca0. Resources: {'instances', 'cores', 'ram'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:16:59.986643 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2b9619e0-95e9-49b9-98ee-bd8d52c88d18 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Going to run 1 instances... {{(pid=121171) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 13:16:59.988885 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2b9619e0-95e9-49b9-98ee-bd8d52c88d18 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='62fcb2c8-bff4-46cf-9892-c43d7626629e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 13:17:00.117573 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2b9619e0-95e9-49b9-98ee-bd8d52c88d18 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.654410 Aug 24 13:17:00.118173 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1979/3962] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 13:16:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 13:17:00.130197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9697f441-fcac-4dd4-8db6-54a9dcd77791 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:17:00.130827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9697f441-fcac-4dd4-8db6-54a9dcd77791 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:17:00.186520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9697f441-fcac-4dd4-8db6-54a9dcd77791 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:17:00.193827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9697f441-fcac-4dd4-8db6-54a9dcd77791 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c" status: 200 len: 1242 microversion: 2.1 time: 0.068527 Aug 24 13:17:00.194386 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1984/3963] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:17:00 2022] GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:17:01.215560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-b4310853-9bce-4c61-8093-8953425640c2 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:17:01.216012 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-b4310853-9bce-4c61-8093-8953425640c2 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:17:01.222763 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b4310853-9bce-4c61-8093-8953425640c2 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:17:01.223247 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b4310853-9bce-4c61-8093-8953425640c2 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:17:01.223675 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b4310853-9bce-4c61-8093-8953425640c2 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:17:01.224361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b4310853-9bce-4c61-8093-8953425640c2 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:17:01.224809 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b4310853-9bce-4c61-8093-8953425640c2 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:17:01.225236 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-b4310853-9bce-4c61-8093-8953425640c2 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:17:01.291407 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-b4310853-9bce-4c61-8093-8953425640c2 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:17:01.298938 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-b4310853-9bce-4c61-8093-8953425640c2 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c" status: 200 len: 1238 microversion: 2.1 time: 0.088035 Aug 24 13:17:01.299504 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1980/3964] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:17:01 2022] GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c => generated 1238 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:17:02.319037 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-040e4685-8734-452a-8ff7-73661c313e82 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:17:02.319750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-040e4685-8734-452a-8ff7-73661c313e82 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:17:02.326130 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-040e4685-8734-452a-8ff7-73661c313e82 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:17:02.326706 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-040e4685-8734-452a-8ff7-73661c313e82 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:17:02.327208 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-040e4685-8734-452a-8ff7-73661c313e82 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:17:02.327958 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-040e4685-8734-452a-8ff7-73661c313e82 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:17:02.328483 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-040e4685-8734-452a-8ff7-73661c313e82 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:17:02.328980 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-040e4685-8734-452a-8ff7-73661c313e82 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:17:02.398869 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-040e4685-8734-452a-8ff7-73661c313e82 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:17:02.406901 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-040e4685-8734-452a-8ff7-73661c313e82 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c" status: 200 len: 1300 microversion: 2.1 time: 0.091738 Aug 24 13:17:02.407512 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1985/3965] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:17:02 2022] GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:17:03.433234 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8eb1da37-3d70-4bf4-ae1c-4896281fb94d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:17:03.434382 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8eb1da37-3d70-4bf4-ae1c-4896281fb94d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:17:03.441199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8eb1da37-3d70-4bf4-ae1c-4896281fb94d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:17:03.441683 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8eb1da37-3d70-4bf4-ae1c-4896281fb94d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:17:03.442120 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8eb1da37-3d70-4bf4-ae1c-4896281fb94d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:17:03.442862 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8eb1da37-3d70-4bf4-ae1c-4896281fb94d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:17:03.443321 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8eb1da37-3d70-4bf4-ae1c-4896281fb94d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:17:03.443749 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8eb1da37-3d70-4bf4-ae1c-4896281fb94d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:17:03.661108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-8eb1da37-3d70-4bf4-ae1c-4896281fb94d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:17:03.668738 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8eb1da37-3d70-4bf4-ae1c-4896281fb94d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c" status: 200 len: 1368 microversion: 2.1 time: 0.239364 Aug 24 13:17:03.669232 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1981/3966] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:17:03 2022] GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:17:03.845640 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-feac4405-7b39-4072-80b0-a8e854e8675a req-cfa94939-79b4-4484-b820-961656976f83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31300f22-6eeb-4def-b92a-bd1697d1986c", "tag": "190400c0-7152-490a-9f3e-292786a844fd"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:17:03.857258 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-feac4405-7b39-4072-80b0-a8e854e8675a req-cfa94939-79b4-4484-b820-961656976f83 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:17:03.857736 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-feac4405-7b39-4072-80b0-a8e854e8675a req-cfa94939-79b4-4484-b820-961656976f83 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:17:03.858165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-feac4405-7b39-4072-80b0-a8e854e8675a req-cfa94939-79b4-4484-b820-961656976f83 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:17:03.869850 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-feac4405-7b39-4072-80b0-a8e854e8675a req-cfa94939-79b4-4484-b820-961656976f83 service nova] Creating event network-changed:190400c0-7152-490a-9f3e-292786a844fd for instance 31300f22-6eeb-4def-b92a-bd1697d1986c on hv-cinder-84889 Aug 24 13:17:03.875136 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-feac4405-7b39-4072-80b0-a8e854e8675a req-cfa94939-79b4-4484-b820-961656976f83 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033360 Aug 24 13:17:03.875693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1986/3967] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:17:04.689540 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-6e9dc240-e744-4f6a-9e03-5b5fbc14ddbe tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:17:04.690688 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-6e9dc240-e744-4f6a-9e03-5b5fbc14ddbe tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:17:04.697085 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e9dc240-e744-4f6a-9e03-5b5fbc14ddbe tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:17:04.697571 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e9dc240-e744-4f6a-9e03-5b5fbc14ddbe tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:17:04.698014 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e9dc240-e744-4f6a-9e03-5b5fbc14ddbe tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:17:04.698728 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e9dc240-e744-4f6a-9e03-5b5fbc14ddbe tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:17:04.699186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e9dc240-e744-4f6a-9e03-5b5fbc14ddbe tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:17:04.699611 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-6e9dc240-e744-4f6a-9e03-5b5fbc14ddbe tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:17:04.830617 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-6e9dc240-e744-4f6a-9e03-5b5fbc14ddbe tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:17:04.838297 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-6e9dc240-e744-4f6a-9e03-5b5fbc14ddbe tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c" status: 200 len: 1368 microversion: 2.1 time: 0.152584 Aug 24 13:17:04.838913 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1982/3968] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:17:04 2022] GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:17:05.860122 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-586818c8-28b2-46d7-8863-62419f49cbd1 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:17:05.860852 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-586818c8-28b2-46d7-8863-62419f49cbd1 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:17:05.867006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-586818c8-28b2-46d7-8863-62419f49cbd1 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:17:05.867490 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-586818c8-28b2-46d7-8863-62419f49cbd1 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:17:05.867932 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-586818c8-28b2-46d7-8863-62419f49cbd1 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:17:05.868617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-586818c8-28b2-46d7-8863-62419f49cbd1 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:17:05.869078 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-586818c8-28b2-46d7-8863-62419f49cbd1 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:17:05.869507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-586818c8-28b2-46d7-8863-62419f49cbd1 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:17:05.995222 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-586818c8-28b2-46d7-8863-62419f49cbd1 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:17:06.003650 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-586818c8-28b2-46d7-8863-62419f49cbd1 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c" status: 200 len: 1368 microversion: 2.1 time: 0.148346 Aug 24 13:17:06.004204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1987/3969] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:17:05 2022] GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:17:07.024300 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-02ba6c71-a19e-4b22-b045-1cb1b6799f55 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:17:07.024855 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-02ba6c71-a19e-4b22-b045-1cb1b6799f55 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:17:07.031257 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02ba6c71-a19e-4b22-b045-1cb1b6799f55 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:17:07.031737 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02ba6c71-a19e-4b22-b045-1cb1b6799f55 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:17:07.032172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02ba6c71-a19e-4b22-b045-1cb1b6799f55 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:17:07.032854 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02ba6c71-a19e-4b22-b045-1cb1b6799f55 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:17:07.033303 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02ba6c71-a19e-4b22-b045-1cb1b6799f55 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:17:07.033740 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-02ba6c71-a19e-4b22-b045-1cb1b6799f55 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:17:07.159782 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-02ba6c71-a19e-4b22-b045-1cb1b6799f55 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:17:07.167369 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-02ba6c71-a19e-4b22-b045-1cb1b6799f55 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c" status: 200 len: 1368 microversion: 2.1 time: 0.147025 Aug 24 13:17:07.167929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1983/3970] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:17:07 2022] GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:17:08.188289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3a9e556f-f34a-4841-8869-de72fc067e58 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:17:08.188895 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3a9e556f-f34a-4841-8869-de72fc067e58 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:17:08.195797 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a9e556f-f34a-4841-8869-de72fc067e58 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:17:08.196275 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a9e556f-f34a-4841-8869-de72fc067e58 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:17:08.196708 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a9e556f-f34a-4841-8869-de72fc067e58 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:17:08.197384 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a9e556f-f34a-4841-8869-de72fc067e58 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:17:08.197834 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a9e556f-f34a-4841-8869-de72fc067e58 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:17:08.198254 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a9e556f-f34a-4841-8869-de72fc067e58 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:17:08.327146 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-3a9e556f-f34a-4841-8869-de72fc067e58 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:17:08.335394 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3a9e556f-f34a-4841-8869-de72fc067e58 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c" status: 200 len: 1368 microversion: 2.1 time: 0.150960 Aug 24 13:17:08.335948 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1988/3971] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:17:08 2022] GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:17:09.356467 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-681c237c-ee91-4ad0-ab20-36ef020cd1b9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:17:09.357083 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-681c237c-ee91-4ad0-ab20-36ef020cd1b9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:17:09.363386 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-681c237c-ee91-4ad0-ab20-36ef020cd1b9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:17:09.363866 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-681c237c-ee91-4ad0-ab20-36ef020cd1b9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:17:09.364299 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-681c237c-ee91-4ad0-ab20-36ef020cd1b9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:17:09.364972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-681c237c-ee91-4ad0-ab20-36ef020cd1b9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:17:09.365420 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-681c237c-ee91-4ad0-ab20-36ef020cd1b9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:17:09.365841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-681c237c-ee91-4ad0-ab20-36ef020cd1b9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:17:09.492884 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-681c237c-ee91-4ad0-ab20-36ef020cd1b9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:17:09.500672 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-681c237c-ee91-4ad0-ab20-36ef020cd1b9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c" status: 200 len: 1368 microversion: 2.1 time: 0.148261 Aug 24 13:17:09.501229 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1984/3972] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:17:09 2022] GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:17:10.479074 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-2c53bc47-8a4d-429b-a380-b925084f244d req-16a96a83-9da7-4726-809e-bf9036ca3e1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31300f22-6eeb-4def-b92a-bd1697d1986c", "name": "network-vif-plugged", "status": "completed", "tag": "190400c0-7152-490a-9f3e-292786a844fd"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:17:10.484711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell0:SELECT=6 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:17:10.493178 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-2c53bc47-8a4d-429b-a380-b925084f244d req-16a96a83-9da7-4726-809e-bf9036ca3e1a service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:17:10.493178 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-2c53bc47-8a4d-429b-a380-b925084f244d req-16a96a83-9da7-4726-809e-bf9036ca3e1a service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:17:10.493178 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-2c53bc47-8a4d-429b-a380-b925084f244d req-16a96a83-9da7-4726-809e-bf9036ca3e1a service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:17:10.502788 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-2c53bc47-8a4d-429b-a380-b925084f244d req-16a96a83-9da7-4726-809e-bf9036ca3e1a service nova] Creating event network-vif-plugged:190400c0-7152-490a-9f3e-292786a844fd for instance 31300f22-6eeb-4def-b92a-bd1697d1986c on hv-cinder-84889 Aug 24 13:17:10.507780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-2c53bc47-8a4d-429b-a380-b925084f244d req-16a96a83-9da7-4726-809e-bf9036ca3e1a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032680 Aug 24 13:17:10.508354 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1989/3973] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:17:10.521105 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d3fb1a9e-df03-4ae9-879e-b19878dc13d0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:17:10.521718 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d3fb1a9e-df03-4ae9-879e-b19878dc13d0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:17:10.523598 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=2 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:17:10.524250 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=6 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:17:10.529388 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3fb1a9e-df03-4ae9-879e-b19878dc13d0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:17:10.529983 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3fb1a9e-df03-4ae9-879e-b19878dc13d0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:17:10.530428 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3fb1a9e-df03-4ae9-879e-b19878dc13d0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:17:10.531149 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3fb1a9e-df03-4ae9-879e-b19878dc13d0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:17:10.531605 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3fb1a9e-df03-4ae9-879e-b19878dc13d0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:17:10.532033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d3fb1a9e-df03-4ae9-879e-b19878dc13d0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:17:10.666790 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d3fb1a9e-df03-4ae9-879e-b19878dc13d0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:17:10.674998 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d3fb1a9e-df03-4ae9-879e-b19878dc13d0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c" status: 200 len: 1368 microversion: 2.1 time: 0.157057 Aug 24 13:17:10.675568 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1985/3974] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:17:10 2022] GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:17:11.697920 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-808d9383-3cb3-474c-9f11-18fc28a45bfb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:17:11.698551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-808d9383-3cb3-474c-9f11-18fc28a45bfb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:17:11.704786 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-808d9383-3cb3-474c-9f11-18fc28a45bfb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:17:11.705271 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-808d9383-3cb3-474c-9f11-18fc28a45bfb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:17:11.705724 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-808d9383-3cb3-474c-9f11-18fc28a45bfb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:17:11.706406 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-808d9383-3cb3-474c-9f11-18fc28a45bfb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:17:11.706889 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-808d9383-3cb3-474c-9f11-18fc28a45bfb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:17:11.707319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-808d9383-3cb3-474c-9f11-18fc28a45bfb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:17:11.837878 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-808d9383-3cb3-474c-9f11-18fc28a45bfb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:17:11.841450 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:17:11.845871 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-808d9383-3cb3-474c-9f11-18fc28a45bfb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c" status: 200 len: 1368 microversion: 2.1 time: 0.153202 Aug 24 13:17:11.846428 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1990/3975] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:17:11 2022] GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:17:12.866935 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-af7b80a7-2bd3-4b26-b01c-6ebdbebda3c0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:17:12.867572 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-af7b80a7-2bd3-4b26-b01c-6ebdbebda3c0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:17:12.874556 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af7b80a7-2bd3-4b26-b01c-6ebdbebda3c0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:17:12.875064 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af7b80a7-2bd3-4b26-b01c-6ebdbebda3c0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:17:12.875499 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af7b80a7-2bd3-4b26-b01c-6ebdbebda3c0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:17:12.876175 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af7b80a7-2bd3-4b26-b01c-6ebdbebda3c0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:17:12.876624 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af7b80a7-2bd3-4b26-b01c-6ebdbebda3c0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:17:12.877050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-af7b80a7-2bd3-4b26-b01c-6ebdbebda3c0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:17:12.904309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=100 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:17:13.019715 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-af7b80a7-2bd3-4b26-b01c-6ebdbebda3c0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:17:13.027444 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-af7b80a7-2bd3-4b26-b01c-6ebdbebda3c0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c" status: 200 len: 1557 microversion: 2.1 time: 0.165088 Aug 24 13:17:13.028001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1986/3976] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:17:12 2022] GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c => generated 1557 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:17:13.047549 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-186b19b0-db58-418d-80bd-ca1642afadfa tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:17:13.048031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-186b19b0-db58-418d-80bd-ca1642afadfa tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:17:13.055227 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-186b19b0-db58-418d-80bd-ca1642afadfa tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:17:13.055720 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-186b19b0-db58-418d-80bd-ca1642afadfa tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:17:13.056165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-186b19b0-db58-418d-80bd-ca1642afadfa tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:17:13.056859 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-186b19b0-db58-418d-80bd-ca1642afadfa tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:17:13.057322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-186b19b0-db58-418d-80bd-ca1642afadfa tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:17:13.057806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-186b19b0-db58-418d-80bd-ca1642afadfa tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:17:13.143555 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-186b19b0-db58-418d-80bd-ca1642afadfa tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091228 Aug 24 13:17:13.143555 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1991/3977] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 24 13:17:13 2022] GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:17:14.083636 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-3f9c5c9b-bd62-4237-8c35-65272e0356f4 req-b1d8ced6-6659-4ed2-8859-fc9b35f2b466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31300f22-6eeb-4def-b92a-bd1697d1986c", "tag": "190400c0-7152-490a-9f3e-292786a844fd"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:17:14.088879 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:17:14.094085 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-3f9c5c9b-bd62-4237-8c35-65272e0356f4 req-b1d8ced6-6659-4ed2-8859-fc9b35f2b466 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:17:14.094640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-3f9c5c9b-bd62-4237-8c35-65272e0356f4 req-b1d8ced6-6659-4ed2-8859-fc9b35f2b466 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:17:14.095163 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-3f9c5c9b-bd62-4237-8c35-65272e0356f4 req-b1d8ced6-6659-4ed2-8859-fc9b35f2b466 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:17:14.107038 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-3f9c5c9b-bd62-4237-8c35-65272e0356f4 req-b1d8ced6-6659-4ed2-8859-fc9b35f2b466 service nova] Creating event network-changed:190400c0-7152-490a-9f3e-292786a844fd for instance 31300f22-6eeb-4def-b92a-bd1697d1986c on hv-cinder-84889 Aug 24 13:17:14.112337 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-3f9c5c9b-bd62-4237-8c35-65272e0356f4 req-b1d8ced6-6659-4ed2-8859-fc9b35f2b466 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032941 Aug 24 13:17:14.113040 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1987/3978] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:18:18.668099 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:18:18.668848 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=4 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:18:18.672986 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5f576b02-f779-4d60-b8d0-de438d551a79 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:18:18.673473 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5f576b02-f779-4d60-b8d0-de438d551a79 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:18:18.679626 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f576b02-f779-4d60-b8d0-de438d551a79 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:18.680049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f576b02-f779-4d60-b8d0-de438d551a79 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:18.680487 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f576b02-f779-4d60-b8d0-de438d551a79 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:18.681174 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f576b02-f779-4d60-b8d0-de438d551a79 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:18.681678 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f576b02-f779-4d60-b8d0-de438d551a79 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:18.682105 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f576b02-f779-4d60-b8d0-de438d551a79 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:18.705418 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5f576b02-f779-4d60-b8d0-de438d551a79 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c/ips" status: 200 len: 149 microversion: 2.1 time: 0.039322 Aug 24 13:18:18.706143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1992/3979] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 24 13:18:18 2022] GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:18:21.449727 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=4 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:18:21.454724 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d7f4bf58-dac5-414d-91b5-ff9c68f158cc tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc6119a3-b322-4bf7-936c-8a998dab5c4f"}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:18:21.457115 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d7f4bf58-dac5-414d-91b5-ff9c68f158cc tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:18:21.463350 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7f4bf58-dac5-414d-91b5-ff9c68f158cc tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:21.463831 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7f4bf58-dac5-414d-91b5-ff9c68f158cc tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:21.464267 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7f4bf58-dac5-414d-91b5-ff9c68f158cc tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:21.464947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7f4bf58-dac5-414d-91b5-ff9c68f158cc tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:21.465397 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7f4bf58-dac5-414d-91b5-ff9c68f158cc tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:21.465819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d7f4bf58-dac5-414d-91b5-ff9c68f158cc tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:22.306493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d7f4bf58-dac5-414d-91b5-ff9c68f158cc tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "POST /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.858691 Aug 24 13:18:22.307127 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1988/3980] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 24 13:18:21 2022] POST /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c/os-volume_attachments => generated 194 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:18:29.826542 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-49b1683e-f0a3-4d1e-8f7d-85e30ef8d6b3 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc6119a3-b322-4bf7-936c-8a998dab5c4f"}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:18:29.828935 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-49b1683e-f0a3-4d1e-8f7d-85e30ef8d6b3 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:18:29.835953 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49b1683e-f0a3-4d1e-8f7d-85e30ef8d6b3 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:29.836425 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49b1683e-f0a3-4d1e-8f7d-85e30ef8d6b3 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:29.836854 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49b1683e-f0a3-4d1e-8f7d-85e30ef8d6b3 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:29.837567 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49b1683e-f0a3-4d1e-8f7d-85e30ef8d6b3 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:29.838016 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49b1683e-f0a3-4d1e-8f7d-85e30ef8d6b3 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:29.838435 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49b1683e-f0a3-4d1e-8f7d-85e30ef8d6b3 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:29.980380 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.wsgi [None req-49b1683e-f0a3-4d1e-8f7d-85e30ef8d6b3 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] HTTP exception thrown: Invalid volume: volume fc6119a3-b322-4bf7-936c-8a998dab5c4f is already attached to instances: 31300f22-6eeb-4def-b92a-bd1697d1986c Aug 24 13:18:29.982144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-49b1683e-f0a3-4d1e-8f7d-85e30ef8d6b3 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Request method failure captured: Aug 24 13:18:29.982144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: request: POST /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c/os-volume_attachments HTTP/1.1 Aug 24 13:18:29.982144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept: application/json Aug 24 13:18:29.982144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept-Encoding: identity Aug 24 13:18:29.982144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Connection: close Aug 24 13:18:29.982144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Length: 74 Aug 24 13:18:29.982144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Type: application/json Aug 24 13:18:29.982144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Host: 10.222.0.45 Aug 24 13:18:29.982144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Openstack-System-Scope: None Aug 24 13:18:29.982144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: User-Agent: python-urllib3/1.26.11 Aug 24 13:18:29.982144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Auth-Token: gAAAAABjBiP5eWEmCH1rTy3m7m9k9tdAn-MnqMzHWGZRmRwtIge3QPfo9RpMXcI_LY98ZmPLiGQnyraOQKKZTpPuQ7xHFVK5Rrn8lL4ilOSLnxJOMDFVHwkD8fW0lAsKO3_bHu1jCBS6E5WwEpSHN863rTspgcEScExi5zF4GV4mWJORGe0jHpc Aug 24 13:18:29.982144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Id: None Aug 24 13:18:29.982144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Name: None Aug 24 13:18:29.982144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Identity-Status: Confirmed Aug 24 13:18:29.982144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Is-Admin-Project: True Aug 24 13:18:29.982144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Id: default Aug 24 13:18:29.982144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Name: Default Aug 24 13:18:29.982144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:18:29.982144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:18:29.982144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Role: member,reader Aug 24 13:18:29.982144 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Roles: member,reader Aug 24 13:18:29.983705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}] Aug 24 13:18:29.983705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:18:29.983705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:18:29.983705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:18:29.983705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:18:29.983705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Id: default Aug 24 13:18:29.983705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Name: Default Aug 24 13:18:29.983705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Id: fa9364936c614a68b22f66c32b76cba9 Aug 24 13:18:29.983705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Name: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:18:29.983705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Aug 24 13:18:29.983705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {"volumeAttachment": {"volumeId": "fc6119a3-b322-4bf7-936c-8a998dab5c4f"}} Aug 24 13:18:29.983705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: method: > Aug 24 13:18:29.984517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: exception: Invalid volume: volume fc6119a3-b322-4bf7-936c-8a998dab5c4f is already attached to instances: 31300f22-6eeb-4def-b92a-bd1697d1986c Aug 24 13:18:29.984517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: action_args: {'server_id': '31300f22-6eeb-4def-b92a-bd1697d1986c', 'body': {'volumeAttachment': {'volumeId': 'fc6119a3-b322-4bf7-936c-8a998dab5c4f'}}} Aug 24 13:18:29.984517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:18:29.984517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:18:29.984517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 13:18:29.984517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 13:18:29.984517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 13:18:29.984517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 13:18:29.984517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 13:18:29.984517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 13:18:29.984517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 13:18:29.984517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 13:18:29.984517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 13:18:29.984517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 13:18:29.984517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fc6119a3-b322-4bf7-936c-8a998dab5c4f is already attached to instances: 31300f22-6eeb-4def-b92a-bd1697d1986c Aug 24 13:18:29.984517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:18:29.984517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:18:29.984517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:18:29.984517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:18:29.985649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:18:29.985649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:18:29.985649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:18:29.985649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:18:29.985649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:18:29.985649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:18:29.985649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 13:18:29.985649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 13:18:29.985649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 13:18:29.985649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 13:18:29.985649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 13:18:29.985649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 13:18:29.985649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 13:18:29.985649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 13:18:29.985649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fc6119a3-b322-4bf7-936c-8a998dab5c4f is already attached to instances: 31300f22-6eeb-4def-b92a-bd1697d1986c Aug 24 13:18:29.985649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:18:29.985649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:18:29.985649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:18:29.985649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:18:29.985649 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:18:29.986827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:18:29.986827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:18:29.986827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:18:29.986827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fc6119a3-b322-4bf7-936c-8a998dab5c4f is already attached to instances: 31300f22-6eeb-4def-b92a-bd1697d1986c Aug 24 13:18:29.986827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:18:29.986827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-49b1683e-f0a3-4d1e-8f7d-85e30ef8d6b3 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Returning 400 to user: Invalid volume: volume fc6119a3-b322-4bf7-936c-8a998dab5c4f is already attached to instances: 31300f22-6eeb-4def-b92a-bd1697d1986c {{(pid=121170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:18:29.986827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-49b1683e-f0a3-4d1e-8f7d-85e30ef8d6b3 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "POST /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.161354 Aug 24 13:18:29.986827 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1993/3981] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 24 13:18:29 2022] POST /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c/os-volume_attachments => generated 174 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 13:18:30.047616 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c58048fb-0bc4-43d5-8295-72a63ef3bf39 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:18:30.048187 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c58048fb-0bc4-43d5-8295-72a63ef3bf39 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:18:30.054810 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c58048fb-0bc4-43d5-8295-72a63ef3bf39 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:30.055287 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c58048fb-0bc4-43d5-8295-72a63ef3bf39 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:30.055718 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c58048fb-0bc4-43d5-8295-72a63ef3bf39 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:30.056391 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c58048fb-0bc4-43d5-8295-72a63ef3bf39 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:30.056834 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c58048fb-0bc4-43d5-8295-72a63ef3bf39 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:30.057253 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c58048fb-0bc4-43d5-8295-72a63ef3bf39 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:30.136253 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.objects.instance [None req-c58048fb-0bc4-43d5-8295-72a63ef3bf39 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lazy-loading 'services' on Instance uuid 31300f22-6eeb-4def-b92a-bd1697d1986c {{(pid=121171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:18:30.336824 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c58048fb-0bc4-43d5-8295-72a63ef3bf39 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "DELETE /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c/os-volume_attachments/fc6119a3-b322-4bf7-936c-8a998dab5c4f" status: 202 len: 0 microversion: 2.1 time: 0.293678 Aug 24 13:18:30.337401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1989/3982] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 24 13:18:30 2022] DELETE /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c/os-volume_attachments/fc6119a3-b322-4bf7-936c-8a998dab5c4f => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 13:18:30.345996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-d9477206-76db-403d-9a16-12ff4884823e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:18:30.354360 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-d9477206-76db-403d-9a16-12ff4884823e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:18:30.357726 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d9477206-76db-403d-9a16-12ff4884823e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:30.358213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d9477206-76db-403d-9a16-12ff4884823e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:30.358661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d9477206-76db-403d-9a16-12ff4884823e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:30.359366 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d9477206-76db-403d-9a16-12ff4884823e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:30.359816 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d9477206-76db-403d-9a16-12ff4884823e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:30.360238 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-d9477206-76db-403d-9a16-12ff4884823e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:30.388992 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-d9477206-76db-403d-9a16-12ff4884823e tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047099 Aug 24 13:18:30.389551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1994/3983] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 13:18:30 2022] GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:18:31.402419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-70d265ae-72ad-46db-ac69-6ba60cae30b6 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:18:31.404642 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-70d265ae-72ad-46db-ac69-6ba60cae30b6 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:18:31.410755 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70d265ae-72ad-46db-ac69-6ba60cae30b6 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:31.411243 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70d265ae-72ad-46db-ac69-6ba60cae30b6 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:31.411684 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70d265ae-72ad-46db-ac69-6ba60cae30b6 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:31.412911 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70d265ae-72ad-46db-ac69-6ba60cae30b6 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:31.413388 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70d265ae-72ad-46db-ac69-6ba60cae30b6 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:31.413810 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-70d265ae-72ad-46db-ac69-6ba60cae30b6 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:31.444245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-70d265ae-72ad-46db-ac69-6ba60cae30b6 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046522 Aug 24 13:18:31.444791 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1990/3984] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 13:18:31 2022] GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 13:18:31.505491 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f7c12cbf-b0d1-4dbd-944a-2f0a1d9755db tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:18:31.506080 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f7c12cbf-b0d1-4dbd-944a-2f0a1d9755db tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:18:31.512320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7c12cbf-b0d1-4dbd-944a-2f0a1d9755db tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:31.512797 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7c12cbf-b0d1-4dbd-944a-2f0a1d9755db tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:31.513228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7c12cbf-b0d1-4dbd-944a-2f0a1d9755db tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:31.513905 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7c12cbf-b0d1-4dbd-944a-2f0a1d9755db tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:31.514353 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7c12cbf-b0d1-4dbd-944a-2f0a1d9755db tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:31.514802 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f7c12cbf-b0d1-4dbd-944a-2f0a1d9755db tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:31.539235 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f7c12cbf-b0d1-4dbd-944a-2f0a1d9755db tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Going to try to terminate instance {{(pid=121170) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 13:18:31.799456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f7c12cbf-b0d1-4dbd-944a-2f0a1d9755db tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "DELETE /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c" status: 204 len: 0 microversion: 2.1 time: 0.297431 Aug 24 13:18:31.800057 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1995/3985] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 13:18:31 2022] DELETE /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:18:31.808656 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-96d7aa59-f05b-419b-99fe-d7f41cac05a1 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:18:31.818967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-96d7aa59-f05b-419b-99fe-d7f41cac05a1 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:18:31.818967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96d7aa59-f05b-419b-99fe-d7f41cac05a1 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:31.818967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96d7aa59-f05b-419b-99fe-d7f41cac05a1 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:31.818967 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96d7aa59-f05b-419b-99fe-d7f41cac05a1 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:31.819367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96d7aa59-f05b-419b-99fe-d7f41cac05a1 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:31.819367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96d7aa59-f05b-419b-99fe-d7f41cac05a1 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:31.819367 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-96d7aa59-f05b-419b-99fe-d7f41cac05a1 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:31.949024 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-96d7aa59-f05b-419b-99fe-d7f41cac05a1 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:18:31.956839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-96d7aa59-f05b-419b-99fe-d7f41cac05a1 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c" status: 200 len: 1682 microversion: 2.1 time: 0.152221 Aug 24 13:18:31.957390 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1991/3986] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:18:31 2022] GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:18:32.138243 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:18:32.138450 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 13:18:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:18:32.979441 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0e109088-4cf5-4531-a664-3fec561cc66a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:18:32.980147 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0e109088-4cf5-4531-a664-3fec561cc66a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:18:32.986481 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0e109088-4cf5-4531-a664-3fec561cc66a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:32.986989 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0e109088-4cf5-4531-a664-3fec561cc66a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:32.987432 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0e109088-4cf5-4531-a664-3fec561cc66a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:32.988107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0e109088-4cf5-4531-a664-3fec561cc66a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:32.988555 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0e109088-4cf5-4531-a664-3fec561cc66a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:32.988974 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0e109088-4cf5-4531-a664-3fec561cc66a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:33.122492 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0e109088-4cf5-4531-a664-3fec561cc66a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:18:33.130231 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0e109088-4cf5-4531-a664-3fec561cc66a tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c" status: 200 len: 1682 microversion: 2.1 time: 0.155196 Aug 24 13:18:33.130823 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1996/3987] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:18:32 2022] GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:18:34.152427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-86421563-24fd-4e23-a7f2-ddab80bed597 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:18:34.152960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-86421563-24fd-4e23-a7f2-ddab80bed597 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:18:34.159338 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86421563-24fd-4e23-a7f2-ddab80bed597 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:34.159825 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86421563-24fd-4e23-a7f2-ddab80bed597 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:34.160263 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86421563-24fd-4e23-a7f2-ddab80bed597 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:34.160985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86421563-24fd-4e23-a7f2-ddab80bed597 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:34.161441 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86421563-24fd-4e23-a7f2-ddab80bed597 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:34.161868 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-86421563-24fd-4e23-a7f2-ddab80bed597 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:34.376899 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-86421563-24fd-4e23-a7f2-ddab80bed597 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:18:34.385060 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-86421563-24fd-4e23-a7f2-ddab80bed597 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c" status: 200 len: 1682 microversion: 2.1 time: 0.236614 Aug 24 13:18:34.385625 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1992/3988] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:18:34 2022] GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c => generated 1682 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:18:34.829000 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-73d17e75-dcce-478c-8578-ae9ca2962921 req-aaefa693-a736-40dc-8a7c-223ecc95073e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31300f22-6eeb-4def-b92a-bd1697d1986c", "name": "network-vif-deleted", "tag": "190400c0-7152-490a-9f3e-292786a844fd"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:18:34.838613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-73d17e75-dcce-478c-8578-ae9ca2962921 req-aaefa693-a736-40dc-8a7c-223ecc95073e service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:34.839104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-73d17e75-dcce-478c-8578-ae9ca2962921 req-aaefa693-a736-40dc-8a7c-223ecc95073e service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:34.839533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-73d17e75-dcce-478c-8578-ae9ca2962921 req-aaefa693-a736-40dc-8a7c-223ecc95073e service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:34.850615 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-73d17e75-dcce-478c-8578-ae9ca2962921 req-aaefa693-a736-40dc-8a7c-223ecc95073e service nova] Creating event network-vif-deleted:190400c0-7152-490a-9f3e-292786a844fd for instance 31300f22-6eeb-4def-b92a-bd1697d1986c on hv-cinder-84889 Aug 24 13:18:34.855656 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-73d17e75-dcce-478c-8578-ae9ca2962921 req-aaefa693-a736-40dc-8a7c-223ecc95073e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030517 Aug 24 13:18:34.856234 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1997/3989] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:18:35.406615 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-4b791a01-aa19-433a-9f05-061dabc6f9fc tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:18:35.407286 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-4b791a01-aa19-433a-9f05-061dabc6f9fc tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:18:35.414318 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b791a01-aa19-433a-9f05-061dabc6f9fc tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:35.414863 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b791a01-aa19-433a-9f05-061dabc6f9fc tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:35.415304 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b791a01-aa19-433a-9f05-061dabc6f9fc tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:35.416030 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b791a01-aa19-433a-9f05-061dabc6f9fc tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:35.416497 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b791a01-aa19-433a-9f05-061dabc6f9fc tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:35.416930 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b791a01-aa19-433a-9f05-061dabc6f9fc tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:35.456259 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b791a01-aa19-433a-9f05-061dabc6f9fc tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:35.456735 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b791a01-aa19-433a-9f05-061dabc6f9fc tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:35.457172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-4b791a01-aa19-433a-9f05-061dabc6f9fc tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:35.457615 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.objects.instance [None req-4b791a01-aa19-433a-9f05-061dabc6f9fc tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lazy-loading 'fault' on Instance uuid 31300f22-6eeb-4def-b92a-bd1697d1986c {{(pid=121171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:18:35.500980 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-4b791a01-aa19-433a-9f05-061dabc6f9fc tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:18:35.508611 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-4b791a01-aa19-433a-9f05-061dabc6f9fc tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c" status: 200 len: 1332 microversion: 2.1 time: 0.105833 Aug 24 13:18:35.509166 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1993/3990] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:18:35 2022] GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c => generated 1332 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:18:36.530316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3a58257f-331c-44fa-9f67-082d59a5dd5d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:18:36.531032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3a58257f-331c-44fa-9f67-082d59a5dd5d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:18:36.537163 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a58257f-331c-44fa-9f67-082d59a5dd5d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:36.537584 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a58257f-331c-44fa-9f67-082d59a5dd5d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:36.538016 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a58257f-331c-44fa-9f67-082d59a5dd5d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:36.538715 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a58257f-331c-44fa-9f67-082d59a5dd5d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:36.539173 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a58257f-331c-44fa-9f67-082d59a5dd5d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:36.539598 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3a58257f-331c-44fa-9f67-082d59a5dd5d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:36.552450 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.wsgi [None req-3a58257f-331c-44fa-9f67-082d59a5dd5d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] HTTP exception thrown: Instance 31300f22-6eeb-4def-b92a-bd1697d1986c could not be found. Aug 24 13:18:36.554032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3a58257f-331c-44fa-9f67-082d59a5dd5d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Request method failure captured: Aug 24 13:18:36.554032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: request: GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c HTTP/1.1 Aug 24 13:18:36.554032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept: application/json Aug 24 13:18:36.554032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept-Encoding: identity Aug 24 13:18:36.554032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Connection: close Aug 24 13:18:36.554032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Length: 0 Aug 24 13:18:36.554032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Type: application/json Aug 24 13:18:36.554032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Host: 10.222.0.45 Aug 24 13:18:36.554032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Openstack-System-Scope: None Aug 24 13:18:36.554032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: User-Agent: python-urllib3/1.26.11 Aug 24 13:18:36.554032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Auth-Token: gAAAAABjBiP5eWEmCH1rTy3m7m9k9tdAn-MnqMzHWGZRmRwtIge3QPfo9RpMXcI_LY98ZmPLiGQnyraOQKKZTpPuQ7xHFVK5Rrn8lL4ilOSLnxJOMDFVHwkD8fW0lAsKO3_bHu1jCBS6E5WwEpSHN863rTspgcEScExi5zF4GV4mWJORGe0jHpc Aug 24 13:18:36.554032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Id: None Aug 24 13:18:36.554032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Name: None Aug 24 13:18:36.554032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Identity-Status: Confirmed Aug 24 13:18:36.554032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Is-Admin-Project: True Aug 24 13:18:36.554032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Id: default Aug 24 13:18:36.554032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Name: Default Aug 24 13:18:36.554032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:18:36.554032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:18:36.554032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Role: member,reader Aug 24 13:18:36.554032 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Roles: member,reader Aug 24 13:18:36.555537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}] Aug 24 13:18:36.555537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:18:36.555537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:18:36.555537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:18:36.555537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:18:36.555537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Id: default Aug 24 13:18:36.555537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Name: Default Aug 24 13:18:36.555537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Id: fa9364936c614a68b22f66c32b76cba9 Aug 24 13:18:36.555537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Name: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:18:36.555537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: method: > Aug 24 13:18:36.555537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: exception: Instance 31300f22-6eeb-4def-b92a-bd1697d1986c could not be found. Aug 24 13:18:36.555537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: action_args: {'id': '31300f22-6eeb-4def-b92a-bd1697d1986c'} Aug 24 13:18:36.556389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:18:36.556389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:18:36.556389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:18:36.556389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:18:36.556389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:18:36.556389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:18:36.556389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:18:36.556389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:18:36.556389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:18:36.556389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:18:36.556389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31300f22-6eeb-4def-b92a-bd1697d1986c could not be found. Aug 24 13:18:36.556389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:18:36.556389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:18:36.556389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:18:36.556389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:18:36.556389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:18:36.556389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:18:36.556389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:18:36.556389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:18:36.556389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:18:36.557832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:18:36.557832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:18:36.557832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:18:36.557832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:18:36.557832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:18:36.557832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:18:36.557832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:18:36.557832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31300f22-6eeb-4def-b92a-bd1697d1986c could not be found. Aug 24 13:18:36.557832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:18:36.557832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:18:36.557832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:18:36.557832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:18:36.557832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:18:36.557832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:18:36.557832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:18:36.557832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:18:36.557832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31300f22-6eeb-4def-b92a-bd1697d1986c could not be found. Aug 24 13:18:36.557832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:18:36.559218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3a58257f-331c-44fa-9f67-082d59a5dd5d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Returning 404 to user: Instance 31300f22-6eeb-4def-b92a-bd1697d1986c could not be found. {{(pid=121170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:18:36.559218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3a58257f-331c-44fa-9f67-082d59a5dd5d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c" status: 404 len: 111 microversion: 2.1 time: 0.029734 Aug 24 13:18:36.559218 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1998/3991] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:18:36 2022] GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:18:36.564085 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-79650d17-2d93-49f4-9bae-de1a361705ba tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '.version_select at 0x7f76f541dc10>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:18:36.640560 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-79650d17-2d93-49f4-9bae-de1a361705ba tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1299927072" status: 202 len: 0 microversion: 2.1 time: 0.080246 Aug 24 13:18:36.642055 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1994/3992] 10.222.0.45 () {58 vars in 1221 bytes} [Wed Aug 24 13:18:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1299927072 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:18:37.364460 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ccc3c51c-da25-49af-a1bf-37f308f4e1e4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Action: 'create', calling method: .version_select at 0x7f76f5d7d310>, body: {"keypair": {"name": "tempest-keypair-146659051", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsi5SZrMG34/zJm4MVdKZb+SJeGmN5dHk6YBygYLEzVXN/bYLp+AYNyx02s8OEhjJ6wp2LJDu1SDVF39ePewjNtzK6NxnBHCUMoJy2nRw07+Uo06+bfKJgmTuGAzK/pag=="}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:18:37.380500 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-ccc3c51c-da25-49af-a1bf-37f308f4e1e4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Getting quotas for project 5e9455e7426b490680c92f1bb3cecca0. Resources: {'key_pairs'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:18:37.384364 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-ccc3c51c-da25-49af-a1bf-37f308f4e1e4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Getting quotas for user fa9364936c614a68b22f66c32b76cba9 and project 5e9455e7426b490680c92f1bb3cecca0. Resources: {'key_pairs'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:18:37.463582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ccc3c51c-da25-49af-a1bf-37f308f4e1e4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.102925 Aug 24 13:18:37.464171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 1999/3993] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 24 13:18:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:18:39.526719 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-137252b3-37ce-4e8f-a06e-37aa6056f46f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1780361031", "imageRef": "62fcb2c8-bff4-46cf-9892-c43d7626629e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3a6b6253-0057-4d36-bf42-268f73b09473"}], "security_groups": [{"name": "tempest-securitygroup--1648614766"}], "key_name": "tempest-keypair-146659051", "user_data": "}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:18:39.628533 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.network.neutron [None req-137252b3-37ce-4e8f-a06e-37aa6056f46f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] validate_networks() for [('3a6b6253-0057-4d36-bf42-268f73b09473', None, None, None, None, None)] {{(pid=121171) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:18:40.040552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-137252b3-37ce-4e8f-a06e-37aa6056f46f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Flavor limits 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:18:40.040978 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-137252b3-37ce-4e8f-a06e-37aa6056f46f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Image limits 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:18:40.041449 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-137252b3-37ce-4e8f-a06e-37aa6056f46f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Flavor pref 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:18:40.041857 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-137252b3-37ce-4e8f-a06e-37aa6056f46f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Image pref 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:18:40.042270 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-137252b3-37ce-4e8f-a06e-37aa6056f46f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:18:40.051017 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-137252b3-37ce-4e8f-a06e-37aa6056f46f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:40.051495 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-137252b3-37ce-4e8f-a06e-37aa6056f46f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:40.051929 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-137252b3-37ce-4e8f-a06e-37aa6056f46f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:40.052651 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-137252b3-37ce-4e8f-a06e-37aa6056f46f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:40.053103 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-137252b3-37ce-4e8f-a06e-37aa6056f46f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:40.053527 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-137252b3-37ce-4e8f-a06e-37aa6056f46f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:40.069569 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-137252b3-37ce-4e8f-a06e-37aa6056f46f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Getting quotas for project 5e9455e7426b490680c92f1bb3cecca0. Resources: {'instances', 'cores', 'ram'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:18:40.073452 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-137252b3-37ce-4e8f-a06e-37aa6056f46f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Getting quotas for user fa9364936c614a68b22f66c32b76cba9 and project 5e9455e7426b490680c92f1bb3cecca0. Resources: {'instances', 'cores', 'ram'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:18:40.084618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-137252b3-37ce-4e8f-a06e-37aa6056f46f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Going to run 1 instances... {{(pid=121171) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 13:18:40.086867 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-137252b3-37ce-4e8f-a06e-37aa6056f46f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='62fcb2c8-bff4-46cf-9892-c43d7626629e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 13:18:40.219200 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-137252b3-37ce-4e8f-a06e-37aa6056f46f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.697108 Aug 24 13:18:40.219842 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1995/3994] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 13:18:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 13:18:40.232163 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b59a370c-7b9a-430c-9ee4-5e42aaf32fcc tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:18:40.232780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b59a370c-7b9a-430c-9ee4-5e42aaf32fcc tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:18:40.292566 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b59a370c-7b9a-430c-9ee4-5e42aaf32fcc tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:18:40.299390 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b59a370c-7b9a-430c-9ee4-5e42aaf32fcc tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a" status: 200 len: 1241 microversion: 2.1 time: 0.071854 Aug 24 13:18:40.299946 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2000/3995] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:18:40 2022] GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:18:41.319268 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e246ed6e-3c38-4c9e-9158-92a749ca1ce0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:18:41.320029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e246ed6e-3c38-4c9e-9158-92a749ca1ce0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:18:41.327344 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e246ed6e-3c38-4c9e-9158-92a749ca1ce0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:41.327814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e246ed6e-3c38-4c9e-9158-92a749ca1ce0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:41.328302 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e246ed6e-3c38-4c9e-9158-92a749ca1ce0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:41.328989 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e246ed6e-3c38-4c9e-9158-92a749ca1ce0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:41.329468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e246ed6e-3c38-4c9e-9158-92a749ca1ce0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:41.329900 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e246ed6e-3c38-4c9e-9158-92a749ca1ce0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:41.392859 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e246ed6e-3c38-4c9e-9158-92a749ca1ce0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:18:41.400572 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e246ed6e-3c38-4c9e-9158-92a749ca1ce0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a" status: 200 len: 1245 microversion: 2.1 time: 0.085727 Aug 24 13:18:41.401297 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1996/3996] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:18:41 2022] GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:18:42.428175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-864132c2-933c-4394-b783-a76b9cffecb6 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:18:42.428175 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-864132c2-933c-4394-b783-a76b9cffecb6 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:18:42.430551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-864132c2-933c-4394-b783-a76b9cffecb6 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:42.431488 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-864132c2-933c-4394-b783-a76b9cffecb6 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:42.432960 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-864132c2-933c-4394-b783-a76b9cffecb6 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:42.433683 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-864132c2-933c-4394-b783-a76b9cffecb6 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:42.434455 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-864132c2-933c-4394-b783-a76b9cffecb6 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:42.434923 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-864132c2-933c-4394-b783-a76b9cffecb6 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:42.504075 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-864132c2-933c-4394-b783-a76b9cffecb6 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:18:42.511830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-864132c2-933c-4394-b783-a76b9cffecb6 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a" status: 200 len: 1299 microversion: 2.1 time: 0.094326 Aug 24 13:18:42.512393 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2001/3997] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:18:42 2022] GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:18:43.532422 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-81095616-5ac4-4dc5-bf96-481bf96c554d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:18:43.533181 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-81095616-5ac4-4dc5-bf96-481bf96c554d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:18:43.540392 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81095616-5ac4-4dc5-bf96-481bf96c554d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:43.540867 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81095616-5ac4-4dc5-bf96-481bf96c554d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:43.541293 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81095616-5ac4-4dc5-bf96-481bf96c554d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:43.541968 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81095616-5ac4-4dc5-bf96-481bf96c554d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:43.542413 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81095616-5ac4-4dc5-bf96-481bf96c554d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:43.542855 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-81095616-5ac4-4dc5-bf96-481bf96c554d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:43.674834 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-81095616-5ac4-4dc5-bf96-481bf96c554d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:18:43.682768 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-81095616-5ac4-4dc5-bf96-481bf96c554d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a" status: 200 len: 1367 microversion: 2.1 time: 0.154109 Aug 24 13:18:43.695801 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1997/3998] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:18:43 2022] GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:18:43.762201 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-68bed99b-b13e-4cf4-99f5-92ad511121b9 req-62b55a1c-c254-4678-bfdb-027a201584a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a", "tag": "338ec554-f887-48bf-8e24-bda22fd867f9"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:18:43.771818 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-68bed99b-b13e-4cf4-99f5-92ad511121b9 req-62b55a1c-c254-4678-bfdb-027a201584a4 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:43.772297 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-68bed99b-b13e-4cf4-99f5-92ad511121b9 req-62b55a1c-c254-4678-bfdb-027a201584a4 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:43.772730 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-68bed99b-b13e-4cf4-99f5-92ad511121b9 req-62b55a1c-c254-4678-bfdb-027a201584a4 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:43.785517 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-68bed99b-b13e-4cf4-99f5-92ad511121b9 req-62b55a1c-c254-4678-bfdb-027a201584a4 service nova] Creating event network-changed:338ec554-f887-48bf-8e24-bda22fd867f9 for instance 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a on hv-cinder-84889 Aug 24 13:18:43.791001 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-68bed99b-b13e-4cf4-99f5-92ad511121b9 req-62b55a1c-c254-4678-bfdb-027a201584a4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093503 Aug 24 13:18:43.792496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2002/3999] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:18:44.703417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e2a9f519-bbc7-4cb6-950b-1d9bd352e200 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:18:44.704025 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e2a9f519-bbc7-4cb6-950b-1d9bd352e200 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:18:44.711836 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2a9f519-bbc7-4cb6-950b-1d9bd352e200 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:44.712320 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2a9f519-bbc7-4cb6-950b-1d9bd352e200 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:44.712752 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2a9f519-bbc7-4cb6-950b-1d9bd352e200 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:44.713432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2a9f519-bbc7-4cb6-950b-1d9bd352e200 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:44.713882 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2a9f519-bbc7-4cb6-950b-1d9bd352e200 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:44.714334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e2a9f519-bbc7-4cb6-950b-1d9bd352e200 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:44.867285 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e2a9f519-bbc7-4cb6-950b-1d9bd352e200 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:18:44.875124 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e2a9f519-bbc7-4cb6-950b-1d9bd352e200 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a" status: 200 len: 1367 microversion: 2.1 time: 0.175560 Aug 24 13:18:44.875682 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1998/4000] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:18:44 2022] GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:18:45.895878 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-514fb84e-3869-4410-b90c-e195d8553c39 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:18:45.896613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-514fb84e-3869-4410-b90c-e195d8553c39 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:18:45.902632 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-514fb84e-3869-4410-b90c-e195d8553c39 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:45.903135 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-514fb84e-3869-4410-b90c-e195d8553c39 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:45.903569 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-514fb84e-3869-4410-b90c-e195d8553c39 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:45.904237 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-514fb84e-3869-4410-b90c-e195d8553c39 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:45.904687 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-514fb84e-3869-4410-b90c-e195d8553c39 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:45.905115 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-514fb84e-3869-4410-b90c-e195d8553c39 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:46.033157 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-514fb84e-3869-4410-b90c-e195d8553c39 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:18:46.040603 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-514fb84e-3869-4410-b90c-e195d8553c39 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a" status: 200 len: 1367 microversion: 2.1 time: 0.149303 Aug 24 13:18:46.041182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2003/4001] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:18:45 2022] GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:18:47.061542 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-73222c67-96ca-4df0-ada4-6eeeb8c77bbb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:18:47.062160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-73222c67-96ca-4df0-ada4-6eeeb8c77bbb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:18:47.069123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-73222c67-96ca-4df0-ada4-6eeeb8c77bbb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:47.069603 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-73222c67-96ca-4df0-ada4-6eeeb8c77bbb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:47.070035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-73222c67-96ca-4df0-ada4-6eeeb8c77bbb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:47.070739 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-73222c67-96ca-4df0-ada4-6eeeb8c77bbb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:47.071192 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-73222c67-96ca-4df0-ada4-6eeeb8c77bbb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:47.071614 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-73222c67-96ca-4df0-ada4-6eeeb8c77bbb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:47.197822 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-73222c67-96ca-4df0-ada4-6eeeb8c77bbb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:18:47.205468 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-73222c67-96ca-4df0-ada4-6eeeb8c77bbb tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a" status: 200 len: 1367 microversion: 2.1 time: 0.147766 Aug 24 13:18:47.206036 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 1999/4002] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:18:47 2022] GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:18:48.226564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7af2c0da-271f-48e6-8434-76947deba8ca tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:18:48.227202 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7af2c0da-271f-48e6-8434-76947deba8ca tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:18:48.233610 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7af2c0da-271f-48e6-8434-76947deba8ca tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:48.234093 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7af2c0da-271f-48e6-8434-76947deba8ca tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:48.234531 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7af2c0da-271f-48e6-8434-76947deba8ca tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:48.235246 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7af2c0da-271f-48e6-8434-76947deba8ca tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:48.235706 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7af2c0da-271f-48e6-8434-76947deba8ca tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:48.236134 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7af2c0da-271f-48e6-8434-76947deba8ca tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:48.372302 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7af2c0da-271f-48e6-8434-76947deba8ca tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:18:48.379904 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7af2c0da-271f-48e6-8434-76947deba8ca tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a" status: 200 len: 1367 microversion: 2.1 time: 0.157213 Aug 24 13:18:48.381268 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2004/4003] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:18:48 2022] GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:18:49.026029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-32d8acd2-3867-46f9-8633-449cd08827cb req-665a84e8-38b6-44f5-8086-269c24eb0fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a", "name": "network-vif-plugged", "status": "completed", "tag": "338ec554-f887-48bf-8e24-bda22fd867f9"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:18:49.035608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-32d8acd2-3867-46f9-8633-449cd08827cb req-665a84e8-38b6-44f5-8086-269c24eb0fe5 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:49.036094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-32d8acd2-3867-46f9-8633-449cd08827cb req-665a84e8-38b6-44f5-8086-269c24eb0fe5 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:49.036528 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-32d8acd2-3867-46f9-8633-449cd08827cb req-665a84e8-38b6-44f5-8086-269c24eb0fe5 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:49.047524 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-32d8acd2-3867-46f9-8633-449cd08827cb req-665a84e8-38b6-44f5-8086-269c24eb0fe5 service nova] Creating event network-vif-plugged:338ec554-f887-48bf-8e24-bda22fd867f9 for instance 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a on hv-cinder-84889 Aug 24 13:18:49.052975 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-32d8acd2-3867-46f9-8633-449cd08827cb req-665a84e8-38b6-44f5-8086-269c24eb0fe5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084325 Aug 24 13:18:49.053565 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2000/4004] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:18:49.400501 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-cf4e11bb-fef8-4be8-9c36-f5c1f19dc11f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:18:49.401109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-cf4e11bb-fef8-4be8-9c36-f5c1f19dc11f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:18:49.407496 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cf4e11bb-fef8-4be8-9c36-f5c1f19dc11f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:49.407984 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cf4e11bb-fef8-4be8-9c36-f5c1f19dc11f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:49.408422 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cf4e11bb-fef8-4be8-9c36-f5c1f19dc11f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:49.409112 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cf4e11bb-fef8-4be8-9c36-f5c1f19dc11f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:49.409572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cf4e11bb-fef8-4be8-9c36-f5c1f19dc11f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:49.410002 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-cf4e11bb-fef8-4be8-9c36-f5c1f19dc11f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:49.536295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-cf4e11bb-fef8-4be8-9c36-f5c1f19dc11f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:18:49.544349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-cf4e11bb-fef8-4be8-9c36-f5c1f19dc11f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a" status: 200 len: 1367 microversion: 2.1 time: 0.147683 Aug 24 13:18:49.544909 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2005/4005] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:18:49 2022] GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:18:50.563401 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=2 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:18:50.564167 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=6 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:18:50.568939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7c63707d-b3e4-4d5e-8f66-161e21aa1649 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:18:50.569563 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7c63707d-b3e4-4d5e-8f66-161e21aa1649 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:18:50.576057 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7c63707d-b3e4-4d5e-8f66-161e21aa1649 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:50.576057 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7c63707d-b3e4-4d5e-8f66-161e21aa1649 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:50.576493 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7c63707d-b3e4-4d5e-8f66-161e21aa1649 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:50.577176 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7c63707d-b3e4-4d5e-8f66-161e21aa1649 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:50.577629 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7c63707d-b3e4-4d5e-8f66-161e21aa1649 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:50.578062 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7c63707d-b3e4-4d5e-8f66-161e21aa1649 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:50.710379 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-7c63707d-b3e4-4d5e-8f66-161e21aa1649 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:18:50.718095 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7c63707d-b3e4-4d5e-8f66-161e21aa1649 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a" status: 200 len: 1367 microversion: 2.1 time: 0.156143 Aug 24 13:18:50.718669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2001/4006] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:18:50 2022] GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:18:51.738678 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f4e91c05-909f-4332-bee7-1ef3bf514598 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:18:51.739294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f4e91c05-909f-4332-bee7-1ef3bf514598 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:18:51.741317 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell0:SELECT=6 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:18:51.746055 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4e91c05-909f-4332-bee7-1ef3bf514598 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:51.746539 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4e91c05-909f-4332-bee7-1ef3bf514598 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:51.747270 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4e91c05-909f-4332-bee7-1ef3bf514598 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:51.747959 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4e91c05-909f-4332-bee7-1ef3bf514598 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:51.748416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4e91c05-909f-4332-bee7-1ef3bf514598 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:51.748847 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f4e91c05-909f-4332-bee7-1ef3bf514598 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:51.879555 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f4e91c05-909f-4332-bee7-1ef3bf514598 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:18:51.887743 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f4e91c05-909f-4332-bee7-1ef3bf514598 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a" status: 200 len: 1557 microversion: 2.1 time: 0.153239 Aug 24 13:18:51.888293 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2006/4007] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:18:51 2022] GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:18:51.907684 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a97d2d95-0d2d-4d65-aaf9-9b6e24af7416 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:18:51.908186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a97d2d95-0d2d-4d65-aaf9-9b6e24af7416 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:18:51.910388 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:18:51.915144 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a97d2d95-0d2d-4d65-aaf9-9b6e24af7416 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:51.915621 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a97d2d95-0d2d-4d65-aaf9-9b6e24af7416 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:51.916078 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a97d2d95-0d2d-4d65-aaf9-9b6e24af7416 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:51.916759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a97d2d95-0d2d-4d65-aaf9-9b6e24af7416 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:51.917204 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a97d2d95-0d2d-4d65-aaf9-9b6e24af7416 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:51.917626 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a97d2d95-0d2d-4d65-aaf9-9b6e24af7416 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:51.921146 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:18:51.992590 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a97d2d95-0d2d-4d65-aaf9-9b6e24af7416 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088741 Aug 24 13:18:51.993172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2002/4008] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 24 13:18:51 2022] GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:18:52.934121 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-0c80eea8-7692-4dc0-8c4b-733ee009dacf req-03c32fe0-8f0b-46d9-9e04-3156cf41ee50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a", "tag": "338ec554-f887-48bf-8e24-bda22fd867f9"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:18:52.945017 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-0c80eea8-7692-4dc0-8c4b-733ee009dacf req-03c32fe0-8f0b-46d9-9e04-3156cf41ee50 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:18:52.953049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-0c80eea8-7692-4dc0-8c4b-733ee009dacf req-03c32fe0-8f0b-46d9-9e04-3156cf41ee50 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:18:52.953049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-0c80eea8-7692-4dc0-8c4b-733ee009dacf req-03c32fe0-8f0b-46d9-9e04-3156cf41ee50 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:18:52.957209 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-0c80eea8-7692-4dc0-8c4b-733ee009dacf req-03c32fe0-8f0b-46d9-9e04-3156cf41ee50 service nova] Creating event network-changed:338ec554-f887-48bf-8e24-bda22fd867f9 for instance 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a on hv-cinder-84889 Aug 24 13:18:52.962830 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-0c80eea8-7692-4dc0-8c4b-733ee009dacf req-03c32fe0-8f0b-46d9-9e04-3156cf41ee50 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032392 Aug 24 13:18:52.963426 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2007/4009] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:20:08.231278 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-346b3539-74b0-4537-85f5-674ca7a1b6b3 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:20:08.231857 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-346b3539-74b0-4537-85f5-674ca7a1b6b3 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:20:08.238619 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-346b3539-74b0-4537-85f5-674ca7a1b6b3 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:08.239129 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-346b3539-74b0-4537-85f5-674ca7a1b6b3 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:08.239565 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-346b3539-74b0-4537-85f5-674ca7a1b6b3 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:08.240245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-346b3539-74b0-4537-85f5-674ca7a1b6b3 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:08.240693 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-346b3539-74b0-4537-85f5-674ca7a1b6b3 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:08.241119 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-346b3539-74b0-4537-85f5-674ca7a1b6b3 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:08.265017 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-346b3539-74b0-4537-85f5-674ca7a1b6b3 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a/ips" status: 200 len: 150 microversion: 2.1 time: 0.040114 Aug 24 13:20:08.265577 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2003/4010] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 24 13:20:08 2022] GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:20:09.766003 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:20:09.766771 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:20:09.771281 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-955cdc34-57d2-4e54-a2e0-e27334f3de74 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "baf5cc94-49f8-477b-b91c-e6f75f6c155e"}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:20:09.773661 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-955cdc34-57d2-4e54-a2e0-e27334f3de74 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:20:09.779608 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-955cdc34-57d2-4e54-a2e0-e27334f3de74 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:09.780152 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-955cdc34-57d2-4e54-a2e0-e27334f3de74 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:09.780595 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-955cdc34-57d2-4e54-a2e0-e27334f3de74 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:09.781286 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-955cdc34-57d2-4e54-a2e0-e27334f3de74 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:09.781745 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-955cdc34-57d2-4e54-a2e0-e27334f3de74 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:09.782176 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-955cdc34-57d2-4e54-a2e0-e27334f3de74 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:10.454301 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-955cdc34-57d2-4e54-a2e0-e27334f3de74 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "POST /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.690069 Aug 24 13:20:10.454978 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2008/4011] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 24 13:20:09 2022] POST /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a/os-volume_attachments => generated 194 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:20:18.074591 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-8eae4d72-d50b-432f-a529-b1bf9cad3714 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:20:18.075096 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-8eae4d72-d50b-432f-a529-b1bf9cad3714 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:20:18.081957 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8eae4d72-d50b-432f-a529-b1bf9cad3714 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:18.082435 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8eae4d72-d50b-432f-a529-b1bf9cad3714 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:18.082901 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8eae4d72-d50b-432f-a529-b1bf9cad3714 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:18.083576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8eae4d72-d50b-432f-a529-b1bf9cad3714 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:18.084029 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8eae4d72-d50b-432f-a529-b1bf9cad3714 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:18.084448 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-8eae4d72-d50b-432f-a529-b1bf9cad3714 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:18.163868 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.objects.instance [None req-8eae4d72-d50b-432f-a529-b1bf9cad3714 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lazy-loading 'services' on Instance uuid 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a {{(pid=121171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:20:18.375453 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-8eae4d72-d50b-432f-a529-b1bf9cad3714 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a/os-volume_attachments/baf5cc94-49f8-477b-b91c-e6f75f6c155e" status: 202 len: 0 microversion: 2.1 time: 0.305153 Aug 24 13:20:18.376312 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2004/4012] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 24 13:20:18 2022] DELETE /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a/os-volume_attachments/baf5cc94-49f8-477b-b91c-e6f75f6c155e => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:20:18.386289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5f8b926a-63ea-49b3-ab7d-b65e3654f006 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:20:18.391373 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5f8b926a-63ea-49b3-ab7d-b65e3654f006 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:20:18.395805 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f8b926a-63ea-49b3-ab7d-b65e3654f006 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:18.396297 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f8b926a-63ea-49b3-ab7d-b65e3654f006 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:18.396742 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f8b926a-63ea-49b3-ab7d-b65e3654f006 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:18.397442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f8b926a-63ea-49b3-ab7d-b65e3654f006 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:18.398579 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f8b926a-63ea-49b3-ab7d-b65e3654f006 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:18.399036 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5f8b926a-63ea-49b3-ab7d-b65e3654f006 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:18.427759 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5f8b926a-63ea-49b3-ab7d-b65e3654f006 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046872 Aug 24 13:20:18.428309 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2009/4013] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 13:20:18 2022] GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:20:19.440339 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5468463b-1ca4-406c-be00-032f47c431f0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:20:19.442724 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5468463b-1ca4-406c-be00-032f47c431f0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:20:19.449327 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5468463b-1ca4-406c-be00-032f47c431f0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:19.451087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5468463b-1ca4-406c-be00-032f47c431f0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:19.451087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5468463b-1ca4-406c-be00-032f47c431f0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:19.451087 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5468463b-1ca4-406c-be00-032f47c431f0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:19.451379 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5468463b-1ca4-406c-be00-032f47c431f0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:19.451799 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5468463b-1ca4-406c-be00-032f47c431f0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:19.483230 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5468463b-1ca4-406c-be00-032f47c431f0 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047238 Aug 24 13:20:19.483796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2005/4014] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 24 13:20:19 2022] GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 13:20:19.551657 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e18af6a8-4291-4713-9af6-dff9b00b7b07 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:20:19.551657 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e18af6a8-4291-4713-9af6-dff9b00b7b07 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:20:19.555018 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e18af6a8-4291-4713-9af6-dff9b00b7b07 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:19.555507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e18af6a8-4291-4713-9af6-dff9b00b7b07 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:19.555947 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e18af6a8-4291-4713-9af6-dff9b00b7b07 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:19.556693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e18af6a8-4291-4713-9af6-dff9b00b7b07 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:19.557150 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e18af6a8-4291-4713-9af6-dff9b00b7b07 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:19.557582 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e18af6a8-4291-4713-9af6-dff9b00b7b07 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:19.582452 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e18af6a8-4291-4713-9af6-dff9b00b7b07 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a] Going to try to terminate instance {{(pid=121170) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 13:20:19.810376 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e18af6a8-4291-4713-9af6-dff9b00b7b07 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a" status: 204 len: 0 microversion: 2.1 time: 0.266673 Aug 24 13:20:19.810909 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2010/4015] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 13:20:19 2022] DELETE /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:20:19.819310 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c01c67ea-e157-4863-9b70-b9dba13db6b9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:20:19.820171 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c01c67ea-e157-4863-9b70-b9dba13db6b9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:20:19.826132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c01c67ea-e157-4863-9b70-b9dba13db6b9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:19.826607 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c01c67ea-e157-4863-9b70-b9dba13db6b9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:19.827077 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c01c67ea-e157-4863-9b70-b9dba13db6b9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:19.827751 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c01c67ea-e157-4863-9b70-b9dba13db6b9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:19.828242 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c01c67ea-e157-4863-9b70-b9dba13db6b9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:19.828659 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c01c67ea-e157-4863-9b70-b9dba13db6b9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:19.959085 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c01c67ea-e157-4863-9b70-b9dba13db6b9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:20:19.967459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c01c67ea-e157-4863-9b70-b9dba13db6b9 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a" status: 200 len: 1682 microversion: 2.1 time: 0.152082 Aug 24 13:20:19.968012 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2006/4016] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:20:19 2022] GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:20:20.988860 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e2ce8b86-4890-4b0f-ba23-c4fa620bb86f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:20:20.989558 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e2ce8b86-4890-4b0f-ba23-c4fa620bb86f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:20:20.996574 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2ce8b86-4890-4b0f-ba23-c4fa620bb86f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:20.997058 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2ce8b86-4890-4b0f-ba23-c4fa620bb86f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:20.997757 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2ce8b86-4890-4b0f-ba23-c4fa620bb86f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:20.998438 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2ce8b86-4890-4b0f-ba23-c4fa620bb86f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:20.998923 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2ce8b86-4890-4b0f-ba23-c4fa620bb86f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:20.999352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e2ce8b86-4890-4b0f-ba23-c4fa620bb86f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:21.127134 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e2ce8b86-4890-4b0f-ba23-c4fa620bb86f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:20:21.134762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e2ce8b86-4890-4b0f-ba23-c4fa620bb86f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a" status: 200 len: 1682 microversion: 2.1 time: 0.150115 Aug 24 13:20:21.135318 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2011/4017] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:20:20 2022] GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:20:22.156333 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bf7493dc-565b-4894-943c-e0b9cbf5e1a4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:20:22.156947 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-bf7493dc-565b-4894-943c-e0b9cbf5e1a4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:20:22.163240 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf7493dc-565b-4894-943c-e0b9cbf5e1a4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:22.163722 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf7493dc-565b-4894-943c-e0b9cbf5e1a4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:22.164160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf7493dc-565b-4894-943c-e0b9cbf5e1a4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:22.164846 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf7493dc-565b-4894-943c-e0b9cbf5e1a4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:22.165295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf7493dc-565b-4894-943c-e0b9cbf5e1a4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:22.165719 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bf7493dc-565b-4894-943c-e0b9cbf5e1a4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:22.390105 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-bf7493dc-565b-4894-943c-e0b9cbf5e1a4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:20:22.398467 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bf7493dc-565b-4894-943c-e0b9cbf5e1a4 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a" status: 200 len: 1682 microversion: 2.1 time: 0.245400 Aug 24 13:20:22.399055 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2007/4018] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:20:22 2022] GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a => generated 1682 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:20:22.854470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-a3c22927-bef9-42de-a180-261e7b738c65 req-7999a066-d9eb-4866-a904-f73392894f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a", "name": "network-vif-deleted", "tag": "338ec554-f887-48bf-8e24-bda22fd867f9"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:20:22.864556 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-a3c22927-bef9-42de-a180-261e7b738c65 req-7999a066-d9eb-4866-a904-f73392894f4e service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:22.865042 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-a3c22927-bef9-42de-a180-261e7b738c65 req-7999a066-d9eb-4866-a904-f73392894f4e service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:22.865586 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-a3c22927-bef9-42de-a180-261e7b738c65 req-7999a066-d9eb-4866-a904-f73392894f4e service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:22.877449 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-a3c22927-bef9-42de-a180-261e7b738c65 req-7999a066-d9eb-4866-a904-f73392894f4e service nova] Creating event network-vif-deleted:338ec554-f887-48bf-8e24-bda22fd867f9 for instance 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a on hv-cinder-84889 Aug 24 13:20:22.883001 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-a3c22927-bef9-42de-a180-261e7b738c65 req-7999a066-d9eb-4866-a904-f73392894f4e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033223 Aug 24 13:20:22.883750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2012/4019] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:20:23.418985 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3aa4c4f2-b38e-4692-b0fb-92970472b332 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:20:23.419504 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3aa4c4f2-b38e-4692-b0fb-92970472b332 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:20:23.425302 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3aa4c4f2-b38e-4692-b0fb-92970472b332 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:23.425791 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3aa4c4f2-b38e-4692-b0fb-92970472b332 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:23.426233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3aa4c4f2-b38e-4692-b0fb-92970472b332 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:23.426949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3aa4c4f2-b38e-4692-b0fb-92970472b332 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:23.427402 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3aa4c4f2-b38e-4692-b0fb-92970472b332 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:23.427825 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3aa4c4f2-b38e-4692-b0fb-92970472b332 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:23.460127 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3aa4c4f2-b38e-4692-b0fb-92970472b332 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:23.460466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3aa4c4f2-b38e-4692-b0fb-92970472b332 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:23.460910 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3aa4c4f2-b38e-4692-b0fb-92970472b332 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:23.461370 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.objects.instance [None req-3aa4c4f2-b38e-4692-b0fb-92970472b332 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lazy-loading 'fault' on Instance uuid 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a {{(pid=121171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:20:23.526134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3aa4c4f2-b38e-4692-b0fb-92970472b332 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9364936c614a68b22f66c32b76cba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9455e7426b490680c92f1bb3cecca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:20:23.534107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3aa4c4f2-b38e-4692-b0fb-92970472b332 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a" status: 200 len: 1331 microversion: 2.1 time: 0.119040 Aug 24 13:20:23.534926 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2008/4020] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:20:23 2022] GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a => generated 1331 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:20:24.557158 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9de53c48-3d4d-4a17-97ee-eb8132059124 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:20:24.557795 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9de53c48-3d4d-4a17-97ee-eb8132059124 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:20:24.563933 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9de53c48-3d4d-4a17-97ee-eb8132059124 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:24.564422 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9de53c48-3d4d-4a17-97ee-eb8132059124 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:24.564861 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9de53c48-3d4d-4a17-97ee-eb8132059124 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:24.565551 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9de53c48-3d4d-4a17-97ee-eb8132059124 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:24.566013 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9de53c48-3d4d-4a17-97ee-eb8132059124 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:24.566441 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9de53c48-3d4d-4a17-97ee-eb8132059124 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:24.579213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.wsgi [None req-9de53c48-3d4d-4a17-97ee-eb8132059124 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] HTTP exception thrown: Instance 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a could not be found. Aug 24 13:20:24.580801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9de53c48-3d4d-4a17-97ee-eb8132059124 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Request method failure captured: Aug 24 13:20:24.580801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: request: GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a HTTP/1.1 Aug 24 13:20:24.580801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept: application/json Aug 24 13:20:24.580801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept-Encoding: identity Aug 24 13:20:24.580801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Connection: close Aug 24 13:20:24.580801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Length: 0 Aug 24 13:20:24.580801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Type: application/json Aug 24 13:20:24.580801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Host: 10.222.0.45 Aug 24 13:20:24.580801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Openstack-System-Scope: None Aug 24 13:20:24.580801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: User-Agent: python-urllib3/1.26.11 Aug 24 13:20:24.580801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Auth-Token: gAAAAABjBiP5eWEmCH1rTy3m7m9k9tdAn-MnqMzHWGZRmRwtIge3QPfo9RpMXcI_LY98ZmPLiGQnyraOQKKZTpPuQ7xHFVK5Rrn8lL4ilOSLnxJOMDFVHwkD8fW0lAsKO3_bHu1jCBS6E5WwEpSHN863rTspgcEScExi5zF4GV4mWJORGe0jHpc Aug 24 13:20:24.580801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Id: None Aug 24 13:20:24.580801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Name: None Aug 24 13:20:24.580801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Identity-Status: Confirmed Aug 24 13:20:24.580801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Is-Admin-Project: True Aug 24 13:20:24.580801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Id: default Aug 24 13:20:24.580801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Name: Default Aug 24 13:20:24.580801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:20:24.580801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:20:24.580801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Role: member,reader Aug 24 13:20:24.580801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Roles: member,reader Aug 24 13:20:24.582295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}] Aug 24 13:20:24.582295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:20:24.582295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:20:24.582295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:20:24.582295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:20:24.582295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Id: default Aug 24 13:20:24.582295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Name: Default Aug 24 13:20:24.582295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Id: fa9364936c614a68b22f66c32b76cba9 Aug 24 13:20:24.582295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Name: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:20:24.582295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: method: > Aug 24 13:20:24.582295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: exception: Instance 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a could not be found. Aug 24 13:20:24.582295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: action_args: {'id': '2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a'} Aug 24 13:20:24.583424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:20:24.583424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:20:24.583424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:20:24.583424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:20:24.583424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:20:24.583424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:20:24.583424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:20:24.583424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:20:24.583424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:20:24.583424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:20:24.583424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a could not be found. Aug 24 13:20:24.583424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:20:24.583424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:20:24.583424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:20:24.583424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:20:24.583424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:20:24.583424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:20:24.583424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:20:24.583424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:20:24.583424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:20:24.584841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:20:24.584841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:20:24.584841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:20:24.584841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:20:24.584841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:20:24.584841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:20:24.584841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:20:24.584841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a could not be found. Aug 24 13:20:24.584841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:20:24.584841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:20:24.584841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:20:24.584841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:20:24.584841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:20:24.584841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:20:24.584841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:20:24.584841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:20:24.584841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a could not be found. Aug 24 13:20:24.584841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:20:24.586352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9de53c48-3d4d-4a17-97ee-eb8132059124 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Returning 404 to user: Instance 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a could not be found. {{(pid=121170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:20:24.586352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9de53c48-3d4d-4a17-97ee-eb8132059124 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a" status: 404 len: 111 microversion: 2.1 time: 0.030459 Aug 24 13:20:24.586352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2013/4021] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:20:24 2022] GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:20:24.590781 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-718f5dae-2a12-4e84-bfe0-1b5394d2a3ed tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '.version_select at 0x7f76f9cd4700>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:20:24.667883 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-718f5dae-2a12-4e84-bfe0-1b5394d2a3ed tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-146659051" status: 202 len: 0 microversion: 2.1 time: 0.080831 Aug 24 13:20:24.668432 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2009/4022] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Aug 24 13:20:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-146659051 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:20:26.875156 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-15a3bf7b-a37d-4a4b-9b5f-377b98af06a5 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:20:26.875653 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-15a3bf7b-a37d-4a4b-9b5f-377b98af06a5 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:20:26.882573 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15a3bf7b-a37d-4a4b-9b5f-377b98af06a5 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:26.883097 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15a3bf7b-a37d-4a4b-9b5f-377b98af06a5 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:26.883544 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15a3bf7b-a37d-4a4b-9b5f-377b98af06a5 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:26.884234 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15a3bf7b-a37d-4a4b-9b5f-377b98af06a5 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:26.884693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15a3bf7b-a37d-4a4b-9b5f-377b98af06a5 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:26.885143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-15a3bf7b-a37d-4a4b-9b5f-377b98af06a5 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:26.898932 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.wsgi [None req-15a3bf7b-a37d-4a4b-9b5f-377b98af06a5 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] HTTP exception thrown: Instance 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a could not be found. Aug 24 13:20:26.900507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-15a3bf7b-a37d-4a4b-9b5f-377b98af06a5 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Request method failure captured: Aug 24 13:20:26.900507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: request: DELETE /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a HTTP/1.1 Aug 24 13:20:26.900507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept: application/json Aug 24 13:20:26.900507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept-Encoding: identity Aug 24 13:20:26.900507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Connection: close Aug 24 13:20:26.900507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Length: 0 Aug 24 13:20:26.900507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Type: application/json Aug 24 13:20:26.900507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Host: 10.222.0.45 Aug 24 13:20:26.900507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Openstack-System-Scope: None Aug 24 13:20:26.900507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: User-Agent: python-urllib3/1.26.11 Aug 24 13:20:26.900507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Auth-Token: gAAAAABjBiP5eWEmCH1rTy3m7m9k9tdAn-MnqMzHWGZRmRwtIge3QPfo9RpMXcI_LY98ZmPLiGQnyraOQKKZTpPuQ7xHFVK5Rrn8lL4ilOSLnxJOMDFVHwkD8fW0lAsKO3_bHu1jCBS6E5WwEpSHN863rTspgcEScExi5zF4GV4mWJORGe0jHpc Aug 24 13:20:26.900507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Id: None Aug 24 13:20:26.900507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Name: None Aug 24 13:20:26.900507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Identity-Status: Confirmed Aug 24 13:20:26.900507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Is-Admin-Project: True Aug 24 13:20:26.900507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Id: default Aug 24 13:20:26.900507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Name: Default Aug 24 13:20:26.900507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:20:26.900507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:20:26.900507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Role: member,reader Aug 24 13:20:26.900507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Roles: member,reader Aug 24 13:20:26.902085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}] Aug 24 13:20:26.902085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:20:26.902085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:20:26.902085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:20:26.902085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:20:26.902085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Id: default Aug 24 13:20:26.902085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Name: Default Aug 24 13:20:26.902085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Id: fa9364936c614a68b22f66c32b76cba9 Aug 24 13:20:26.902085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Name: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:20:26.902085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: method: > Aug 24 13:20:26.902085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: exception: Instance 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a could not be found. Aug 24 13:20:26.902085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: action_args: {'id': '2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a'} Aug 24 13:20:26.903050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:20:26.903050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:20:26.903050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:20:26.903050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:20:26.903050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:20:26.903050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:20:26.903050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:20:26.903050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:20:26.903050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:20:26.903050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:20:26.903050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a could not be found. Aug 24 13:20:26.903050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:20:26.903050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:20:26.903050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:20:26.903050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:20:26.903050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:20:26.903050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:20:26.903050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:20:26.903050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:20:26.903050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:20:26.904521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:20:26.904521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 13:20:26.904521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 13:20:26.904521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 13:20:26.904521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 13:20:26.904521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:20:26.904521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:20:26.904521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:20:26.904521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:20:26.904521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a could not be found. Aug 24 13:20:26.904521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:20:26.904521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:20:26.904521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:20:26.904521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:20:26.904521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:20:26.904521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:20:26.904521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:20:26.904521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:20:26.904521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a could not be found. Aug 24 13:20:26.904521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:20:26.906129 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-15a3bf7b-a37d-4a4b-9b5f-377b98af06a5 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Returning 404 to user: Instance 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a could not be found. {{(pid=121170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:20:26.906129 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-15a3bf7b-a37d-4a4b-9b5f-377b98af06a5 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a" status: 404 len: 111 microversion: 2.1 time: 0.030900 Aug 24 13:20:26.906129 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2014/4023] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 13:20:26 2022] DELETE /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:20:26.910918 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-62d3294c-85e8-4b16-88e3-4716f368da85 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:20:26.911521 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-62d3294c-85e8-4b16-88e3-4716f368da85 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:20:26.918297 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62d3294c-85e8-4b16-88e3-4716f368da85 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:26.919227 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62d3294c-85e8-4b16-88e3-4716f368da85 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:26.919658 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62d3294c-85e8-4b16-88e3-4716f368da85 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:26.920330 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62d3294c-85e8-4b16-88e3-4716f368da85 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:26.920784 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62d3294c-85e8-4b16-88e3-4716f368da85 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:26.921204 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-62d3294c-85e8-4b16-88e3-4716f368da85 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:26.933841 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.wsgi [None req-62d3294c-85e8-4b16-88e3-4716f368da85 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] HTTP exception thrown: Instance 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a could not be found. Aug 24 13:20:26.935471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-62d3294c-85e8-4b16-88e3-4716f368da85 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Request method failure captured: Aug 24 13:20:26.935471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: request: GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a HTTP/1.1 Aug 24 13:20:26.935471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept: application/json Aug 24 13:20:26.935471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept-Encoding: identity Aug 24 13:20:26.935471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Connection: close Aug 24 13:20:26.935471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Length: 0 Aug 24 13:20:26.935471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Type: application/json Aug 24 13:20:26.935471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Host: 10.222.0.45 Aug 24 13:20:26.935471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Openstack-System-Scope: None Aug 24 13:20:26.935471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: User-Agent: python-urllib3/1.26.11 Aug 24 13:20:26.935471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Auth-Token: gAAAAABjBiP5eWEmCH1rTy3m7m9k9tdAn-MnqMzHWGZRmRwtIge3QPfo9RpMXcI_LY98ZmPLiGQnyraOQKKZTpPuQ7xHFVK5Rrn8lL4ilOSLnxJOMDFVHwkD8fW0lAsKO3_bHu1jCBS6E5WwEpSHN863rTspgcEScExi5zF4GV4mWJORGe0jHpc Aug 24 13:20:26.935471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Id: None Aug 24 13:20:26.935471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Name: None Aug 24 13:20:26.935471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Identity-Status: Confirmed Aug 24 13:20:26.935471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Is-Admin-Project: True Aug 24 13:20:26.935471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Id: default Aug 24 13:20:26.935471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Name: Default Aug 24 13:20:26.935471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:20:26.935471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:20:26.935471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Role: member,reader Aug 24 13:20:26.935471 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Roles: member,reader Aug 24 13:20:26.936932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}] Aug 24 13:20:26.936932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:20:26.936932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:20:26.936932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:20:26.936932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:20:26.936932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Id: default Aug 24 13:20:26.936932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Name: Default Aug 24 13:20:26.936932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Id: fa9364936c614a68b22f66c32b76cba9 Aug 24 13:20:26.936932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Name: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:20:26.936932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: method: > Aug 24 13:20:26.936932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: exception: Instance 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a could not be found. Aug 24 13:20:26.936932 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: action_args: {'id': '2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a'} Aug 24 13:20:26.937838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:20:26.937838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:20:26.937838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:20:26.937838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:20:26.937838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:20:26.937838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:20:26.937838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:20:26.937838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:20:26.937838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:20:26.937838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:20:26.937838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a could not be found. Aug 24 13:20:26.937838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:20:26.937838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:20:26.937838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:20:26.937838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:20:26.937838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:20:26.937838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:20:26.937838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:20:26.937838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:20:26.937838 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:20:26.939547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:20:26.939547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:20:26.939547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:20:26.939547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:20:26.939547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:20:26.939547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:20:26.939547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:20:26.939547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a could not be found. Aug 24 13:20:26.939547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:20:26.939547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:20:26.939547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:20:26.939547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:20:26.939547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:20:26.939547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:20:26.939547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:20:26.939547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:20:26.939547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a could not be found. Aug 24 13:20:26.939547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:20:26.941133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-62d3294c-85e8-4b16-88e3-4716f368da85 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Returning 404 to user: Instance 2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a could not be found. {{(pid=121171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:20:26.941133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-62d3294c-85e8-4b16-88e3-4716f368da85 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a" status: 404 len: 111 microversion: 2.1 time: 0.030268 Aug 24 13:20:26.941133 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2010/4024] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:20:26 2022] GET /compute/v2.1/servers/2f95dcc8-e6d8-4b53-a1dd-5b3cd4ba843a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:20:28.243476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8d7754bd-79e8-480c-951a-62cbfc2c0247 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:20:28.243974 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8d7754bd-79e8-480c-951a-62cbfc2c0247 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:20:28.250507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d7754bd-79e8-480c-951a-62cbfc2c0247 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:28.251023 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d7754bd-79e8-480c-951a-62cbfc2c0247 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:28.251463 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d7754bd-79e8-480c-951a-62cbfc2c0247 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:28.252219 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d7754bd-79e8-480c-951a-62cbfc2c0247 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:28.252681 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d7754bd-79e8-480c-951a-62cbfc2c0247 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:28.253099 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8d7754bd-79e8-480c-951a-62cbfc2c0247 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:28.266206 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.wsgi [None req-8d7754bd-79e8-480c-951a-62cbfc2c0247 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] HTTP exception thrown: Instance 31300f22-6eeb-4def-b92a-bd1697d1986c could not be found. Aug 24 13:20:28.267841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8d7754bd-79e8-480c-951a-62cbfc2c0247 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Request method failure captured: Aug 24 13:20:28.267841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: request: DELETE /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c HTTP/1.1 Aug 24 13:20:28.267841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept: application/json Aug 24 13:20:28.267841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept-Encoding: identity Aug 24 13:20:28.267841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Connection: close Aug 24 13:20:28.267841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Length: 0 Aug 24 13:20:28.267841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Type: application/json Aug 24 13:20:28.267841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Host: 10.222.0.45 Aug 24 13:20:28.267841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Openstack-System-Scope: None Aug 24 13:20:28.267841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: User-Agent: python-urllib3/1.26.11 Aug 24 13:20:28.267841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Auth-Token: gAAAAABjBiP5eWEmCH1rTy3m7m9k9tdAn-MnqMzHWGZRmRwtIge3QPfo9RpMXcI_LY98ZmPLiGQnyraOQKKZTpPuQ7xHFVK5Rrn8lL4ilOSLnxJOMDFVHwkD8fW0lAsKO3_bHu1jCBS6E5WwEpSHN863rTspgcEScExi5zF4GV4mWJORGe0jHpc Aug 24 13:20:28.267841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Id: None Aug 24 13:20:28.267841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Name: None Aug 24 13:20:28.267841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Identity-Status: Confirmed Aug 24 13:20:28.267841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Is-Admin-Project: True Aug 24 13:20:28.267841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Id: default Aug 24 13:20:28.267841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Name: Default Aug 24 13:20:28.267841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:20:28.267841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:20:28.267841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Role: member,reader Aug 24 13:20:28.267841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Roles: member,reader Aug 24 13:20:28.269320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}] Aug 24 13:20:28.269320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:20:28.269320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:20:28.269320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:20:28.269320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:20:28.269320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Id: default Aug 24 13:20:28.269320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Name: Default Aug 24 13:20:28.269320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Id: fa9364936c614a68b22f66c32b76cba9 Aug 24 13:20:28.269320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Name: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:20:28.269320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: method: > Aug 24 13:20:28.269320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: exception: Instance 31300f22-6eeb-4def-b92a-bd1697d1986c could not be found. Aug 24 13:20:28.269320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: action_args: {'id': '31300f22-6eeb-4def-b92a-bd1697d1986c'} Aug 24 13:20:28.270199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:20:28.270199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:20:28.270199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:20:28.270199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:20:28.270199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:20:28.270199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:20:28.270199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:20:28.270199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:20:28.270199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:20:28.270199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:20:28.270199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31300f22-6eeb-4def-b92a-bd1697d1986c could not be found. Aug 24 13:20:28.270199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:20:28.270199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:20:28.270199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:20:28.270199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:20:28.270199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:20:28.270199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:20:28.270199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:20:28.270199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:20:28.270199 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:20:28.271617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:20:28.271617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 13:20:28.271617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 13:20:28.271617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 13:20:28.271617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 13:20:28.271617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:20:28.271617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:20:28.271617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:20:28.271617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:20:28.271617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31300f22-6eeb-4def-b92a-bd1697d1986c could not be found. Aug 24 13:20:28.271617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:20:28.271617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:20:28.271617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:20:28.271617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:20:28.271617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:20:28.271617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:20:28.271617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:20:28.271617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:20:28.271617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31300f22-6eeb-4def-b92a-bd1697d1986c could not be found. Aug 24 13:20:28.271617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:20:28.273119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8d7754bd-79e8-480c-951a-62cbfc2c0247 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Returning 404 to user: Instance 31300f22-6eeb-4def-b92a-bd1697d1986c could not be found. {{(pid=121170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:20:28.273119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8d7754bd-79e8-480c-951a-62cbfc2c0247 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "DELETE /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c" status: 404 len: 111 microversion: 2.1 time: 0.030323 Aug 24 13:20:28.273119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2015/4025] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 13:20:28 2022] DELETE /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:20:28.277525 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e3739f19-963e-4d9e-8d3a-eec899a4f0e8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:20:28.278127 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e3739f19-963e-4d9e-8d3a-eec899a4f0e8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 31300f22-6eeb-4def-b92a-bd1697d1986c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:20:28.284592 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e3739f19-963e-4d9e-8d3a-eec899a4f0e8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:28.285062 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e3739f19-963e-4d9e-8d3a-eec899a4f0e8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:28.285491 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e3739f19-963e-4d9e-8d3a-eec899a4f0e8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:28.286160 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e3739f19-963e-4d9e-8d3a-eec899a4f0e8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:28.286606 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e3739f19-963e-4d9e-8d3a-eec899a4f0e8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:28.287049 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e3739f19-963e-4d9e-8d3a-eec899a4f0e8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:28.300475 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.wsgi [None req-e3739f19-963e-4d9e-8d3a-eec899a4f0e8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] HTTP exception thrown: Instance 31300f22-6eeb-4def-b92a-bd1697d1986c could not be found. Aug 24 13:20:28.301987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e3739f19-963e-4d9e-8d3a-eec899a4f0e8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Request method failure captured: Aug 24 13:20:28.301987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: request: GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c HTTP/1.1 Aug 24 13:20:28.301987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept: application/json Aug 24 13:20:28.301987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept-Encoding: identity Aug 24 13:20:28.301987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Connection: close Aug 24 13:20:28.301987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Length: 0 Aug 24 13:20:28.301987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Type: application/json Aug 24 13:20:28.301987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Host: 10.222.0.45 Aug 24 13:20:28.301987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Openstack-System-Scope: None Aug 24 13:20:28.301987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: User-Agent: python-urllib3/1.26.11 Aug 24 13:20:28.301987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Auth-Token: gAAAAABjBiP5eWEmCH1rTy3m7m9k9tdAn-MnqMzHWGZRmRwtIge3QPfo9RpMXcI_LY98ZmPLiGQnyraOQKKZTpPuQ7xHFVK5Rrn8lL4ilOSLnxJOMDFVHwkD8fW0lAsKO3_bHu1jCBS6E5WwEpSHN863rTspgcEScExi5zF4GV4mWJORGe0jHpc Aug 24 13:20:28.301987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Id: None Aug 24 13:20:28.301987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Name: None Aug 24 13:20:28.301987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Identity-Status: Confirmed Aug 24 13:20:28.301987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Is-Admin-Project: True Aug 24 13:20:28.301987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Id: default Aug 24 13:20:28.301987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Name: Default Aug 24 13:20:28.301987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:20:28.301987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:20:28.301987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Role: member,reader Aug 24 13:20:28.301987 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Roles: member,reader Aug 24 13:20:28.303547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}] Aug 24 13:20:28.303547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:20:28.303547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:20:28.303547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:20:28.303547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:20:28.303547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Id: default Aug 24 13:20:28.303547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Name: Default Aug 24 13:20:28.303547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Id: fa9364936c614a68b22f66c32b76cba9 Aug 24 13:20:28.303547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Name: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:20:28.303547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: method: > Aug 24 13:20:28.303547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: exception: Instance 31300f22-6eeb-4def-b92a-bd1697d1986c could not be found. Aug 24 13:20:28.303547 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: action_args: {'id': '31300f22-6eeb-4def-b92a-bd1697d1986c'} Aug 24 13:20:28.305035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:20:28.305035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:20:28.305035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:20:28.305035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:20:28.305035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:20:28.305035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:20:28.305035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:20:28.305035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:20:28.305035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:20:28.305035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:20:28.305035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31300f22-6eeb-4def-b92a-bd1697d1986c could not be found. Aug 24 13:20:28.305035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:20:28.305035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:20:28.305035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:20:28.305035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:20:28.305035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:20:28.305035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:20:28.305035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:20:28.305035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:20:28.305035 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:20:28.306459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:20:28.306459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:20:28.306459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:20:28.306459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:20:28.306459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:20:28.306459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:20:28.306459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:20:28.306459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31300f22-6eeb-4def-b92a-bd1697d1986c could not be found. Aug 24 13:20:28.306459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:20:28.306459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:20:28.306459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:20:28.306459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:20:28.306459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:20:28.306459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:20:28.306459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:20:28.306459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:20:28.306459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31300f22-6eeb-4def-b92a-bd1697d1986c could not be found. Aug 24 13:20:28.306459 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:20:28.307982 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e3739f19-963e-4d9e-8d3a-eec899a4f0e8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Returning 404 to user: Instance 31300f22-6eeb-4def-b92a-bd1697d1986c could not be found. {{(pid=121171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:20:28.307982 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e3739f19-963e-4d9e-8d3a-eec899a4f0e8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c" status: 404 len: 111 microversion: 2.1 time: 0.029691 Aug 24 13:20:28.307982 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2011/4026] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:20:28 2022] GET /compute/v2.1/servers/31300f22-6eeb-4def-b92a-bd1697d1986c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:20:28.312319 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f02b08df-71e2-47c8-a62d-af4653a2f7ce tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:20:28.312841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f02b08df-71e2-47c8-a62d-af4653a2f7ce tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 183254c6-4230-403b-88db-0ed629171a8c] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:20:28.318780 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f02b08df-71e2-47c8-a62d-af4653a2f7ce tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:28.319293 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f02b08df-71e2-47c8-a62d-af4653a2f7ce tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:28.319732 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f02b08df-71e2-47c8-a62d-af4653a2f7ce tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:28.320407 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f02b08df-71e2-47c8-a62d-af4653a2f7ce tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:28.320858 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f02b08df-71e2-47c8-a62d-af4653a2f7ce tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:28.321281 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f02b08df-71e2-47c8-a62d-af4653a2f7ce tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:28.334455 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.wsgi [None req-f02b08df-71e2-47c8-a62d-af4653a2f7ce tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] HTTP exception thrown: Instance 183254c6-4230-403b-88db-0ed629171a8c could not be found. Aug 24 13:20:28.336081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f02b08df-71e2-47c8-a62d-af4653a2f7ce tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Request method failure captured: Aug 24 13:20:28.336081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: request: DELETE /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c HTTP/1.1 Aug 24 13:20:28.336081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept: application/json Aug 24 13:20:28.336081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept-Encoding: identity Aug 24 13:20:28.336081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Connection: close Aug 24 13:20:28.336081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Length: 0 Aug 24 13:20:28.336081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Type: application/json Aug 24 13:20:28.336081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Host: 10.222.0.45 Aug 24 13:20:28.336081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Openstack-System-Scope: None Aug 24 13:20:28.336081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: User-Agent: python-urllib3/1.26.11 Aug 24 13:20:28.336081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Auth-Token: gAAAAABjBiP5eWEmCH1rTy3m7m9k9tdAn-MnqMzHWGZRmRwtIge3QPfo9RpMXcI_LY98ZmPLiGQnyraOQKKZTpPuQ7xHFVK5Rrn8lL4ilOSLnxJOMDFVHwkD8fW0lAsKO3_bHu1jCBS6E5WwEpSHN863rTspgcEScExi5zF4GV4mWJORGe0jHpc Aug 24 13:20:28.336081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Id: None Aug 24 13:20:28.336081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Name: None Aug 24 13:20:28.336081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Identity-Status: Confirmed Aug 24 13:20:28.336081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Is-Admin-Project: True Aug 24 13:20:28.336081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Id: default Aug 24 13:20:28.336081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Name: Default Aug 24 13:20:28.336081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:20:28.336081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:20:28.336081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Role: member,reader Aug 24 13:20:28.336081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Roles: member,reader Aug 24 13:20:28.337564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}] Aug 24 13:20:28.337564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:20:28.337564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:20:28.337564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:20:28.337564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:20:28.337564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Id: default Aug 24 13:20:28.337564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Name: Default Aug 24 13:20:28.337564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Id: fa9364936c614a68b22f66c32b76cba9 Aug 24 13:20:28.337564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Name: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:20:28.337564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: method: > Aug 24 13:20:28.337564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: exception: Instance 183254c6-4230-403b-88db-0ed629171a8c could not be found. Aug 24 13:20:28.337564 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: action_args: {'id': '183254c6-4230-403b-88db-0ed629171a8c'} Aug 24 13:20:28.338524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:20:28.338524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:20:28.338524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:20:28.338524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:20:28.338524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:20:28.338524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:20:28.338524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:20:28.338524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:20:28.338524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:20:28.338524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:20:28.338524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 183254c6-4230-403b-88db-0ed629171a8c could not be found. Aug 24 13:20:28.338524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:20:28.338524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:20:28.338524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:20:28.338524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:20:28.338524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:20:28.338524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:20:28.338524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:20:28.338524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:20:28.338524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:20:28.339936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:20:28.339936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 13:20:28.339936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 13:20:28.339936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 13:20:28.339936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 13:20:28.339936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:20:28.339936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:20:28.339936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:20:28.339936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:20:28.339936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 183254c6-4230-403b-88db-0ed629171a8c could not be found. Aug 24 13:20:28.339936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:20:28.339936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:20:28.339936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:20:28.339936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:20:28.339936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:20:28.339936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:20:28.339936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:20:28.339936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:20:28.339936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 183254c6-4230-403b-88db-0ed629171a8c could not be found. Aug 24 13:20:28.339936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:20:28.341375 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f02b08df-71e2-47c8-a62d-af4653a2f7ce tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Returning 404 to user: Instance 183254c6-4230-403b-88db-0ed629171a8c could not be found. {{(pid=121170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:20:28.341375 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f02b08df-71e2-47c8-a62d-af4653a2f7ce tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "DELETE /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c" status: 404 len: 111 microversion: 2.1 time: 0.028937 Aug 24 13:20:28.341375 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2016/4027] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 13:20:28 2022] DELETE /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:20:28.345664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f45b1a3c-f009-4b0c-b55a-d1a27ff1bcd8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:20:28.346265 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f45b1a3c-f009-4b0c-b55a-d1a27ff1bcd8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 183254c6-4230-403b-88db-0ed629171a8c] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:20:28.352579 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f45b1a3c-f009-4b0c-b55a-d1a27ff1bcd8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:28.353050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f45b1a3c-f009-4b0c-b55a-d1a27ff1bcd8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:28.353481 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f45b1a3c-f009-4b0c-b55a-d1a27ff1bcd8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:28.354150 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f45b1a3c-f009-4b0c-b55a-d1a27ff1bcd8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:28.354596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f45b1a3c-f009-4b0c-b55a-d1a27ff1bcd8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:28.355041 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f45b1a3c-f009-4b0c-b55a-d1a27ff1bcd8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:28.369843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.wsgi [None req-f45b1a3c-f009-4b0c-b55a-d1a27ff1bcd8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] HTTP exception thrown: Instance 183254c6-4230-403b-88db-0ed629171a8c could not be found. Aug 24 13:20:28.371359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f45b1a3c-f009-4b0c-b55a-d1a27ff1bcd8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Request method failure captured: Aug 24 13:20:28.371359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: request: GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c HTTP/1.1 Aug 24 13:20:28.371359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept: application/json Aug 24 13:20:28.371359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept-Encoding: identity Aug 24 13:20:28.371359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Connection: close Aug 24 13:20:28.371359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Length: 0 Aug 24 13:20:28.371359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Type: application/json Aug 24 13:20:28.371359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Host: 10.222.0.45 Aug 24 13:20:28.371359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Openstack-System-Scope: None Aug 24 13:20:28.371359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: User-Agent: python-urllib3/1.26.11 Aug 24 13:20:28.371359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Auth-Token: gAAAAABjBiP5eWEmCH1rTy3m7m9k9tdAn-MnqMzHWGZRmRwtIge3QPfo9RpMXcI_LY98ZmPLiGQnyraOQKKZTpPuQ7xHFVK5Rrn8lL4ilOSLnxJOMDFVHwkD8fW0lAsKO3_bHu1jCBS6E5WwEpSHN863rTspgcEScExi5zF4GV4mWJORGe0jHpc Aug 24 13:20:28.371359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Id: None Aug 24 13:20:28.371359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Name: None Aug 24 13:20:28.371359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Identity-Status: Confirmed Aug 24 13:20:28.371359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Is-Admin-Project: True Aug 24 13:20:28.371359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Id: default Aug 24 13:20:28.371359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Name: Default Aug 24 13:20:28.371359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:20:28.371359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:20:28.371359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Role: member,reader Aug 24 13:20:28.371359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Roles: member,reader Aug 24 13:20:28.373070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}] Aug 24 13:20:28.373070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:20:28.373070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:20:28.373070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:20:28.373070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:20:28.373070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Id: default Aug 24 13:20:28.373070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Name: Default Aug 24 13:20:28.373070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Id: fa9364936c614a68b22f66c32b76cba9 Aug 24 13:20:28.373070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Name: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:20:28.373070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: method: > Aug 24 13:20:28.373070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: exception: Instance 183254c6-4230-403b-88db-0ed629171a8c could not be found. Aug 24 13:20:28.373070 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: action_args: {'id': '183254c6-4230-403b-88db-0ed629171a8c'} Aug 24 13:20:28.373823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:20:28.373823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:20:28.373823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:20:28.373823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:20:28.373823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:20:28.373823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:20:28.373823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:20:28.373823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:20:28.373823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:20:28.373823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:20:28.373823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 183254c6-4230-403b-88db-0ed629171a8c could not be found. Aug 24 13:20:28.373823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:20:28.373823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:20:28.373823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:20:28.373823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:20:28.373823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:20:28.373823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:20:28.373823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:20:28.373823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:20:28.373823 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:20:28.375225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:20:28.375225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:20:28.375225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:20:28.375225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:20:28.375225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:20:28.375225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:20:28.375225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:20:28.375225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 183254c6-4230-403b-88db-0ed629171a8c could not be found. Aug 24 13:20:28.375225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:20:28.375225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:20:28.375225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:20:28.375225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:20:28.375225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:20:28.375225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:20:28.375225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:20:28.375225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:20:28.375225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 183254c6-4230-403b-88db-0ed629171a8c could not be found. Aug 24 13:20:28.375225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:20:28.376427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f45b1a3c-f009-4b0c-b55a-d1a27ff1bcd8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Returning 404 to user: Instance 183254c6-4230-403b-88db-0ed629171a8c could not be found. {{(pid=121171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:20:28.376427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f45b1a3c-f009-4b0c-b55a-d1a27ff1bcd8 tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c" status: 404 len: 111 microversion: 2.1 time: 0.030838 Aug 24 13:20:28.376427 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2012/4028] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:20:28 2022] GET /compute/v2.1/servers/183254c6-4230-403b-88db-0ed629171a8c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:20:29.626803 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-09ddd4bd-f287-46ba-abc3-8f53f990501d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:20:29.627325 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-09ddd4bd-f287-46ba-abc3-8f53f990501d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:20:29.634106 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09ddd4bd-f287-46ba-abc3-8f53f990501d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:29.634584 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09ddd4bd-f287-46ba-abc3-8f53f990501d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:29.635041 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09ddd4bd-f287-46ba-abc3-8f53f990501d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:29.635717 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09ddd4bd-f287-46ba-abc3-8f53f990501d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:29.636170 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09ddd4bd-f287-46ba-abc3-8f53f990501d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:29.636591 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09ddd4bd-f287-46ba-abc3-8f53f990501d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:29.652403 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.wsgi [None req-09ddd4bd-f287-46ba-abc3-8f53f990501d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] HTTP exception thrown: Instance 55f47f59-c5c5-4831-b535-881f53f6a2bc could not be found. Aug 24 13:20:29.654050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-09ddd4bd-f287-46ba-abc3-8f53f990501d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Request method failure captured: Aug 24 13:20:29.654050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: request: DELETE /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc HTTP/1.1 Aug 24 13:20:29.654050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept: application/json Aug 24 13:20:29.654050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept-Encoding: identity Aug 24 13:20:29.654050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Connection: close Aug 24 13:20:29.654050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Length: 0 Aug 24 13:20:29.654050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Type: application/json Aug 24 13:20:29.654050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Host: 10.222.0.45 Aug 24 13:20:29.654050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Openstack-System-Scope: None Aug 24 13:20:29.654050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: User-Agent: python-urllib3/1.26.11 Aug 24 13:20:29.654050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Auth-Token: gAAAAABjBiP5eWEmCH1rTy3m7m9k9tdAn-MnqMzHWGZRmRwtIge3QPfo9RpMXcI_LY98ZmPLiGQnyraOQKKZTpPuQ7xHFVK5Rrn8lL4ilOSLnxJOMDFVHwkD8fW0lAsKO3_bHu1jCBS6E5WwEpSHN863rTspgcEScExi5zF4GV4mWJORGe0jHpc Aug 24 13:20:29.654050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Id: None Aug 24 13:20:29.654050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Name: None Aug 24 13:20:29.654050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Identity-Status: Confirmed Aug 24 13:20:29.654050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Is-Admin-Project: True Aug 24 13:20:29.654050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Id: default Aug 24 13:20:29.654050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Name: Default Aug 24 13:20:29.654050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:20:29.654050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:20:29.654050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Role: member,reader Aug 24 13:20:29.654050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Roles: member,reader Aug 24 13:20:29.655572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}] Aug 24 13:20:29.655572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:20:29.655572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:20:29.655572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:20:29.655572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:20:29.655572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Id: default Aug 24 13:20:29.655572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Name: Default Aug 24 13:20:29.655572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Id: fa9364936c614a68b22f66c32b76cba9 Aug 24 13:20:29.655572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Name: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:20:29.655572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: method: > Aug 24 13:20:29.655572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: exception: Instance 55f47f59-c5c5-4831-b535-881f53f6a2bc could not be found. Aug 24 13:20:29.655572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: action_args: {'id': '55f47f59-c5c5-4831-b535-881f53f6a2bc'} Aug 24 13:20:29.656424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:20:29.656424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:20:29.656424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:20:29.656424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:20:29.656424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:20:29.656424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:20:29.656424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:20:29.656424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:20:29.656424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:20:29.656424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:20:29.656424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55f47f59-c5c5-4831-b535-881f53f6a2bc could not be found. Aug 24 13:20:29.656424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:20:29.656424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:20:29.656424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:20:29.656424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:20:29.656424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:20:29.656424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:20:29.656424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:20:29.656424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:20:29.656424 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:20:29.657753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:20:29.657753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 13:20:29.657753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 13:20:29.657753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 13:20:29.657753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 13:20:29.657753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:20:29.657753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:20:29.657753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:20:29.657753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:20:29.657753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55f47f59-c5c5-4831-b535-881f53f6a2bc could not be found. Aug 24 13:20:29.657753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:20:29.657753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:20:29.657753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:20:29.657753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:20:29.657753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:20:29.657753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:20:29.657753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:20:29.657753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:20:29.657753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55f47f59-c5c5-4831-b535-881f53f6a2bc could not be found. Aug 24 13:20:29.657753 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:20:29.659355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-09ddd4bd-f287-46ba-abc3-8f53f990501d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Returning 404 to user: Instance 55f47f59-c5c5-4831-b535-881f53f6a2bc could not be found. {{(pid=121170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:20:29.659355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-09ddd4bd-f287-46ba-abc3-8f53f990501d tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "DELETE /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc" status: 404 len: 111 microversion: 2.1 time: 0.032821 Aug 24 13:20:29.659355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2017/4029] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 13:20:29 2022] DELETE /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:20:29.665161 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-64658403-7bbd-49cc-96a7-31315788831f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:20:29.665777 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-64658403-7bbd-49cc-96a7-31315788831f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] [instance: 55f47f59-c5c5-4831-b535-881f53f6a2bc] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:20:29.672278 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64658403-7bbd-49cc-96a7-31315788831f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:29.672759 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64658403-7bbd-49cc-96a7-31315788831f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:29.673197 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64658403-7bbd-49cc-96a7-31315788831f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:29.673892 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64658403-7bbd-49cc-96a7-31315788831f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:20:29.674347 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64658403-7bbd-49cc-96a7-31315788831f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:20:29.674800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-64658403-7bbd-49cc-96a7-31315788831f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:20:29.688025 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.wsgi [None req-64658403-7bbd-49cc-96a7-31315788831f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] HTTP exception thrown: Instance 55f47f59-c5c5-4831-b535-881f53f6a2bc could not be found. Aug 24 13:20:29.689549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-64658403-7bbd-49cc-96a7-31315788831f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Request method failure captured: Aug 24 13:20:29.689549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: request: GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc HTTP/1.1 Aug 24 13:20:29.689549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept: application/json Aug 24 13:20:29.689549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept-Encoding: identity Aug 24 13:20:29.689549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Connection: close Aug 24 13:20:29.689549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Length: 0 Aug 24 13:20:29.689549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Type: application/json Aug 24 13:20:29.689549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Host: 10.222.0.45 Aug 24 13:20:29.689549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Openstack-System-Scope: None Aug 24 13:20:29.689549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: User-Agent: python-urllib3/1.26.11 Aug 24 13:20:29.689549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Auth-Token: gAAAAABjBiP5eWEmCH1rTy3m7m9k9tdAn-MnqMzHWGZRmRwtIge3QPfo9RpMXcI_LY98ZmPLiGQnyraOQKKZTpPuQ7xHFVK5Rrn8lL4ilOSLnxJOMDFVHwkD8fW0lAsKO3_bHu1jCBS6E5WwEpSHN863rTspgcEScExi5zF4GV4mWJORGe0jHpc Aug 24 13:20:29.689549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Id: None Aug 24 13:20:29.689549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Name: None Aug 24 13:20:29.689549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Identity-Status: Confirmed Aug 24 13:20:29.689549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Is-Admin-Project: True Aug 24 13:20:29.689549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Id: default Aug 24 13:20:29.689549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Name: Default Aug 24 13:20:29.689549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:20:29.689549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:20:29.689549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Role: member,reader Aug 24 13:20:29.689549 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Roles: member,reader Aug 24 13:20:29.691084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5e9455e7426b490680c92f1bb3cecca0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5e9455e7426b490680c92f1bb3cecca0"}]}] Aug 24 13:20:29.691084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:20:29.691084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Id: 5e9455e7426b490680c92f1bb3cecca0 Aug 24 13:20:29.691084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122525202 Aug 24 13:20:29.691084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:20:29.691084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Id: default Aug 24 13:20:29.691084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Name: Default Aug 24 13:20:29.691084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Id: fa9364936c614a68b22f66c32b76cba9 Aug 24 13:20:29.691084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Name: tempest-AttachVolumeNegativeTest-2122525202-project Aug 24 13:20:29.691084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: method: > Aug 24 13:20:29.691084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: exception: Instance 55f47f59-c5c5-4831-b535-881f53f6a2bc could not be found. Aug 24 13:20:29.691084 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: action_args: {'id': '55f47f59-c5c5-4831-b535-881f53f6a2bc'} Aug 24 13:20:29.691873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:20:29.691873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:20:29.691873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:20:29.691873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:20:29.691873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:20:29.691873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:20:29.691873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:20:29.691873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:20:29.691873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:20:29.691873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:20:29.691873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55f47f59-c5c5-4831-b535-881f53f6a2bc could not be found. Aug 24 13:20:29.691873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:20:29.691873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:20:29.691873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:20:29.691873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:20:29.691873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:20:29.691873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:20:29.691873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:20:29.691873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:20:29.691873 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:20:29.692991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:20:29.692991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:20:29.692991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:20:29.692991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:20:29.692991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:20:29.692991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:20:29.692991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:20:29.692991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55f47f59-c5c5-4831-b535-881f53f6a2bc could not be found. Aug 24 13:20:29.692991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:20:29.692991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:20:29.692991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:20:29.692991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:20:29.692991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:20:29.692991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:20:29.692991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:20:29.692991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:20:29.692991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55f47f59-c5c5-4831-b535-881f53f6a2bc could not be found. Aug 24 13:20:29.692991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:20:29.693978 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-64658403-7bbd-49cc-96a7-31315788831f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] Returning 404 to user: Instance 55f47f59-c5c5-4831-b535-881f53f6a2bc could not be found. {{(pid=121171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:20:29.693978 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-64658403-7bbd-49cc-96a7-31315788831f tempest-AttachVolumeNegativeTest-2122525202 tempest-AttachVolumeNegativeTest-2122525202-project] 10.222.0.45 "GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc" status: 404 len: 111 microversion: 2.1 time: 0.029742 Aug 24 13:20:29.693978 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2013/4030] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:20:29 2022] GET /compute/v2.1/servers/55f47f59-c5c5-4831-b535-881f53f6a2bc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 13:21:21.233262 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:21:21.234213 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:21:21.421776 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-edb7d615-c35e-4a42-8264-628a60d6a12d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Action: 'create', calling method: .version_select at 0x7f76f54c7280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-897906530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1SSLr+Fuy7Oa0ZaOEo+AgJ7PtUanfP6pIgO1oyc7tmPTcnFX2C27GCr0U2FR2Q74K+Uv9ccZD+zmD/DyZKeNGJn2CEdtJnRAMx9HJ8zx3TCQycvtcevX/clBbe8DZRlQ=="}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:21:21.438386 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-edb7d615-c35e-4a42-8264-628a60d6a12d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Getting quotas for project e4ab80b71d1f4f06b20c597689ae8a2e. Resources: {'key_pairs'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:21:21.442772 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-edb7d615-c35e-4a42-8264-628a60d6a12d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Getting quotas for user cc07ef53f88c4a809deab768daff8132 and project e4ab80b71d1f4f06b20c597689ae8a2e. Resources: {'key_pairs'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:21:21.470502 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR oslo.messaging._drivers.impl_rabbit [None req-edb7d615-c35e-4a42-8264-628a60d6a12d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [6d44cf10-b730-42fe-b904-c92c07350f0e] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 13:21:22.478698 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [None req-edb7d615-c35e-4a42-8264-628a60d6a12d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [6d44cf10-b730-42fe-b904-c92c07350f0e] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 50260. Aug 24 13:21:22.553470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-edb7d615-c35e-4a42-8264-628a60d6a12d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 1.324935 Aug 24 13:21:22.554483 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2018/4031] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 24 13:21:21 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:21:48.832766 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:21:48.833576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=50,nova_cell1:INSERT=1 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:21:48.837513 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-7161c37d-13b5-4981-9020-d57261c02cc9 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-388854461", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-897906530", "security_groups": [{"name": "tempest-secgroup-smoke-878579104"}], "block_device_mapping_v2": [{"uuid": "6224c435-8ad9-4c9f-8539-50daa3a2c675", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7ce5b031-607c-4454-8881-f77d4334dcf2"}]}} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:21:48.952433 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.network.neutron [None req-7161c37d-13b5-4981-9020-d57261c02cc9 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] validate_networks() for [('7ce5b031-607c-4454-8881-f77d4334dcf2', None, None, None, None, None)] {{(pid=121171) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:21:49.315903 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-7161c37d-13b5-4981-9020-d57261c02cc9 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Flavor limits 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:21:49.316322 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-7161c37d-13b5-4981-9020-d57261c02cc9 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Image limits 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:21:49.316789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-7161c37d-13b5-4981-9020-d57261c02cc9 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Flavor pref 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:21:49.317191 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-7161c37d-13b5-4981-9020-d57261c02cc9 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Image pref 0:0:0 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:21:49.317595 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.virt.hardware [None req-7161c37d-13b5-4981-9020-d57261c02cc9 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:21:49.326189 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7161c37d-13b5-4981-9020-d57261c02cc9 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:21:49.326679 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7161c37d-13b5-4981-9020-d57261c02cc9 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:21:49.327110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7161c37d-13b5-4981-9020-d57261c02cc9 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:21:49.327818 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7161c37d-13b5-4981-9020-d57261c02cc9 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:21:49.328262 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7161c37d-13b5-4981-9020-d57261c02cc9 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:21:49.328686 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-7161c37d-13b5-4981-9020-d57261c02cc9 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:21:49.345744 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-7161c37d-13b5-4981-9020-d57261c02cc9 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Getting quotas for project e4ab80b71d1f4f06b20c597689ae8a2e. Resources: {'instances', 'cores', 'ram'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:21:49.349596 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.quota [None req-7161c37d-13b5-4981-9020-d57261c02cc9 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Getting quotas for user cc07ef53f88c4a809deab768daff8132 and project e4ab80b71d1f4f06b20c597689ae8a2e. Resources: {'instances', 'cores', 'ram'} {{(pid=121171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:21:49.406734 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7161c37d-13b5-4981-9020-d57261c02cc9 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Going to run 1 instances... {{(pid=121171) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 13:21:49.408845 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-7161c37d-13b5-4981-9020-d57261c02cc9 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6224c435-8ad9-4c9f-8539-50daa3a2c675',volume_size=None,volume_type=None)] {{(pid=121171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 13:21:49.859952 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7161c37d-13b5-4981-9020-d57261c02cc9 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [234238be-16be-4d72-ae14-da565c4fbbf4] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 13:21:50.866852 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [None req-7161c37d-13b5-4981-9020-d57261c02cc9 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [234238be-16be-4d72-ae14-da565c4fbbf4] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 50408. Aug 24 13:21:50.871172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-7161c37d-13b5-4981-9020-d57261c02cc9 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.040270 Aug 24 13:21:50.871803 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2014/4032] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 13:21:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 2041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 13:21:50.880183 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell0:SELECT=4 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:21:50.881439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:21:50.885324 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9161fc41-5ac2-4f15-995b-1a5ae06cb3bd tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:21:50.886431 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9161fc41-5ac2-4f15-995b-1a5ae06cb3bd tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:21:50.942136 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9161fc41-5ac2-4f15-995b-1a5ae06cb3bd tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:21:50.949060 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9161fc41-5ac2-4f15-995b-1a5ae06cb3bd tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d" status: 200 len: 1093 microversion: 2.1 time: 0.070092 Aug 24 13:21:50.949812 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2019/4033] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:21:50 2022] GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:21:51.970771 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-205cc0c6-cfce-4e95-9334-820a9464ebe2 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:21:51.971374 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-205cc0c6-cfce-4e95-9334-820a9464ebe2 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:21:52.025523 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-205cc0c6-cfce-4e95-9334-820a9464ebe2 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:21:52.032395 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-205cc0c6-cfce-4e95-9334-820a9464ebe2 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d" status: 200 len: 1093 microversion: 2.1 time: 0.066246 Aug 24 13:21:52.032954 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2015/4034] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:21:51 2022] GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:21:52.147597 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:21:52.148146 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 13:21:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:21:53.053433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ba1deb65-ba66-4823-93b6-ab7ab4aed0e0 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:21:53.054045 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ba1deb65-ba66-4823-93b6-ab7ab4aed0e0 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:21:53.060679 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba1deb65-ba66-4823-93b6-ab7ab4aed0e0 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:21:53.061168 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba1deb65-ba66-4823-93b6-ab7ab4aed0e0 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:21:53.061621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba1deb65-ba66-4823-93b6-ab7ab4aed0e0 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:21:53.062308 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba1deb65-ba66-4823-93b6-ab7ab4aed0e0 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:21:53.062798 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba1deb65-ba66-4823-93b6-ab7ab4aed0e0 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:21:53.063232 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ba1deb65-ba66-4823-93b6-ab7ab4aed0e0 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:21:53.124494 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ba1deb65-ba66-4823-93b6-ab7ab4aed0e0 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:21:53.132096 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ba1deb65-ba66-4823-93b6-ab7ab4aed0e0 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d" status: 200 len: 1191 microversion: 2.1 time: 0.082594 Aug 24 13:21:53.132762 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2020/4035] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:21:53 2022] GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d => generated 1191 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:21:54.161671 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-be1a6fe7-01ef-43b4-8d68-2decaaa6660d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:21:54.162492 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-be1a6fe7-01ef-43b4-8d68-2decaaa6660d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:21:54.168633 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be1a6fe7-01ef-43b4-8d68-2decaaa6660d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:21:54.169111 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be1a6fe7-01ef-43b4-8d68-2decaaa6660d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:21:54.169577 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be1a6fe7-01ef-43b4-8d68-2decaaa6660d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:21:54.170256 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be1a6fe7-01ef-43b4-8d68-2decaaa6660d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:21:54.170735 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be1a6fe7-01ef-43b4-8d68-2decaaa6660d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:21:54.171162 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-be1a6fe7-01ef-43b4-8d68-2decaaa6660d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:21:54.232309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-be1a6fe7-01ef-43b4-8d68-2decaaa6660d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:21:54.240649 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-be1a6fe7-01ef-43b4-8d68-2decaaa6660d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d" status: 200 len: 1209 microversion: 2.1 time: 0.082367 Aug 24 13:21:54.240781 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2016/4036] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:21:54 2022] GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d => generated 1209 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:21:55.261977 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-449fc07c-4bb7-4cda-a66a-c3381ac2c777 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:21:55.262588 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-449fc07c-4bb7-4cda-a66a-c3381ac2c777 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:21:55.269102 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-449fc07c-4bb7-4cda-a66a-c3381ac2c777 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:21:55.269584 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-449fc07c-4bb7-4cda-a66a-c3381ac2c777 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:21:55.270022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-449fc07c-4bb7-4cda-a66a-c3381ac2c777 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:21:55.270728 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-449fc07c-4bb7-4cda-a66a-c3381ac2c777 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:21:55.271188 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-449fc07c-4bb7-4cda-a66a-c3381ac2c777 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:21:55.271610 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-449fc07c-4bb7-4cda-a66a-c3381ac2c777 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:21:55.313271 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-22bea7fe-7947-4eed-9f01-195bf66fd300 req-e1e384ef-41bb-47c9-8d86-c5782b4c45fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b22e30d3-d9df-47d6-a456-205df43da39d", "tag": "a0dc5a49-cb5f-4a1d-85df-62bf657f54f3"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:21:55.324073 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-22bea7fe-7947-4eed-9f01-195bf66fd300 req-e1e384ef-41bb-47c9-8d86-c5782b4c45fb service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:21:55.324796 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-22bea7fe-7947-4eed-9f01-195bf66fd300 req-e1e384ef-41bb-47c9-8d86-c5782b4c45fb service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:21:55.325429 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-22bea7fe-7947-4eed-9f01-195bf66fd300 req-e1e384ef-41bb-47c9-8d86-c5782b4c45fb service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:21:55.337588 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-22bea7fe-7947-4eed-9f01-195bf66fd300 req-e1e384ef-41bb-47c9-8d86-c5782b4c45fb service nova] Creating event network-changed:a0dc5a49-cb5f-4a1d-85df-62bf657f54f3 for instance b22e30d3-d9df-47d6-a456-205df43da39d on hv-cinder-84889 Aug 24 13:21:55.343033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-22bea7fe-7947-4eed-9f01-195bf66fd300 req-e1e384ef-41bb-47c9-8d86-c5782b4c45fb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034022 Aug 24 13:21:55.343728 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2017/4037] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:21:55.412401 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-449fc07c-4bb7-4cda-a66a-c3381ac2c777 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:21:55.420357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-449fc07c-4bb7-4cda-a66a-c3381ac2c777 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d" status: 200 len: 1276 microversion: 2.1 time: 0.162867 Aug 24 13:21:55.420921 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2021/4038] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:21:55 2022] GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d => generated 1276 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:21:56.441806 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bd05d02c-8057-46cc-9b9d-6a59eabc9197 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:21:56.442504 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-bd05d02c-8057-46cc-9b9d-6a59eabc9197 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:21:56.449108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd05d02c-8057-46cc-9b9d-6a59eabc9197 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:21:56.449589 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd05d02c-8057-46cc-9b9d-6a59eabc9197 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:21:56.450026 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd05d02c-8057-46cc-9b9d-6a59eabc9197 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:21:56.450736 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd05d02c-8057-46cc-9b9d-6a59eabc9197 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:21:56.451191 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd05d02c-8057-46cc-9b9d-6a59eabc9197 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:21:56.451670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bd05d02c-8057-46cc-9b9d-6a59eabc9197 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:21:56.587085 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-bd05d02c-8057-46cc-9b9d-6a59eabc9197 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:21:56.595280 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bd05d02c-8057-46cc-9b9d-6a59eabc9197 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d" status: 200 len: 1264 microversion: 2.1 time: 0.157684 Aug 24 13:21:56.595842 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2018/4039] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:21:56 2022] GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:21:57.615946 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b3cefa01-aeda-4f00-ad73-536faecfccd5 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:21:57.616493 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b3cefa01-aeda-4f00-ad73-536faecfccd5 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:21:57.623591 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3cefa01-aeda-4f00-ad73-536faecfccd5 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:21:57.624079 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3cefa01-aeda-4f00-ad73-536faecfccd5 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:21:57.624518 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3cefa01-aeda-4f00-ad73-536faecfccd5 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:21:57.625204 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3cefa01-aeda-4f00-ad73-536faecfccd5 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:21:57.625662 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3cefa01-aeda-4f00-ad73-536faecfccd5 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:21:57.626089 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b3cefa01-aeda-4f00-ad73-536faecfccd5 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:21:57.753145 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b3cefa01-aeda-4f00-ad73-536faecfccd5 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:21:57.761293 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b3cefa01-aeda-4f00-ad73-536faecfccd5 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d" status: 200 len: 1264 microversion: 2.1 time: 0.149265 Aug 24 13:21:57.761843 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2022/4040] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:21:57 2022] GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:21:58.781410 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-1467cb83-348d-4f9a-9d58-ebe866f3511d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:21:58.782013 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-1467cb83-348d-4f9a-9d58-ebe866f3511d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:21:58.788332 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1467cb83-348d-4f9a-9d58-ebe866f3511d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:21:58.788814 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1467cb83-348d-4f9a-9d58-ebe866f3511d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:21:58.789245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1467cb83-348d-4f9a-9d58-ebe866f3511d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:21:58.789916 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1467cb83-348d-4f9a-9d58-ebe866f3511d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:21:58.790362 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1467cb83-348d-4f9a-9d58-ebe866f3511d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:21:58.790864 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-1467cb83-348d-4f9a-9d58-ebe866f3511d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:21:58.918504 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-1467cb83-348d-4f9a-9d58-ebe866f3511d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:21:58.926308 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-1467cb83-348d-4f9a-9d58-ebe866f3511d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d" status: 200 len: 1264 microversion: 2.1 time: 0.148745 Aug 24 13:21:58.926887 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2019/4041] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:21:58 2022] GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:21:59.946610 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f18b08e5-bb83-4ce5-bba4-7e527b238f18 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:21:59.947851 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f18b08e5-bb83-4ce5-bba4-7e527b238f18 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:21:59.954285 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f18b08e5-bb83-4ce5-bba4-7e527b238f18 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:21:59.954793 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f18b08e5-bb83-4ce5-bba4-7e527b238f18 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:21:59.955228 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f18b08e5-bb83-4ce5-bba4-7e527b238f18 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:21:59.955903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f18b08e5-bb83-4ce5-bba4-7e527b238f18 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:21:59.956355 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f18b08e5-bb83-4ce5-bba4-7e527b238f18 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:21:59.956776 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f18b08e5-bb83-4ce5-bba4-7e527b238f18 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:22:00.088033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f18b08e5-bb83-4ce5-bba4-7e527b238f18 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:22:00.095505 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f18b08e5-bb83-4ce5-bba4-7e527b238f18 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d" status: 200 len: 1264 microversion: 2.1 time: 0.152860 Aug 24 13:22:00.096052 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2023/4042] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:21:59 2022] GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:22:01.115668 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a92c7222-8711-4038-9b72-a1d22b0c2342 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:22:01.116278 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a92c7222-8711-4038-9b72-a1d22b0c2342 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:22:01.118186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=2 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:01.123634 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a92c7222-8711-4038-9b72-a1d22b0c2342 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:22:01.124112 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a92c7222-8711-4038-9b72-a1d22b0c2342 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:22:01.124548 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a92c7222-8711-4038-9b72-a1d22b0c2342 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:22:01.125222 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a92c7222-8711-4038-9b72-a1d22b0c2342 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:22:01.125674 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a92c7222-8711-4038-9b72-a1d22b0c2342 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:22:01.126098 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a92c7222-8711-4038-9b72-a1d22b0c2342 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:22:01.265901 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a92c7222-8711-4038-9b72-a1d22b0c2342 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:22:01.273458 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a92c7222-8711-4038-9b72-a1d22b0c2342 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d" status: 200 len: 1264 microversion: 2.1 time: 0.161636 Aug 24 13:22:01.274012 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2020/4043] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:22:01 2022] GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:22:02.293909 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-8423399e-8461-447c-86da-d96ebb143b85 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:22:02.294506 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-8423399e-8461-447c-86da-d96ebb143b85 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:22:02.296369 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell0:SELECT=2 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:02.301541 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8423399e-8461-447c-86da-d96ebb143b85 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:22:02.302031 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8423399e-8461-447c-86da-d96ebb143b85 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:22:02.302448 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8423399e-8461-447c-86da-d96ebb143b85 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:22:02.303154 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8423399e-8461-447c-86da-d96ebb143b85 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:22:02.303644 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8423399e-8461-447c-86da-d96ebb143b85 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:22:02.304063 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-8423399e-8461-447c-86da-d96ebb143b85 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:22:02.434265 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-8423399e-8461-447c-86da-d96ebb143b85 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:22:02.442028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-8423399e-8461-447c-86da-d96ebb143b85 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d" status: 200 len: 1264 microversion: 2.1 time: 0.152582 Aug 24 13:22:02.442588 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2024/4044] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:22:02 2022] GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:22:03.462592 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-f5a56ab0-aefe-4894-b0f1-ce52f5848c0e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:22:03.463296 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-f5a56ab0-aefe-4894-b0f1-ce52f5848c0e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:22:03.465127 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=8 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:03.470290 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5a56ab0-aefe-4894-b0f1-ce52f5848c0e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:22:03.470805 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5a56ab0-aefe-4894-b0f1-ce52f5848c0e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:22:03.471240 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5a56ab0-aefe-4894-b0f1-ce52f5848c0e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:22:03.471920 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5a56ab0-aefe-4894-b0f1-ce52f5848c0e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:22:03.472368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5a56ab0-aefe-4894-b0f1-ce52f5848c0e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:22:03.472787 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-f5a56ab0-aefe-4894-b0f1-ce52f5848c0e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:22:03.602085 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-f5a56ab0-aefe-4894-b0f1-ce52f5848c0e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:22:03.609754 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-f5a56ab0-aefe-4894-b0f1-ce52f5848c0e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d" status: 200 len: 1264 microversion: 2.1 time: 0.151121 Aug 24 13:22:03.610309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2021/4045] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:22:03 2022] GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:22:04.630615 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0fc84b69-4734-4211-b21d-59f4b1ec1093 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:22:04.631245 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0fc84b69-4734-4211-b21d-59f4b1ec1093 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:22:04.637553 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fc84b69-4734-4211-b21d-59f4b1ec1093 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:22:04.638038 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fc84b69-4734-4211-b21d-59f4b1ec1093 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:22:04.638480 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fc84b69-4734-4211-b21d-59f4b1ec1093 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:22:04.639192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fc84b69-4734-4211-b21d-59f4b1ec1093 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:22:04.639650 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fc84b69-4734-4211-b21d-59f4b1ec1093 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:22:04.640074 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0fc84b69-4734-4211-b21d-59f4b1ec1093 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:22:04.773697 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0fc84b69-4734-4211-b21d-59f4b1ec1093 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:22:04.784417 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0fc84b69-4734-4211-b21d-59f4b1ec1093 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d" status: 200 len: 1264 microversion: 2.1 time: 0.157527 Aug 24 13:22:04.785239 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2025/4046] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:22:04 2022] GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:22:05.805346 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3c700863-47b6-4368-a9d7-df2994008e7d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:22:05.805960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3c700863-47b6-4368-a9d7-df2994008e7d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:22:05.812888 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c700863-47b6-4368-a9d7-df2994008e7d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:22:05.813374 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c700863-47b6-4368-a9d7-df2994008e7d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:22:05.814124 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c700863-47b6-4368-a9d7-df2994008e7d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:22:05.814487 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c700863-47b6-4368-a9d7-df2994008e7d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:22:05.814962 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c700863-47b6-4368-a9d7-df2994008e7d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:22:05.815388 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3c700863-47b6-4368-a9d7-df2994008e7d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:22:05.953247 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3c700863-47b6-4368-a9d7-df2994008e7d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:22:05.961755 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3c700863-47b6-4368-a9d7-df2994008e7d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d" status: 200 len: 1264 microversion: 2.1 time: 0.159725 Aug 24 13:22:05.962185 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2022/4047] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:22:05 2022] GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:22:06.981823 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-945f81a8-8dc9-40e1-b492-cfc12624cceb tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:22:06.982436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-945f81a8-8dc9-40e1-b492-cfc12624cceb tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:22:06.988806 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-945f81a8-8dc9-40e1-b492-cfc12624cceb tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:22:06.989289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-945f81a8-8dc9-40e1-b492-cfc12624cceb tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:22:06.989726 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-945f81a8-8dc9-40e1-b492-cfc12624cceb tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:22:06.990404 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-945f81a8-8dc9-40e1-b492-cfc12624cceb tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:22:06.990892 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-945f81a8-8dc9-40e1-b492-cfc12624cceb tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:22:06.991320 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-945f81a8-8dc9-40e1-b492-cfc12624cceb tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:22:07.119180 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-945f81a8-8dc9-40e1-b492-cfc12624cceb tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:22:07.126900 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-945f81a8-8dc9-40e1-b492-cfc12624cceb tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d" status: 200 len: 1264 microversion: 2.1 time: 0.149413 Aug 24 13:22:07.127478 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2026/4048] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:22:06 2022] GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:22:07.933394 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-be11a45c-a071-4aeb-a2af-bab12bbf0b5a req-6a30d5d4-286a-4fcf-a6fd-446ac922e9fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b22e30d3-d9df-47d6-a456-205df43da39d", "name": "network-vif-plugged", "status": "completed", "tag": "a0dc5a49-cb5f-4a1d-85df-62bf657f54f3"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:22:07.942997 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-be11a45c-a071-4aeb-a2af-bab12bbf0b5a req-6a30d5d4-286a-4fcf-a6fd-446ac922e9fb service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:22:07.943414 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-be11a45c-a071-4aeb-a2af-bab12bbf0b5a req-6a30d5d4-286a-4fcf-a6fd-446ac922e9fb service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:22:07.943845 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-be11a45c-a071-4aeb-a2af-bab12bbf0b5a req-6a30d5d4-286a-4fcf-a6fd-446ac922e9fb service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:22:07.954931 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-be11a45c-a071-4aeb-a2af-bab12bbf0b5a req-6a30d5d4-286a-4fcf-a6fd-446ac922e9fb service nova] Creating event network-vif-plugged:a0dc5a49-cb5f-4a1d-85df-62bf657f54f3 for instance b22e30d3-d9df-47d6-a456-205df43da39d on hv-cinder-84889 Aug 24 13:22:07.959821 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-be11a45c-a071-4aeb-a2af-bab12bbf0b5a req-6a30d5d4-286a-4fcf-a6fd-446ac922e9fb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030574 Aug 24 13:22:07.960380 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2023/4049] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:22:08.147837 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-be2d48c5-3e74-4180-ba5d-2d3fabe998bd tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:22:08.148446 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-be2d48c5-3e74-4180-ba5d-2d3fabe998bd tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:22:08.155841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be2d48c5-3e74-4180-ba5d-2d3fabe998bd tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:22:08.156331 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be2d48c5-3e74-4180-ba5d-2d3fabe998bd tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:22:08.156770 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be2d48c5-3e74-4180-ba5d-2d3fabe998bd tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:22:08.157456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be2d48c5-3e74-4180-ba5d-2d3fabe998bd tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:22:08.157917 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be2d48c5-3e74-4180-ba5d-2d3fabe998bd tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:22:08.158347 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be2d48c5-3e74-4180-ba5d-2d3fabe998bd tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:22:08.291467 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-be2d48c5-3e74-4180-ba5d-2d3fabe998bd tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:22:08.300049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-be2d48c5-3e74-4180-ba5d-2d3fabe998bd tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d" status: 200 len: 1264 microversion: 2.1 time: 0.156104 Aug 24 13:22:08.303169 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2027/4050] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:22:08 2022] GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:22:09.321879 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-a4d603f4-49a7-4463-9552-e191c1317a1e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:22:09.322573 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-a4d603f4-49a7-4463-9552-e191c1317a1e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:22:09.329310 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a4d603f4-49a7-4463-9552-e191c1317a1e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:22:09.329789 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a4d603f4-49a7-4463-9552-e191c1317a1e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:22:09.330226 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a4d603f4-49a7-4463-9552-e191c1317a1e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:22:09.330940 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a4d603f4-49a7-4463-9552-e191c1317a1e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:22:09.331395 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a4d603f4-49a7-4463-9552-e191c1317a1e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:22:09.331870 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-a4d603f4-49a7-4463-9552-e191c1317a1e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:22:09.465282 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-a4d603f4-49a7-4463-9552-e191c1317a1e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:22:09.471261 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-a4d603f4-49a7-4463-9552-e191c1317a1e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d" status: 200 len: 1264 microversion: 2.1 time: 0.154075 Aug 24 13:22:09.471857 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2024/4051] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:22:09 2022] GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:22:10.491882 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-0f331080-39b2-4fb5-898f-52712fb0536a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:22:10.492489 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-0f331080-39b2-4fb5-898f-52712fb0536a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:22:10.499269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f331080-39b2-4fb5-898f-52712fb0536a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:22:10.499754 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f331080-39b2-4fb5-898f-52712fb0536a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:22:10.500190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f331080-39b2-4fb5-898f-52712fb0536a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:22:10.500870 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f331080-39b2-4fb5-898f-52712fb0536a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:22:10.501349 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f331080-39b2-4fb5-898f-52712fb0536a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:22:10.501776 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-0f331080-39b2-4fb5-898f-52712fb0536a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:22:10.635072 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-0f331080-39b2-4fb5-898f-52712fb0536a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:22:10.643187 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-0f331080-39b2-4fb5-898f-52712fb0536a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d" status: 200 len: 1451 microversion: 2.1 time: 0.155205 Aug 24 13:22:10.643744 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2028/4052] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:22:10 2022] GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:22:10.662723 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-e157681f-2f74-46b3-ac37-0088027fb49a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:22:10.663335 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-e157681f-2f74-46b3-ac37-0088027fb49a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:22:10.670177 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e157681f-2f74-46b3-ac37-0088027fb49a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:22:10.670681 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e157681f-2f74-46b3-ac37-0088027fb49a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:22:10.671113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e157681f-2f74-46b3-ac37-0088027fb49a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:22:10.671794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e157681f-2f74-46b3-ac37-0088027fb49a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:22:10.672245 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e157681f-2f74-46b3-ac37-0088027fb49a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:22:10.672670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-e157681f-2f74-46b3-ac37-0088027fb49a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:22:10.803853 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-e157681f-2f74-46b3-ac37-0088027fb49a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:22:10.812726 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-e157681f-2f74-46b3-ac37-0088027fb49a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d" status: 200 len: 1451 microversion: 2.1 time: 0.153838 Aug 24 13:22:10.813284 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2025/4053] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:22:10 2022] GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:22:12.720224 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-fab25bc1-7e5e-4ed1-b776-4f1a71771c1a req-bea3f361-ba69-4c92-9a9a-efa4be879615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b22e30d3-d9df-47d6-a456-205df43da39d", "tag": "a0dc5a49-cb5f-4a1d-85df-62bf657f54f3"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:22:12.730889 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-fab25bc1-7e5e-4ed1-b776-4f1a71771c1a req-bea3f361-ba69-4c92-9a9a-efa4be879615 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:22:12.731370 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-fab25bc1-7e5e-4ed1-b776-4f1a71771c1a req-bea3f361-ba69-4c92-9a9a-efa4be879615 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:22:12.731801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-fab25bc1-7e5e-4ed1-b776-4f1a71771c1a req-bea3f361-ba69-4c92-9a9a-efa4be879615 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:22:12.743234 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-fab25bc1-7e5e-4ed1-b776-4f1a71771c1a req-bea3f361-ba69-4c92-9a9a-efa4be879615 service nova] Creating event network-changed:a0dc5a49-cb5f-4a1d-85df-62bf657f54f3 for instance b22e30d3-d9df-47d6-a456-205df43da39d on hv-cinder-84889 Aug 24 13:22:12.749072 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-fab25bc1-7e5e-4ed1-b776-4f1a71771c1a req-bea3f361-ba69-4c92-9a9a-efa4be879615 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032508 Aug 24 13:22:12.749711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2029/4054] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:23:23.086342 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:23:23.086939 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 13:23:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:24:26.919027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b6b80c23-6823-4ba7-8f9f-446190311493] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 13:24:26.919835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:24:26.921122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=54 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:24:26.924933 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d48e6f14-52c6-4d89-9111-c663e4c866ea tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:24:26.925449 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d48e6f14-52c6-4d89-9111-c663e4c866ea tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:24:26.931165 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d48e6f14-52c6-4d89-9111-c663e4c866ea tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:26.931644 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d48e6f14-52c6-4d89-9111-c663e4c866ea tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:26.932078 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d48e6f14-52c6-4d89-9111-c663e4c866ea tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:26.932751 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d48e6f14-52c6-4d89-9111-c663e4c866ea tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:26.933198 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d48e6f14-52c6-4d89-9111-c663e4c866ea tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:26.933620 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d48e6f14-52c6-4d89-9111-c663e4c866ea tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:26.957684 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d48e6f14-52c6-4d89-9111-c663e4c866ea tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Going to try to terminate instance {{(pid=121171) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 13:24:27.164336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d48e6f14-52c6-4d89-9111-c663e4c866ea tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [0fda3551-bb5d-4bb2-ba26-d3a1679f86f2] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 13:24:27.927534 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] [b6b80c23-6823-4ba7-8f9f-446190311493] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 50554. Aug 24 13:24:28.172378 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [None req-d48e6f14-52c6-4d89-9111-c663e4c866ea tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [0fda3551-bb5d-4bb2-ba26-d3a1679f86f2] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 50556. Aug 24 13:24:28.252375 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d48e6f14-52c6-4d89-9111-c663e4c866ea tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d" status: 204 len: 0 microversion: 2.1 time: 1.335197 Aug 24 13:24:28.252951 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2026/4055] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 13:24:26 2022] DELETE /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d => generated 0 bytes in 1336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:24:28.259114 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e9b880af-0db7-46d0-80b6-f6e6eac4ce9b] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 13:24:28.259707 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=24 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:24:28.260433 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=56 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:24:28.264854 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-45552c8b-ef15-4cbc-a06f-f59d9a063857 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:24:28.265537 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-45552c8b-ef15-4cbc-a06f-f59d9a063857 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:24:28.271471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45552c8b-ef15-4cbc-a06f-f59d9a063857 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:28.276423 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45552c8b-ef15-4cbc-a06f-f59d9a063857 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:28.276423 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45552c8b-ef15-4cbc-a06f-f59d9a063857 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:28.276423 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45552c8b-ef15-4cbc-a06f-f59d9a063857 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:28.276423 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45552c8b-ef15-4cbc-a06f-f59d9a063857 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:28.276803 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-45552c8b-ef15-4cbc-a06f-f59d9a063857 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:28.455708 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-45552c8b-ef15-4cbc-a06f-f59d9a063857 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:24:28.463329 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-45552c8b-ef15-4cbc-a06f-f59d9a063857 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d" status: 200 len: 1576 microversion: 2.1 time: 0.206041 Aug 24 13:24:28.463879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2030/4056] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:24:28 2022] GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d => generated 1576 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:24:29.485730 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-06263b3e-a117-448c-beb7-f59012d80152 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:24:29.486426 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-06263b3e-a117-448c-beb7-f59012d80152 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:24:29.495852 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-06263b3e-a117-448c-beb7-f59012d80152 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:29.496334 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-06263b3e-a117-448c-beb7-f59012d80152 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:29.496772 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-06263b3e-a117-448c-beb7-f59012d80152 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:29.497454 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-06263b3e-a117-448c-beb7-f59012d80152 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:29.497909 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-06263b3e-a117-448c-beb7-f59012d80152 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:29.498335 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-06263b3e-a117-448c-beb7-f59012d80152 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:29.680997 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-06263b3e-a117-448c-beb7-f59012d80152 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:24:29.688781 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-06263b3e-a117-448c-beb7-f59012d80152 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d" status: 200 len: 1576 microversion: 2.1 time: 0.207793 Aug 24 13:24:29.689335 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2027/4057] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:24:29 2022] GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d => generated 1576 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:24:30.709293 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-dbaa76c0-1249-4b4a-8fda-d52e9d4b8d89 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:24:30.709903 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-dbaa76c0-1249-4b4a-8fda-d52e9d4b8d89 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:24:30.720737 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] [e9b880af-0db7-46d0-80b6-f6e6eac4ce9b] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 50574. Aug 24 13:24:30.725006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dbaa76c0-1249-4b4a-8fda-d52e9d4b8d89 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:30.725503 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dbaa76c0-1249-4b4a-8fda-d52e9d4b8d89 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:30.725945 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dbaa76c0-1249-4b4a-8fda-d52e9d4b8d89 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:30.726666 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dbaa76c0-1249-4b4a-8fda-d52e9d4b8d89 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:30.727138 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dbaa76c0-1249-4b4a-8fda-d52e9d4b8d89 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:30.727566 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-dbaa76c0-1249-4b4a-8fda-d52e9d4b8d89 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:30.866353 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-dbaa76c0-1249-4b4a-8fda-d52e9d4b8d89 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:24:30.875274 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-dbaa76c0-1249-4b4a-8fda-d52e9d4b8d89 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d" status: 200 len: 1576 microversion: 2.1 time: 0.169961 Aug 24 13:24:30.875841 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2031/4058] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:24:30 2022] GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:24:31.329597 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-7094b780-0cda-4022-b8a1-0527a7de5f59 req-5d386915-3079-4146-8b2d-5a20cae3a8b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b22e30d3-d9df-47d6-a456-205df43da39d", "name": "network-vif-deleted", "tag": "a0dc5a49-cb5f-4a1d-85df-62bf657f54f3"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:24:31.339812 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-7094b780-0cda-4022-b8a1-0527a7de5f59 req-5d386915-3079-4146-8b2d-5a20cae3a8b7 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:31.340294 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-7094b780-0cda-4022-b8a1-0527a7de5f59 req-5d386915-3079-4146-8b2d-5a20cae3a8b7 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:31.340737 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-7094b780-0cda-4022-b8a1-0527a7de5f59 req-5d386915-3079-4146-8b2d-5a20cae3a8b7 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:31.362816 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-7094b780-0cda-4022-b8a1-0527a7de5f59 req-5d386915-3079-4146-8b2d-5a20cae3a8b7 service nova] Creating event network-vif-deleted:a0dc5a49-cb5f-4a1d-85df-62bf657f54f3 for instance b22e30d3-d9df-47d6-a456-205df43da39d on hv-cinder-84889 Aug 24 13:24:31.367993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-7094b780-0cda-4022-b8a1-0527a7de5f59 req-5d386915-3079-4146-8b2d-5a20cae3a8b7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100442 Aug 24 13:24:31.368655 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2028/4059] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:24:31.896769 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-eaf860ae-be29-4614-a390-cd20ce9efc49 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:24:31.898862 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-eaf860ae-be29-4614-a390-cd20ce9efc49 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:24:31.905421 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eaf860ae-be29-4614-a390-cd20ce9efc49 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:31.905861 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eaf860ae-be29-4614-a390-cd20ce9efc49 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:31.906297 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eaf860ae-be29-4614-a390-cd20ce9efc49 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:31.907019 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eaf860ae-be29-4614-a390-cd20ce9efc49 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:31.907474 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eaf860ae-be29-4614-a390-cd20ce9efc49 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:31.907897 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-eaf860ae-be29-4614-a390-cd20ce9efc49 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:31.975006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-eaf860ae-be29-4614-a390-cd20ce9efc49 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:24:31.987062 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-eaf860ae-be29-4614-a390-cd20ce9efc49 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d" status: 200 len: 1224 microversion: 2.1 time: 0.094207 Aug 24 13:24:31.987913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2032/4060] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:24:31 2022] GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:24:33.017123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-48001376-9a6d-447d-9eeb-cae9d978d508 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:24:33.017845 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-48001376-9a6d-447d-9eeb-cae9d978d508 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:24:33.023888 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-48001376-9a6d-447d-9eeb-cae9d978d508 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:33.024366 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-48001376-9a6d-447d-9eeb-cae9d978d508 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:33.024806 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-48001376-9a6d-447d-9eeb-cae9d978d508 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:33.025488 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-48001376-9a6d-447d-9eeb-cae9d978d508 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:33.025938 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-48001376-9a6d-447d-9eeb-cae9d978d508 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:33.026359 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-48001376-9a6d-447d-9eeb-cae9d978d508 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:33.039845 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.wsgi [None req-48001376-9a6d-447d-9eeb-cae9d978d508 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] HTTP exception thrown: Instance b22e30d3-d9df-47d6-a456-205df43da39d could not be found. Aug 24 13:24:33.041437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-48001376-9a6d-447d-9eeb-cae9d978d508 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Request method failure captured: Aug 24 13:24:33.041437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: request: GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d HTTP/1.1 Aug 24 13:24:33.041437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept: application/json Aug 24 13:24:33.041437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept-Encoding: identity Aug 24 13:24:33.041437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Connection: close Aug 24 13:24:33.041437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Length: 0 Aug 24 13:24:33.041437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Type: application/json Aug 24 13:24:33.041437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Host: 10.222.0.45 Aug 24 13:24:33.041437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Openstack-System-Scope: None Aug 24 13:24:33.041437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: User-Agent: python-urllib3/1.26.11 Aug 24 13:24:33.041437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Auth-Token: gAAAAABjBiXLudjORddMlp8ho_Zg1O5dKwzV6daRfzIJk9_tcQ3djbbO1yGZNXTMv_r01iDym2ImLEMixjIMCpxGc0L5gdCCZbILxJcUCufIZ-SNbvrYd1s6lnL3rdphV7Y6X8PdU0OUXjZObVggpodJ_mIlw_5WCFFAOoRQ3J6SLbFUGaWmh-A Aug 24 13:24:33.041437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Id: None Aug 24 13:24:33.041437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Name: None Aug 24 13:24:33.041437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Identity-Status: Confirmed Aug 24 13:24:33.041437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Is-Admin-Project: True Aug 24 13:24:33.041437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Id: default Aug 24 13:24:33.041437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Name: Default Aug 24 13:24:33.041437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Id: e4ab80b71d1f4f06b20c597689ae8a2e Aug 24 13:24:33.041437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Name: tempest-TestVolumeBootPattern-136844174 Aug 24 13:24:33.041437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Role: member,reader Aug 24 13:24:33.041437 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Roles: member,reader Aug 24 13:24:33.042813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e4ab80b71d1f4f06b20c597689ae8a2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e4ab80b71d1f4f06b20c597689ae8a2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e4ab80b71d1f4f06b20c597689ae8a2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e4ab80b71d1f4f06b20c597689ae8a2e"}]}] Aug 24 13:24:33.042813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant: tempest-TestVolumeBootPattern-136844174 Aug 24 13:24:33.042813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Id: e4ab80b71d1f4f06b20c597689ae8a2e Aug 24 13:24:33.042813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Name: tempest-TestVolumeBootPattern-136844174 Aug 24 13:24:33.042813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User: tempest-TestVolumeBootPattern-136844174-project Aug 24 13:24:33.042813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Id: default Aug 24 13:24:33.042813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Name: Default Aug 24 13:24:33.042813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Id: cc07ef53f88c4a809deab768daff8132 Aug 24 13:24:33.042813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Name: tempest-TestVolumeBootPattern-136844174-project Aug 24 13:24:33.042813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: method: > Aug 24 13:24:33.042813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: exception: Instance b22e30d3-d9df-47d6-a456-205df43da39d could not be found. Aug 24 13:24:33.042813 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: action_args: {'id': 'b22e30d3-d9df-47d6-a456-205df43da39d'} Aug 24 13:24:33.043664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:24:33.043664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:24:33.043664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:24:33.043664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:24:33.043664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:24:33.043664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:24:33.043664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:24:33.043664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:24:33.043664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:24:33.043664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:24:33.043664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b22e30d3-d9df-47d6-a456-205df43da39d could not be found. Aug 24 13:24:33.043664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:24:33.043664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:24:33.043664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:24:33.043664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:24:33.043664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:24:33.043664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:24:33.043664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:24:33.043664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:24:33.043664 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:24:33.045110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:24:33.045110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:24:33.045110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:24:33.045110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:24:33.045110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:24:33.045110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:24:33.045110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:24:33.045110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b22e30d3-d9df-47d6-a456-205df43da39d could not be found. Aug 24 13:24:33.045110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:24:33.045110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:24:33.045110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:24:33.045110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:24:33.045110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:24:33.045110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:24:33.045110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:24:33.045110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:24:33.045110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b22e30d3-d9df-47d6-a456-205df43da39d could not be found. Aug 24 13:24:33.045110 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:24:33.046510 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-48001376-9a6d-447d-9eeb-cae9d978d508 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Returning 404 to user: Instance b22e30d3-d9df-47d6-a456-205df43da39d could not be found. {{(pid=121171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:24:33.046510 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-48001376-9a6d-447d-9eeb-cae9d978d508 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d" status: 404 len: 111 microversion: 2.1 time: 0.030890 Aug 24 13:24:33.046510 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2029/4061] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:24:33 2022] GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:24:33.089401 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-a7f9b9bb-335d-4208-ac55-845345c38556 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1225148922", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-897906530", "security_groups": [{"name": "tempest-secgroup-smoke-878579104"}], "block_device_mapping_v2": [{"uuid": "6224c435-8ad9-4c9f-8539-50daa3a2c675", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7ce5b031-607c-4454-8881-f77d4334dcf2"}]}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:24:33.199329 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.network.neutron [None req-a7f9b9bb-335d-4208-ac55-845345c38556 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] validate_networks() for [('7ce5b031-607c-4454-8881-f77d4334dcf2', None, None, None, None, None)] {{(pid=121170) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:24:33.607295 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-a7f9b9bb-335d-4208-ac55-845345c38556 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Flavor limits 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:24:33.607740 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-a7f9b9bb-335d-4208-ac55-845345c38556 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Image limits 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:24:33.608372 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-a7f9b9bb-335d-4208-ac55-845345c38556 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Flavor pref 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:24:33.608929 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-a7f9b9bb-335d-4208-ac55-845345c38556 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Image pref 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:24:33.609518 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-a7f9b9bb-335d-4208-ac55-845345c38556 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:24:33.619601 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7f9b9bb-335d-4208-ac55-845345c38556 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:33.620081 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7f9b9bb-335d-4208-ac55-845345c38556 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:33.620515 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7f9b9bb-335d-4208-ac55-845345c38556 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:33.621233 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7f9b9bb-335d-4208-ac55-845345c38556 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:33.621685 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7f9b9bb-335d-4208-ac55-845345c38556 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:33.622106 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-a7f9b9bb-335d-4208-ac55-845345c38556 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:33.638891 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-a7f9b9bb-335d-4208-ac55-845345c38556 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Getting quotas for project e4ab80b71d1f4f06b20c597689ae8a2e. Resources: {'instances', 'cores', 'ram'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:24:33.643489 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-a7f9b9bb-335d-4208-ac55-845345c38556 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Getting quotas for user cc07ef53f88c4a809deab768daff8132 and project e4ab80b71d1f4f06b20c597689ae8a2e. Resources: {'instances', 'cores', 'ram'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:24:33.698321 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a7f9b9bb-335d-4208-ac55-845345c38556 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Going to run 1 instances... {{(pid=121170) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 13:24:33.700447 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-a7f9b9bb-335d-4208-ac55-845345c38556 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: 08842333-bf50-4664-9f30-7a368506547a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6224c435-8ad9-4c9f-8539-50daa3a2c675',volume_size=None,volume_type=None)] {{(pid=121170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 13:24:34.105050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-a7f9b9bb-335d-4208-ac55-845345c38556 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.019449 Aug 24 13:24:34.110711 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2033/4062] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 13:24:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 13:24:34.116892 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d19ab59b-706f-4411-88bf-4e43aee66caa tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:24:34.117512 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d19ab59b-706f-4411-88bf-4e43aee66caa tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: 08842333-bf50-4664-9f30-7a368506547a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:24:34.175800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d19ab59b-706f-4411-88bf-4e43aee66caa tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:24:34.182637 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d19ab59b-706f-4411-88bf-4e43aee66caa tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a" status: 200 len: 1094 microversion: 2.1 time: 0.069637 Aug 24 13:24:34.183383 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2030/4063] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:24:34 2022] GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:24:35.203311 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-322053b8-beca-4ab4-8bfb-a01d3e71ab0c tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:24:35.203846 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-322053b8-beca-4ab4-8bfb-a01d3e71ab0c tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: 08842333-bf50-4664-9f30-7a368506547a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:24:35.210479 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-322053b8-beca-4ab4-8bfb-a01d3e71ab0c tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:35.214855 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-322053b8-beca-4ab4-8bfb-a01d3e71ab0c tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:35.214855 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-322053b8-beca-4ab4-8bfb-a01d3e71ab0c tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:35.214855 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-322053b8-beca-4ab4-8bfb-a01d3e71ab0c tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:35.214855 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-322053b8-beca-4ab4-8bfb-a01d3e71ab0c tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:35.215215 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-322053b8-beca-4ab4-8bfb-a01d3e71ab0c tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:35.273703 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-322053b8-beca-4ab4-8bfb-a01d3e71ab0c tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:24:35.281853 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-322053b8-beca-4ab4-8bfb-a01d3e71ab0c tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a" status: 200 len: 1144 microversion: 2.1 time: 0.082993 Aug 24 13:24:35.282500 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2034/4064] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:24:35 2022] GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:24:36.301944 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ad8e05a1-25f0-4627-9924-a44d6a1aa54e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:24:36.302617 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ad8e05a1-25f0-4627-9924-a44d6a1aa54e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: 08842333-bf50-4664-9f30-7a368506547a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:24:36.309723 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ad8e05a1-25f0-4627-9924-a44d6a1aa54e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:36.310261 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ad8e05a1-25f0-4627-9924-a44d6a1aa54e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:36.310718 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ad8e05a1-25f0-4627-9924-a44d6a1aa54e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:36.311610 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ad8e05a1-25f0-4627-9924-a44d6a1aa54e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:36.312068 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ad8e05a1-25f0-4627-9924-a44d6a1aa54e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:36.312490 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ad8e05a1-25f0-4627-9924-a44d6a1aa54e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:36.374287 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ad8e05a1-25f0-4627-9924-a44d6a1aa54e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:24:36.382172 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ad8e05a1-25f0-4627-9924-a44d6a1aa54e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a" status: 200 len: 1210 microversion: 2.1 time: 0.084015 Aug 24 13:24:36.383272 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2031/4065] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:24:36 2022] GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:24:37.404232 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e5bb42d8-fd46-484f-8ad9-f4eea3d99757 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:24:37.405362 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e5bb42d8-fd46-484f-8ad9-f4eea3d99757 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: 08842333-bf50-4664-9f30-7a368506547a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:24:37.412470 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e5bb42d8-fd46-484f-8ad9-f4eea3d99757 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:37.413190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e5bb42d8-fd46-484f-8ad9-f4eea3d99757 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:37.413813 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e5bb42d8-fd46-484f-8ad9-f4eea3d99757 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:37.414704 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e5bb42d8-fd46-484f-8ad9-f4eea3d99757 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:37.415350 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e5bb42d8-fd46-484f-8ad9-f4eea3d99757 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:37.415996 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e5bb42d8-fd46-484f-8ad9-f4eea3d99757 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:37.562853 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e5bb42d8-fd46-484f-8ad9-f4eea3d99757 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:24:37.570507 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e5bb42d8-fd46-484f-8ad9-f4eea3d99757 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a" status: 200 len: 1277 microversion: 2.1 time: 0.170158 Aug 24 13:24:37.577504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2035/4066] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:24:37 2022] GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:24:37.692235 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-0a317d35-48f8-4dd4-9735-5eaffefad322 req-1716c990-1346-400c-bfac-bca455cd9a90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08842333-bf50-4664-9f30-7a368506547a", "tag": "659f4cbc-6b02-4aca-9cf5-522508e54ef8"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:24:37.703375 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-0a317d35-48f8-4dd4-9735-5eaffefad322 req-1716c990-1346-400c-bfac-bca455cd9a90 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:37.704033 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-0a317d35-48f8-4dd4-9735-5eaffefad322 req-1716c990-1346-400c-bfac-bca455cd9a90 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:37.704466 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-0a317d35-48f8-4dd4-9735-5eaffefad322 req-1716c990-1346-400c-bfac-bca455cd9a90 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:37.716800 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-0a317d35-48f8-4dd4-9735-5eaffefad322 req-1716c990-1346-400c-bfac-bca455cd9a90 service nova] Creating event network-changed:659f4cbc-6b02-4aca-9cf5-522508e54ef8 for instance 08842333-bf50-4664-9f30-7a368506547a on hv-cinder-84889 Aug 24 13:24:37.722446 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-0a317d35-48f8-4dd4-9735-5eaffefad322 req-1716c990-1346-400c-bfac-bca455cd9a90 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034075 Aug 24 13:24:37.723051 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2032/4067] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:24:38.591941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-ac97ddf6-5295-4f19-a1ac-0f96d87d40f8 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:24:38.592598 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-ac97ddf6-5295-4f19-a1ac-0f96d87d40f8 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: 08842333-bf50-4664-9f30-7a368506547a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:24:38.599008 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac97ddf6-5295-4f19-a1ac-0f96d87d40f8 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:38.599438 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac97ddf6-5295-4f19-a1ac-0f96d87d40f8 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:38.599873 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac97ddf6-5295-4f19-a1ac-0f96d87d40f8 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:38.600558 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac97ddf6-5295-4f19-a1ac-0f96d87d40f8 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:38.601016 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac97ddf6-5295-4f19-a1ac-0f96d87d40f8 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:38.601443 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-ac97ddf6-5295-4f19-a1ac-0f96d87d40f8 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:38.732593 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-ac97ddf6-5295-4f19-a1ac-0f96d87d40f8 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:24:38.741090 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-ac97ddf6-5295-4f19-a1ac-0f96d87d40f8 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a" status: 200 len: 1265 microversion: 2.1 time: 0.152979 Aug 24 13:24:38.741666 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2036/4068] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:24:38 2022] GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:24:39.763700 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c0d2e746-e33e-4237-876c-980a22e1a71d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:24:39.764444 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c0d2e746-e33e-4237-876c-980a22e1a71d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: 08842333-bf50-4664-9f30-7a368506547a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:24:39.770960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0d2e746-e33e-4237-876c-980a22e1a71d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:39.771441 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0d2e746-e33e-4237-876c-980a22e1a71d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:39.771876 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0d2e746-e33e-4237-876c-980a22e1a71d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:39.772546 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0d2e746-e33e-4237-876c-980a22e1a71d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:39.772991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0d2e746-e33e-4237-876c-980a22e1a71d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:39.773411 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c0d2e746-e33e-4237-876c-980a22e1a71d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:39.907139 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-c0d2e746-e33e-4237-876c-980a22e1a71d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:24:39.914555 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c0d2e746-e33e-4237-876c-980a22e1a71d tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a" status: 200 len: 1265 microversion: 2.1 time: 0.155116 Aug 24 13:24:39.915125 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2033/4069] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:24:39 2022] GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:24:40.935364 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-019a351e-2402-46b0-89fc-77bfeee56226 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:24:40.935971 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-019a351e-2402-46b0-89fc-77bfeee56226 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: 08842333-bf50-4664-9f30-7a368506547a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:24:40.942256 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-019a351e-2402-46b0-89fc-77bfeee56226 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:40.942763 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-019a351e-2402-46b0-89fc-77bfeee56226 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:40.943197 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-019a351e-2402-46b0-89fc-77bfeee56226 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:40.943876 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-019a351e-2402-46b0-89fc-77bfeee56226 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:40.944327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-019a351e-2402-46b0-89fc-77bfeee56226 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:40.944748 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-019a351e-2402-46b0-89fc-77bfeee56226 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:41.076030 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-019a351e-2402-46b0-89fc-77bfeee56226 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:24:41.083628 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-019a351e-2402-46b0-89fc-77bfeee56226 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a" status: 200 len: 1265 microversion: 2.1 time: 0.152126 Aug 24 13:24:41.084174 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2037/4070] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:24:40 2022] GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:24:42.104699 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-bedfcdfc-366e-4f8c-a07d-25d994f89d9c tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:24:42.105308 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-bedfcdfc-366e-4f8c-a07d-25d994f89d9c tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: 08842333-bf50-4664-9f30-7a368506547a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:24:42.112186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bedfcdfc-366e-4f8c-a07d-25d994f89d9c tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:42.112669 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bedfcdfc-366e-4f8c-a07d-25d994f89d9c tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:42.113111 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bedfcdfc-366e-4f8c-a07d-25d994f89d9c tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:42.113794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bedfcdfc-366e-4f8c-a07d-25d994f89d9c tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:42.114253 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bedfcdfc-366e-4f8c-a07d-25d994f89d9c tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:42.114717 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-bedfcdfc-366e-4f8c-a07d-25d994f89d9c tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:42.244376 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-bedfcdfc-366e-4f8c-a07d-25d994f89d9c tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:24:42.252408 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-bedfcdfc-366e-4f8c-a07d-25d994f89d9c tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a" status: 200 len: 1265 microversion: 2.1 time: 0.151658 Aug 24 13:24:42.252960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2034/4071] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:24:42 2022] GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:24:43.273624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-937a3dd0-eed6-4c12-b825-1176b1e5e364 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:24:43.274232 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-937a3dd0-eed6-4c12-b825-1176b1e5e364 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: 08842333-bf50-4664-9f30-7a368506547a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:24:43.281099 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-937a3dd0-eed6-4c12-b825-1176b1e5e364 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:43.281581 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-937a3dd0-eed6-4c12-b825-1176b1e5e364 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:43.282018 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-937a3dd0-eed6-4c12-b825-1176b1e5e364 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:43.282722 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-937a3dd0-eed6-4c12-b825-1176b1e5e364 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:43.283182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-937a3dd0-eed6-4c12-b825-1176b1e5e364 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:43.283605 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-937a3dd0-eed6-4c12-b825-1176b1e5e364 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:43.412225 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-937a3dd0-eed6-4c12-b825-1176b1e5e364 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:24:43.419954 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-937a3dd0-eed6-4c12-b825-1176b1e5e364 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a" status: 200 len: 1265 microversion: 2.1 time: 0.150218 Aug 24 13:24:43.421073 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2038/4072] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:24:43 2022] GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:24:44.441273 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-de5fcbfa-980b-4f71-ba7b-4010b27ffce3 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:24:44.441883 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-de5fcbfa-980b-4f71-ba7b-4010b27ffce3 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: 08842333-bf50-4664-9f30-7a368506547a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:24:44.444251 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=2 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:24:44.448960 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de5fcbfa-980b-4f71-ba7b-4010b27ffce3 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:44.449445 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de5fcbfa-980b-4f71-ba7b-4010b27ffce3 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:44.449875 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de5fcbfa-980b-4f71-ba7b-4010b27ffce3 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:44.455809 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de5fcbfa-980b-4f71-ba7b-4010b27ffce3 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:44.455809 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de5fcbfa-980b-4f71-ba7b-4010b27ffce3 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:44.455809 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-de5fcbfa-980b-4f71-ba7b-4010b27ffce3 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:44.588144 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-de5fcbfa-980b-4f71-ba7b-4010b27ffce3 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:24:44.596321 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-de5fcbfa-980b-4f71-ba7b-4010b27ffce3 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a" status: 200 len: 1265 microversion: 2.1 time: 0.158914 Aug 24 13:24:44.596872 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2035/4073] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:24:44 2022] GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:24:45.616647 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-30de362a-e74d-4621-ab35-3b6758427e5f tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:24:45.617267 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-30de362a-e74d-4621-ab35-3b6758427e5f tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: 08842333-bf50-4664-9f30-7a368506547a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:24:45.619085 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell0:SELECT=2 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:24:45.619758 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell0:SELECT=6 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:24:45.625720 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30de362a-e74d-4621-ab35-3b6758427e5f tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:45.626210 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30de362a-e74d-4621-ab35-3b6758427e5f tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:45.626723 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30de362a-e74d-4621-ab35-3b6758427e5f tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:45.632821 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30de362a-e74d-4621-ab35-3b6758427e5f tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:45.632821 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30de362a-e74d-4621-ab35-3b6758427e5f tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:45.632821 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-30de362a-e74d-4621-ab35-3b6758427e5f tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:45.760476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-30de362a-e74d-4621-ab35-3b6758427e5f tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:24:45.768202 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-30de362a-e74d-4621-ab35-3b6758427e5f tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a" status: 200 len: 1265 microversion: 2.1 time: 0.155642 Aug 24 13:24:45.768761 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2039/4074] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:24:45 2022] GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:24:46.788536 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-d9d1e7b7-55ef-48b3-bf26-2e3713e73f19 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:24:46.789141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-d9d1e7b7-55ef-48b3-bf26-2e3713e73f19 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: 08842333-bf50-4664-9f30-7a368506547a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:24:46.795469 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d9d1e7b7-55ef-48b3-bf26-2e3713e73f19 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:46.795982 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d9d1e7b7-55ef-48b3-bf26-2e3713e73f19 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:46.796417 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d9d1e7b7-55ef-48b3-bf26-2e3713e73f19 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:46.797132 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d9d1e7b7-55ef-48b3-bf26-2e3713e73f19 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:46.797585 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d9d1e7b7-55ef-48b3-bf26-2e3713e73f19 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:46.798009 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-d9d1e7b7-55ef-48b3-bf26-2e3713e73f19 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:46.924993 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-d9d1e7b7-55ef-48b3-bf26-2e3713e73f19 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:24:46.932531 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-d9d1e7b7-55ef-48b3-bf26-2e3713e73f19 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a" status: 200 len: 1265 microversion: 2.1 time: 0.147918 Aug 24 13:24:46.933086 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2036/4075] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:24:46 2022] GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:24:47.953364 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-04eddaaf-4ea7-4428-9bf2-53bf52fd2a42 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:24:47.953973 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-04eddaaf-4ea7-4428-9bf2-53bf52fd2a42 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: 08842333-bf50-4664-9f30-7a368506547a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:24:47.960400 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-04eddaaf-4ea7-4428-9bf2-53bf52fd2a42 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:47.960889 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-04eddaaf-4ea7-4428-9bf2-53bf52fd2a42 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:47.961327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-04eddaaf-4ea7-4428-9bf2-53bf52fd2a42 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:47.962015 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-04eddaaf-4ea7-4428-9bf2-53bf52fd2a42 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:47.962475 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-04eddaaf-4ea7-4428-9bf2-53bf52fd2a42 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:47.962931 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-04eddaaf-4ea7-4428-9bf2-53bf52fd2a42 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:48.094488 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-04eddaaf-4ea7-4428-9bf2-53bf52fd2a42 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:24:48.102033 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-04eddaaf-4ea7-4428-9bf2-53bf52fd2a42 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a" status: 200 len: 1265 microversion: 2.1 time: 0.152585 Aug 24 13:24:48.102593 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2040/4076] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:24:47 2022] GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:24:49.122001 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fd4e524c-6b27-40d5-b53a-93476828e78e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:24:49.122538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fd4e524c-6b27-40d5-b53a-93476828e78e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: 08842333-bf50-4664-9f30-7a368506547a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:24:49.129991 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd4e524c-6b27-40d5-b53a-93476828e78e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:49.130479 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd4e524c-6b27-40d5-b53a-93476828e78e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:49.130949 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd4e524c-6b27-40d5-b53a-93476828e78e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:49.131645 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd4e524c-6b27-40d5-b53a-93476828e78e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:49.132103 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd4e524c-6b27-40d5-b53a-93476828e78e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:49.132530 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd4e524c-6b27-40d5-b53a-93476828e78e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:49.264878 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-fd4e524c-6b27-40d5-b53a-93476828e78e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:24:49.272515 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fd4e524c-6b27-40d5-b53a-93476828e78e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a" status: 200 len: 1265 microversion: 2.1 time: 0.154510 Aug 24 13:24:49.273068 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2037/4077] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:24:49 2022] GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:24:50.292584 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-98a3d95e-8b2d-42f1-932c-9a2c824fccff tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:24:50.293196 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-98a3d95e-8b2d-42f1-932c-9a2c824fccff tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: 08842333-bf50-4664-9f30-7a368506547a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:24:50.300141 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-98a3d95e-8b2d-42f1-932c-9a2c824fccff tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:50.300626 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-98a3d95e-8b2d-42f1-932c-9a2c824fccff tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:50.301056 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-98a3d95e-8b2d-42f1-932c-9a2c824fccff tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:50.301787 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-98a3d95e-8b2d-42f1-932c-9a2c824fccff tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:50.302240 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-98a3d95e-8b2d-42f1-932c-9a2c824fccff tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:50.302683 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-98a3d95e-8b2d-42f1-932c-9a2c824fccff tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:50.435207 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-98a3d95e-8b2d-42f1-932c-9a2c824fccff tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:24:50.444067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-98a3d95e-8b2d-42f1-932c-9a2c824fccff tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a" status: 200 len: 1265 microversion: 2.1 time: 0.155344 Aug 24 13:24:50.449792 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2041/4078] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:24:50 2022] GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:24:50.558890 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-2ed2a8e2-9e47-49f6-9355-36f3bd44f43a req-b73cff11-a965-41b8-ae86-abee17df8637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08842333-bf50-4664-9f30-7a368506547a", "name": "network-vif-plugged", "status": "completed", "tag": "659f4cbc-6b02-4aca-9cf5-522508e54ef8"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:24:50.568694 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-2ed2a8e2-9e47-49f6-9355-36f3bd44f43a req-b73cff11-a965-41b8-ae86-abee17df8637 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:50.569159 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-2ed2a8e2-9e47-49f6-9355-36f3bd44f43a req-b73cff11-a965-41b8-ae86-abee17df8637 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:50.569583 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-2ed2a8e2-9e47-49f6-9355-36f3bd44f43a req-b73cff11-a965-41b8-ae86-abee17df8637 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:50.585074 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-2ed2a8e2-9e47-49f6-9355-36f3bd44f43a req-b73cff11-a965-41b8-ae86-abee17df8637 service nova] Creating event network-vif-plugged:659f4cbc-6b02-4aca-9cf5-522508e54ef8 for instance 08842333-bf50-4664-9f30-7a368506547a on hv-cinder-84889 Aug 24 13:24:50.586895 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-2ed2a8e2-9e47-49f6-9355-36f3bd44f43a req-b73cff11-a965-41b8-ae86-abee17df8637 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084169 Aug 24 13:24:50.587472 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2038/4079] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:24:51.465104 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-9b188a1c-4bfb-4c62-9f93-bc92464b2ec7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:24:51.465712 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-9b188a1c-4bfb-4c62-9f93-bc92464b2ec7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: 08842333-bf50-4664-9f30-7a368506547a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:24:51.472543 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9b188a1c-4bfb-4c62-9f93-bc92464b2ec7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:51.473026 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9b188a1c-4bfb-4c62-9f93-bc92464b2ec7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:51.473616 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9b188a1c-4bfb-4c62-9f93-bc92464b2ec7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:51.474313 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9b188a1c-4bfb-4c62-9f93-bc92464b2ec7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:51.474879 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9b188a1c-4bfb-4c62-9f93-bc92464b2ec7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:51.475305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-9b188a1c-4bfb-4c62-9f93-bc92464b2ec7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:51.606524 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-9b188a1c-4bfb-4c62-9f93-bc92464b2ec7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:24:51.614107 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-9b188a1c-4bfb-4c62-9f93-bc92464b2ec7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a" status: 200 len: 1265 microversion: 2.1 time: 0.152929 Aug 24 13:24:51.614679 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2042/4080] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:24:51 2022] GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:24:52.635959 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ed8697f8-d490-4ea4-af60-69f580aa44f6 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:24:52.636574 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ed8697f8-d490-4ea4-af60-69f580aa44f6 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: 08842333-bf50-4664-9f30-7a368506547a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:24:52.643627 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ed8697f8-d490-4ea4-af60-69f580aa44f6 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:52.644107 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ed8697f8-d490-4ea4-af60-69f580aa44f6 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:52.644552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ed8697f8-d490-4ea4-af60-69f580aa44f6 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:52.645223 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ed8697f8-d490-4ea4-af60-69f580aa44f6 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:52.645674 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ed8697f8-d490-4ea4-af60-69f580aa44f6 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:52.646097 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ed8697f8-d490-4ea4-af60-69f580aa44f6 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:52.776507 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ed8697f8-d490-4ea4-af60-69f580aa44f6 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:24:52.784834 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ed8697f8-d490-4ea4-af60-69f580aa44f6 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a" status: 200 len: 1451 microversion: 2.1 time: 0.153189 Aug 24 13:24:52.785387 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2039/4081] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:24:52 2022] GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:24:52.804611 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-790dcbec-a2c9-471b-897a-a0d451a73ee6 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:24:52.810439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-790dcbec-a2c9-471b-897a-a0d451a73ee6 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: 08842333-bf50-4664-9f30-7a368506547a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:24:52.811717 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-790dcbec-a2c9-471b-897a-a0d451a73ee6 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:52.812202 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-790dcbec-a2c9-471b-897a-a0d451a73ee6 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:52.812636 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-790dcbec-a2c9-471b-897a-a0d451a73ee6 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:52.813326 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-790dcbec-a2c9-471b-897a-a0d451a73ee6 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:52.813782 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-790dcbec-a2c9-471b-897a-a0d451a73ee6 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:52.814210 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-790dcbec-a2c9-471b-897a-a0d451a73ee6 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:52.941543 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-790dcbec-a2c9-471b-897a-a0d451a73ee6 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:24:52.949214 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-790dcbec-a2c9-471b-897a-a0d451a73ee6 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a" status: 200 len: 1451 microversion: 2.1 time: 0.148421 Aug 24 13:24:52.949771 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2043/4082] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:24:52 2022] GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:24:54.860533 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-232b72c6-08a0-4834-a214-f6889038ea57 req-138cc54d-7403-4c68-9548-8e4bc63ecc6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08842333-bf50-4664-9f30-7a368506547a", "tag": "659f4cbc-6b02-4aca-9cf5-522508e54ef8"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:24:54.870489 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-232b72c6-08a0-4834-a214-f6889038ea57 req-138cc54d-7403-4c68-9548-8e4bc63ecc6a service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:24:54.871030 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-232b72c6-08a0-4834-a214-f6889038ea57 req-138cc54d-7403-4c68-9548-8e4bc63ecc6a service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:24:54.871457 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-232b72c6-08a0-4834-a214-f6889038ea57 req-138cc54d-7403-4c68-9548-8e4bc63ecc6a service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:24:54.883295 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-232b72c6-08a0-4834-a214-f6889038ea57 req-138cc54d-7403-4c68-9548-8e4bc63ecc6a service nova] Creating event network-changed:659f4cbc-6b02-4aca-9cf5-522508e54ef8 for instance 08842333-bf50-4664-9f30-7a368506547a on hv-cinder-84889 Aug 24 13:24:54.888278 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-232b72c6-08a0-4834-a214-f6889038ea57 req-138cc54d-7403-4c68-9548-8e4bc63ecc6a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031383 Aug 24 13:24:54.890077 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2040/4083] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:25:27.931533 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:25:27.932147 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 13:25:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:26:39.308697 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:26:39.309389 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 13:26:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:26:43.095411 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:26:43.095969 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 13:26:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:26:52.157614 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:26:52.158684 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 13:26:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:26:52.665647 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:26:52.666090 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 13:26:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:26:56.200123 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:26:56.200867 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=80 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:26:56.204747 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-3ba7ec58-b45a-4a70-8d52-e7a318a17635 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1160561605", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-897906530", "security_groups": [{"name": "tempest-secgroup-smoke-878579104"}], "block_device_mapping_v2": [{"uuid": "6bb5bd36-c5f6-4dcf-9bab-6b4594efbf46", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7ce5b031-607c-4454-8881-f77d4334dcf2"}]}} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:26:56.320211 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.network.neutron [None req-3ba7ec58-b45a-4a70-8d52-e7a318a17635 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] validate_networks() for [('7ce5b031-607c-4454-8881-f77d4334dcf2', None, None, None, None, None)] {{(pid=121170) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:26:56.692300 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-3ba7ec58-b45a-4a70-8d52-e7a318a17635 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Flavor limits 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:26:56.692750 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-3ba7ec58-b45a-4a70-8d52-e7a318a17635 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Image limits 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:26:56.693223 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-3ba7ec58-b45a-4a70-8d52-e7a318a17635 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Flavor pref 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:26:56.693630 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-3ba7ec58-b45a-4a70-8d52-e7a318a17635 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Image pref 0:0:0 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:26:56.694040 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.virt.hardware [None req-3ba7ec58-b45a-4a70-8d52-e7a318a17635 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:26:56.702495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ba7ec58-b45a-4a70-8d52-e7a318a17635 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:26:56.703004 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ba7ec58-b45a-4a70-8d52-e7a318a17635 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:26:56.703442 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ba7ec58-b45a-4a70-8d52-e7a318a17635 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:26:56.704165 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ba7ec58-b45a-4a70-8d52-e7a318a17635 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:26:56.704613 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ba7ec58-b45a-4a70-8d52-e7a318a17635 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:26:56.705034 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-3ba7ec58-b45a-4a70-8d52-e7a318a17635 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:26:56.722456 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-3ba7ec58-b45a-4a70-8d52-e7a318a17635 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Getting quotas for project e4ab80b71d1f4f06b20c597689ae8a2e. Resources: {'instances', 'cores', 'ram'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:26:56.726207 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.quota [None req-3ba7ec58-b45a-4a70-8d52-e7a318a17635 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Getting quotas for user cc07ef53f88c4a809deab768daff8132 and project e4ab80b71d1f4f06b20c597689ae8a2e. Resources: {'instances', 'cores', 'ram'} {{(pid=121170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:26:56.783066 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3ba7ec58-b45a-4a70-8d52-e7a318a17635 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Going to run 1 instances... {{(pid=121170) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 13:26:56.785067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-3ba7ec58-b45a-4a70-8d52-e7a318a17635 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: d116ff28-faa0-4c91-bbfb-71198e61d95a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6bb5bd36-c5f6-4dcf-9bab-6b4594efbf46',volume_size=None,volume_type=None)] {{(pid=121170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 13:26:57.167632 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-3ba7ec58-b45a-4a70-8d52-e7a318a17635 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.969151 Aug 24 13:26:57.168262 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2044/4084] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 24 13:26:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 13:26:57.177988 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b6b80c23-6823-4ba7-8f9f-446190311493] AMQP server on 10.222.0.45:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 24 13:26:57.178593 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:26:57.179443 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:26:57.183749 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-48cfe524-6fb7-4cf7-8e9e-fc667ae7888c tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:26:57.188519 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-48cfe524-6fb7-4cf7-8e9e-fc667ae7888c tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: d116ff28-faa0-4c91-bbfb-71198e61d95a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:26:57.239574 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-48cfe524-6fb7-4cf7-8e9e-fc667ae7888c tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:26:57.246598 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-48cfe524-6fb7-4cf7-8e9e-fc667ae7888c tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a" status: 200 len: 1094 microversion: 2.1 time: 0.070708 Aug 24 13:26:57.247168 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2041/4085] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:26:57 2022] GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:26:58.269046 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-137f7680-510f-4515-b813-e33360171db2 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:26:58.269589 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-137f7680-510f-4515-b813-e33360171db2 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: d116ff28-faa0-4c91-bbfb-71198e61d95a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:26:58.276203 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-137f7680-510f-4515-b813-e33360171db2 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:26:58.276702 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-137f7680-510f-4515-b813-e33360171db2 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:26:58.277135 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-137f7680-510f-4515-b813-e33360171db2 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:26:58.277832 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-137f7680-510f-4515-b813-e33360171db2 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:26:58.278292 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-137f7680-510f-4515-b813-e33360171db2 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:26:58.278737 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-137f7680-510f-4515-b813-e33360171db2 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:26:58.347644 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-137f7680-510f-4515-b813-e33360171db2 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:26:58.355795 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-137f7680-510f-4515-b813-e33360171db2 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a" status: 200 len: 1144 microversion: 2.1 time: 0.092107 Aug 24 13:26:58.356387 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2045/4086] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:26:58 2022] GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:26:59.377571 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-ef28a974-9028-4206-b3b7-68bcdf455c2e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:26:59.378792 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-ef28a974-9028-4206-b3b7-68bcdf455c2e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: d116ff28-faa0-4c91-bbfb-71198e61d95a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:26:59.391951 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] [b6b80c23-6823-4ba7-8f9f-446190311493] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 50808. Aug 24 13:26:59.393640 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef28a974-9028-4206-b3b7-68bcdf455c2e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:26:59.394119 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef28a974-9028-4206-b3b7-68bcdf455c2e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:26:59.394553 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef28a974-9028-4206-b3b7-68bcdf455c2e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:26:59.395277 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef28a974-9028-4206-b3b7-68bcdf455c2e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:26:59.395751 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef28a974-9028-4206-b3b7-68bcdf455c2e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:26:59.400094 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-ef28a974-9028-4206-b3b7-68bcdf455c2e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:26:59.462864 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-ef28a974-9028-4206-b3b7-68bcdf455c2e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:26:59.471361 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-ef28a974-9028-4206-b3b7-68bcdf455c2e tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a" status: 200 len: 1192 microversion: 2.1 time: 0.098301 Aug 24 13:26:59.472420 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2042/4087] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:26:59 2022] GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a => generated 1192 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:27:00.492644 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-95ed56b0-0a60-4c83-bbef-521e5ad174e7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:27:00.493708 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-95ed56b0-0a60-4c83-bbef-521e5ad174e7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: d116ff28-faa0-4c91-bbfb-71198e61d95a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:27:00.500255 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95ed56b0-0a60-4c83-bbef-521e5ad174e7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:00.500741 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95ed56b0-0a60-4c83-bbef-521e5ad174e7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:00.501185 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95ed56b0-0a60-4c83-bbef-521e5ad174e7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:00.501882 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95ed56b0-0a60-4c83-bbef-521e5ad174e7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:00.502343 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95ed56b0-0a60-4c83-bbef-521e5ad174e7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:00.502803 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-95ed56b0-0a60-4c83-bbef-521e5ad174e7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:00.644560 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-95ed56b0-0a60-4c83-bbef-521e5ad174e7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:27:00.652607 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-95ed56b0-0a60-4c83-bbef-521e5ad174e7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a" status: 200 len: 1277 microversion: 2.1 time: 0.163763 Aug 24 13:27:00.657898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2046/4088] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:27:00 2022] GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:27:01.493773 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-9bc0e4ba-d9c9-4277-a406-f6e4702d37ea req-82ddb478-ef95-4b0a-afc6-df9fe22ead05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d116ff28-faa0-4c91-bbfb-71198e61d95a", "tag": "4c8d95b1-b587-4737-a520-78a88a061d80"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:27:01.504763 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-9bc0e4ba-d9c9-4277-a406-f6e4702d37ea req-82ddb478-ef95-4b0a-afc6-df9fe22ead05 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:01.505886 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-9bc0e4ba-d9c9-4277-a406-f6e4702d37ea req-82ddb478-ef95-4b0a-afc6-df9fe22ead05 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:01.506340 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-9bc0e4ba-d9c9-4277-a406-f6e4702d37ea req-82ddb478-ef95-4b0a-afc6-df9fe22ead05 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:01.517134 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-9bc0e4ba-d9c9-4277-a406-f6e4702d37ea req-82ddb478-ef95-4b0a-afc6-df9fe22ead05 service nova] Creating event network-changed:4c8d95b1-b587-4737-a520-78a88a061d80 for instance d116ff28-faa0-4c91-bbfb-71198e61d95a on hv-cinder-84889 Aug 24 13:27:01.522882 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-9bc0e4ba-d9c9-4277-a406-f6e4702d37ea req-82ddb478-ef95-4b0a-afc6-df9fe22ead05 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032704 Aug 24 13:27:01.523470 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2043/4089] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:27:01.673441 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-135e9118-ec36-4aa1-a73e-a32ef316ee39 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:27:01.674049 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-135e9118-ec36-4aa1-a73e-a32ef316ee39 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: d116ff28-faa0-4c91-bbfb-71198e61d95a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:27:01.680171 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-135e9118-ec36-4aa1-a73e-a32ef316ee39 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:01.680602 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-135e9118-ec36-4aa1-a73e-a32ef316ee39 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:01.681083 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-135e9118-ec36-4aa1-a73e-a32ef316ee39 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:01.681778 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-135e9118-ec36-4aa1-a73e-a32ef316ee39 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:01.682239 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-135e9118-ec36-4aa1-a73e-a32ef316ee39 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:01.682685 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-135e9118-ec36-4aa1-a73e-a32ef316ee39 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:01.813688 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-135e9118-ec36-4aa1-a73e-a32ef316ee39 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:27:01.822142 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-135e9118-ec36-4aa1-a73e-a32ef316ee39 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a" status: 200 len: 1265 microversion: 2.1 time: 0.152544 Aug 24 13:27:01.825480 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2047/4090] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:27:01 2022] GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:27:02.847476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-25443647-901c-4ee0-aec3-2af30d380e00 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:27:02.848233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-25443647-901c-4ee0-aec3-2af30d380e00 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: d116ff28-faa0-4c91-bbfb-71198e61d95a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:27:02.854335 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-25443647-901c-4ee0-aec3-2af30d380e00 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:02.854847 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-25443647-901c-4ee0-aec3-2af30d380e00 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:02.855288 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-25443647-901c-4ee0-aec3-2af30d380e00 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:02.855968 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-25443647-901c-4ee0-aec3-2af30d380e00 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:02.856419 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-25443647-901c-4ee0-aec3-2af30d380e00 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:02.856843 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-25443647-901c-4ee0-aec3-2af30d380e00 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:02.988005 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-25443647-901c-4ee0-aec3-2af30d380e00 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:27:02.995600 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-25443647-901c-4ee0-aec3-2af30d380e00 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a" status: 200 len: 1265 microversion: 2.1 time: 0.153402 Aug 24 13:27:02.997602 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2044/4091] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:27:02 2022] GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:27:04.017011 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-68a72218-9bf1-4516-88eb-99af255475b4 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:27:04.017616 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-68a72218-9bf1-4516-88eb-99af255475b4 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: d116ff28-faa0-4c91-bbfb-71198e61d95a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:27:04.024504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-68a72218-9bf1-4516-88eb-99af255475b4 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:04.024982 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-68a72218-9bf1-4516-88eb-99af255475b4 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:04.025416 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-68a72218-9bf1-4516-88eb-99af255475b4 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:04.026087 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-68a72218-9bf1-4516-88eb-99af255475b4 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:04.026540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-68a72218-9bf1-4516-88eb-99af255475b4 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:04.026986 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-68a72218-9bf1-4516-88eb-99af255475b4 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:04.156316 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-68a72218-9bf1-4516-88eb-99af255475b4 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:27:04.163768 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-68a72218-9bf1-4516-88eb-99af255475b4 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a" status: 200 len: 1265 microversion: 2.1 time: 0.150589 Aug 24 13:27:04.164327 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2048/4092] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:27:04 2022] GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:27:05.185674 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3d8eb1ea-07db-42dc-b80e-cd1964289034 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:27:05.186349 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3d8eb1ea-07db-42dc-b80e-cd1964289034 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: d116ff28-faa0-4c91-bbfb-71198e61d95a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:27:05.193615 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3d8eb1ea-07db-42dc-b80e-cd1964289034 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:05.194093 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3d8eb1ea-07db-42dc-b80e-cd1964289034 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:05.194529 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3d8eb1ea-07db-42dc-b80e-cd1964289034 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:05.195491 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3d8eb1ea-07db-42dc-b80e-cd1964289034 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:05.196082 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3d8eb1ea-07db-42dc-b80e-cd1964289034 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:05.196505 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3d8eb1ea-07db-42dc-b80e-cd1964289034 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:05.329523 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3d8eb1ea-07db-42dc-b80e-cd1964289034 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:27:05.337689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3d8eb1ea-07db-42dc-b80e-cd1964289034 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a" status: 200 len: 1265 microversion: 2.1 time: 0.156793 Aug 24 13:27:05.338233 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2045/4093] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:27:05 2022] GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:27:06.358486 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-5816f125-f13c-429c-a258-6697df868c13 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:27:06.359190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-5816f125-f13c-429c-a258-6697df868c13 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: d116ff28-faa0-4c91-bbfb-71198e61d95a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:27:06.365557 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5816f125-f13c-429c-a258-6697df868c13 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:06.366037 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5816f125-f13c-429c-a258-6697df868c13 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:06.366468 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5816f125-f13c-429c-a258-6697df868c13 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:06.367182 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5816f125-f13c-429c-a258-6697df868c13 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:06.367631 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5816f125-f13c-429c-a258-6697df868c13 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:06.368050 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-5816f125-f13c-429c-a258-6697df868c13 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:06.498378 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-5816f125-f13c-429c-a258-6697df868c13 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:27:06.506825 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-5816f125-f13c-429c-a258-6697df868c13 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a" status: 200 len: 1265 microversion: 2.1 time: 0.152314 Aug 24 13:27:06.507380 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2049/4094] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:27:06 2022] GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:27:07.528279 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-3fdd08e0-318c-4f7f-a612-59ca2adfe831 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:27:07.528888 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-3fdd08e0-318c-4f7f-a612-59ca2adfe831 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: d116ff28-faa0-4c91-bbfb-71198e61d95a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:27:07.531348 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell0:SELECT=2 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:27:07.536712 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3fdd08e0-318c-4f7f-a612-59ca2adfe831 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:07.537192 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3fdd08e0-318c-4f7f-a612-59ca2adfe831 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:07.537629 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3fdd08e0-318c-4f7f-a612-59ca2adfe831 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:07.538309 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3fdd08e0-318c-4f7f-a612-59ca2adfe831 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:07.538791 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3fdd08e0-318c-4f7f-a612-59ca2adfe831 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:07.544785 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-3fdd08e0-318c-4f7f-a612-59ca2adfe831 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:07.666122 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-3fdd08e0-318c-4f7f-a612-59ca2adfe831 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:27:07.673690 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-3fdd08e0-318c-4f7f-a612-59ca2adfe831 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a" status: 200 len: 1265 microversion: 2.1 time: 0.149296 Aug 24 13:27:07.674244 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2046/4095] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:27:07 2022] GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:27:08.694030 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-46f27161-4bb1-4fd6-b9c3-a7abf652e770 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:27:08.694574 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-46f27161-4bb1-4fd6-b9c3-a7abf652e770 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: d116ff28-faa0-4c91-bbfb-71198e61d95a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:27:08.696387 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell0:SELECT=2 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:27:08.697100 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell0:SELECT=6 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:27:08.702289 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46f27161-4bb1-4fd6-b9c3-a7abf652e770 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:08.702801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46f27161-4bb1-4fd6-b9c3-a7abf652e770 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:08.703269 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46f27161-4bb1-4fd6-b9c3-a7abf652e770 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:08.703954 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46f27161-4bb1-4fd6-b9c3-a7abf652e770 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:08.704418 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46f27161-4bb1-4fd6-b9c3-a7abf652e770 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:08.704971 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-46f27161-4bb1-4fd6-b9c3-a7abf652e770 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:09.058747 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-46f27161-4bb1-4fd6-b9c3-a7abf652e770 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:27:09.066294 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-46f27161-4bb1-4fd6-b9c3-a7abf652e770 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a" status: 200 len: 1265 microversion: 2.1 time: 0.376186 Aug 24 13:27:09.066878 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2050/4096] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:27:08 2022] GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a => generated 1265 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:27:10.087393 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-5663c9a5-3322-4802-a3c7-96f6d2d49361 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:27:10.088091 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-5663c9a5-3322-4802-a3c7-96f6d2d49361 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: d116ff28-faa0-4c91-bbfb-71198e61d95a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:27:10.094409 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5663c9a5-3322-4802-a3c7-96f6d2d49361 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:10.094917 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5663c9a5-3322-4802-a3c7-96f6d2d49361 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:10.095356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5663c9a5-3322-4802-a3c7-96f6d2d49361 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:10.096042 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5663c9a5-3322-4802-a3c7-96f6d2d49361 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:10.096520 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5663c9a5-3322-4802-a3c7-96f6d2d49361 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:10.096948 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-5663c9a5-3322-4802-a3c7-96f6d2d49361 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:10.227050 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-5663c9a5-3322-4802-a3c7-96f6d2d49361 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:27:10.234627 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-5663c9a5-3322-4802-a3c7-96f6d2d49361 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a" status: 200 len: 1265 microversion: 2.1 time: 0.151068 Aug 24 13:27:10.235205 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2047/4097] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:27:10 2022] GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:27:11.255428 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-f3dff41e-2ca8-4e8d-895a-5bc2490505fe tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:27:11.256037 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-f3dff41e-2ca8-4e8d-895a-5bc2490505fe tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: d116ff28-faa0-4c91-bbfb-71198e61d95a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:27:11.262432 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3dff41e-2ca8-4e8d-895a-5bc2490505fe tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:11.262885 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3dff41e-2ca8-4e8d-895a-5bc2490505fe tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:11.263322 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3dff41e-2ca8-4e8d-895a-5bc2490505fe tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:11.264001 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3dff41e-2ca8-4e8d-895a-5bc2490505fe tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:11.264457 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3dff41e-2ca8-4e8d-895a-5bc2490505fe tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:11.264882 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-f3dff41e-2ca8-4e8d-895a-5bc2490505fe tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:11.391471 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-f3dff41e-2ca8-4e8d-895a-5bc2490505fe tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:27:11.400023 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-f3dff41e-2ca8-4e8d-895a-5bc2490505fe tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a" status: 200 len: 1265 microversion: 2.1 time: 0.148362 Aug 24 13:27:11.400583 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2051/4098] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:27:11 2022] GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:27:12.420625 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-37059342-bf06-47c7-8231-12698ed0fd80 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:27:12.421262 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-37059342-bf06-47c7-8231-12698ed0fd80 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: d116ff28-faa0-4c91-bbfb-71198e61d95a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:27:12.429235 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37059342-bf06-47c7-8231-12698ed0fd80 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:12.429963 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37059342-bf06-47c7-8231-12698ed0fd80 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:12.430613 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37059342-bf06-47c7-8231-12698ed0fd80 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:12.431680 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37059342-bf06-47c7-8231-12698ed0fd80 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:12.432368 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37059342-bf06-47c7-8231-12698ed0fd80 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:12.433018 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-37059342-bf06-47c7-8231-12698ed0fd80 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:12.569156 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-37059342-bf06-47c7-8231-12698ed0fd80 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:27:12.576756 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-37059342-bf06-47c7-8231-12698ed0fd80 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a" status: 200 len: 1265 microversion: 2.1 time: 0.159983 Aug 24 13:27:12.577314 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2048/4099] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:27:12 2022] GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:27:13.107990 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-fda5a9f3-ebdf-4301-9ba9-2931ce576afb req-7f27af29-fcbb-44f2-b1ff-aed44cf69de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d116ff28-faa0-4c91-bbfb-71198e61d95a", "name": "network-vif-plugged", "status": "completed", "tag": "4c8d95b1-b587-4737-a520-78a88a061d80"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:27:13.118404 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-fda5a9f3-ebdf-4301-9ba9-2931ce576afb req-7f27af29-fcbb-44f2-b1ff-aed44cf69de2 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:13.118913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-fda5a9f3-ebdf-4301-9ba9-2931ce576afb req-7f27af29-fcbb-44f2-b1ff-aed44cf69de2 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:13.119343 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-fda5a9f3-ebdf-4301-9ba9-2931ce576afb req-7f27af29-fcbb-44f2-b1ff-aed44cf69de2 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:13.132867 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-fda5a9f3-ebdf-4301-9ba9-2931ce576afb req-7f27af29-fcbb-44f2-b1ff-aed44cf69de2 service nova] Creating event network-vif-plugged:4c8d95b1-b587-4737-a520-78a88a061d80 for instance d116ff28-faa0-4c91-bbfb-71198e61d95a on hv-cinder-84889 Aug 24 13:27:13.138682 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-fda5a9f3-ebdf-4301-9ba9-2931ce576afb req-7f27af29-fcbb-44f2-b1ff-aed44cf69de2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034552 Aug 24 13:27:13.139250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2052/4100] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:27:13.597509 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-808b6bc1-4051-4bb0-b237-fb83a96ff0ef tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:27:13.598123 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-808b6bc1-4051-4bb0-b237-fb83a96ff0ef tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: d116ff28-faa0-4c91-bbfb-71198e61d95a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:27:13.604687 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-808b6bc1-4051-4bb0-b237-fb83a96ff0ef tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:13.605154 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-808b6bc1-4051-4bb0-b237-fb83a96ff0ef tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:13.605598 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-808b6bc1-4051-4bb0-b237-fb83a96ff0ef tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:13.606284 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-808b6bc1-4051-4bb0-b237-fb83a96ff0ef tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:13.606769 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-808b6bc1-4051-4bb0-b237-fb83a96ff0ef tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:13.607199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-808b6bc1-4051-4bb0-b237-fb83a96ff0ef tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:13.734835 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-808b6bc1-4051-4bb0-b237-fb83a96ff0ef tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:27:13.742972 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-808b6bc1-4051-4bb0-b237-fb83a96ff0ef tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a" status: 200 len: 1265 microversion: 2.1 time: 0.149513 Aug 24 13:27:13.743530 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2049/4101] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:27:13 2022] GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:27:14.765296 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-391bb908-0d0a-46f4-8f76-8f0280433d08 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:27:14.765983 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-391bb908-0d0a-46f4-8f76-8f0280433d08 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: d116ff28-faa0-4c91-bbfb-71198e61d95a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:27:14.772657 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-391bb908-0d0a-46f4-8f76-8f0280433d08 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:14.773134 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-391bb908-0d0a-46f4-8f76-8f0280433d08 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:14.773568 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-391bb908-0d0a-46f4-8f76-8f0280433d08 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:14.774241 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-391bb908-0d0a-46f4-8f76-8f0280433d08 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:14.774718 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-391bb908-0d0a-46f4-8f76-8f0280433d08 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:14.775143 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-391bb908-0d0a-46f4-8f76-8f0280433d08 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:14.907488 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-391bb908-0d0a-46f4-8f76-8f0280433d08 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:27:14.916932 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-391bb908-0d0a-46f4-8f76-8f0280433d08 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a" status: 200 len: 1265 microversion: 2.1 time: 0.156337 Aug 24 13:27:14.917665 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2053/4102] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:27:14 2022] GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:27:15.937696 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-0ffac290-7211-4bb2-a8f3-6bf6670e7fba tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:27:15.938297 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-0ffac290-7211-4bb2-a8f3-6bf6670e7fba tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: d116ff28-faa0-4c91-bbfb-71198e61d95a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:27:15.944670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ffac290-7211-4bb2-a8f3-6bf6670e7fba tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:15.945152 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ffac290-7211-4bb2-a8f3-6bf6670e7fba tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:15.945588 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ffac290-7211-4bb2-a8f3-6bf6670e7fba tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:15.946273 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ffac290-7211-4bb2-a8f3-6bf6670e7fba tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:15.946763 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ffac290-7211-4bb2-a8f3-6bf6670e7fba tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:15.947197 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-0ffac290-7211-4bb2-a8f3-6bf6670e7fba tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:16.075027 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-0ffac290-7211-4bb2-a8f3-6bf6670e7fba tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:27:16.082555 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-0ffac290-7211-4bb2-a8f3-6bf6670e7fba tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a" status: 200 len: 1452 microversion: 2.1 time: 0.148739 Aug 24 13:27:16.083141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2050/4103] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:27:15 2022] GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:27:16.102707 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-b0531731-9ce6-4938-84fe-fd61662669f7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:27:16.103337 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-b0531731-9ce6-4938-84fe-fd61662669f7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: d116ff28-faa0-4c91-bbfb-71198e61d95a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:27:16.109540 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0531731-9ce6-4938-84fe-fd61662669f7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:16.110022 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0531731-9ce6-4938-84fe-fd61662669f7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:16.110453 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0531731-9ce6-4938-84fe-fd61662669f7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:16.111157 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0531731-9ce6-4938-84fe-fd61662669f7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:16.111614 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0531731-9ce6-4938-84fe-fd61662669f7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:16.112670 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-b0531731-9ce6-4938-84fe-fd61662669f7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:16.244802 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-b0531731-9ce6-4938-84fe-fd61662669f7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:27:16.252774 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-b0531731-9ce6-4938-84fe-fd61662669f7 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a" status: 200 len: 1452 microversion: 2.1 time: 0.153842 Aug 24 13:27:16.253331 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2054/4104] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:27:16 2022] GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:27:18.296678 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-7fa4de33-12c7-4e0b-a6ce-9a54cbe241e8 req-d375aaf3-c819-4112-9134-5149ef6b0c6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d116ff28-faa0-4c91-bbfb-71198e61d95a", "tag": "4c8d95b1-b587-4737-a520-78a88a061d80"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:27:18.306608 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-7fa4de33-12c7-4e0b-a6ce-9a54cbe241e8 req-d375aaf3-c819-4112-9134-5149ef6b0c6f service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:27:18.307173 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-7fa4de33-12c7-4e0b-a6ce-9a54cbe241e8 req-d375aaf3-c819-4112-9134-5149ef6b0c6f service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:27:18.307598 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-7fa4de33-12c7-4e0b-a6ce-9a54cbe241e8 req-d375aaf3-c819-4112-9134-5149ef6b0c6f service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:27:18.318610 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-7fa4de33-12c7-4e0b-a6ce-9a54cbe241e8 req-d375aaf3-c819-4112-9134-5149ef6b0c6f service nova] Creating event network-changed:4c8d95b1-b587-4737-a520-78a88a061d80 for instance d116ff28-faa0-4c91-bbfb-71198e61d95a on hv-cinder-84889 Aug 24 13:27:18.323725 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-7fa4de33-12c7-4e0b-a6ce-9a54cbe241e8 req-d375aaf3-c819-4112-9134-5149ef6b0c6f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087181 Aug 24 13:27:18.324502 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2051/4105] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:29:07.894617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:29:07.894617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG dbcounter [-] [121170] Writing DB stats nova_cell1:SELECT=58 {{(pid=121170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:29:07.894617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-09dbd1e5-b71c-4de0-884b-cdcbf6c10f1b tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:29:07.894617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-09dbd1e5-b71c-4de0-884b-cdcbf6c10f1b tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: d116ff28-faa0-4c91-bbfb-71198e61d95a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:29:07.894617 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09dbd1e5-b71c-4de0-884b-cdcbf6c10f1b tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:07.895379 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09dbd1e5-b71c-4de0-884b-cdcbf6c10f1b tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:07.895379 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09dbd1e5-b71c-4de0-884b-cdcbf6c10f1b tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:07.895379 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09dbd1e5-b71c-4de0-884b-cdcbf6c10f1b tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:07.895379 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09dbd1e5-b71c-4de0-884b-cdcbf6c10f1b tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:07.895693 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-09dbd1e5-b71c-4de0-884b-cdcbf6c10f1b tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:07.920490 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-09dbd1e5-b71c-4de0-884b-cdcbf6c10f1b tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: d116ff28-faa0-4c91-bbfb-71198e61d95a] Going to try to terminate instance {{(pid=121170) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 13:29:07.979903 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b6b80c23-6823-4ba7-8f9f-446190311493] AMQP server on 10.222.0.45:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 24 13:29:07.980488 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_api:SELECT=24 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:29:07.981264 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG dbcounter [-] [121171] Writing DB stats nova_cell1:SELECT=52 {{(pid=121171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:29:08.081016 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-0c8314c7-ab7d-4225-95ef-b5a8fb5c6b21 req-91e3dc3b-b8bc-4c20-bc81-ea203e4003a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d116ff28-faa0-4c91-bbfb-71198e61d95a", "tag": "4c8d95b1-b587-4737-a520-78a88a061d80"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:29:08.090331 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-0c8314c7-ab7d-4225-95ef-b5a8fb5c6b21 req-91e3dc3b-b8bc-4c20-bc81-ea203e4003a4 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:08.090914 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-0c8314c7-ab7d-4225-95ef-b5a8fb5c6b21 req-91e3dc3b-b8bc-4c20-bc81-ea203e4003a4 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:08.091445 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-0c8314c7-ab7d-4225-95ef-b5a8fb5c6b21 req-91e3dc3b-b8bc-4c20-bc81-ea203e4003a4 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:08.102314 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-0c8314c7-ab7d-4225-95ef-b5a8fb5c6b21 req-91e3dc3b-b8bc-4c20-bc81-ea203e4003a4 service nova] Creating event network-changed:4c8d95b1-b587-4737-a520-78a88a061d80 for instance d116ff28-faa0-4c91-bbfb-71198e61d95a on hv-cinder-84889 Aug 24 13:29:08.107404 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-0c8314c7-ab7d-4225-95ef-b5a8fb5c6b21 req-91e3dc3b-b8bc-4c20-bc81-ea203e4003a4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130775 Aug 24 13:29:08.107978 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2052/4106] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:29:08.266323 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-09dbd1e5-b71c-4de0-884b-cdcbf6c10f1b tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a" status: 204 len: 0 microversion: 2.1 time: 0.386665 Aug 24 13:29:08.267196 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2055/4107] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 13:29:07 2022] DELETE /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:29:08.275689 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-cae15f2e-4512-4a29-9e68-412c24c19895 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:29:08.276487 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-cae15f2e-4512-4a29-9e68-412c24c19895 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: d116ff28-faa0-4c91-bbfb-71198e61d95a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:29:08.283357 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cae15f2e-4512-4a29-9e68-412c24c19895 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:08.283922 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cae15f2e-4512-4a29-9e68-412c24c19895 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:08.284430 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cae15f2e-4512-4a29-9e68-412c24c19895 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:08.285190 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cae15f2e-4512-4a29-9e68-412c24c19895 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:08.285720 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cae15f2e-4512-4a29-9e68-412c24c19895 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:08.286169 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-cae15f2e-4512-4a29-9e68-412c24c19895 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:08.525011 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-cae15f2e-4512-4a29-9e68-412c24c19895 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:29:08.532632 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-cae15f2e-4512-4a29-9e68-412c24c19895 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a" status: 200 len: 1576 microversion: 2.1 time: 0.261062 Aug 24 13:29:08.533230 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2053/4108] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:29:08 2022] GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a => generated 1576 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:29:09.554691 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-49da1066-4043-480e-beac-3f39e4b341b5 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:29:09.555398 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-49da1066-4043-480e-beac-3f39e4b341b5 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: d116ff28-faa0-4c91-bbfb-71198e61d95a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:29:09.562035 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49da1066-4043-480e-beac-3f39e4b341b5 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:09.562520 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49da1066-4043-480e-beac-3f39e4b341b5 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:09.563108 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49da1066-4043-480e-beac-3f39e4b341b5 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:09.564472 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49da1066-4043-480e-beac-3f39e4b341b5 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:09.564997 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49da1066-4043-480e-beac-3f39e4b341b5 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:09.565428 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-49da1066-4043-480e-beac-3f39e4b341b5 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:09.819622 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-49da1066-4043-480e-beac-3f39e4b341b5 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:29:09.827898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-49da1066-4043-480e-beac-3f39e4b341b5 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a" status: 200 len: 1576 microversion: 2.1 time: 0.277056 Aug 24 13:29:09.827898 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2056/4109] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:29:09 2022] GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a => generated 1576 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:29:10.705862 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-e16fb2b1-d286-4973-aa50-438c2076ca79 req-d07925fe-74a9-4f2a-a489-3ed726bf9bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d116ff28-faa0-4c91-bbfb-71198e61d95a", "name": "network-vif-deleted", "tag": "4c8d95b1-b587-4737-a520-78a88a061d80"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:29:10.721399 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] [b6b80c23-6823-4ba7-8f9f-446190311493] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 50918. Aug 24 13:29:10.723801 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-e16fb2b1-d286-4973-aa50-438c2076ca79 req-d07925fe-74a9-4f2a-a489-3ed726bf9bd2 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:10.724274 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-e16fb2b1-d286-4973-aa50-438c2076ca79 req-d07925fe-74a9-4f2a-a489-3ed726bf9bd2 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:10.724704 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-e16fb2b1-d286-4973-aa50-438c2076ca79 req-d07925fe-74a9-4f2a-a489-3ed726bf9bd2 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:10.735615 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-e16fb2b1-d286-4973-aa50-438c2076ca79 req-d07925fe-74a9-4f2a-a489-3ed726bf9bd2 service nova] Creating event network-vif-deleted:4c8d95b1-b587-4737-a520-78a88a061d80 for instance d116ff28-faa0-4c91-bbfb-71198e61d95a on hv-cinder-84889 Aug 24 13:29:10.740956 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-e16fb2b1-d286-4973-aa50-438c2076ca79 req-d07925fe-74a9-4f2a-a489-3ed726bf9bd2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038778 Aug 24 13:29:10.741520 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2054/4110] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:29:10.849119 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e310b39c-03b1-4810-85a2-80267955dca2 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:29:10.849673 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e310b39c-03b1-4810-85a2-80267955dca2 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: d116ff28-faa0-4c91-bbfb-71198e61d95a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:29:10.856109 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e310b39c-03b1-4810-85a2-80267955dca2 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:10.856596 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e310b39c-03b1-4810-85a2-80267955dca2 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:10.857036 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e310b39c-03b1-4810-85a2-80267955dca2 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:10.857719 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e310b39c-03b1-4810-85a2-80267955dca2 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:10.858252 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e310b39c-03b1-4810-85a2-80267955dca2 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:10.858708 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e310b39c-03b1-4810-85a2-80267955dca2 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:10.920339 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e310b39c-03b1-4810-85a2-80267955dca2 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:29:10.927997 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e310b39c-03b1-4810-85a2-80267955dca2 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a" status: 200 len: 1391 microversion: 2.1 time: 0.083338 Aug 24 13:29:10.932436 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2057/4111] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:29:10 2022] GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a => generated 1391 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:29:11.950593 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-2ea5585a-592c-4b90-b0d1-a508d38dca65 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:29:11.951324 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-2ea5585a-592c-4b90-b0d1-a508d38dca65 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: d116ff28-faa0-4c91-bbfb-71198e61d95a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:29:11.957938 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ea5585a-592c-4b90-b0d1-a508d38dca65 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:11.958438 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ea5585a-592c-4b90-b0d1-a508d38dca65 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:11.958902 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ea5585a-592c-4b90-b0d1-a508d38dca65 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:11.959606 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ea5585a-592c-4b90-b0d1-a508d38dca65 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:11.960037 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ea5585a-592c-4b90-b0d1-a508d38dca65 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:11.960463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ea5585a-592c-4b90-b0d1-a508d38dca65 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:11.991936 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ea5585a-592c-4b90-b0d1-a508d38dca65 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:11.992336 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ea5585a-592c-4b90-b0d1-a508d38dca65 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:11.992773 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-2ea5585a-592c-4b90-b0d1-a508d38dca65 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:11.993211 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.objects.instance [None req-2ea5585a-592c-4b90-b0d1-a508d38dca65 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lazy-loading 'fault' on Instance uuid d116ff28-faa0-4c91-bbfb-71198e61d95a {{(pid=121171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:29:12.035141 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-2ea5585a-592c-4b90-b0d1-a508d38dca65 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:29:12.042923 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-2ea5585a-592c-4b90-b0d1-a508d38dca65 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a" status: 200 len: 1230 microversion: 2.1 time: 0.097142 Aug 24 13:29:12.043480 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2055/4112] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:29:11 2022] GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:29:13.064817 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e9ba39e5-c0bc-4917-85f3-fc35a8eeea80 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:29:13.065420 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e9ba39e5-c0bc-4917-85f3-fc35a8eeea80 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: d116ff28-faa0-4c91-bbfb-71198e61d95a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:29:13.073891 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9ba39e5-c0bc-4917-85f3-fc35a8eeea80 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:13.074370 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9ba39e5-c0bc-4917-85f3-fc35a8eeea80 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:13.074838 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9ba39e5-c0bc-4917-85f3-fc35a8eeea80 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:13.075519 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9ba39e5-c0bc-4917-85f3-fc35a8eeea80 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:13.075971 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9ba39e5-c0bc-4917-85f3-fc35a8eeea80 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:13.076391 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e9ba39e5-c0bc-4917-85f3-fc35a8eeea80 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:13.092006 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.wsgi [None req-e9ba39e5-c0bc-4917-85f3-fc35a8eeea80 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] HTTP exception thrown: Instance d116ff28-faa0-4c91-bbfb-71198e61d95a could not be found. Aug 24 13:29:13.093621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e9ba39e5-c0bc-4917-85f3-fc35a8eeea80 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Request method failure captured: Aug 24 13:29:13.093621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: request: GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a HTTP/1.1 Aug 24 13:29:13.093621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept: application/json Aug 24 13:29:13.093621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept-Encoding: identity Aug 24 13:29:13.093621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Connection: close Aug 24 13:29:13.093621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Length: 0 Aug 24 13:29:13.093621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Type: application/json Aug 24 13:29:13.093621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Host: 10.222.0.45 Aug 24 13:29:13.093621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Openstack-System-Scope: None Aug 24 13:29:13.093621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: User-Agent: python-urllib3/1.26.11 Aug 24 13:29:13.093621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Auth-Token: gAAAAABjBiXLudjORddMlp8ho_Zg1O5dKwzV6daRfzIJk9_tcQ3djbbO1yGZNXTMv_r01iDym2ImLEMixjIMCpxGc0L5gdCCZbILxJcUCufIZ-SNbvrYd1s6lnL3rdphV7Y6X8PdU0OUXjZObVggpodJ_mIlw_5WCFFAOoRQ3J6SLbFUGaWmh-A Aug 24 13:29:13.093621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Id: None Aug 24 13:29:13.093621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Name: None Aug 24 13:29:13.093621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Identity-Status: Confirmed Aug 24 13:29:13.093621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Is-Admin-Project: True Aug 24 13:29:13.093621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Id: default Aug 24 13:29:13.093621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Name: Default Aug 24 13:29:13.093621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Id: e4ab80b71d1f4f06b20c597689ae8a2e Aug 24 13:29:13.093621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Name: tempest-TestVolumeBootPattern-136844174 Aug 24 13:29:13.093621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Role: member,reader Aug 24 13:29:13.093621 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Roles: member,reader Aug 24 13:29:13.095278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e4ab80b71d1f4f06b20c597689ae8a2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e4ab80b71d1f4f06b20c597689ae8a2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e4ab80b71d1f4f06b20c597689ae8a2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e4ab80b71d1f4f06b20c597689ae8a2e"}]}] Aug 24 13:29:13.095278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant: tempest-TestVolumeBootPattern-136844174 Aug 24 13:29:13.095278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Id: e4ab80b71d1f4f06b20c597689ae8a2e Aug 24 13:29:13.095278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Name: tempest-TestVolumeBootPattern-136844174 Aug 24 13:29:13.095278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User: tempest-TestVolumeBootPattern-136844174-project Aug 24 13:29:13.095278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Id: default Aug 24 13:29:13.095278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Name: Default Aug 24 13:29:13.095278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Id: cc07ef53f88c4a809deab768daff8132 Aug 24 13:29:13.095278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Name: tempest-TestVolumeBootPattern-136844174-project Aug 24 13:29:13.095278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: method: > Aug 24 13:29:13.095278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: exception: Instance d116ff28-faa0-4c91-bbfb-71198e61d95a could not be found. Aug 24 13:29:13.095278 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: action_args: {'id': 'd116ff28-faa0-4c91-bbfb-71198e61d95a'} Aug 24 13:29:13.096088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:29:13.096088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:29:13.096088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:29:13.096088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:29:13.096088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:29:13.096088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:29:13.096088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:29:13.096088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:29:13.096088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:29:13.096088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:29:13.096088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d116ff28-faa0-4c91-bbfb-71198e61d95a could not be found. Aug 24 13:29:13.096088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:29:13.096088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:29:13.096088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:29:13.096088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:29:13.096088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:29:13.096088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:29:13.096088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:29:13.096088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:29:13.096088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:29:13.097305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:29:13.097305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:29:13.097305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:29:13.097305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:29:13.097305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:29:13.097305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:29:13.097305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:29:13.097305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d116ff28-faa0-4c91-bbfb-71198e61d95a could not be found. Aug 24 13:29:13.097305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:29:13.097305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:29:13.097305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:29:13.097305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:29:13.097305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:29:13.097305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:29:13.097305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:29:13.097305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:29:13.097305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d116ff28-faa0-4c91-bbfb-71198e61d95a could not be found. Aug 24 13:29:13.097305 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:29:13.098397 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e9ba39e5-c0bc-4917-85f3-fc35a8eeea80 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Returning 404 to user: Instance d116ff28-faa0-4c91-bbfb-71198e61d95a could not be found. {{(pid=121170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:29:13.098397 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e9ba39e5-c0bc-4917-85f3-fc35a8eeea80 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a" status: 404 len: 111 microversion: 2.1 time: 0.034539 Aug 24 13:29:13.098397 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2058/4113] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:29:13 2022] GET /compute/v2.1/servers/d116ff28-faa0-4c91-bbfb-71198e61d95a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:29:16.483113 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-fd48f012-03ad-4abd-b1a3-e906c522d4be tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:29:16.483618 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fd48f012-03ad-4abd-b1a3-e906c522d4be tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: 08842333-bf50-4664-9f30-7a368506547a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:29:16.493655 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd48f012-03ad-4abd-b1a3-e906c522d4be tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:16.494205 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd48f012-03ad-4abd-b1a3-e906c522d4be tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:16.494685 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd48f012-03ad-4abd-b1a3-e906c522d4be tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:16.495968 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd48f012-03ad-4abd-b1a3-e906c522d4be tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:16.496463 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd48f012-03ad-4abd-b1a3-e906c522d4be tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:16.496894 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-fd48f012-03ad-4abd-b1a3-e906c522d4be tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:16.528579 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-fd48f012-03ad-4abd-b1a3-e906c522d4be tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: 08842333-bf50-4664-9f30-7a368506547a] Going to try to terminate instance {{(pid=121171) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 13:29:16.578095 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [req-7a2fb814-2f13-4547-bd23-c236d3784731 req-e6a612d9-236b-44fd-b48f-1bc027d21212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08842333-bf50-4664-9f30-7a368506547a", "tag": "659f4cbc-6b02-4aca-9cf5-522508e54ef8"}]} {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:29:16.591402 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-7a2fb814-2f13-4547-bd23-c236d3784731 req-e6a612d9-236b-44fd-b48f-1bc027d21212 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:16.599342 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-7a2fb814-2f13-4547-bd23-c236d3784731 req-e6a612d9-236b-44fd-b48f-1bc027d21212 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:16.599342 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [req-7a2fb814-2f13-4547-bd23-c236d3784731 req-e6a612d9-236b-44fd-b48f-1bc027d21212 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:16.602929 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.compute.server_external_events [req-7a2fb814-2f13-4547-bd23-c236d3784731 req-e6a612d9-236b-44fd-b48f-1bc027d21212 service nova] Creating event network-changed:659f4cbc-6b02-4aca-9cf5-522508e54ef8 for instance 08842333-bf50-4664-9f30-7a368506547a on hv-cinder-84889 Aug 24 13:29:16.608210 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [req-7a2fb814-2f13-4547-bd23-c236d3784731 req-e6a612d9-236b-44fd-b48f-1bc027d21212 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087519 Aug 24 13:29:16.608801 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2059/4114] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:29:16.821199 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-fd48f012-03ad-4abd-b1a3-e906c522d4be tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "DELETE /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a" status: 204 len: 0 microversion: 2.1 time: 0.341522 Aug 24 13:29:16.830611 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-597acb35-e637-4771-9d9e-2cd58b058613 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:29:16.830906 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2056/4115] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 13:29:16 2022] DELETE /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:29:16.831783 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-597acb35-e637-4771-9d9e-2cd58b058613 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: 08842333-bf50-4664-9f30-7a368506547a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:29:16.837951 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-597acb35-e637-4771-9d9e-2cd58b058613 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:16.838439 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-597acb35-e637-4771-9d9e-2cd58b058613 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:16.838909 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-597acb35-e637-4771-9d9e-2cd58b058613 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:16.839604 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-597acb35-e637-4771-9d9e-2cd58b058613 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:16.840067 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-597acb35-e637-4771-9d9e-2cd58b058613 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:16.840495 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-597acb35-e637-4771-9d9e-2cd58b058613 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:16.973366 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-597acb35-e637-4771-9d9e-2cd58b058613 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:29:16.981146 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-597acb35-e637-4771-9d9e-2cd58b058613 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a" status: 200 len: 1575 microversion: 2.1 time: 0.155262 Aug 24 13:29:16.981705 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2060/4116] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:29:16 2022] GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:29:18.004234 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-25beae5e-19e9-4cd3-8884-b1a8f83b774f tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:29:18.004931 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-25beae5e-19e9-4cd3-8884-b1a8f83b774f tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: 08842333-bf50-4664-9f30-7a368506547a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:29:18.011257 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-25beae5e-19e9-4cd3-8884-b1a8f83b774f tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:18.011734 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-25beae5e-19e9-4cd3-8884-b1a8f83b774f tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:18.012170 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-25beae5e-19e9-4cd3-8884-b1a8f83b774f tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:18.012849 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-25beae5e-19e9-4cd3-8884-b1a8f83b774f tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:18.013301 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-25beae5e-19e9-4cd3-8884-b1a8f83b774f tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:18.013722 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-25beae5e-19e9-4cd3-8884-b1a8f83b774f tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:18.226677 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.policy [None req-25beae5e-19e9-4cd3-8884-b1a8f83b774f tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:29:18.234452 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-25beae5e-19e9-4cd3-8884-b1a8f83b774f tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a" status: 200 len: 1575 microversion: 2.1 time: 0.235394 Aug 24 13:29:18.235032 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2057/4117] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:29:17 2022] GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a => generated 1575 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:29:19.256936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-7126d0ba-d199-4625-9df8-963cc3fd8aa3 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:29:19.257521 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-7126d0ba-d199-4625-9df8-963cc3fd8aa3 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: 08842333-bf50-4664-9f30-7a368506547a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:29:19.263855 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7126d0ba-d199-4625-9df8-963cc3fd8aa3 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:19.264357 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7126d0ba-d199-4625-9df8-963cc3fd8aa3 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:19.264831 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7126d0ba-d199-4625-9df8-963cc3fd8aa3 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:19.265508 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7126d0ba-d199-4625-9df8-963cc3fd8aa3 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:19.265963 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7126d0ba-d199-4625-9df8-963cc3fd8aa3 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:19.266387 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-7126d0ba-d199-4625-9df8-963cc3fd8aa3 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:19.328599 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-7126d0ba-d199-4625-9df8-963cc3fd8aa3 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:29:19.336614 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-7126d0ba-d199-4625-9df8-963cc3fd8aa3 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a" status: 200 len: 1390 microversion: 2.1 time: 0.083524 Aug 24 13:29:19.337174 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2061/4118] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:29:19 2022] GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:29:19.400225 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [req-d031d67d-8b2d-4c81-a6d9-178b39748f81 req-2570a17b-74f4-495f-8f6a-3c411c112e31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08842333-bf50-4664-9f30-7a368506547a", "name": "network-vif-deleted", "tag": "659f4cbc-6b02-4aca-9cf5-522508e54ef8"}]} {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:29:19.409583 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-d031d67d-8b2d-4c81-a6d9-178b39748f81 req-2570a17b-74f4-495f-8f6a-3c411c112e31 service nova] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:19.410048 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-d031d67d-8b2d-4c81-a6d9-178b39748f81 req-2570a17b-74f4-495f-8f6a-3c411c112e31 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:19.410476 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [req-d031d67d-8b2d-4c81-a6d9-178b39748f81 req-2570a17b-74f4-495f-8f6a-3c411c112e31 service nova] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:19.421562 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.compute.server_external_events [req-d031d67d-8b2d-4c81-a6d9-178b39748f81 req-2570a17b-74f4-495f-8f6a-3c411c112e31 service nova] Creating event network-vif-deleted:659f4cbc-6b02-4aca-9cf5-522508e54ef8 for instance 08842333-bf50-4664-9f30-7a368506547a on hv-cinder-84889 Aug 24 13:29:19.427138 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [req-d031d67d-8b2d-4c81-a6d9-178b39748f81 req-2570a17b-74f4-495f-8f6a-3c411c112e31 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030525 Aug 24 13:29:19.427713 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2058/4119] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 24 13:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:29:20.357624 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-e361f646-ecec-45ab-9b77-5871e3f2abab tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:29:20.358227 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-e361f646-ecec-45ab-9b77-5871e3f2abab tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: 08842333-bf50-4664-9f30-7a368506547a] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:29:20.364547 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e361f646-ecec-45ab-9b77-5871e3f2abab tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:20.365028 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e361f646-ecec-45ab-9b77-5871e3f2abab tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:20.365476 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e361f646-ecec-45ab-9b77-5871e3f2abab tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:20.366190 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e361f646-ecec-45ab-9b77-5871e3f2abab tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:20.366639 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e361f646-ecec-45ab-9b77-5871e3f2abab tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:20.367088 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e361f646-ecec-45ab-9b77-5871e3f2abab tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:20.399005 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e361f646-ecec-45ab-9b77-5871e3f2abab tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:20.405975 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e361f646-ecec-45ab-9b77-5871e3f2abab tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:20.405975 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-e361f646-ecec-45ab-9b77-5871e3f2abab tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:20.405975 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.objects.instance [None req-e361f646-ecec-45ab-9b77-5871e3f2abab tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lazy-loading 'fault' on Instance uuid 08842333-bf50-4664-9f30-7a368506547a {{(pid=121170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:29:20.443595 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.policy [None req-e361f646-ecec-45ab-9b77-5871e3f2abab tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc07ef53f88c4a809deab768daff8132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ab80b71d1f4f06b20c597689ae8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:29:20.451262 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-e361f646-ecec-45ab-9b77-5871e3f2abab tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a" status: 200 len: 1230 microversion: 2.1 time: 0.097556 Aug 24 13:29:20.451899 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2062/4120] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:29:20 2022] GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:29:21.473496 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-10404d22-6318-43bc-96c5-03f0441424dd tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:29:21.474184 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-10404d22-6318-43bc-96c5-03f0441424dd tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: 08842333-bf50-4664-9f30-7a368506547a] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:29:21.480201 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-10404d22-6318-43bc-96c5-03f0441424dd tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:21.480675 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-10404d22-6318-43bc-96c5-03f0441424dd tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:21.481108 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-10404d22-6318-43bc-96c5-03f0441424dd tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:21.481779 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-10404d22-6318-43bc-96c5-03f0441424dd tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:21.482227 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-10404d22-6318-43bc-96c5-03f0441424dd tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:21.482670 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-10404d22-6318-43bc-96c5-03f0441424dd tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:21.495839 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.wsgi [None req-10404d22-6318-43bc-96c5-03f0441424dd tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] HTTP exception thrown: Instance 08842333-bf50-4664-9f30-7a368506547a could not be found. Aug 24 13:29:21.497356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-10404d22-6318-43bc-96c5-03f0441424dd tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Request method failure captured: Aug 24 13:29:21.497356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: request: GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a HTTP/1.1 Aug 24 13:29:21.497356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept: application/json Aug 24 13:29:21.497356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept-Encoding: identity Aug 24 13:29:21.497356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Connection: close Aug 24 13:29:21.497356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Length: 0 Aug 24 13:29:21.497356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Type: application/json Aug 24 13:29:21.497356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Host: 10.222.0.45 Aug 24 13:29:21.497356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Openstack-System-Scope: None Aug 24 13:29:21.497356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: User-Agent: python-urllib3/1.26.11 Aug 24 13:29:21.497356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Auth-Token: gAAAAABjBiXLudjORddMlp8ho_Zg1O5dKwzV6daRfzIJk9_tcQ3djbbO1yGZNXTMv_r01iDym2ImLEMixjIMCpxGc0L5gdCCZbILxJcUCufIZ-SNbvrYd1s6lnL3rdphV7Y6X8PdU0OUXjZObVggpodJ_mIlw_5WCFFAOoRQ3J6SLbFUGaWmh-A Aug 24 13:29:21.497356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Id: None Aug 24 13:29:21.497356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Name: None Aug 24 13:29:21.497356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Identity-Status: Confirmed Aug 24 13:29:21.497356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Is-Admin-Project: True Aug 24 13:29:21.497356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Id: default Aug 24 13:29:21.497356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Name: Default Aug 24 13:29:21.497356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Id: e4ab80b71d1f4f06b20c597689ae8a2e Aug 24 13:29:21.497356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Name: tempest-TestVolumeBootPattern-136844174 Aug 24 13:29:21.497356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Role: member,reader Aug 24 13:29:21.497356 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Roles: member,reader Aug 24 13:29:21.498934 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e4ab80b71d1f4f06b20c597689ae8a2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e4ab80b71d1f4f06b20c597689ae8a2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e4ab80b71d1f4f06b20c597689ae8a2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e4ab80b71d1f4f06b20c597689ae8a2e"}]}] Aug 24 13:29:21.498934 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant: tempest-TestVolumeBootPattern-136844174 Aug 24 13:29:21.498934 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Id: e4ab80b71d1f4f06b20c597689ae8a2e Aug 24 13:29:21.498934 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Name: tempest-TestVolumeBootPattern-136844174 Aug 24 13:29:21.498934 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User: tempest-TestVolumeBootPattern-136844174-project Aug 24 13:29:21.498934 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Id: default Aug 24 13:29:21.498934 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Name: Default Aug 24 13:29:21.498934 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Id: cc07ef53f88c4a809deab768daff8132 Aug 24 13:29:21.498934 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Name: tempest-TestVolumeBootPattern-136844174-project Aug 24 13:29:21.498934 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: method: > Aug 24 13:29:21.498934 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: exception: Instance 08842333-bf50-4664-9f30-7a368506547a could not be found. Aug 24 13:29:21.498934 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: action_args: {'id': '08842333-bf50-4664-9f30-7a368506547a'} Aug 24 13:29:21.499819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:29:21.499819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:29:21.499819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:29:21.499819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:29:21.499819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:29:21.499819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:29:21.499819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:29:21.499819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:29:21.499819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:29:21.499819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:29:21.499819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08842333-bf50-4664-9f30-7a368506547a could not be found. Aug 24 13:29:21.499819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:29:21.499819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:29:21.499819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:29:21.499819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:29:21.499819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:29:21.499819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:29:21.499819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:29:21.499819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:29:21.499819 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:29:21.501551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:29:21.501551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:29:21.501551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:29:21.501551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:29:21.501551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:29:21.501551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:29:21.501551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:29:21.501551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08842333-bf50-4664-9f30-7a368506547a could not be found. Aug 24 13:29:21.501551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:29:21.501551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:29:21.501551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:29:21.501551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:29:21.501551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:29:21.501551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:29:21.501551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:29:21.501551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:29:21.501551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08842333-bf50-4664-9f30-7a368506547a could not be found. Aug 24 13:29:21.501551 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:29:21.503501 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-10404d22-6318-43bc-96c5-03f0441424dd tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Returning 404 to user: Instance 08842333-bf50-4664-9f30-7a368506547a could not be found. {{(pid=121171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:29:21.503501 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-10404d22-6318-43bc-96c5-03f0441424dd tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a" status: 404 len: 111 microversion: 2.1 time: 0.029893 Aug 24 13:29:21.503501 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2059/4121] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:29:21 2022] GET /compute/v2.1/servers/08842333-bf50-4664-9f30-7a368506547a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:29:22.005746 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-be28e798-38ce-49c5-ab3a-4166efe6162a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:29:22.006250 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.compute.api [None req-be28e798-38ce-49c5-ab3a-4166efe6162a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Fetching instance by UUID {{(pid=121170) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:29:22.012572 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be28e798-38ce-49c5-ab3a-4166efe6162a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:22.013059 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be28e798-38ce-49c5-ab3a-4166efe6162a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:22.013504 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be28e798-38ce-49c5-ab3a-4166efe6162a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:22.014192 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be28e798-38ce-49c5-ab3a-4166efe6162a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:22.014675 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be28e798-38ce-49c5-ab3a-4166efe6162a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:22.015116 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG oslo_concurrency.lockutils [None req-be28e798-38ce-49c5-ab3a-4166efe6162a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:22.028723 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.wsgi [None req-be28e798-38ce-49c5-ab3a-4166efe6162a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] HTTP exception thrown: Instance b22e30d3-d9df-47d6-a456-205df43da39d could not be found. Aug 24 13:29:22.030352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-be28e798-38ce-49c5-ab3a-4166efe6162a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Request method failure captured: Aug 24 13:29:22.030352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: request: DELETE /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d HTTP/1.1 Aug 24 13:29:22.030352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept: application/json Aug 24 13:29:22.030352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Accept-Encoding: identity Aug 24 13:29:22.030352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Connection: close Aug 24 13:29:22.030352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Length: 0 Aug 24 13:29:22.030352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Content-Type: application/json Aug 24 13:29:22.030352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Host: 10.222.0.45 Aug 24 13:29:22.030352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Openstack-System-Scope: None Aug 24 13:29:22.030352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: User-Agent: python-urllib3/1.26.11 Aug 24 13:29:22.030352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Auth-Token: gAAAAABjBiXLudjORddMlp8ho_Zg1O5dKwzV6daRfzIJk9_tcQ3djbbO1yGZNXTMv_r01iDym2ImLEMixjIMCpxGc0L5gdCCZbILxJcUCufIZ-SNbvrYd1s6lnL3rdphV7Y6X8PdU0OUXjZObVggpodJ_mIlw_5WCFFAOoRQ3J6SLbFUGaWmh-A Aug 24 13:29:22.030352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Id: None Aug 24 13:29:22.030352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Domain-Name: None Aug 24 13:29:22.030352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Identity-Status: Confirmed Aug 24 13:29:22.030352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Is-Admin-Project: True Aug 24 13:29:22.030352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Id: default Aug 24 13:29:22.030352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Domain-Name: Default Aug 24 13:29:22.030352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Id: e4ab80b71d1f4f06b20c597689ae8a2e Aug 24 13:29:22.030352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Project-Name: tempest-TestVolumeBootPattern-136844174 Aug 24 13:29:22.030352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Role: member,reader Aug 24 13:29:22.030352 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Roles: member,reader Aug 24 13:29:22.031913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e4ab80b71d1f4f06b20c597689ae8a2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e4ab80b71d1f4f06b20c597689ae8a2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e4ab80b71d1f4f06b20c597689ae8a2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e4ab80b71d1f4f06b20c597689ae8a2e"}]}] Aug 24 13:29:22.031913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant: tempest-TestVolumeBootPattern-136844174 Aug 24 13:29:22.031913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Id: e4ab80b71d1f4f06b20c597689ae8a2e Aug 24 13:29:22.031913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-Tenant-Name: tempest-TestVolumeBootPattern-136844174 Aug 24 13:29:22.031913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User: tempest-TestVolumeBootPattern-136844174-project Aug 24 13:29:22.031913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Id: default Aug 24 13:29:22.031913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Domain-Name: Default Aug 24 13:29:22.031913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Id: cc07ef53f88c4a809deab768daff8132 Aug 24 13:29:22.031913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: X-User-Name: tempest-TestVolumeBootPattern-136844174-project Aug 24 13:29:22.031913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: method: > Aug 24 13:29:22.031913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: exception: Instance b22e30d3-d9df-47d6-a456-205df43da39d could not be found. Aug 24 13:29:22.031913 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: action_args: {'id': 'b22e30d3-d9df-47d6-a456-205df43da39d'} Aug 24 13:29:22.032941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:29:22.032941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:29:22.032941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:29:22.032941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:29:22.032941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:29:22.032941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:29:22.032941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:29:22.032941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:29:22.032941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:29:22.032941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:29:22.032941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b22e30d3-d9df-47d6-a456-205df43da39d could not be found. Aug 24 13:29:22.032941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:29:22.032941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:29:22.032941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:29:22.032941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:29:22.032941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:29:22.032941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:29:22.032941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:29:22.032941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:29:22.032941 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:29:22.034351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:29:22.034351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 13:29:22.034351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 13:29:22.034351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 13:29:22.034351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 13:29:22.034351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:29:22.034351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:29:22.034351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:29:22.034351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:29:22.034351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b22e30d3-d9df-47d6-a456-205df43da39d could not be found. Aug 24 13:29:22.034351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:29:22.034351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:29:22.034351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:29:22.034351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:29:22.034351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:29:22.034351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:29:22.034351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:29:22.034351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:29:22.034351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b22e30d3-d9df-47d6-a456-205df43da39d could not be found. Aug 24 13:29:22.034351 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: ERROR nova.api.openstack.wsgi Aug 24 13:29:22.035936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-be28e798-38ce-49c5-ab3a-4166efe6162a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Returning 404 to user: Instance b22e30d3-d9df-47d6-a456-205df43da39d could not be found. {{(pid=121170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:29:22.035936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-be28e798-38ce-49c5-ab3a-4166efe6162a tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d" status: 404 len: 111 microversion: 2.1 time: 0.030437 Aug 24 13:29:22.035936 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2063/4122] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 24 13:29:22 2022] DELETE /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:29:22.040117 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c96358d2-9b2f-4263-aed4-22809a63f678 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '>' {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:29:22.040730 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.compute.api [None req-c96358d2-9b2f-4263-aed4-22809a63f678 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] [instance: b22e30d3-d9df-47d6-a456-205df43da39d] Fetching instance by UUID {{(pid=121171) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 13:29:22.046526 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c96358d2-9b2f-4263-aed4-22809a63f678 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:22.047045 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c96358d2-9b2f-4263-aed4-22809a63f678 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:22.047482 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c96358d2-9b2f-4263-aed4-22809a63f678 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:22.048193 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c96358d2-9b2f-4263-aed4-22809a63f678 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Acquiring lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:22.048645 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c96358d2-9b2f-4263-aed4-22809a63f678 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:22.049073 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG oslo_concurrency.lockutils [None req-c96358d2-9b2f-4263-aed4-22809a63f678 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Lock "acc877c2-bd26-41e8-94b1-fba881fedcaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:22.061996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.wsgi [None req-c96358d2-9b2f-4263-aed4-22809a63f678 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] HTTP exception thrown: Instance b22e30d3-d9df-47d6-a456-205df43da39d could not be found. Aug 24 13:29:22.063538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c96358d2-9b2f-4263-aed4-22809a63f678 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Request method failure captured: Aug 24 13:29:22.063538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: request: GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d HTTP/1.1 Aug 24 13:29:22.063538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept: application/json Aug 24 13:29:22.063538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Accept-Encoding: identity Aug 24 13:29:22.063538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Connection: close Aug 24 13:29:22.063538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Length: 0 Aug 24 13:29:22.063538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Content-Type: application/json Aug 24 13:29:22.063538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Host: 10.222.0.45 Aug 24 13:29:22.063538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Openstack-System-Scope: None Aug 24 13:29:22.063538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: User-Agent: python-urllib3/1.26.11 Aug 24 13:29:22.063538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Auth-Token: gAAAAABjBiXLudjORddMlp8ho_Zg1O5dKwzV6daRfzIJk9_tcQ3djbbO1yGZNXTMv_r01iDym2ImLEMixjIMCpxGc0L5gdCCZbILxJcUCufIZ-SNbvrYd1s6lnL3rdphV7Y6X8PdU0OUXjZObVggpodJ_mIlw_5WCFFAOoRQ3J6SLbFUGaWmh-A Aug 24 13:29:22.063538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Id: None Aug 24 13:29:22.063538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Domain-Name: None Aug 24 13:29:22.063538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Identity-Status: Confirmed Aug 24 13:29:22.063538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Is-Admin-Project: True Aug 24 13:29:22.063538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Id: default Aug 24 13:29:22.063538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Domain-Name: Default Aug 24 13:29:22.063538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Id: e4ab80b71d1f4f06b20c597689ae8a2e Aug 24 13:29:22.063538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Project-Name: tempest-TestVolumeBootPattern-136844174 Aug 24 13:29:22.063538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Role: member,reader Aug 24 13:29:22.063538 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Roles: member,reader Aug 24 13:29:22.065552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e4ab80b71d1f4f06b20c597689ae8a2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e4ab80b71d1f4f06b20c597689ae8a2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e4ab80b71d1f4f06b20c597689ae8a2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e4ab80b71d1f4f06b20c597689ae8a2e"}]}] Aug 24 13:29:22.065552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant: tempest-TestVolumeBootPattern-136844174 Aug 24 13:29:22.065552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Id: e4ab80b71d1f4f06b20c597689ae8a2e Aug 24 13:29:22.065552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-Tenant-Name: tempest-TestVolumeBootPattern-136844174 Aug 24 13:29:22.065552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User: tempest-TestVolumeBootPattern-136844174-project Aug 24 13:29:22.065552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Id: default Aug 24 13:29:22.065552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Domain-Name: Default Aug 24 13:29:22.065552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Id: cc07ef53f88c4a809deab768daff8132 Aug 24 13:29:22.065552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: X-User-Name: tempest-TestVolumeBootPattern-136844174-project Aug 24 13:29:22.065552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: method: > Aug 24 13:29:22.065552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: exception: Instance b22e30d3-d9df-47d6-a456-205df43da39d could not be found. Aug 24 13:29:22.065552 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: action_args: {'id': 'b22e30d3-d9df-47d6-a456-205df43da39d'} Aug 24 13:29:22.066576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: {{(pid=121171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:29:22.066576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:29:22.066576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:29:22.066576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:29:22.066576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 13:29:22.066576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:29:22.066576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 13:29:22.066576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:29:22.066576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 13:29:22.066576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:29:22.066576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b22e30d3-d9df-47d6-a456-205df43da39d could not be found. Aug 24 13:29:22.066576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:29:22.066576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:29:22.066576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:29:22.066576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:29:22.066576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:29:22.066576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:29:22.066576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:29:22.066576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:29:22.066576 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:29:22.067996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:29:22.067996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:29:22.067996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:29:22.067996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:29:22.067996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:29:22.067996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:29:22.067996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:29:22.067996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b22e30d3-d9df-47d6-a456-205df43da39d could not be found. Aug 24 13:29:22.067996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:29:22.067996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:29:22.067996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:29:22.067996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:29:22.067996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:29:22.067996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:29:22.067996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:29:22.067996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:29:22.067996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b22e30d3-d9df-47d6-a456-205df43da39d could not be found. Aug 24 13:29:22.067996 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: ERROR nova.api.openstack.wsgi Aug 24 13:29:22.069318 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: DEBUG nova.api.openstack.wsgi [None req-c96358d2-9b2f-4263-aed4-22809a63f678 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Returning 404 to user: Instance b22e30d3-d9df-47d6-a456-205df43da39d could not be found. {{(pid=121171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:29:22.069318 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO nova.api.openstack.requestlog [None req-c96358d2-9b2f-4263-aed4-22809a63f678 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d" status: 404 len: 111 microversion: 2.1 time: 0.029084 Aug 24 13:29:22.069318 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: [pid: 121171|app: 0|req: 2060/4123] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 24 13:29:22 2022] GET /compute/v2.1/servers/b22e30d3-d9df-47d6-a456-205df43da39d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:29:23.553226 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: DEBUG nova.api.openstack.wsgi [None req-567a7bb4-8e2a-46b6-bb23-4a72c67de8c1 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] Calling method '.version_select at 0x7f76f554b160>' {{(pid=121170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:29:23.635733 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO nova.api.openstack.requestlog [None req-567a7bb4-8e2a-46b6-bb23-4a72c67de8c1 tempest-TestVolumeBootPattern-136844174 tempest-TestVolumeBootPattern-136844174-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-897906530" status: 202 len: 0 microversion: 2.1 time: 0.086470 Aug 24 13:29:23.636303 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: [pid: 121170|app: 0|req: 2064/4124] 10.222.0.45 () {58 vars in 1260 bytes} [Wed Aug 24 13:29:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-897906530 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 13:30:03.103627 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:30:03.104251 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 13:30:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:30:12.165983 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:30:12.166614 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 13:30:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:30:12.673791 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:30:12.674247 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 13:30:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:31:39.318535 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:31:39.319174 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 13:31:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:32:07.812186 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:32:07.812794 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 13:32:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:32:07.943408 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:32:07.943901 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 13:32:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:33:23.111912 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:33:23.112438 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 13:33:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:33:32.174329 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:33:32.174900 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 13:33:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:33:32.682585 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:33:32.683068 dv-cinder-848899-3-iscsi devstack@n-api.service[121171]: Wed Aug 24 13:33:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:34:59.326114 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:34:59.326761 dv-cinder-848899-3-iscsi devstack@n-api.service[121170]: Wed Aug 24 13:34:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!